Commit Graph
14 Commits
Author SHA1 Message Date
Alex 2c55c6cd9a fix: tiktoken import in markdown parser 2026-01-12 23:04:20 +00:00
Alex df57053613 feat: improve crawlers and update chunk filtering (#2250) 2026-01-06 00:52:12 +02:00
Alex 9e7f1ad1c0 Add Amazon S3 support and synchronization features (#2244)
* Add Amazon S3 support and synchronization features

* refactor: remove unused variable in load_data test
2025-12-30 20:26:51 +02:00
Alex 98e949d2fd Patches (#2218)
* feat: implement URL validation to prevent SSRF

* feat: add zip extraction security

* ruff fixes
2025-12-24 17:05:35 +02:00
Alex e0a9f08632 refactor and deps (#2184) 2025-12-10 23:53:59 +02:00
Harshit Ranjan 695191d888 added error saving vector store (#2081)
* added error saving vector store

* fixed code formating

* added tests for embedding pipeline
2025-10-31 16:29:35 +02:00
Alex 03452ffd9f feat: add GitHub access token support and fix file content fetching logic (#2032) 2025-10-07 16:53:14 +03:00
ManishMadan2882 7d8ed2d102 ruff-fix 2025-10-01 02:23:53 +05:30
ManishMadan2882 402d5e054b (fix:test_markdown) patch tokenizer 2025-09-30 13:35:03 +05:30
ManishMadan2882 e24a0ac686 (test:parsers) github, reddit 2025-09-29 20:33:05 +05:30
ManishMadan2882 8c91b1c527 (tests:parsers) remote 2025-09-29 19:39:24 +05:30
ManishMadan2882 2b38f80d04 (test:files) epub, image, rst 2025-09-29 17:39:20 +05:30
ManishMadan2882 282bd35f52 (test:files) html, md, json 2025-09-29 17:23:15 +05:30
ManishMadan2882 ba496a772b (test) doc parsers coverage 2025-09-26 16:07:12 +05:30