Amir Mohsen
29a4dec387
feat: Integrate WaterCrawl.dev as a new knowledge base provider
...
Add WaterCrawl.dev as an alternative provider for website crawling in datasets/knowledge base alongside Firecrawl and Jina Reader. This integration enhances the data source options for knowledge bases, allowing users to configure and use WaterCrawl for their website content extraction needs. Resolved #15950
2025-03-21 00:18:18 +01:00
Ademílson Tonato
d0a21086bd
refactor: Update Firecrawl API parameters and default settings ( #13082 )
2025-01-29 11:21:05 +08:00
Ademílson Tonato
6024d8a42d
refactor: Update Firecrawl to use v1 API ( #12574 )
...
Co-authored-by: Ademílson Tonato <ademilson.tonato@refurbed.com>
2025-01-23 11:14:48 +08:00
yihong
56e15d09a9
feat: mypy for all type check ( #10921 )
2024-12-24 18:38:51 +08:00
yihong
0067b16d1e
fix: refactor all 'or []' and 'or {}' logic to make code more clear ( #10883 )
...
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
2024-11-21 10:34:43 +08:00
Jyong
625e4c4c72
fix multiple retrieval in knowledge node ( #8942 )
2024-09-30 23:07:04 +08:00
Zhaofeng Miao
369e1e6f58
feat(website-crawl): add jina reader as additional alternative for website crawling ( #8761 )
2024-09-30 09:57:19 +08:00
Bowen Liang
40fb4d16ef
chore: refurbish Python code by applying refurb linter rules ( #8296 )
2024-09-12 15:50:49 +08:00
Bowen Liang
17fd773a30
chore(api/services): apply ruff reformatting ( #7599 )
...
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-08-26 13:43:57 +08:00
Jyong
ba5f8afaa8
Feat/firecrawl data source ( #5232 )
...
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-15 02:46:02 +08:00
