Commit Graph

137 Commits

Author SHA1 Message Date
TzuxinChen
f0d10553b4
Fixed a bug where permission was clearly displaye… (#6934) 2024-08-05 13:19:01 +08:00
liuzhenghua
ef616c604a
fix: The permissions issue of the editor role accessing some backend … (#6945)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-08-05 12:55:55 +08:00
Jyong
048bc4c06e
fix update dataset failed when embedding model is not exist (#6920) 2024-08-02 20:30:22 +08:00
tmuife
06fc1bce9e
Add search by full text when using Oracle23ai as vector DB (#6559) 2024-07-23 15:03:21 +08:00
Shoya SHIRAKI
c57b3931d5
refactor(api): switch to dify_config in controllers/console (#6485) 2024-07-21 01:11:40 +08:00
Bowen Liang
7943f7f697
chore: fix legacy API usages of Query.get() by Session.get() in SqlAlchemy 2 (#6340) 2024-07-17 13:54:35 +08:00
Jyong
0de224b153
fix wrong using of RetrievalMethod Enum (#6345) 2024-07-16 19:09:04 +08:00
Zhuo Qiu
63e34e5227
feat: support MyScale vector database (#6092) 2024-07-11 15:21:59 +08:00
Joe
ce930f19b9
fix dataset operator (#6064)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-09 17:47:54 +08:00
8bitpd
7c70eb87bc
feat: support AnalyticDB vector store (#5586)
Co-authored-by: xiaozeyu <xiaozeyu.xzy@alibaba-inc.com>
2024-07-09 13:32:04 +08:00
takatost
79df8825c8
Revert "feat: knowledge admin role" (#6018) 2024-07-05 21:31:34 +08:00
Joe
5d9ad430af
feat: knowledge admin role (#5965)
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
2024-07-04 16:21:40 +08:00
Jyong
71bcf75d9a
Feat/add delete knowledge confirm (#5810) 2024-07-01 17:06:51 +08:00
Jyong
43335b5c87
delete the deprecated method (#5612) 2024-06-26 12:51:50 +08:00
kurokobo
c5d64baba4
fix: correct typos (#5510) 2024-06-22 23:01:02 +08:00
tmuife
6a09409ec9
Add Oracle23ai as a vector datasource (#5342)
Co-authored-by: walter from vm <walter.jin@oracle.com>
2024-06-22 01:48:07 +08:00
Bowen Liang
c923684edd
chore: extract retrival method literal values into enum (#5060) 2024-06-19 16:05:27 +08:00
baojingyu
d160d1ed02
feat: support opensearch approximate k-NN (#5322) 2024-06-19 12:44:33 +08:00
Jyong
ba5f8afaa8
Feat/firecrawl data source (#5232)
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-15 02:46:02 +08:00
Charles Zhou
8bcc5a36bb
feat: new editor user permission profile (#4435)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-06-14 20:34:25 +08:00
quicksand
4080f7b8ad
feat: support tencent vector db (#3568) 2024-06-14 19:25:17 +08:00
Summer-Gu
7f98c2ea3f
refactor: Delete the dataset to verify whether it is in use (#5112) 2024-06-14 03:25:38 +08:00
Bowen Liang
cdc08a434f
feat: support Chroma vector store (#5015) 2024-06-13 18:02:18 +08:00
Bowen Liang
bdad993901
improve: generalize vector factory classes and vector type (#5033) 2024-06-08 22:29:24 +08:00
Weaxs
0797f9bc05
feat: support tidb vector (#4588) 2024-06-05 18:19:53 +08:00
Jyong
4e3b0c5aea
support rename document (#4915) 2024-06-04 20:07:40 +08:00
Moonlit
86e7c7321f
Fixed a bug where any content in the 'fetch' was converted to True (#4400) 2024-06-04 13:27:23 +08:00
LiuVaayne
875249eb00
Feat/vector db pgvector (#3879) 2024-05-10 17:20:30 +08:00
Jyong
3e9dbe3e0a
add pgvecto_rs support and upgrade SQLAlchemy (#3833) 2024-04-29 11:58:17 +08:00
羊羽
975b2fb79e
delete duplicate check get_dataset (#3966)
Co-authored-by: baxiang <baxiang@lixiang.com>
2024-04-29 11:57:26 +08:00
Jingpan Xiong
1be222af2e
fix: using api can not execute relyt vector database (#3766)
Co-authored-by: jingsi <jingsi@leadincloud.com>
2024-04-25 19:46:20 +08:00
Jyong
f257f2c396
Knowledge optimization (#3755)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-04-24 15:02:29 +08:00
Jyong
394ceee141
optimize question classifier prompt and support keyword hit test (#3565) 2024-04-17 17:40:40 +08:00
LIU HONGWEI
c227f3d985
feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) (#3416) 2024-04-12 16:22:24 +08:00
Jyong
e12a0c154c
add segment function billing check for SAAS env (#3082)
Co-authored-by: jyong <jyong@dify.ai>
2024-04-02 17:55:49 +08:00
Garfield Dai
8e66b96221
Feat: Add documents limitation (#2662) 2024-03-03 12:45:06 +08:00
Jyong
5b953c1ef2
Fix some RAG bugs (#2570)
Co-authored-by: jyong <jyong@dify.ai>
2024-02-27 11:39:05 +08:00
Jyong
6c4e6bf1d6
Feat/dify rag (#2528)
Co-authored-by: jyong <jyong@dify.ai>
2024-02-22 23:31:57 +08:00
Bowen Liang
063191889d
chore: apply ruff's pyupgrade linter rules to modernize Python code with targeted version (#2419) 2024-02-09 15:21:33 +08:00
Bowen Liang
14a19a3da9
chore: apply ruff's pyflakes linter rules (#2420) 2024-02-08 14:11:10 +08:00
Bowen Liang
843280f82b
enhancement: introduce Ruff for Python linter for reordering and removing unused imports with automated pre-commit and sytle check (#2366) 2024-02-06 13:21:13 +08:00
takatost
9f637ead38
bump version to 0.5.3 (#2306) 2024-02-01 18:11:57 +08:00
crazywoola
828822243a
fix: multiple rows were found correctly (#2219) 2024-01-26 12:47:42 +08:00
crazywoola
1f48e3d44a
feat: support legacy doc (#2100) 2024-01-20 22:21:51 +08:00
crazywoola
ec1659cba0
fix: saving error in empty dataset (#2098) 2024-01-19 20:12:04 +08:00
Bowen Liang
cc9e74123c
improve: introduce isort for linting Python imports (#1983) 2024-01-12 12:34:01 +08:00
Jyong
5e75f7022f
fix data_source_detail_dict parameter error (#2000)
Co-authored-by: jyong <jyong@dify.ai>
2024-01-11 17:49:20 +08:00
Jyong
4d99c689f0
prohibit enable and disable function when segment is not completed (#1954)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-01-05 18:18:38 +08:00
takatost
4562e83b24
fix: hit testing throws errors cause internal server error (#1865) 2024-01-03 08:57:39 +08:00
takatost
d069c668f8
Model Runtime (#1858)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-01-02 23:42:00 +08:00
Jyong
e91dd28a76
fix file estimate issue (#1860)
Co-authored-by: jyong <jyong@dify.ai>
2024-01-02 16:25:59 +08:00
taokuizu
10fc44e2af
fix typo (#1791) 2023-12-19 17:23:49 +08:00
Jyong
5e34f938c1
Feat/add unstructured support (#1780)
Co-authored-by: jyong <jyong@dify.ai>
2023-12-18 23:24:06 +08:00
Garfield Dai
7b8a10f3ea
feat: billing enhancement 20231204 (#1691)
Co-authored-by: jyong <jyong@dify.ai>
2023-12-05 16:53:55 +08:00
Garfield Dai
053102f433
Feat/dify billing (#1679)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: takatost <takatost@users.noreply.github.com>
2023-12-03 20:59:29 +08:00
Jyong
6717bb2b72
fix the error message (#1564)
Co-authored-by: jyong <jyong@dify.ai>
2023-11-19 15:12:55 +08:00
Jyong
4588831bff
Feat/add retriever rerank (#1560)
Co-authored-by: jyong <jyong@dify.ai>
2023-11-17 22:13:37 +08:00
takatost
41d0a8b295
feat: [backend] vision support (#1510)
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
2023-11-13 22:05:46 +08:00
takatost
024250803a
feat: move login_required wrapper outside (#1281) 2023-10-08 05:21:32 -05:00
Jyong
5e511e01bf
Fix/dataset api key delete (#1255)
Co-authored-by: jyong <jyong@dify.ai>
2023-09-28 10:41:41 +08:00
Jyong
46154c6705
Feat/dataset service api (#1245)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2023-09-27 16:06:32 +08:00
KVOJJJin
e161c511af
Feat:csv & docx support (#1139)
Co-authored-by: jyong <jyong@dify.ai>
2023-09-10 15:17:22 +08:00
yezhwi
d33a269548
refactor(file extractor): file extractor (#1059) 2023-08-31 14:45:31 +08:00
KVOJJJin
c67f345d0e
Fix: disable operations of dataset when embedding unavailable (#1055)
Co-authored-by: jyong <jyong@dify.ai>
2023-08-30 17:27:19 +08:00
yezhwi
8b8e510bfe
fix: handle AttributeError for datasets and index (#1052) 2023-08-30 11:14:16 +08:00
Jyong
a55ba6e614
Fix/ignore economy dataset (#1043)
Co-authored-by: jyong <jyong@dify.ai>
2023-08-29 03:37:45 +08:00
Jyong
e053215155
fix document estimate parameter (#1019)
Co-authored-by: jyong <jyong@dify.ai>
2023-08-25 20:10:08 +08:00
Jyong
e7199826cc
embedding model available check (#1009)
Co-authored-by: jyong <jyong@dify.ai>
2023-08-25 00:25:16 +08:00
Jyong
5397799aac
document limit (#999)
Co-authored-by: jyong <jyong@dify.ai>
2023-08-24 21:27:13 +08:00
Jyong
4b53bb1a32
Feat/token support (#909)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: jyong <jyong@dify.ai>
2023-08-21 13:57:18 +08:00
Jyong
db7156dafd
Feature/mutil embedding model (#908)
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2023-08-18 17:37:31 +08:00
Matri
155a4733f6
Feat/customizable file upload config (#818) 2023-08-16 23:14:27 +08:00
takatost
5fa2161b05
feat: server multi models support (#799) 2023-08-12 00:57:00 +08:00
Jyong
082f8b17ab
Feat/milvus support (#671)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
2023-07-28 22:19:39 +08:00
KVOJJJin
cf93d8d6e2
Feat: Q&A format segmentation support (#668)
Co-authored-by: jyong <718720800@qq.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
2023-07-28 20:47:15 +08:00
Jyong
026f0bfce9
Feat/clean vector dataset (#605) 2023-07-19 21:30:25 +08:00
John Wang
7599f79a17
feat: claude api support (#572) 2023-07-17 00:14:19 +08:00
John Wang
3241e4015b
feat: upgrade langchain (#430)
Co-authored-by: jyong <718720800@qq.com>
2023-06-25 16:49:14 +08:00
Jyong
b08c19d926
fix encoding is none (#394) 2023-06-17 15:21:48 +08:00
Jyong
9253f72dea
Feat/dataset notion import (#392)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
2023-06-16 21:47:51 +08:00
Columbus
eeb2c28526
Fix the issue of decoding a non-UTF-8 encoded file using UTF-8 encodi… (#378) 2023-06-16 14:12:07 +08:00
lisaifei@cvte.com
0abd67288b
feat: support xlsx file parsing (#304)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2023-06-09 15:57:19 +08:00
杨睿
20899c44ff
fix: segment search by keyword (#303) 2023-06-07 00:45:25 +08:00
John Wang
2478c88e07
feat: increase dataset description length to 400 (#283) 2023-06-02 14:03:18 +08:00
KVOJJJin
c67f626b66
Feat: Support re-segmentation (#114)
Co-authored-by: John Wang <takatost@gmail.com>
Co-authored-by: Jyong <718720800@qq.com>
Co-authored-by: 金伟强 <iamjoel007@gmail.com>
2023-06-01 23:19:36 +08:00
John Wang
9a5ae9f51f
Feat: optimize error desc (#152) 2023-05-22 17:39:28 +08:00
John Wang
db896255d6 Initial commit 2023-05-15 08:51:32 +08:00