outman/dify
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,127 Commits 121 Branches 125 Tags 288 MiB
d4b0f79c66
Commit Graph

293 Commits

Author SHA1 Message Date
jyong
d4b0f79c66 fix document could be None 2025-03-14 16:57:41 +08:00
jyong
361365c74e Merge branch 'main' into feat/support-knowledge-metadata 
# Conflicts:
#	api/core/rag/datasource/vdb/pgvector/pgvector.py
#	api/core/rag/retrieval/dataset_retrieval.py
#	api/core/workflow/nodes/knowledge_retrieval/knowledge_retrieval_node.py
#	api/models/dataset.py
#	api/poetry.lock
#	api/services/tag_service.py
 2025-03-14 16:51:59 +08:00
jyong
88733f8591 knowledge retrival with metadata 2025-03-13 17:18:30 +08:00
Yuichiro Utsumi
5f9d236d22
Feat: Add pg_bigm for keyword search in pgvector (#13876) 
Signed-off-by: Yuichiro Utsumi <utsumi.yuichiro@fujitsu.com>
 2025-03-13 16:32:34 +08:00
Jyong
a8e8c37fdd
improve text split (#15719) 2025-03-13 15:29:33 +08:00
kenwoodjw
087bb60b31
fix: preserve Unicode characters in keyword search queries (#15522) 
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
 2025-03-12 18:34:42 +08:00
jyong
f5632fa678 source name display 2025-03-11 18:53:14 +08:00
jyong
c05abe2448 fix text split 2025-03-11 18:31:30 +08:00
jyong
e90642d624 fix text split 2025-03-11 16:53:32 +08:00
jyong
e2e1a7add0 fix text split 2025-03-11 15:34:13 +08:00
jyong
fd499a5518 fix text split 2025-03-11 15:12:02 +08:00
Jyong
f77f7e1437
fix text split (#15426) 2025-03-11 00:24:27 +08:00
jyong
7a8f4bef16 fix metadata 2025-03-10 19:31:53 +08:00
jyong
0d2f7dd688 fix metadata 2025-03-10 19:30:22 +08:00
jyong
958081108a fix metadata 2025-03-10 16:42:43 +08:00
jyong
778c246c68 fix metadata 2025-03-10 16:25:38 +08:00
jyong
07e3805da7 fix metadata 2025-03-10 15:32:46 +08:00
jyong
d30e16c4c3 fix metadata 2025-03-10 15:06:53 +08:00
jyong
8b9fc4c57f fix metadata 2025-03-07 15:34:34 +08:00
jyong
2fac7785f3 fix parent-child retrival count 2025-03-07 12:54:15 +08:00
jyong
1bbef1f028 fix parent-child retrival count 2025-03-07 10:27:02 +08:00
Jyong
435564f0f2
fix parent-child retrival count (#15119) 2025-03-06 22:32:38 +08:00
engchina
9c1db7dca7
modify oracle lexer name Fixes #15106 (#15108) 
Co-authored-by: engchina <atjapan2015@gmail.com>
 2025-03-06 18:58:51 +08:00
jyong
b33063e946 fix parent-child retrival count 2025-03-06 18:09:05 +08:00
jyong
54c33ca476 fix metadata 2025-03-06 15:54:46 +08:00
jyong
5b4589951d fix metadata 2025-03-05 16:10:04 +08:00
llinvokerl
d04f40c274
Fix empty results issue in full-text search with Milvus vector database (#14885) 
Co-authored-by: liusurong.lsr <liusurong.lsr@alibaba-inc.com>
 2025-03-05 12:27:01 +08:00
jyong
abc4d49e18 fix metadata 2025-03-04 17:07:28 +08:00
engchina
c8de30f3d9
feat: support oracle oci autonomouse database. Fixes #14792 and Fixes #14628. (#14804) 
Co-authored-by: engchina <atjapan2015@gmail.com>
 2025-03-04 09:22:04 +08:00
jyong
9e258c495d dataset metadata fix 2025-02-27 15:30:37 +08:00
yuhaowin
1e3197a1ea
Fixes 14217: database retrieve api and chat-messages api response doc_metadata (#14219) 2025-02-27 14:56:46 +08:00
jyong
c53786d229 dataset metadata update 2025-02-26 19:59:57 +08:00
jyong
17f23f4798 Merge branch 'main' into feat/support-knowledge-metadata 
# Conflicts:
#	api/core/rag/datasource/retrieval_service.py
#	api/core/workflow/nodes/code/code_node.py
#	api/services/dataset_service.py
 2025-02-26 19:59:14 +08:00
jyong
67f2c766bc dataset metadata update 2025-02-26 19:56:19 +08:00
Rhys
548f6ef2b6
fix: incorrect score in the chroma vector (#14273) 2025-02-25 09:40:22 +08:00
Bowen Liang
dfdd6dfa20
fix: change the config name and fix typo in description of the number of retrieval executors (#13856) 2025-02-19 09:13:36 +08:00
Jyong
aa19bb3f30
fix session close issue (#13946) 2025-02-18 19:29:57 +08:00
Charlie.Wei
abe5aca3e2
Retrieval service optimization (#13849) 2025-02-17 18:22:36 +08:00
jyong
d2cc502c71 knowledge metadata 2025-02-17 18:17:26 +08:00
Yeuoly
403e2d58b9
Introduce Plugins (#13836) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: -LAN- <laipz8200@outlook.com>
Signed-off-by: xhe <xw897002528@gmail.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: takatost <takatost@gmail.com>
Co-authored-by: kurokobo <kuro664@gmail.com>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: AkaraChen <akarachen@outlook.com>
Co-authored-by: Yi <yxiaoisme@gmail.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: twwu <twwu@dify.ai>
Co-authored-by: Hiroshi Fujita <fujita-h@users.noreply.github.com>
Co-authored-by: AkaraChen <85140972+AkaraChen@users.noreply.github.com>
Co-authored-by: NFish <douxc512@gmail.com>
Co-authored-by: Wu Tianwei <30284043+WTW0313@users.noreply.github.com>
Co-authored-by: 非法操作 <hjlarry@163.com>
Co-authored-by: Novice <857526207@qq.com>
Co-authored-by: Hiroki Nagai <82458324+nagaihiroki-git@users.noreply.github.com>
Co-authored-by: Gen Sato <52241300+halogen22@users.noreply.github.com>
Co-authored-by: eux <euxuuu@gmail.com>
Co-authored-by: huangzhuo1949 <167434202+huangzhuo1949@users.noreply.github.com>
Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
Co-authored-by: lotsik <lotsik@mail.ru>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: nite-knite <nkCoding@gmail.com>
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: gakkiyomi <gakkiyomi@aliyun.com>
Co-authored-by: CN-P5 <heibai2006@gmail.com>
Co-authored-by: CN-P5 <heibai2006@qq.com>
Co-authored-by: Chuehnone <1897025+chuehnone@users.noreply.github.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Kevin9703 <51311316+Kevin9703@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Boris Feld <lothiraldan@gmail.com>
Co-authored-by: mbo <himabo@gmail.com>
Co-authored-by: mabo <mabo@aeyes.ai>
Co-authored-by: Warren Chen <warren.chen830@gmail.com>
Co-authored-by: JzoNgKVO <27049666+JzoNgKVO@users.noreply.github.com>
Co-authored-by: jiandanfeng <chenjh3@wangsu.com>
Co-authored-by: zhu-an <70234959+xhdd123321@users.noreply.github.com>
Co-authored-by: zhaoqingyu.1075 <zhaoqingyu.1075@bytedance.com>
Co-authored-by: 海狸大師 <86974027+yenslife@users.noreply.github.com>
Co-authored-by: Xu Song <xusong.vip@gmail.com>
Co-authored-by: rayshaw001 <396301947@163.com>
Co-authored-by: Ding Jiatong <dingjiatong@gmail.com>
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
Co-authored-by: JasonVV <jasonwangiii@outlook.com>
Co-authored-by: le0zh <newlight@qq.com>
Co-authored-by: zhuxinliang <zhuxinliang@didiglobal.com>
Co-authored-by: k-zaku <zaku99@outlook.jp>
Co-authored-by: luckylhb90 <luckylhb90@gmail.com>
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: jiangbo721 <365065261@qq.com>
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: Shun Miyazawa <34241526+miya@users.noreply.github.com>
Co-authored-by: EricPan <30651140+Egfly@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: sino <sino2322@gmail.com>
Co-authored-by: Jhvcc <37662342+Jhvcc@users.noreply.github.com>
Co-authored-by: lowell <lowell.hu@zkteco.in>
Co-authored-by: Boris Polonsky <BorisPolonsky@users.noreply.github.com>
Co-authored-by: Ademílson Tonato <ademilsonft@outlook.com>
Co-authored-by: Ademílson Tonato <ademilson.tonato@refurbed.com>
Co-authored-by: IWAI, Masaharu <iwaim.sub@gmail.com>
Co-authored-by: Yueh-Po Peng (Yabi) <94939112+y10ab1@users.noreply.github.com>
Co-authored-by: Jason <ggbbddjm@gmail.com>
Co-authored-by: Xin Zhang <sjhpzx@gmail.com>
Co-authored-by: yjc980121 <3898524+yjc980121@users.noreply.github.com>
Co-authored-by: heyszt <36215648+hieheihei@users.noreply.github.com>
Co-authored-by: Abdullah AlOsaimi <osaimiacc@gmail.com>
Co-authored-by: Abdullah AlOsaimi <189027247+osaimi@users.noreply.github.com>
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: Hash Brown <hi@xzd.me>
Co-authored-by: zuodongxu <192560071+zuodongxu@users.noreply.github.com>
Co-authored-by: Masashi Tomooka <tmokmss@users.noreply.github.com>
Co-authored-by: aplio <ryo.091219@gmail.com>
Co-authored-by: Obada Khalili <54270856+obadakhalili@users.noreply.github.com>
Co-authored-by: Nam Vu <zuzoovn@gmail.com>
Co-authored-by: Kei YAMAZAKI <1715090+kei-yamazaki@users.noreply.github.com>
Co-authored-by: TechnoHouse <13776377+deephbz@users.noreply.github.com>
Co-authored-by: Riddhimaan-Senapati <114703025+Riddhimaan-Senapati@users.noreply.github.com>
Co-authored-by: MaFee921 <31881301+2284730142@users.noreply.github.com>
Co-authored-by: te-chan <t-nakanome@sakura-is.co.jp>
Co-authored-by: HQidea <HQidea@users.noreply.github.com>
Co-authored-by: Joshbly <36315710+Joshbly@users.noreply.github.com>
Co-authored-by: xhe <xw897002528@gmail.com>
Co-authored-by: weiwenyan-dev <154779315+weiwenyan-dev@users.noreply.github.com>
Co-authored-by: ex_wenyan.wei <ex_wenyan.wei@tcl.com>
Co-authored-by: engchina <12236799+engchina@users.noreply.github.com>
Co-authored-by: engchina <atjapan2015@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: 呆萌闷油瓶 <253605712@qq.com>
Co-authored-by: Kemal <kemalmeler@outlook.com>
Co-authored-by: Lazy_Frog <4590648+lazyFrogLOL@users.noreply.github.com>
Co-authored-by: Yi Xiao <54782454+YIXIAO0@users.noreply.github.com>
Co-authored-by: Steven sun <98230804+Tuyohai@users.noreply.github.com>
Co-authored-by: steven <sunzwj@digitalchina.com>
Co-authored-by: Kalo Chin <91766386+fdb02983rhy@users.noreply.github.com>
Co-authored-by: Katy Tao <34019945+KatyTao@users.noreply.github.com>
Co-authored-by: depy <42985524+h4ckdepy@users.noreply.github.com>
Co-authored-by: 胡春东 <gycm520@gmail.com>
Co-authored-by: Junjie.M <118170653@qq.com>
Co-authored-by: MuYu <mr.muzea@gmail.com>
Co-authored-by: Naoki Takashima <39912547+takatea@users.noreply.github.com>
Co-authored-by: Summer-Gu <37869445+gubinjie@users.noreply.github.com>
Co-authored-by: Fei He <droxer.he@gmail.com>
Co-authored-by: ybalbert001 <120714773+ybalbert001@users.noreply.github.com>
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
Co-authored-by: douxc <7553076+douxc@users.noreply.github.com>
Co-authored-by: liuzhenghua <1090179900@qq.com>
Co-authored-by: Wu Jiayang <62842862+Wu-Jiayang@users.noreply.github.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: kimjion <45935338+kimjion@users.noreply.github.com>
Co-authored-by: AugNSo <song.tiankai@icloud.com>
Co-authored-by: llinvokerl <38915183+llinvokerl@users.noreply.github.com>
Co-authored-by: liusurong.lsr <liusurong.lsr@alibaba-inc.com>
Co-authored-by: Vasu Negi <vasu-negi@users.noreply.github.com>
Co-authored-by: Hundredwz <1808096180@qq.com>
Co-authored-by: Xiyuan Chen <52963600+GareArc@users.noreply.github.com>
 2025-02-17 17:05:13 +08:00
Charlie.Wei
222df44d21
Retrieval Service efficiency optimization (#13543) 2025-02-17 14:09:57 +08:00
Bowen Liang
0751ad1eeb
feat(vdb): add HNSW vector index for TiDB vector store with TiFlash (#12043) 2025-02-12 13:53:51 +08:00
liuzhenghua
47a64610ca
Fix the issue of repeated escaping of quotes in hit test (#13477) 2025-02-11 09:58:31 +08:00
Ademílson Tonato
d0a21086bd
refactor: Update Firecrawl API parameters and default settings (#13082) 2025-01-29 11:21:05 +08:00
Ademílson Tonato
6024d8a42d
refactor: Update Firecrawl to use v1 API (#12574) 
Co-authored-by: Ademílson Tonato <ademilson.tonato@refurbed.com>
 2025-01-23 11:14:48 +08:00
huangzhuo1949
4c3076f2a4
feat: add pg vector index (#12338) 
Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
 2025-01-22 17:07:18 +08:00
Bowen Liang
166221d784
chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 2025-01-21 10:12:29 +08:00
yihong
4e101604c3
fix: ruff check for True if ... else (#12576) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-01-13 09:38:48 +08:00
CN-P5
cd257b91c5
Fix pandas indexing method for knowledge base imports (#12637) (#12638) 
Co-authored-by: CN-P5 <heibai2006@qq.com>
 2025-01-13 09:06:59 +08:00
YoungLH
040a3b782c
FEAT: support milvus to full text search (#11430) 
Signed-off-by: YoungLH <974840768@qq.com>
 2025-01-08 17:39:53 +08:00