Commit Graph

281 Commits

Author SHA1 Message Date
-LAN-
9369cc44e6
refactor(list_operator): replace ValueError with InvalidKeyError (#10222) 2024-11-04 15:23:08 +08:00
-LAN-
38bca6731c
refactor(workflow): introduce specific error handling for LLM nodes (#10221) 2024-11-04 15:22:58 +08:00
-LAN-
2adab7f71a
refactor(http_request): add custom exception handling for HTTP request nodes (#10219) 2024-11-04 15:22:50 +08:00
-LAN-
be96f6e62d
refactor(workflow): introduce specific exceptions for code validation (#10218) 2024-11-04 15:22:41 +08:00
-LAN-
8b5ea39916
chore(llm_node): remove unnecessary type ignore for context assignment (#10216) 2024-11-04 15:22:31 +08:00
-LAN-
1432c268a8
chore(list_operator): refine exception handling for error specificity (#10206) 2024-11-03 11:55:19 +08:00
-LAN-
ec6a03afdd
fix(document_extractor): update base exception class (#10208) 2024-11-03 11:55:07 +08:00
-LAN-
53a7cb0e9d
feat(document_extractor): integrate unstructured API for PPTX extraction (#10180) 2024-11-01 23:19:11 +08:00
-LAN-
3b53e06e0d
fix(workflow): refine variable type checks in LLMNode (#10051) 2024-10-30 16:23:12 +08:00
zhuhao
0095896051
feat: add YAML type in document extractor node (#9997) 2024-10-30 13:47:19 +08:00
非法操作
c7fb8a4f20
fix: conversation variable may not change in the answer node (#10034) 2024-10-30 11:10:31 +08:00
-LAN-
eb87e690ed
fix(llm-node): handle NoneSegment variables properly (#9978) 2024-10-30 08:46:11 +08:00
Hiroshi Fujita
539fc8b760
Fix content-type header case sensitivity (#9961) 2024-10-30 02:11:18 +08:00
-LAN-
4da0b70694
feat(http-request-executor): enhance file handling in HTTP requests (#9944) 2024-10-28 17:51:01 +08:00
Zixuan Cheng
216442ddc1
feat(workflow): Support JSON type in document extractor node (#9899)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-10-26 20:29:48 +08:00
-LAN-
72ea3d6b98
fix(workflow): Take back LLM streaming output after IF-ELSE (#9875) 2024-10-25 22:33:34 +08:00
非法操作
2346b0ab99
chore: make doc extractor node also can extract text by file extension (#9543) 2024-10-24 22:54:48 +08:00
-LAN-
d018b32d0b
fix(workflow): enhance prompt handling with vision support (#9790) 2024-10-24 17:52:11 +08:00
-LAN-
9a5bdae07f
feat(condition): add support for 'exists' and 'not exists' operators (#9687) 2024-10-23 13:25:17 +08:00
-LAN-
d5a93a6400
fix(variable_pool): handle invalid attributes in variable lookup (#9646) 2024-10-23 10:19:33 +08:00
feiyang_deepnova
999d3f1539
fix: add downstream nodes of this branch (#9640) 2024-10-23 01:20:02 +08:00
-LAN-
7263af13ed
fix(http_request): simplify JSON handling in requests (#9616) 2024-10-22 15:37:37 +08:00
-LAN-
8f670f31b8
refactor(variables): replace deprecated 'get_any' with 'get' method (#9584) 2024-10-22 10:49:19 +08:00
-LAN-
5838345f48
fix(entities): add validator for VisionConfig to handle None values (#9598) 2024-10-22 10:49:03 +08:00
-LAN-
ac24300274
refactor(template_transform): use keyword-only arguments (#9575) 2024-10-22 09:00:21 +08:00
-LAN-
2e657b7b12
fix(workflow): handle NoneSegments in variable extraction (#9585) 2024-10-22 08:59:04 +08:00
-LAN-
c063617553
fix(workflow): improve database session handling and variable management (#9581) 2024-10-22 00:42:40 +08:00
-LAN-
38a4f0234d
fix(http_request): handle empty and string data inputs (#9579) 2024-10-21 23:35:25 +08:00
-LAN-
5459d812e7
fix(iteration): handle empty iterator gracefully (#9565) 2024-10-21 20:16:46 +08:00
非法操作
f83ed19dfe
fix: list filter node some operator raise error (#9539) 2024-10-21 15:33:42 +08:00
非法操作
53b14bde4d
fix: list filter node url not work (#9540) 2024-10-21 15:32:28 +08:00
-LAN-
e61752bd3a
feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
非法操作
853b0e84cc
fix: draft run workflow node with image will raise error (#9406) 2024-10-21 09:05:42 +08:00
Jyong
50635e9c15
Fix/economical knowledge retrieval (#9396) 2024-10-16 15:13:45 +08:00
Jyong
42b02b3a5f
Fix/agent external knowledge retrieval (#9241) 2024-10-11 19:21:03 +08:00
Joe
e947103b6d
Feat/add workflow sys params (#9108)
Co-authored-by: Joel <iamjoel007@gmail.com>
2024-10-10 11:15:52 +08:00
Jyong
625e4c4c72
fix multiple retrieval in knowledge node (#8942) 2024-09-30 23:07:04 +08:00
Jyong
9d221a5e19
external knowledge api (#8913)
Co-authored-by: Yi <yxiaoisme@gmail.com>
2024-09-30 15:38:43 +08:00
Nam Vu
bef83a4d2e
fix: typos and improve naming conventions: (#8687) 2024-09-23 21:32:58 +08:00
Nam Vu
eaa7e9b1f0
fix: llm_generator.py JSONDecodeError (#8504) 2024-09-22 14:02:12 +08:00
takatost
e0a3307563
fix(workflow): "Max submit count reached" error occurred when executing workflow as tool in iteration (#8595) 2024-09-20 19:47:25 +08:00
takatost
ffd2f61dd9
fix: thread_pool submit count in parallel workflow not releasing (#8549) 2024-09-19 15:34:56 +08:00
takatost
88c9834ef2
chore(workflow): Optimize the iteration when selecting a variable from a branch in the output variable causes iteration index err (#8440) 2024-09-14 18:02:43 +08:00
takatost
f01602b570
fix(workflow): the answer node after the iteration node containing the answer was output prematurely (#8419) 2024-09-14 14:02:09 +08:00
Bowen Liang
a1104ab97e
chore: refurish python code by applying Pylint linter rules (#8322) 2024-09-13 22:42:08 +08:00
takatost
cd3eaed335
fix(workflow): both parallel and single branch errors occur in if-else (#8378) 2024-09-13 19:55:54 +08:00
Bowen Liang
40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2024-09-12 15:50:49 +08:00
Bowen Liang
c69f5b07ba
chore: apply ruff E501 line-too-long linter rule (#8275)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-12 14:00:36 +08:00
takatost
56c90e212a
fix(workflow): missing content in the answer node stream output during iterations (#8292)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-12 13:59:48 +08:00
Bowen Liang
0f14873255
chore: cleanup ruff flake8-simplify linter rules (#8286)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-12 12:55:45 +08:00
Bowen Liang
781d294f49
chore: cleanup pycodestyle E rules (#8269) 2024-09-11 18:55:00 +08:00
Bowen Liang
292220c596
chore: apply pep8-naming rules for naming convention (#8261) 2024-09-11 16:40:52 +08:00
takatost
5f4cdd66fa
fix(workflow): IF-ELSE nodes connected to the same subsequent node cause execution to stop (#8247) 2024-09-11 12:28:32 +08:00
takatost
cee0c51dbb
feat: add from_variable_selector for stream chunk / message event (#8228) 2024-09-10 22:15:50 +08:00
takatost
fdbbdb706f
fix(workflow): answers are output simultaneously across different braches in the question classifier node. (#8225) 2024-09-10 21:11:35 +08:00
takatost
f6dfe23cf8
fix(workflow): in multi-parallel execution with multiple conditional branches (#8221) 2024-09-10 21:09:18 +08:00
Jyong
bb3002b173
revert page column (#8217) 2024-09-10 18:21:22 +08:00
Bowen Liang
2cf1187b32
chore(api/core): apply ruff reformatting (#7624) 2024-09-10 17:00:20 +08:00
takatost
dabfd74622
feat: Parallel Execution of Nodes in Workflows (#8192)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Yi <yxiaoisme@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-10 15:23:16 +08:00
Nam Vu
2d7954c7da
Fix variable typo (#8084) 2024-09-08 13:14:11 +08:00
crazywoola
44f963f281
If else add regexmatch (#8059)
Co-authored-by: 罗威 <luowei@cvte.com>
2024-09-06 18:35:51 +08:00
Charlie.Wei
01858e1caf
ifEsle node add regex match (#8007) 2024-09-06 17:44:09 +08:00
Byeongjin Kang
d489b8b3e0
feat: return page number of pdf documents upon retrieval (#7749) 2024-09-05 16:43:26 +08:00
Joe
fee4d3f6ca
feat: ops trace add llm model (#7306) 2024-09-04 10:39:00 +08:00
Bowen Liang
0c2a62f847
fix: correct http timeout configs‘ default values and ignorance by HttpRequestNode (#7762) 2024-08-30 19:09:10 +08:00
Bowen Liang
1262277714
chore: improve http executor configs (#7730) 2024-08-28 17:46:37 +08:00
Leheng Lu
5d0914daea
fix: not able to pass array of string/number/object into variable aggregator groups (#7757) 2024-08-28 17:25:20 +08:00
Bowen Liang
a15080a1d7
bug: (#7586 followup) fix config of CODE_MAX_STRING_LENGTH (#7683) 2024-08-27 10:38:24 +08:00
Bowen Liang
3ace01cfb3
chore: cleanup and rearrange unclassified configs into feature config groups (#7586) 2024-08-23 22:40:07 +08:00
orangeclk
f53454f81d
add finish_reason to the LLM node output (#7498) 2024-08-21 17:29:30 +08:00
Yeuoly
784b11ce19
Chore/remove python dependencies selector (#7494) 2024-08-21 16:57:14 +08:00
Yeuoly
a02118d5bc
Fix/incorrect code template (#7490) 2024-08-21 15:31:13 +08:00
Nam Vu
85fc0fdb51
chore: support CODE_MAX_PRECISION (#7484) 2024-08-21 15:11:56 +08:00
hisir
6435b4eb44
Separate CODE_MAX_DEPTH and set it as an environment variable (#7474) 2024-08-21 12:48:25 +08:00
luckylhb90
9a715f6b68
fix(tool): tool node error (#7459)
Co-authored-by: hobo.l <hobo.l@binance.com>
2024-08-21 09:04:54 +08:00
-LAN-
4f5f27cf2b
refactor(api/core/workflow/enums.py): Rename SystemVariable to SystemVariableKey. (#7445) 2024-08-20 17:52:06 +08:00
-LAN-
a10b207de2
refactor(api/core/app/app_config/entities.py): Move Type to outside and add EXTERNAL_DATA_TOOL. (#7444) 2024-08-20 17:30:14 +08:00
-LAN-
4f64a5d36d
refactor(api/core/workflow/nodes/variable_assigner): Split into multi files. (#7434) 2024-08-20 15:40:19 +08:00
-LAN-
8f16165f92
chore(api/core): Improve FileVar's type hint and imports. (#7290) 2024-08-15 12:43:18 +08:00
-LAN-
32dc963556
feat(api/workflow): Add Conversation.dialogue_count (#7275) 2024-08-15 10:53:05 +08:00
Nam Vu
d2ccd8ba53
fix: #7222 docstrings (#7276) 2024-08-15 09:47:26 +08:00
非法操作
3a27166c2e
chore: allow download audio/video through HTTP node (#7224) 2024-08-14 16:25:59 +08:00
KVOJJJin
935e72d449
Feat: conversation variable & variable assigner node (#7222)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-08-13 14:44:10 +08:00
灰灰
ac60182c91
fix: solving http-request-tool bugs in workflow (#6685) 2024-08-11 16:32:06 +08:00
-LAN-
67a2f14cef
fix(api/core/workflow/nodes/tool/tool_node.py): Keep None value in tool params. (#7066) 2024-08-07 19:36:21 +08:00
灰灰
96dcf0fe8a
fix: code tool fails when null property exists in object (#6988) 2024-08-06 16:11:00 +08:00
chenxu9741
dff3f41ef6
Workflow TTS playback node filtering issue. (#6877) 2024-08-04 14:28:56 +08:00
Jyong
2ab9af3b38
delete weight_type in knowledge retrieval node (#6892) 2024-08-01 21:38:59 +08:00
非法操作
29e3c3061c
fix: remote image not display in answer node (#6867) 2024-08-01 13:21:49 +08:00
-LAN-
b6c3010f02
refactor(api/core/workflow/nodes/base_node.py): Update extract_variable_selector_to_variable_mapping method signature. (#6733)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-27 14:43:25 +08:00
-LAN-
c6996a48a4
refactor(api/core/app/segments): Support more kinds of Segments. (#6706)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-26 15:03:56 +08:00
majian
a876baf0a9
Resolve variable type parameter error (#6646) 2024-07-25 11:15:54 +08:00
Jyong
91fd8521c3
fix reranking model field error (#6654) 2024-07-25 10:07:55 +08:00
-LAN-
4ec9a87e46
fix(api/core/workflow/nodes/iteration/iteration_node.py): Extend output in iteration if output is a array. (#6647)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-25 00:32:39 +08:00
-LAN-
31efe10c75
refactor(api/core/workflow/workflow_engine_manager.py): Remove (#6630)
Signed-off-by: -LAN- <laipz8200@outlook.com>
2024-07-24 19:35:40 +08:00
Jyong
e4bb943fe5
Feat/delete single dataset retrival (#6570) 2024-07-24 12:50:11 +08:00
-LAN-
ad7552ea8d
fix(api/core/workflow/nodes/llm/llm_node.py): Fix LLM Node error. (#6576) 2024-07-23 17:09:16 +08:00
-LAN-
f019bc4bd7
feat(variables): Support to_object. (#6572) 2024-07-23 16:22:06 +08:00
-LAN-
cfc408095c
fix(api/nodes): Fallback to get_any in some nodes that use object or array. (#6566) 2024-07-23 15:51:07 +08:00
takatost
6b5fac3004
fix: fetch context error in llm node (#6562) 2024-07-23 15:04:51 +08:00
-LAN-
5e6fc58db3
Feat/environment variables in workflow (#6515)
Co-authored-by: JzoNg <jzongcode@gmail.com>
2024-07-22 15:29:39 +08:00
Poorandy
8a80af39c9
refactor(models&tools): switch to dify_config in models and tools. (#6394)
Co-authored-by: Poorandy <andymonicamua1@gmail.com>
2024-07-17 22:26:18 +08:00
-LAN-
fc37887a21
refactor(api/core/workflow/nodes/http_request): Remove mask_authorization_header because its alwary true. (#6379) 2024-07-17 16:52:14 +08:00
Jyong
0de224b153
fix wrong using of RetrievalMethod Enum (#6345) 2024-07-16 19:09:04 +08:00
JasonVV
0e82072323
Fix if_else node compatibility with historical workflows. (#6186) 2024-07-11 17:13:16 +08:00
Joe
5a3e09518c
feat: add if elif (#6094) 2024-07-10 18:22:51 +08:00
75py
610da4f662
Fix authorization header validation to handle bearer types correctly - "authorization config header is required" error (#6040) 2024-07-08 00:09:59 +08:00
Yeuoly
a877d4831d
Fix/incorrect parameter extractor memory (#6038) 2024-07-07 12:17:34 +08:00
-LAN-
4d105d7bd7
feat(*): Swtich to dify_config. (#6025) 2024-07-06 12:05:13 +08:00
-LAN-
02982df0d4
fix: Fix some type error in http executor. (#5915) 2024-07-04 19:34:37 +08:00
Yeuoly
f101fcd0e7
fix: missing process data in parameter extractor (#5755) 2024-06-29 23:29:43 +08:00
Joe
e8b8f6c6dd
Feat/fix ops trace (#5672)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-28 00:24:37 +08:00
非法操作
92c56fdf2b
fix: HTTP request header is overwritten when user set Content-Type (#5628) 2024-06-27 12:31:37 +08:00
Bowen Liang
dcb72e0067
chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-27 11:21:31 +08:00
Joe
4e2de638af
feat: add ops trace (#5483)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-26 17:33:29 +08:00
非法操作
b8926ea267
fix: DuckDuckGo image search tool error (#5606) 2024-06-26 13:21:40 +08:00
非法操作
f7900f298f
chore: refactor the http executor node (#5212) 2024-06-24 16:14:59 +08:00
非法操作
1e28a8c033
chore: add create_json_message api for tools (#5440) 2024-06-24 15:46:16 +08:00
takatost
a88aa20824
fix: optional parameter missing default value None in http request node (#5413) 2024-06-20 11:07:01 +08:00
Bowen Liang
c923684edd
chore: extract retrival method literal values into enum (#5060) 2024-06-19 16:05:27 +08:00
sino
d7213b12cc
fix: extract params by function calling for models supporting tool call (#5334) 2024-06-17 23:25:29 +08:00
-LAN-
54756cd3b2
chore(core/workflow/utils/variable_template_parser): Refactor VariableTemplateParser class for better readability and maintainability. (#5328) 2024-06-17 21:18:56 +08:00
-LAN-
5a99aeb864
fix(core): Reorder field_validator and classmethod to fit Pydantic V2. (#5257) 2024-06-17 10:04:28 +08:00
rerorero
3a423e8ce7
fix: visioin model always with low quality (#5253) 2024-06-16 09:46:17 +08:00
th3n00b13
cdb6c801c1
Fix: http_request delete method not working (#4975) 2024-06-14 20:07:22 +08:00
Bowen Liang
f976740b57
improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592) 2024-06-14 01:05:37 +08:00
smoky
742b08e1d5
chore: update question classifier prompt (#5137)
Signed-off-by: 0xff-dev <stevenshuang521@gmail.com>
2024-06-13 13:04:51 +08:00
Yeuoly
73dee84cab
fix: add handling for non-string type in variable template parser (#4996) 2024-06-06 16:38:13 +08:00
JasonVV
7749b71fff
Optimize knowledge retrieval performance by batching dataset quries. (#4917) 2024-06-05 13:30:32 +08:00
takatost
21ac2afb3a
fix: question classifier instruction npe (#4931) 2024-06-05 01:27:58 +08:00
takatost
d1dbbc1e33
feat: backend model load balancing support (#4927) 2024-06-05 00:13:04 +08:00
Jyong
c7bddb637b
support instruction in classifier node (#4913) 2024-06-04 20:07:54 +08:00
zxhlyh
4b91383efc
feat: workflow variable aggregator support group (#4811)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-05-30 18:54:58 +08:00
Yeuoly
d4cd6149ac
fix: incorrect workflow max call depth (#4759) 2024-05-29 14:52:28 +08:00
majian
72a90074bc
Add WORKFLOW_CALL_MAX_DEPTH env var. (#4713) 2024-05-29 13:39:11 +08:00
Yeuoly
e852a21634
Feat/workflow phase2 (#4687) 2024-05-27 22:01:11 +08:00
kronus-ho
f56b984d97
Fix Unnecessary Newline Characters in Extracted Tool Response Text (#4646)
Co-authored-by: kronus <kronus@istarshine.com>
2024-05-25 15:24:59 +08:00
10YearsDiary
109aabc6f2
fix: incorrect handling when http header value contain multiple colons. (#4574) 2024-05-25 13:20:06 +08:00
majian
8c2ca60c8b
feat: Add WORKFLOW_MAX_EXECUTION_TIME env var (#4632) 2024-05-24 15:27:12 +08:00
Jyong
233c4150d1
support images and tables extract from docx (#4619) 2024-05-23 18:05:23 +08:00
Bowen Liang
e8e213ad1e
chore: apply and fix flake8-bugbear lint rules (#4496) 2024-05-20 16:34:13 +08:00
Bowen Liang
04ad46dd31
chore: skip unnecessary key checks prior to accessing a dictionary (#4497) 2024-05-19 18:30:45 +08:00
Bowen Liang
083ef2e6fc
improve: exract Code Node provider for each supported scripting language (#4164) 2024-05-17 11:58:12 +08:00
Han Fangyuan
3df47b7b59
fix: wrong category name in examples of question classifier completion prompt (#4421) 2024-05-16 13:04:57 +08:00
VoidIsVoid
a76ae2d756
chore: remove useless code in knowledge_retrieval_node (#4412) 2024-05-15 15:24:40 +08:00
非法操作
1d0f88264f
Fix HTTP REQUEST NODE is always waiting but endpoint have responsed (#4395) 2024-05-15 11:05:46 +08:00
非法操作
3271e3e803
improve the code readability of http_executor node (#4360) 2024-05-14 16:11:12 +08:00
Yeuoly
16d47923c3
fix: requests timeout (#4370) 2024-05-14 16:01:23 +08:00
Yeuoly
bbef964eb5
improve: code upgrade (#4231) 2024-05-13 14:39:14 +08:00
Patryk Garstecki
2c1c660c6e
fix(Backend:http_executor): 🔧 prevent splitting JSON data as v… (#4276) 2024-05-11 11:23:35 +08:00