1577 Commits

Author	SHA1	Message	Date
Aurelius Huang	4585cffce1	fix: Compatible with special characters in pg full-text search. (#8921) ... Co-authored-by: Aurelius Huang <cm.huang@aftership.com>	2024-09-30 16:32:23 +08:00
Jyong	9d221a5e19	external knowledge api (#8913) ... Co-authored-by: Yi <yxiaoisme@gmail.com>	2024-09-30 15:38:43 +08:00
jyong	f200c0c030	update tidb batch create	2024-09-30 14:44:35 +08:00
zhuhao	77aef9ff1d	refactor: optimize the calculation of rerank threshold and the logic for forbidden characters in model_uid (#8879)	2024-09-30 12:55:01 +08:00
zhuhao	503561f464	fix: fix the data validation consistency issue in keyword content review (#8908)	2024-09-30 12:52:18 +08:00
-LAN-	ada9d408ac	refactor(api/variables): VariableError as a ValueError. (#8554)	2024-09-30 12:48:58 +08:00
Zhaofeng Miao	369e1e6f58	feat(website-crawl): add jina reader as additional alternative for website crawling (#8761)	2024-09-30 09:57:19 +08:00
zhuhao	fb49413a41	feat: add voyage ai as a new model provider (#8747)	2024-09-29 16:55:59 +08:00
zhuhao	42dfde6546	docs: add english versions for the files customizable_model_scale_out and predefined_model_scale_out (#8871)	2024-09-29 16:16:56 +08:00
chenxu9741	c531b4a911	fix: #8843 event: tts_message_end always return in api streaming resp… (#8846)	2024-09-29 16:13:20 +08:00
longzhihun	e4ed916baa	Add Jamba and Llama3.2 model support (#8878)	2024-09-29 16:12:56 +08:00
Bowen Liang	74f58f29f9	chore: bump ruff to 0.6.8 for fixing violation in SIM910 (#8869)	2024-09-29 00:29:59 +08:00
zhuhao	f97607370a	refactor: update Callback to an abstract class (#8868)	2024-09-28 21:41:02 +08:00
zhuhao	850492dafa	feat: deprecate gte-Qwen2-7B-instruct embedding model (#8866)	2024-09-28 21:40:27 +08:00
zhuhao	61c89a9168	feat: add internlm2.5-20b and qwen2.5-coder-7b model (#8862)	2024-09-28 16:31:02 +08:00
takatost	49af18fbd6	fix: customize model credentials were invalid despite the provider credentials being active (#8864)	2024-09-28 15:54:26 +08:00
zhuhao	6cd22f3bca	fix: update qwen2.5-coder-7b model name (#8861)	2024-09-28 15:01:27 +08:00
ice yao	27e33fb15c	chore: fix wrong VectorType match case (#8857)	2024-09-28 10:54:04 +08:00
jyong	0e8b857fb0	add tidb on qdrant whitelist and batch job	2024-09-27 19:01:55 +08:00
zhuhao	55e6123db9	feat: add min-connection and max-connection for pgvector (#8841)	2024-09-27 18:16:20 +08:00
走在修行的大街上	c828a5dfdf	feat(Tools): add feishu tools (#8800) ... Co-authored-by: 黎斌 <libin.23@bytedance.com>	2024-09-27 17:31:45 +08:00
jyong	31df381ed2	Merge branch 'mapleeit/main' into feat/add-tidb-on-qdrant-type ... # Conflicts: # api/configs/feature/__init__.py # api/configs/middleware/__init__.py # api/controllers/console/datasets/datasets.py # api/core/rag/datasource/vdb/vector_type.py	2024-09-27 14:34:30 +08:00
CXwudi	0603359e2d	fix: delete harm catalog settings for gemini (#8829)	2024-09-27 13:49:03 +08:00
HowardChan	bb781764b8	Add Llama3.2 models in Groq provider (#8831)	2024-09-27 12:13:00 +08:00
zhuhao	29275c7447	feat: deprecate mistral model for siliconflow (#8828)	2024-09-27 12:11:56 +08:00
8bitpd	4c1063e1c5	fix: AnalyticdbVector retrieval scores (#8803)	2024-09-27 12:05:21 +08:00
Shai Perednik	a36117e12d	Updated the YouTube channel to Dify's (#8817)	2024-09-27 09:15:33 +08:00
CXwudi	e5efd09ebb	chore: massive update of the Gemini models based on latest documentation (#8822)	2024-09-27 09:14:33 +08:00
wenmeng zhou	ecc951609d	add more detailed doc for models of qwen series (#8799) ... Co-authored-by: crazywoola <427733928@qq.com>	2024-09-26 22:32:33 +08:00
ice yao	063474f408	Add llama3.2 model in fireworks provider (#8809)	2024-09-26 22:21:01 +08:00
AAEE86	9a4b53a212	feat: add stream for Gemini (#8678)	2024-09-26 19:08:59 +08:00
AAEE86	03edfbe6f5	feat: add qwen to add custom model parameters (#8759)	2024-09-26 19:04:25 +08:00
zhuhao	008e0efeb0	refactor: update delete method as an abstract method (#8794)	2024-09-26 16:36:21 +08:00
cx	128a66f7fe	fix: Ollama modelfeature set vision, and an exception occurred at the… (#8783)	2024-09-26 16:34:40 +08:00
非法操作	d1173a69f8	fix: the Image-1X tool (#8787)	2024-09-26 13:48:06 +08:00
Shenghang Tsai	a0b0809b1c	Add more models for SiliconFlow (#8779)	2024-09-26 11:29:53 +08:00
Aaron Ji	4c9ef6e830	fix: update usage for Jina Embeddings v3 (#8771)	2024-09-26 11:29:35 +08:00
非法操作	0c96f0aa51	fix: credential *** should be string (#8785)	2024-09-26 11:24:03 +08:00
zhuhao	ac73763726	chore: add input_type param desc for the _invoke method of text_embedding (#8778)	2024-09-26 11:23:09 +08:00
非法操作	5ba19d64e9	fix: TavilySearch tool get api link (#8780)	2024-09-26 11:22:18 +08:00
Qun	fefbc43fb0	chore: fix comfyui tool doc url (#8775)	2024-09-26 08:18:13 +08:00
Pan, Wen-Ming	02ff6cca70	feat: add support for Vertex AI Gemini 1.5 002 and experimental models (#8767)	2024-09-25 21:27:26 +08:00
Zhaofeng Miao	fd226d3923	feat(website-crawl): add jina reader as additional alternative for website crawling	2024-09-25 17:26:47 +08:00
cherryhuahua	d0e0111f88	fix:Spark's large language model token calculation error #7911 (#8755)	2024-09-25 14:51:42 +08:00
crazywoola	bf64ff215b	fix: . is missing in file_extension (#8736)	2024-09-25 10:09:20 +08:00
ybalbert001	68c7e68a8a	Fix Issue: switch LLM of SageMaker endpoint doesn't take effect (#8737) ... Co-authored-by: Yuanbo Li <ybalbert@amazon.com>	2024-09-25 09:12:35 +08:00
ice yao	91f70d0bd9	Add embedding models in fireworks provider (#8728)	2024-09-25 08:47:11 +08:00
Jyong	4669eb24be	add embedding input type parameter (#8724)	2024-09-24 21:53:50 +08:00
Sa Zhang	debe5953a8	Fix/update jina ai products labels and descriptions (#8730) ... Co-authored-by: sa zhang <sa.zhang@jina.ai>	2024-09-24 21:19:49 +08:00
Shota Totsuka	1c7877b048	fix: remove harm category setting from vertex ai (#8721)	2024-09-24 20:53:26 +08:00
ice yao	64baedb484	fix: update nomic model provider token calculation (#8705)	2024-09-24 14:04:07 +08:00
Benjamin	4638f99aaa	fix: change model provider name issue Ref #8691 (#8710)	2024-09-24 13:26:58 +08:00
AAEE86	aebe5fc68c	fix: Remove unsupported parameters in qwen model (#8699)	2024-09-24 13:06:21 +08:00
zhuhao	1ecf70dca0	feat: add mixedbread as a new model provider (#8523)	2024-09-24 11:20:15 +08:00
ybalbert001	7c485f8bb8	fix llm integration problem: It doesn't work on docker env (#8701) ... Co-authored-by: Yuanbo Li <ybalbert@amazon.com>	2024-09-24 10:33:30 +08:00
themanforfree	21e9608b23	feat: add xinference sd web ui api tool (#8385) ... Signed-off-by: themanforfree <themanforfree@gmail.com>	2024-09-24 10:20:06 +08:00
Sa Zhang	7f1b028840	fix: change the brand name to Jina AI (#8691) ... Co-authored-by: sa zhang <sa.zhang@jina.ai>	2024-09-23 21:39:26 +08:00
Nam Vu	bef83a4d2e	fix: typos and improve naming conventions: (#8687)	2024-09-23 21:32:58 +08:00
crazywoola	8cc9e68363	fix: prompt for the follow-up suggestions (#8685)	2024-09-23 20:00:34 +08:00
ice yao	d7aada38a1	Add nomic embedding model provider (#8640)	2024-09-23 19:57:21 +08:00
Nam Vu	c7eacd1aac	chore: Optimize I18nObject class for better performance and readability (#8681)	2024-09-23 18:40:40 +08:00
AAEE86	a126d535cf	add Spark Max-32K (#8676)	2024-09-23 16:39:46 +08:00
AAEE86	3554a803e7	add zhipuai web search (#8668)	2024-09-23 16:19:42 +08:00
AAEE86	c66cecaa55	add Qwen model translate (#8674)	2024-09-23 16:18:55 +08:00
Bowen Liang	86f90fd9ff	chore: skip PLR6201 linter rule (#8666)	2024-09-23 15:28:57 +08:00
haike-1213	4c7beb9d7b	fix: Assignment exception (#8663) ... Co-authored-by: fum <fum@investoday.com.cn>	2024-09-23 15:23:52 +08:00
Aaron Ji	3618a97c20	feat: extend api params for Jina Embeddings V3 (#8657)	2024-09-23 13:45:09 +08:00
Shota Totsuka	03fdf5e7f8	chore: Enable Japanese descriptions for Tools (#8646)	2024-09-23 09:06:01 +08:00
zhuhao	e34f04380d	feat: add deepseek-v2.5 for model provider siliconflow (#8639)	2024-09-22 21:44:06 +08:00
zhuhao	6df77038a2	docs: fix predefined_model_scale_out.md redirect error (#8633)	2024-09-22 16:45:45 +08:00
zhuhao	45c0a44411	feat: add qwen2.5 for model provider siliconflow (#8630)	2024-09-22 16:42:34 +08:00
Nam Vu	eaa7e9b1f0	fix: llm_generator.py JSONDecodeError (#8504)	2024-09-22 14:02:12 +08:00
omr	8fd297f8b4	fix: redundant check for available_document_count (#8491)	2024-09-22 13:39:41 +08:00
CXwudi	97895ec41a	chore: add Gemini newest experimental models (close #7121) (#8621)	2024-09-22 13:38:08 +08:00
sino	6d56d5c1f6	feat: support o1 series models for openrouter (#8358)	2024-09-22 10:23:50 +08:00
AAEE86	c9f1e18df1	Add model parameter translation (#8509) ... Co-authored-by: swingchen01 <swings@126.com> Co-authored-by: 陈长君 <chenchangjun@shuwen.com>	2024-09-22 10:14:33 +08:00
Waffle	740fad06c1	feat(tools/cogview): Updated cogview tool to support cogview-3 and the latest cogview-3-plus (#8382)	2024-09-22 10:14:14 +08:00
ice yao	0665268578	Add Fireworks AI as new model provider (#8428)	2024-09-22 10:13:00 +08:00
呆萌闷油瓶	c8b9bdebfe	feat:use xinference tts stream mode (#8616)	2024-09-22 10:08:35 +08:00
Shota Totsuka	a587f0d3f1	docs: Add Japanese documentation for tools (#8469)	2024-09-22 09:04:00 +08:00
Hash Brown	8c51d06222	feat: regenerate in Chat, agent and Chatflow app (#7661)	2024-09-22 03:15:11 +08:00
zhuhao	831c5a93af	refactor(ops): Optimize the iteration for filter_none_values and use logging.error to record logs when an exception occurs (#8461)	2024-09-21 22:56:37 +08:00
AAEE86	1a8dcae10e	add Qwen custom add model interface (#8565)	2024-09-21 22:52:10 +08:00
Nam Vu	8219f9e090	fix: api/core/ops/ops_trace_manager.py (#8501)	2024-09-21 20:49:01 +08:00
AAEE86	5ddb601e43	add MixtralAI Model (#8517)	2024-09-21 18:08:07 +08:00
Hongbin	5541248264	Update the PerfXCloud provider model list，Update PerfXCloudProvider validate_provider_credentials method. (#8587) ... Co-authored-by: xhb <466010723@qq.com>	2024-09-21 17:33:15 +08:00
takatost	e0a3307563	fix(workflow): "Max submit count reached" error occurred when executing workflow as tool in iteration (#8595)	2024-09-20 19:47:25 +08:00
Qun	1583283635	ComfyUI tool use the new internal enumeration class "VariableKey" (#8533)	2024-09-20 17:42:47 +08:00
Su Yang	c87f710d58	Fix: update qwen model and model config (#8584) ... Co-authored-by: -LAN- <laipz8200@outlook.com>	2024-09-20 17:05:57 +08:00
Su Yang	1568c5cae9	fix: fix qwen series model type (#8580)	2024-09-20 15:29:33 +08:00
MuYu	a03919c3b3	feat: add hunyuan-vision (#8529)	2024-09-19 18:08:01 +08:00
Su Yang	d6de96c4b4	feat: sync Qwen API with Aliyun Bailian (#8538)	2024-09-19 17:08:59 +08:00
takatost	ffd2f61dd9	fix: thread_pool submit count in parallel workflow not releasing (#8549)	2024-09-19 15:34:56 +08:00
takatost	54b9e1f6d1	fix: ci issues(missing duckduckgo-search==6.2.11, ruff lint issue) (#8543)	2024-09-19 11:43:00 +08:00
Wang Bo	6f222b49f2	refactor: rename task_type to task for jina embeddings v3 (#8488)	2024-09-18 14:53:15 +08:00
-LAN-	8dfe8c773a	chore: Deprecate gpt-3.5-turbo-0613 and gpt-3.5-turbo-16k-0613 models (#8500)	2024-09-18 14:38:09 +08:00
Qun	cf645c3ba1	feat: Add ComfyUI tool for Stable Diffusion (#8160)	2024-09-18 10:56:29 +08:00
Xiao Ley	6dba68f62d	feat: Add base URL settings and secure_ascii options to the Brave search tool (#8463) ... Co-authored-by: crazywoola <427733928@qq.com>	2024-09-15 17:38:43 +08:00
非法操作	3d083b758f	feat: add flux dev of siliconflow image-gen tool (#8450)	2024-09-15 17:14:12 +08:00
takatost	bf16de50fe	fix: internal error when tool authorization (#8449)	2024-09-14 21:50:02 +08:00
Jyong	7e611ffbf3	multi-retrival use dataset's top-k (#8416)	2024-09-14 21:48:44 +08:00
走在修行的大街上	72b7f8a949	Bugfix/fix feishu plugins (#8443) ... Co-authored-by: 黎斌 <libin.23@bytedance.com>	2024-09-14 18:59:06 +08:00
takatost	88c9834ef2	chore(workflow): Optimize the iteration when selecting a variable from a branch in the output variable causes iteration index err (#8440)	2024-09-14 18:02:43 +08:00
ybalbert001	b6ad7a1e06	Fix: https://github.com/langgenius/dify/issues/8190 (Update Model nam… (#8426) ... Co-authored-by: Yuanbo Li <ybalbert@amazon.com>	2024-09-14 17:14:18 +08:00
Aaron Ji	6f7625fa47	chore: update Jina embedding model (#8376)	2024-09-14 16:21:17 +08:00
takatost	f01602b570	fix(workflow): the answer node after the iteration node containing the answer was output prematurely (#8419)	2024-09-14 14:02:09 +08:00
HowardChan	0123498452	fix:logs and rm unused codes in CacheEmbedding (#8409)	2024-09-14 12:56:45 +08:00
ybalbert001	b613b11422	Fix: Support Bedrock cross region inference #8190 (Update Model name to distinguish between different region groups) (#8402) ... Co-authored-by: Yuanbo Li <ybalbert@amazon.com>	2024-09-14 11:06:20 +08:00
crazywoola	71b4480c4a	fix: o1-mini 65563 -> 65536 (#8388)	2024-09-14 02:39:58 +08:00
Bowen Liang	5b98acde2f	chore: improve usage of striping prefix or suffix of string with Ruff 0.6.5 (#8392)	2024-09-13 23:34:39 +08:00
Bowen Liang	aad6f340b3	fix (#8322 followup): resolve the violation of pylint rules (#8391)	2024-09-13 23:19:36 +08:00
Bowen Liang	a1104ab97e	chore: refurish python code by applying Pylint linter rules (#8322)	2024-09-13 22:42:08 +08:00
xiandan-erizo	1ab81b4972	support hunyuan-turbo (#8372) ... Co-authored-by: sunkesi <sunkesi@hosecloud.com>	2024-09-13 20:21:48 +08:00
非法操作	06b66216d7	chore: update firecrawl scrape to V1 api (#8367)	2024-09-13 20:02:00 +08:00
takatost	cd3eaed335	fix(workflow): both parallel and single branch errors occur in if-else (#8378)	2024-09-13 19:55:54 +08:00
takatost	24af4b9313	fix: o1-series model encounters an error when the generate mode is blocking (#8363)	2024-09-13 15:37:54 +08:00
Bowen Liang	6613b8f2e0	chore: fix unnecessary string concatation in single line (#8311)	2024-09-13 14:24:49 +08:00
-LAN-	08c486452f	fix: score_threshold handling in vector search methods (#8356)	2024-09-13 14:24:35 +08:00
sino	a45ac6ab98	fix: ark token usage is none (#8351)	2024-09-13 14:19:24 +08:00
takatost	4637ddaa7f	feat: add o1-series models support in Agent App (ReACT only) (#8350)	2024-09-13 13:08:27 +08:00
Jyong	49cee773c5	fixed score threshold is none (#8342)	2024-09-13 10:21:58 +08:00
takatost	e90d3c29ab	feat: add OpenAI o1 series models support (#8328)	2024-09-13 02:15:19 +08:00
Nam Vu	153807f243	fix: response_format label (#8326)	2024-09-12 23:17:29 +08:00
Ikko Eltociear Ashimine	5db0b56c5b	docs: update lambda_translate_utils.yaml (#8293)	2024-09-12 20:33:07 +08:00
Tamer	404db1ae5b	Fix VariableEntityType Bug external-data-tool -> external_data_tool (#8299)	2024-09-12 20:27:55 +08:00
呆萌闷油瓶	02c4b1af71	chore:add Azure openai api version 2024-08-01-preview (#8291)	2024-09-12 20:22:57 +08:00
ybalbert001	d4985fb3aa	Fix: Support Bedrock cross region inference [#8190](https://github.com/langgenius/dify/issues/8190) (#8317)	2024-09-12 19:15:20 +08:00
Bowen Liang	40fb4d16ef	chore: refurbish Python code by applying refurb linter rules (#8296)	2024-09-12 15:50:49 +08:00
Bowen Liang	c69f5b07ba	chore: apply ruff E501 line-too-long linter rule (#8275) ... Co-authored-by: -LAN- <laipz8200@outlook.com>	2024-09-12 14:00:36 +08:00
takatost	56c90e212a	fix(workflow): missing content in the answer node stream output during iterations (#8292) ... Co-authored-by: -LAN- <laipz8200@outlook.com>	2024-09-12 13:59:48 +08:00
Bowen Liang	0f14873255	chore: cleanup ruff flake8-simplify linter rules (#8286) ... Co-authored-by: -LAN- <laipz8200@outlook.com>	2024-09-12 12:55:45 +08:00
Bowen Liang	781d294f49	chore: cleanup pycodestyle E rules (#8269)	2024-09-11 18:55:00 +08:00
yalei	f515af2232	let claude models in bedrock support the response_format parameter (#8220) ... Co-authored-by: duyalei <>	2024-09-11 18:24:50 +08:00
crazywoola	4d2cd6703b	chore: remove useless code (#8198)	2024-09-11 18:19:34 +08:00
Bowen Liang	292220c596	chore: apply pep8-naming rules for naming convention (#8261)	2024-09-11 16:40:52 +08:00
HowardChan	53f37a6704	fix:ollama text embedding 500 error (#8252)	2024-09-11 16:23:19 +08:00
Leo.Wang	75c1a82556	Update Gitlab query field, add query by path (#8244)	2024-09-11 16:09:53 +08:00
Nam Vu	342607f4a4	fix: truthy value (#8208)	2024-09-11 15:44:53 +08:00
takatost	5f4cdd66fa	fix(workflow): IF-ELSE nodes connected to the same subsequent node cause execution to stop (#8247)	2024-09-11 12:28:32 +08:00
HowardChan	82c42b9ec5	fix:error when adding the ollama embedding model (#8236) ... Co-authored-by: crazywoola <427733928@qq.com>	2024-09-11 10:25:45 +08:00
takatost	cee0c51dbb	feat: add from_variable_selector for stream chunk / message event (#8228)	2024-09-10 22:15:50 +08:00
takatost	fdbbdb706f	fix(workflow): answers are output simultaneously across different braches in the question classifier node. (#8225)	2024-09-10 21:11:35 +08:00
takatost	f6dfe23cf8	fix(workflow): in multi-parallel execution with multiple conditional branches (#8221)	2024-09-10 21:09:18 +08:00
Jyong	bb3002b173	revert page column (#8217)	2024-09-10 18:21:22 +08:00
Bowen Liang	2cf1187b32	chore(api/core): apply ruff reformatting (#7624)	2024-09-10 17:00:20 +08:00
takatost	dabfd74622	feat: Parallel Execution of Nodes in Workflows (#8192) ... Co-authored-by: StyleZhang <jasonapring2015@outlook.com> Co-authored-by: Yi <yxiaoisme@gmail.com> Co-authored-by: -LAN- <laipz8200@outlook.com>	2024-09-10 15:23:16 +08:00
-LAN-	ed37439ef7	refactor(api/core): Improve type hints and apply ruff formatter in agent runner and model manager. (#8166)	2024-09-10 15:00:25 +08:00
Jyong	af92f19291	filter excel empty sheet (#8194)	2024-09-10 14:55:08 +08:00
Jyong	2d690801d1	nvidia rerank top n missed (#8185)	2024-09-10 13:17:48 +08:00
-LAN-	4313d92e6b	feat(api/core/model_runtime/entities/defaults.py): Add TOP_K in default parameters. (#8167)	2024-09-10 09:11:31 +08:00