2402 Commits

Author	SHA1	Message	Date
zxhlyh	d498f4e55e	Chore/model icon url (#9218) ... Co-authored-by: takatost <takatost@gmail.com> Co-authored-by: jyong <718720800@qq.com>	2024-10-11 12:33:34 +08:00
AAEE86	fe41e8bc18	feat: add siliconflow custom add model interface (#8745)	2024-10-11 11:56:11 +08:00
Joe	1e7ef46e9c	fix: update inner api proxies (#9174)	2024-10-11 11:35:01 +08:00
crazywoola	e0c8189f1a	feat: add NotFound error for dataset service (#9215)	2024-10-11 11:28:09 +08:00
Fei He	5c76131d3d	feat: add gte rerank for tongyi (#9153)	2024-10-11 10:35:56 +08:00
Jyong	cabdb4ef17	fix retrieval resource positon missed (#9155) ... Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>	2024-10-11 10:32:42 +08:00
zhuhao	05c1ef75c4	feat: add allow_llm_to_see_data flag for vanna (#9156)	2024-10-10 17:39:26 +08:00
Xiaoguang Sun	be2f1e59f2	improve: Refresh updated_at field of DataSourceOauthBinding model (#9173) ... Signed-off-by: Xiaoguang Sun <sunxiaoguang@gmail.com>	2024-10-10 17:21:28 +08:00
Sa Zhang	75f0a5e36a	fix: Typo Correction in jina.yaml (#9161)	2024-10-10 17:00:34 +08:00
Jyong	68107fe355	downgrade elastic to 8.14 (#9171)	2024-10-10 16:43:11 +08:00
takatost	477beae3bb	fix: missing usage of metadata in the chatflow app (#9167)	2024-10-10 16:34:06 +08:00
Charlie.Wei	6b6e94da08	Fix code indentation errors (#9164)	2024-10-10 15:26:38 +08:00
Ziyu Huang	fc60b554a1	Fixes #9159: Modify to make it works to llama.cpp rerank API (#9160)	2024-10-10 15:18:07 +08:00
Joe	e947103b6d	Feat/add workflow sys params (#9108) ... Co-authored-by: Joel <iamjoel007@gmail.com>	2024-10-10 11:15:52 +08:00
ronaksingh27	62051d5171	Corrected type annotation to "Any" from "any" all files in "model_providers" folder (#9135)	2024-10-10 10:34:25 +08:00
luckylhb90	2024a6c941	fix: vertex ai remote url error(Error: not enough values to unpack) (#9134) ... Co-authored-by: hobo.l <hobo.l@binance.com>	2024-10-10 10:16:42 +08:00
-LAN-	37d5c166ca	fix(migrations): correct parent_message_id for service-api records (#9132)	2024-10-10 10:16:24 +08:00
呆萌闷油瓶	060897b25b	chore:add azure openai api version 2024-09-01-preview (#9141)	2024-10-10 10:07:49 +08:00
非法操作	499cc57082	fix: response_format of model_parameters will not be removed (#9148)	2024-10-10 10:07:21 +08:00
Bowen Liang	b279d19040	chore: avoid star imports usage (#9123)	2024-10-09 21:12:50 +08:00
Hash Brown	511ffa4698	fix: follow-up (suggested questions) does not refer to the most recen… (#9122)	2024-10-09 21:10:55 +08:00
pinsily	7a1da2409d	add generate conversation name error log (#9117)	2024-10-09 21:09:36 +08:00
Charlie.Wei	55679b4389	azure add o1-mini、o1-preview models (#9088) ... Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>	2024-10-09 16:15:03 +08:00
kurokobo	c0b71f8286	feat: respect x-* headers for redirections (#9054)	2024-10-09 14:42:30 +08:00
Bowen Liang	240b66d737	chore: avoid implicit optional in type annotations of method (#8727)	2024-10-09 14:36:43 +08:00
Bowen Liang	b360feb4c1	refactor: introduce storage factory and speed up api startup by importing storage client on demand (#9086)	2024-10-09 14:15:27 +08:00
zhuhao	5fcd614186	feat: output the execution results of tool should only in debug mode (#9104)	2024-10-09 12:53:55 +08:00
zhuhao	4be1aa516c	feat: add tags for vanna tools (#9102)	2024-10-09 12:53:03 +08:00
zhuhao	5e250403d3	chore: add the missing tool names to the _position file (#9099)	2024-10-09 11:04:26 +08:00
SebastjanPrachovskij	f8af9c6ad0	refactor: Update countries & languages list for SearchApi engines (#9090)	2024-10-09 10:24:09 +08:00
ybalbert001	57994e4a24	fix s3 presign url check problem, support two versions(v2,v4) (#9093) ... Co-authored-by: Yuanbo Li <ybalbert@amazon.com>	2024-10-09 10:23:21 +08:00
crazywoola	3a0734d94c	Feat/9081 add support for llamaguard through groq provider (#9083)	2024-10-09 01:00:10 +08:00
zhuhao	5b7de7705e	feat: add timestamp conversion and timestamp retrieval for time tool (#9085)	2024-10-08 23:25:11 +08:00
zhuhao	5213650fed	feat: update the xinf tool's API key to optional (#9073)	2024-10-08 19:07:53 +08:00
gaocarri	8204e0e14a	fix: Count exception occurs when searching conversations (#8754) ... Co-authored-by: zheng.gao <zheng.gao@amh-group.com>	2024-10-08 17:25:33 +08:00
Infinitnet	e741ee2f45	Correct max_tokens for OpenRouter Sonnet 3.5 (#9068)	2024-10-08 16:06:47 +08:00
非法操作	966e65bb66	fix: zhipu ai web_search not work (#9058)	2024-10-08 15:36:31 +08:00
Bowen Liang	896998ef3f	chore: refine python dependency list and check dependencies in order (#9061)	2024-10-08 15:11:45 +08:00
Bowen Liang	7c0b159a81	chore: removing unused imports in tests (#9049)	2024-10-08 11:13:11 +08:00
Bowen Liang	b933c9d206	chore: move testing env variables from pyproject.toml to pytest.ini (#9019)	2024-10-08 08:40:29 +08:00
呆萌闷油瓶	f45042aa8e	fix:ddg ratelimit 202 (#9047)	2024-10-07 22:13:41 +08:00
aiscrm	2ab8bc679f	fix: Missing model information in llm span of Langfuse #9029 (#9030) ... Co-authored-by: corel <corelchen@qq.com>	2024-10-07 18:03:30 +08:00
zhuhao	2571b0c4e3	feat: add baidu obs storage (#9024)	2024-10-07 11:09:27 +08:00
zhuhao	959a81a41b	refactor: remove the duplicate definitions across different modules (#9022)	2024-10-07 11:08:06 +08:00
Bowen Liang	4480b469a6	chore: fix the yanked dependency vesion aiohappyeyeballs 2.4.2 (#9020)	2024-10-07 11:07:34 +08:00
zg0d233	fcfa1252a0	fix bug when adding openai or openai-compatible stt model instance (#9006)	2024-10-07 11:06:38 +08:00
zhuhao	e1e2d0b364	fix: failed to open links to images generated by QR code tool when using Huawei OBS (#9034)	2024-10-07 11:06:08 +08:00
Giannis Kepas	dc5839b6bb	feat: Update AWS Bedrock supported regions (#8992)	2024-10-03 15:17:28 +08:00
zhaoyi233	4373777871	Update json_in_md_parser.py (#8983) ... Co-authored-by: crazywoola <427733928@qq.com>	2024-10-03 10:20:56 +08:00
ice yao	415d27c8bf	feat(Tools): add discord incoming webhook for sending messages (#7852)	2024-10-02 13:18:35 +08:00
Hash Brown	5f8a27074e	fix: chat API is not bringing the conversation/session history (#8965)	2024-10-01 12:10:36 +08:00
zhuhao	24ba9fdf6c	feat: enhance stepfun image generation tool (#8954)	2024-10-01 10:55:54 +08:00
zhuhao	824a0dd63e	feat: add qwen2.5-72b and llama3.2 for openrouter (#8956)	2024-10-01 10:55:51 +08:00
omr	2deaece7e2	refactor: remove unnecessary comment (#8949)	2024-10-01 09:14:49 +08:00
CXwudi	0d84221b2c	chore: sort Gemini models (#8951)	2024-10-01 09:14:36 +08:00
CXwudi	cdd7e55a88	chore: add missing models from Voyage (#8950)	2024-10-01 09:14:21 +08:00
-LAN-	1f5cc071f8	chore(version): bump to 0.9.1 (#8945)	2024-09-30 23:22:21 +08:00
Jyong	625e4c4c72	fix multiple retrieval in knowledge node (#8942)	2024-09-30 23:07:04 +08:00
-LAN-	7850a28ec8	Revert "chore(version): bump to 0.9.1" (#8944)	2024-09-30 22:53:32 +08:00
-LAN-	730d3a6d7c	chore(version): bump to 0.9.1 (#8938)	2024-09-30 22:13:38 +08:00
Jyong	3069b5cf57	original dataset update remove unuseful parameters (#8939)	2024-09-30 22:01:32 +08:00
Jyong	a651b73db0	original dataset update issue (#8935)	2024-09-30 21:17:12 +08:00
-LAN-	d2ce4960f1	chore(versioning): bump version to 0.9.0 (#8911)	2024-09-30 18:33:20 +08:00
zhuhao	fa837b2dfd	fix: fix the issue with the system model configuration update (#8923)	2024-09-30 17:14:13 +08:00
Aurelius Huang	4585cffce1	fix: Compatible with special characters in pg full-text search. (#8921) ... Co-authored-by: Aurelius Huang <cm.huang@aftership.com>	2024-09-30 16:32:23 +08:00
Jyong	9d221a5e19	external knowledge api (#8913) ... Co-authored-by: Yi <yxiaoisme@gmail.com>	2024-09-30 15:38:43 +08:00
jyong	f200c0c030	update tidb batch create	2024-09-30 14:44:35 +08:00
zhuhao	77aef9ff1d	refactor: optimize the calculation of rerank threshold and the logic for forbidden characters in model_uid (#8879)	2024-09-30 12:55:01 +08:00
zhuhao	503561f464	fix: fix the data validation consistency issue in keyword content review (#8908)	2024-09-30 12:52:18 +08:00
-LAN-	ada9d408ac	refactor(api/variables): VariableError as a ValueError. (#8554)	2024-09-30 12:48:58 +08:00
Joe	9f36156514	feat: add ip email code ligin limit	2024-09-30 12:46:20 +08:00
-LAN-	3af65b2f45	feat(api): add version comparison logic (#8902)	2024-09-30 11:12:26 +08:00
Joe	98aa54038f	fix: login password judgement	2024-09-30 10:57:35 +08:00
Joe	f6297109cf	chore: lint	2024-09-30 10:37:53 +08:00
Joe	01d1caecf7	fix: unique_tenant_account_join	2024-09-30 10:34:21 +08:00
Zhaofeng Miao	369e1e6f58	feat(website-crawl): add jina reader as additional alternative for website crawling (#8761)	2024-09-30 09:57:19 +08:00
Joe	91d3e43b11	feat: change ALLOW_CREATE_WORKSPACE false	2024-09-29 21:55:17 +08:00
Joe	5165894b1a	feat: add invite menmber workspace all create	2024-09-29 21:54:05 +08:00
Joe	7e4d105e8b	feat: add setup only	2024-09-29 21:04:54 +08:00
Joe	067955c2b1	feat: remove self-host	2024-09-29 20:59:28 +08:00
Joe	cd88f27cd5	Merge branch 'main' into feat/new-login ... * main: (77 commits) feat: add voyage ai as a new model provider (#8747) docs: add english versions for the files customizable_model_scale_out and predefined_model_scale_out (#8871) fix: #8843 event: tts_message_end always return in api streaming resp… (#8846) Add Jamba and Llama3.2 model support (#8878) fix(workflow): update tagging logic in GitHub Actions (#8882) chore: bump ruff to 0.6.8 for fixing violation in SIM910 (#8869) refactor: update Callback to an abstract class (#8868) feat: deprecate gte-Qwen2-7B-instruct embedding model (#8866) feat: add internlm2.5-20b and qwen2.5-coder-7b model (#8862) fix: customize model credentials were invalid despite the provider credentials being active (#8864) fix: update qwen2.5-coder-7b model name (#8861) fix(workflow/nodes/knowledge-retrieval/use-config): Preserve rerankin… (#8842) chore: fix wrong VectorType match case (#8857) feat: add min-connection and max-connection for pgvector (#8841) feat(Tools): add feishu tools (#8800) fix: delete harm catalog settings for gemini (#8829) Add Llama3.2 models in Groq provider (#8831) feat: deprecate mistral model for siliconflow (#8828) fix: AnalyticdbVector retrieval scores (#8803) fix: close log status option raise error (#8826) ...	2024-09-29 17:15:29 +08:00
Joe	d481a1b998	chore: lint ... chore: lint	2024-09-29 17:06:27 +08:00
Joe	86b182ff73	feat: add email code login invite token	2024-09-29 16:59:03 +08:00
zhuhao	fb49413a41	feat: add voyage ai as a new model provider (#8747)	2024-09-29 16:55:59 +08:00
zhuhao	42dfde6546	docs: add english versions for the files customizable_model_scale_out and predefined_model_scale_out (#8871)	2024-09-29 16:16:56 +08:00
chenxu9741	c531b4a911	fix: #8843 event: tts_message_end always return in api streaming resp… (#8846)	2024-09-29 16:13:20 +08:00
longzhihun	e4ed916baa	Add Jamba and Llama3.2 model support (#8878)	2024-09-29 16:12:56 +08:00
Bowen Liang	74f58f29f9	chore: bump ruff to 0.6.8 for fixing violation in SIM910 (#8869)	2024-09-29 00:29:59 +08:00
zhuhao	f97607370a	refactor: update Callback to an abstract class (#8868)	2024-09-28 21:41:02 +08:00
zhuhao	850492dafa	feat: deprecate gte-Qwen2-7B-instruct embedding model (#8866)	2024-09-28 21:40:27 +08:00
zhuhao	61c89a9168	feat: add internlm2.5-20b and qwen2.5-coder-7b model (#8862)	2024-09-28 16:31:02 +08:00
takatost	49af18fbd6	fix: customize model credentials were invalid despite the provider credentials being active (#8864)	2024-09-28 15:54:26 +08:00
zhuhao	6cd22f3bca	fix: update qwen2.5-coder-7b model name (#8861)	2024-09-28 15:01:27 +08:00
ice yao	27e33fb15c	chore: fix wrong VectorType match case (#8857)	2024-09-28 10:54:04 +08:00
jyong	0e8b857fb0	add tidb on qdrant whitelist and batch job	2024-09-27 19:01:55 +08:00
zhuhao	55e6123db9	feat: add min-connection and max-connection for pgvector (#8841)	2024-09-27 18:16:20 +08:00
走在修行的大街上	c828a5dfdf	feat(Tools): add feishu tools (#8800) ... Co-authored-by: 黎斌 <libin.23@bytedance.com>	2024-09-27 17:31:45 +08:00
Joe	7ad6c32acb	feat: auto update user status	2024-09-27 15:15:10 +08:00
Joe	6e5fd6710c	fix: query error	2024-09-27 14:56:00 +08:00
Joe	51e7c17bae	fix: tenant search	2024-09-27 14:49:35 +08:00
Joe	161d725350	feat: add self host user auto join	2024-09-27 14:44:34 +08:00
Joe	9a6918069d	feat: self host not create workspace	2024-09-27 14:36:31 +08:00
jyong	31df381ed2	Merge branch 'mapleeit/main' into feat/add-tidb-on-qdrant-type ... # Conflicts: # api/configs/feature/__init__.py # api/configs/middleware/__init__.py # api/controllers/console/datasets/datasets.py # api/core/rag/datasource/vdb/vector_type.py	2024-09-27 14:34:30 +08:00
CXwudi	0603359e2d	fix: delete harm catalog settings for gemini (#8829)	2024-09-27 13:49:03 +08:00
Joe	d3d0d6451a	chore: change invite member template	2024-09-27 12:49:58 +08:00
Joe	62f14088b5	feat: change error resp	2024-09-27 12:48:15 +08:00
HowardChan	bb781764b8	Add Llama3.2 models in Groq provider (#8831)	2024-09-27 12:13:00 +08:00
zhuhao	29275c7447	feat: deprecate mistral model for siliconflow (#8828)	2024-09-27 12:11:56 +08:00
8bitpd	4c1063e1c5	fix: AnalyticdbVector retrieval scores (#8803)	2024-09-27 12:05:21 +08:00
Joe	133beea491	fix: change type error	2024-09-27 11:56:37 +08:00
Joe	3801378f5e	feat: change valid_password error resp	2024-09-27 10:52:01 +08:00
Shai Perednik	a36117e12d	Updated the YouTube channel to Dify's (#8817)	2024-09-27 09:15:33 +08:00
CXwudi	e5efd09ebb	chore: massive update of the Gemini models based on latest documentation (#8822)	2024-09-27 09:14:33 +08:00
wenmeng zhou	ecc951609d	add more detailed doc for models of qwen series (#8799) ... Co-authored-by: crazywoola <427733928@qq.com>	2024-09-26 22:32:33 +08:00
ice yao	063474f408	Add llama3.2 model in fireworks provider (#8809)	2024-09-26 22:21:01 +08:00
AAEE86	9a4b53a212	feat: add stream for Gemini (#8678)	2024-09-26 19:08:59 +08:00
AAEE86	03edfbe6f5	feat: add qwen to add custom model parameters (#8759)	2024-09-26 19:04:25 +08:00
zhuhao	008e0efeb0	refactor: update delete method as an abstract method (#8794)	2024-09-26 16:36:21 +08:00
cx	128a66f7fe	fix: Ollama modelfeature set vision, and an exception occurred at the… (#8783)	2024-09-26 16:34:40 +08:00
Joe	456e7a4abd	feat: change email language	2024-09-26 16:15:23 +08:00
Joe	8059706e18	chore: style lint	2024-09-26 15:50:19 +08:00
Joe	b249f2b9f9	feat: update raise error	2024-09-26 15:49:37 +08:00
Joe	9e4ee2beb1	feat: add EmailPasswordLoginLimitError	2024-09-26 14:59:13 +08:00
Joe	5066233cd4	feat: email api add password param	2024-09-26 14:30:06 +08:00
非法操作	d1173a69f8	fix: the Image-1X tool (#8787)	2024-09-26 13:48:06 +08:00
Joe	0cbef254cd	chore: change email template style	2024-09-26 11:34:28 +08:00
Shenghang Tsai	a0b0809b1c	Add more models for SiliconFlow (#8779)	2024-09-26 11:29:53 +08:00
Aaron Ji	4c9ef6e830	fix: update usage for Jina Embeddings v3 (#8771)	2024-09-26 11:29:35 +08:00
Joe	34c97d686d	chore: change password type	2024-09-26 11:28:10 +08:00
非法操作	0c96f0aa51	fix: credential *** should be string (#8785)	2024-09-26 11:24:03 +08:00
zhuhao	ac73763726	chore: add input_type param desc for the _invoke method of text_embedding (#8778)	2024-09-26 11:23:09 +08:00
非法操作	5ba19d64e9	fix: TavilySearch tool get api link (#8780)	2024-09-26 11:22:18 +08:00
Qun	fefbc43fb0	chore: fix comfyui tool doc url (#8775)	2024-09-26 08:18:13 +08:00
Bowen Liang	a8b837c4a9	dep: bump ElasticSearch from 8.14.x to 8.15.x (#8197)	2024-09-25 22:55:24 +08:00
Pan, Wen-Ming	02ff6cca70	feat: add support for Vertex AI Gemini 1.5 002 and experimental models (#8767)	2024-09-25 21:27:26 +08:00
Zhaofeng Miao	fd226d3923	feat(website-crawl): add jina reader as additional alternative for website crawling	2024-09-25 17:26:47 +08:00
cherryhuahua	d0e0111f88	fix:Spark's large language model token calculation error #7911 (#8755)	2024-09-25 14:51:42 +08:00
crazywoola	bf64ff215b	fix: . is missing in file_extension (#8736)	2024-09-25 10:09:20 +08:00
ybalbert001	68c7e68a8a	Fix Issue: switch LLM of SageMaker endpoint doesn't take effect (#8737) ... Co-authored-by: Yuanbo Li <ybalbert@amazon.com>	2024-09-25 09:12:35 +08:00
ice yao	91f70d0bd9	Add embedding models in fireworks provider (#8728)	2024-09-25 08:47:11 +08:00
Jyong	4669eb24be	add embedding input type parameter (#8724)	2024-09-24 21:53:50 +08:00
Sa Zhang	debe5953a8	Fix/update jina ai products labels and descriptions (#8730) ... Co-authored-by: sa zhang <sa.zhang@jina.ai>	2024-09-24 21:19:49 +08:00
Shota Totsuka	1c7877b048	fix: remove harm category setting from vertex ai (#8721)	2024-09-24 20:53:26 +08:00
非法操作	9ca2e2c968	chore: remove windows platform timezone set (#8712)	2024-09-24 17:33:29 +08:00
ice yao	64baedb484	fix: update nomic model provider token calculation (#8705)	2024-09-24 14:04:07 +08:00
Benjamin	4638f99aaa	fix: change model provider name issue Ref #8691 (#8710)	2024-09-24 13:26:58 +08:00
AAEE86	aebe5fc68c	fix: Remove unsupported parameters in qwen model (#8699)	2024-09-24 13:06:21 +08:00
zhuhao	1ecf70dca0	feat: add mixedbread as a new model provider (#8523)	2024-09-24 11:20:15 +08:00
ybalbert001	7c485f8bb8	fix llm integration problem: It doesn't work on docker env (#8701) ... Co-authored-by: Yuanbo Li <ybalbert@amazon.com>	2024-09-24 10:33:30 +08:00
themanforfree	21e9608b23	feat: add xinference sd web ui api tool (#8385) ... Signed-off-by: themanforfree <themanforfree@gmail.com>	2024-09-24 10:20:06 +08:00