Commit Graph

432 Commits

Author SHA1 Message Date
thibautleaux-kreactive
96c171805a
Update bedrock.yaml (#6281) 2024-07-15 16:53:03 +08:00
Benjamin
ec181649ae
Update model provider configuration for Triton Inference Server and X… (#6274) 2024-07-15 15:07:28 +08:00
Waffle
07add06c59
Feat/add zhipu CogView 3 tool (#6210) 2024-07-13 17:39:17 +08:00
Little 羊
7c2c949f01
Update ernie_bot.py (#6236) 2024-07-12 19:54:53 +08:00
耐小心
d7a6f25c63
fix: differentiate prompts fields based on function_calling_type (#5880) 2024-07-12 11:07:38 +08:00
crazywoola
ee3936916f
upgrade deepseek params (#6215) 2024-07-12 10:55:44 +08:00
Little 羊
2f064c68bc
Create ernie-4.0-turbo-8k-preview (#6132) 2024-07-11 20:20:07 +08:00
Su Yang
215661ef91
feat: add PerfXCloud, Qwen series #6116 (#6117) 2024-07-10 18:26:10 +08:00
chenxu9741
6ef401a9f0
feat:add tts-streaming config and future (#5492) 2024-07-09 11:33:58 +08:00
sino
85744b72e5
feat: support moonshot and glm base models for volcengine provider (#6029) 2024-07-07 01:17:33 +08:00
Masashi Tomooka
3b23d6764f
fix: token count includes base64 string of input images (#5868) 2024-07-06 16:53:32 +08:00
-LAN-
4d105d7bd7
feat(*): Swtich to dify_config. (#6025) 2024-07-06 12:05:13 +08:00
orangeclk
f8aaa57f31
feat: add retry mechanism for zhipuai (#5926) 2024-07-05 10:49:18 +08:00
-LAN-
d7f75d17cc
Chore/remove-unused-code (#5917) 2024-07-04 18:18:26 +08:00
longzhihun
aecdfa2d5c
feat: add claude3 function calling (#5889) 2024-07-03 22:21:02 +08:00
longzhihun
fdfbbde10d
[seanguo] modify bedrock Claude3 invoke method to converse API (#5768)
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-07-01 04:36:13 +08:00
takatost
0bf4817474
fix: _convert_prompt_message_to_dict parameters err (#5716) 2024-06-28 21:00:00 +08:00
呆萌闷油瓶
68ac433218
feat: add support Spark4.0 (#5688) 2024-06-28 17:39:11 +08:00
Kevin
b3d6726f65
Feature/add qwen llm (#5659) 2024-06-28 11:06:29 +08:00
liuzhenghua
2b080b5cfc
feature: Add presence_penalty and frequency_penalty parameters to the … (#5637)
Co-authored-by: liuzhenghua-jk <liuzhenghua-jk@360shuke.com>
2024-06-28 00:27:20 +08:00
takatost
3ccad33194
feat: add jina new pre-defined rerankers, include: jina-reranker-v2 (#5657) 2024-06-27 13:45:35 +08:00
sunxichen
bafc8a0bde
fix: tool call message role according to credentials (#5625)
Co-authored-by: sunxichen <sun.xc@digitalcnzz.com>
2024-06-27 12:35:27 +08:00
Bowen Liang
dcb72e0067
chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-27 11:21:31 +08:00
Joe
4e2de638af
feat: add ops trace (#5483)
Co-authored-by: takatost <takatost@gmail.com>
2024-06-26 17:33:29 +08:00
sino
877a2c144b
feat: support predefined models for openrouter (#5494) 2024-06-24 16:31:53 +08:00
-LAN-
ba67206bb9
fix(api/model_runtime/azure/llm): Switch to tool_call. (#5541) 2024-06-24 15:35:21 +08:00
vccler
48757e581e
fix: zhipu tool calling, this PR fixes the bug described in issue #5496 (#5469)
Co-authored-by: vccler <vccler@163.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-22 12:41:24 +08:00
LXM
e8ad0339a3
fix: tongyi json output (#5396) 2024-06-22 12:25:23 +08:00
crazywoola
91d38a535f
fix: max_tokens of qwen-plus & qwen-plus-chat (#5480) 2024-06-21 16:49:33 +08:00
Pan, Wen-Ming
95c882934e
feat: add support for Vertex AI claude-3-5-sonnet@20240620 (#5475)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-21 16:45:56 +08:00
Su Yang
26b6fd2236
feat: add support for bedrock claude-3-5-sonnet-20240620 (#5461) 2024-06-21 10:21:35 +08:00
takatost
ff0f02d809
feat: add support for claude-3-5-sonnet-20240620 (#5452) 2024-06-21 00:23:15 +08:00
-LAN-
142dc0afd7
refactor: Remove unused code in large_language_model.py (#5433) 2024-06-20 16:20:40 +08:00
-LAN-
23fa3dedc4
fix(core): Fix incorrect type hints. (#5427) 2024-06-20 15:16:21 +08:00
Ikko Eltociear Ashimine
8266842809
chore: update llm.py (#5335) 2024-06-18 09:29:14 +08:00
Richards Tu
c163521b9e
Update and fix the model param of Deepseek (#5329) 2024-06-17 21:40:04 +08:00
Justin Wu
61f4f08744
Add bedrock command r models (#4521)
Co-authored-by: Justin Wu <justin.wu@ringcentral.com>
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-06-17 20:37:46 +08:00
-LAN-
5a99aeb864
fix(core): Reorder field_validator and classmethod to fit Pydantic V2. (#5257) 2024-06-17 10:04:28 +08:00
crazywoola
9a64aa76c1
fix: typo and check (#5287) 2024-06-17 09:15:43 +08:00
Pan, Wen-Ming
4b54843ed7
fix: run agent with Vertex AI Gemini models (#5260)
Co-authored-by: Wenming Pan <pwm@google.com>
2024-06-16 09:36:31 +08:00
kurokobo
2e842333b1
fix: correct typos in the icons for microsoft (#5243) 2024-06-15 21:02:47 +08:00
Masashi Tomooka
d9bee03ff6
fix: embedding job fails using IAM role (#5252) 2024-06-15 18:57:54 +08:00
Jyong
ba5f8afaa8
Feat/firecrawl data source (#5232)
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-06-15 02:46:02 +08:00
Bin
0f35d07052
support ERNIE-4.0-8K-Latest (#5216) 2024-06-14 18:45:24 +08:00
-LAN-
7f44e88eda
fix(model_providers/ollama): Fix OllamaLargeLanguageModel to correctly set the stop option (#5217) 2024-06-14 18:26:14 +08:00
Jason
b7ff765d8d
Add novita.ai as model provider (#4961) 2024-06-14 18:23:06 +08:00
Masashi Tomooka
0633aae7dc
feat: allow to use IAM Role for Bedrock (#5188) 2024-06-14 15:18:42 +08:00
takatost
415022aa14
fix: pydantic2 error (#5172) 2024-06-14 03:05:04 +08:00
rerorero
b85ae146a7
fix: JSON mode with an image doesn't work for Gemini (#5169) 2024-06-14 02:32:09 +08:00
Pan, Wen-Ming
f13af5a811
fix(model_providers/vertex_ai): Vertex AI Anthropic models authentication failed (#4971) 2024-06-14 01:34:31 +08:00
Bowen Liang
f976740b57
improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592) 2024-06-14 01:05:37 +08:00
kurokobo
e61f5d029a
chore(docs): fix minor small typos (#5124) 2024-06-13 17:36:01 +08:00
sino
8210637bc5
feat: support jina-clip-v1 embedding model (#5146) 2024-06-13 16:31:18 +08:00
呆萌闷油瓶
790543131a
chore:add some new api version for azure openai (#5142) 2024-06-13 16:30:47 +08:00
yanghx
adc948e87c
fix(api/core/model_runtime/model_providers/baichuan,localai): Parse ToolPromptMessage. #4943 (#5138)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-13 13:08:30 +08:00
orangeclk
79e8489942
feat: support siliconflow (#5129) 2024-06-13 12:59:41 +08:00
xielong
ea69dc2a7e
feat: support hunyuan llm models (#5013)
Co-authored-by: takatost <takatost@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
2024-06-12 17:24:23 +08:00
Pika
ecc7f130b4
fix(typo): misspelling (#5094) 2024-06-12 17:01:21 +08:00
sino
0ce97e6315
feat: support doubao llm function calling (#5100) 2024-06-12 15:43:50 +08:00
rerorero
28997772a5
fix: remote_url doesn't work for gemini (#5090) 2024-06-12 13:14:53 +08:00
orangeclk
2050a8b8f0
feat: add glm4 new models and zhipu embedding-2 (#5089) 2024-06-12 08:22:17 +08:00
sino
5f870ac950
chore: update maas model provider description (#5056) 2024-06-11 11:22:22 +08:00
Jaxon Ley
2573b138bf
fix: update presence_penalty configuration for wenxin AI ernie-4.0-8k and ernie-3.5-8k models (#5039) 2024-06-09 14:44:11 +08:00
takatost
3929d289e0
feat: set default memory messages limit to infinite (#5002) 2024-06-06 17:39:44 +08:00
Joe
5cdb95be1f
fix: gemini timeout error (#4955) 2024-06-06 10:19:03 +08:00
Bowen Liang
f32b440c4a
chore: fix indention violations by applying E111 to E117 ruff rules (#4925) 2024-06-05 14:05:15 +08:00
takatost
f44d1e62d2
fix: bedrock get_num_tokens prompt_messages parameter name err (#4932) 2024-06-05 01:53:05 +08:00
takatost
d1dbbc1e33
feat: backend model load balancing support (#4927) 2024-06-05 00:13:04 +08:00
Pan, Wen-Ming
b98a1a3303
feat: added Anthropic Claude3 models to Google Cloud Vertex AI (#4870)
Co-authored-by: pwm <pwm@google.com>
2024-06-04 02:52:46 +08:00
takatost
696c5308a9
chore: optimize nvidia nim credential schema and info (#4898) 2024-06-04 02:26:26 +08:00
Joshua
3c8a120e51
add-nvidia-mim (#4882) 2024-06-03 21:10:18 +08:00
Pan, Wen-Ming
cdbc260571
Bugfix: Vertex AI vision model not support image (#4853) 2024-06-02 11:11:09 +08:00
Yash Parmar
e0da0744b5
add: ollama keep alive parameter added. issue #4024 (#4655) 2024-05-31 12:22:02 +08:00
Weaxs
b189faca52
feat: update ernie model (#4756) 2024-05-29 14:57:23 +08:00
xielong
e1cd9aef8f
feat: support baichuan3 turbo, baichuan3 turbo 128k, and baichuan4 (#4762) 2024-05-29 14:46:04 +08:00
crazywoola
705a6e3a8e
Fix/4742 ollama num gpu option not consistent with allowed values (#4751) 2024-05-29 13:33:35 +08:00
xielong
793f0c1dd6
fix: Corrected schema link in model_runtime's README.md (#4757) 2024-05-29 13:03:21 +08:00
xielong
88b4d69278
fix: Correct context size for banchuan2-53b and banchuan2-turbo (#4721) 2024-05-28 16:37:44 +08:00
crazywoola
27dae156db
fix: colon in file mistral.mistral-small-2402-v1:0 (#4673) 2024-05-27 13:15:20 +08:00
Giovanny Gutiérrez
2deb23e00e
fix: Show rerank in system for localai (#4652) 2024-05-27 12:09:51 +08:00
longzhihun
fe9bf5fc4a
[seanguo] add support of amazon titan v2 and modify the price of amazon titan v1 (#4643)
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-05-26 23:30:22 +08:00
miendinh
f804adbff3
feat: Support for Vertex AI - load Default Application Configuration (#4641)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-05-25 13:40:25 +08:00
Krasus.Chen
f156014daa
update lite8k/speed8k/128k max_token to newest (#4636)
Co-authored-by: Your Name <chen@krasus.red>
2024-05-24 19:33:42 +08:00
Bowen Liang
3fda2245a4
improve: extract method for safe loading yaml file and avoid using PyYaml's FullLoader (#4031) 2024-05-24 12:08:12 +08:00
Patryk Garstecki
296887754f
Support for Vertex AI (#4586) 2024-05-24 12:01:40 +08:00
QuietRocket
9ae72cdcf4
feat: Add Gemini Flash (#4616) 2024-05-24 11:43:06 +08:00
takatost
11642192d1
chore: add https://api.openai.com placeholder in OpenAI api base (#4604) 2024-05-23 12:56:05 +08:00
呆萌闷油瓶
e57bdd4e58
chore:update gpt-3.5-turbo and gpt-4-turbo parameter for azure (#4596) 2024-05-23 11:51:38 +08:00
somethingwentwell
461488e9bf
Add Azure OpenAI API version for GPT4o support (#4569)
Co-authored-by: wwwc <wwwc@outlook.com>
2024-05-22 17:43:16 +08:00
Justin Wu
3ab19be9ea
Fix bedrock claude wrong pricing (#4572)
Co-authored-by: Justin Wu <justin.wu@ringcentral.com>
2024-05-22 14:28:28 +08:00
呆萌闷油瓶
d5a33a0323
feat:add gpt-4o for azure (#4568) 2024-05-22 11:02:43 +08:00
Bowen Liang
e8e213ad1e
chore: apply and fix flake8-bugbear lint rules (#4496) 2024-05-20 16:34:13 +08:00
Ever
4086f5051c
feat:Provide parameter config for mask_sensitive_info of MiniMax mode… (#4294)
Co-authored-by: 老潮 <zhangyongsheng@3vjia.com>
Co-authored-by: takatost <takatost@users.noreply.github.com>
Co-authored-by: takatost <takatost@gmail.com>
2024-05-20 10:15:27 +08:00
fanghongtai
1cca100a48
fix:modify spelling errors: lanuage ->language in schema.md (#4499)
Co-authored-by: wxfanghongtai <wxfanghongtai@gf.com.cn>
2024-05-19 18:31:05 +08:00
Bowen Liang
04ad46dd31
chore: skip unnecessary key checks prior to accessing a dictionary (#4497) 2024-05-19 18:30:45 +08:00
Yeuoly
091fba74cb
enhance: claude stream tool call (#4469) 2024-05-17 12:43:58 +08:00
jiaqianjing
0ac5d621b6
add llm: ernie-character-8k of wenxin (#4448) 2024-05-16 18:31:07 +08:00
sino
6e9066ebf4
feat: support doubao llm and embeding models (#4431) 2024-05-16 11:41:24 +08:00
Yash Parmar
332baca538
FIX: fix the temperature value of ollama model (#4027) 2024-05-15 08:05:54 +08:00
Yeuoly
e8311357ff
feat: gpt-4o (#4346) 2024-05-14 02:52:41 +08:00
orangeclk
ece0f08a2b
add yi models (#4335)
Co-authored-by: 陈力坤 <likunchen@caixin.com>
2024-05-13 17:40:53 +08:00
Weaxs
8cc492721b
fix: minimax streaming function_call message (#4271) 2024-05-11 21:07:22 +08:00
Joshua
a80fe20456
add-some-new-models-hosted-on-nvidia (#4303) 2024-05-11 21:05:31 +08:00
呆萌闷油瓶
4796f9d914
feat:add gpt-4-turbo for azure (#4287) 2024-05-11 13:02:56 +08:00
Sebastian.W
a588df4371
Add rerank model type for LocalAI provider (#3952) 2024-05-11 11:29:28 +08:00
Bowen Liang
228de1f12a
fix: miss usage of os.path.join for URL assembly and add tests on yarl (#4224) 2024-05-10 18:14:48 +08:00
sino
4aa21242b6
feat: add volcengine maas model provider (#4142) 2024-05-08 12:45:53 +08:00
Yong723
8ce93faf08
Typo on deepseek.yaml and yi.yaml (#4170) 2024-05-08 10:52:04 +08:00
Su Yang
9f440c11e0
feat: DeepSeek (#4162) 2024-05-08 00:28:16 +08:00
Joshua
58bd5627bf
Add-Deepseek (#4157) 2024-05-07 22:45:38 +08:00
Moonlit
2fdd64c1b5
feat: add proxy configuration for Cohere model (#4152) 2024-05-07 18:12:13 +08:00
VoidIsVoid
543a00e597
feat: update model_provider jina to support custom url and model (#4110)
Co-authored-by: Gimling <huangjl@ruyi.ai>
Co-authored-by: takatost <takatost@gmail.com>
2024-05-07 17:43:24 +08:00
Minamiyama
f361c7004d
feat: support vision models from xinference (#4094)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-05-07 17:37:36 +08:00
Tomy
bb7c62777d
Add support for local ai speech to text (#3921)
Co-authored-by: Yeuoly <admin@srmxy.cn>
2024-05-07 17:14:24 +08:00
Charlie.Wei
087b7a6607
azure_openai add gpt-4-turbo-2024-04-09 model (#4144)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
2024-05-07 15:55:23 +08:00
Weaxs
6f1911533c
bug fix: update minimax model_apis (#4116) 2024-05-07 14:40:24 +08:00
Yeuoly
d5d8b98d82
feat: support openai stream usage (#4140) 2024-05-07 13:49:45 +08:00
Joshua
51a9e678f0
Leptonai integrate (#4079) 2024-05-05 14:37:47 +08:00
chenx5
ad76ee76a8
Update bedrock.yaml add Region Asia Pacific (Sydney) (#4016) 2024-05-05 10:49:17 +08:00
orangeclk
cbdb861ee4
add glm-3-turbo max_tokens parameter setting (#4017)
Co-authored-by: 陈力坤 <likunchen@caixin.com>
2024-04-30 17:08:04 +08:00
Weaxs
1e6e8b446d
feat: support minimax abab6.5, abab6.5s (#4012) 2024-04-30 17:02:01 +08:00
Joshua
2f84d00300
fix-nvidia-llama3 (#3973) 2024-04-29 13:41:15 +08:00
longzhihun
43a5ba9415
feat: add support for Bedrock LLAMA3 (#3890) 2024-04-27 13:13:09 +08:00
Garfield Dai
cefe156811
feat: replicate supports default version. (#3884) 2024-04-26 21:16:22 +08:00
Jyong
0ec8b57825
add together ai model setting (#3895) 2024-04-26 20:43:17 +08:00
takatost
a4e4fb4094
fix: credentials validate failed for groqcloud model provider (#3817) 2024-04-25 12:09:44 +08:00
1102
59cba930e5
bedrock llm Model file name change (#3714)
Co-authored-by: heshunchang <shuncanghe@clouditera.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-04-23 18:57:34 +08:00
呆萌闷油瓶
f76ac8bdee
enhance:speedup xinference audio transcription (#3636) 2024-04-23 17:09:30 +08:00
longzhihun
28236147ee
feat: add support for bedrock Mistral AI model (#3676)
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
2024-04-22 17:24:02 +08:00
Chenhe Gu
4969783383
add groq llama3 (#3673) 2024-04-22 15:21:09 +08:00
Joshua
7545e5de6c
add-llama3-for-nvidia-api-catalog (#3631) 2024-04-19 14:51:22 +08:00
Yeuoly
a0c30702c1
feat: moonshot fc (#3629) 2024-04-19 14:04:30 +08:00
jeessy2
646858ea08
feat: Vision switch functionality is provided on OpenRouter (#3564) 2024-04-19 09:13:25 +08:00
Bowen Liang
d9b821cecc
chore: apply ruff rules on tests and app.py (#3605) 2024-04-18 20:24:05 +08:00
Joshua
de3b490f8e
Add mixtral 8x22b (#3606) 2024-04-18 17:44:22 +08:00
aniaan
aa6d2e3035
fix(openai_api_compatible): fixing the error when converting chunk to json (#3570) 2024-04-18 16:54:16 +08:00
呆萌闷油瓶
4365843c20
enhance:speedup xinference embedding & rerank (#3587) 2024-04-18 16:54:00 +08:00
Joshua
b9b28900b1
add-open-mixtral-8x22b (#3591) 2024-04-18 13:48:32 +08:00
Siddharth Jain
8ba95c08a1
added claude 3 opus (#3545) 2024-04-17 20:53:59 +08:00
takatost
b890c11c14
feat: filter empty content messages in llm node (#3547) 2024-04-17 13:30:33 +08:00
takatost
9b8861e3e1
feat: increase read timeout of OpenAI Compatible API, Ollama, Nvidia LLM (#3538) 2024-04-17 09:25:50 +08:00
Yeuoly
fbd3ef8752
fix: add completion mode object check (#3515) 2024-04-16 13:36:02 +08:00
kerlion
200010be19
Add suuport for AWS Bedrock Cohere embedding (#3444) 2024-04-16 13:22:38 +08:00
liuzhenghua
5e02a83b53
fix: the object field is empty string in some openAI api compatible model (#3506) 2024-04-16 12:13:10 +08:00
takatost
5b447d61a6
feat: refactor tongyi models (#3496) 2024-04-15 22:28:32 +08:00
Joshua
fd38e1cf15
nvidia-label-update (#3482) 2024-04-15 13:50:16 +08:00
Yeuoly
8f8e9de601
feat: support configurate openai compatible stream tool call (#3467) 2024-04-14 22:04:45 +08:00
Josh Feng
3e6631312d
Add nvidia codegemma 7b (#3437) 2024-04-13 13:10:32 +08:00
Yash Parmar
dd354bd396
FEAT: cohere rerank 3 model added (#3431) 2024-04-12 22:36:39 +08:00
Yeuoly
a258a90291
feat: gemini pro function call (#3406) 2024-04-12 16:38:02 +08:00