Commit Graph

115 Commits

Author SHA1 Message Date
StyleZhang
1397c782d4 merge feat/attachment 2024-10-17 15:31:32 +08:00
-LAN-
13ad040b36 Merge branch 'feat/enhance-multi-modal-support' into deploy/dev 2024-10-17 12:03:00 +08:00
Jyong
5aabb83f5a
update dataset clean rule (#9426) 2024-10-17 10:40:22 +08:00
-LAN-
46ea94b8ee chore(version): Sync version with main. 2024-10-16 19:48:53 +08:00
Yi
03d704ea5a Merge branch 'fix/rerank-validation-in-run' into deploy/dev 2024-10-16 16:47:49 +08:00
Bowen Liang
5eb00502ec
chore: clean-up unnecessary annotation on configs with non-null default value (#9323)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-10-14 23:47:58 +08:00
Joe
73fb3c40e5 Merge 'feat/new-login' into 'deploy/dev' 2024-10-14 18:35:44 +08:00
-LAN-
5c7b1358d4
chore(release): bump version to 0.9.2 (#9314) 2024-10-14 17:21:58 +08:00
-LAN-
353ed8652c Merge branch 'feat/enhance-multi-modal-support' into deploy/dev 2024-10-14 16:53:38 +08:00
-LAN-
ea18dd1571 feat(api): Enhance multi modal support. 2024-10-14 16:47:03 +08:00
twwu
84819ff220 Merge branch 'fix/refresh-token' into deploy/dev
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-10-14 11:44:39 +08:00
Joe
c2e40d5bc2 Merge branch 'main' into feat/new-login-refresh-token
* main: (121 commits)
  fix: remove the latest message from the user that does not have any answer yet (#9297)
  Add Volcengine VikingDB as new vector provider (#9287)
  chore: translate i18n files (#9288)
  chore: add baidu-obs and supabase for .env.example (#9289)
  chore: add abstract decorator and output log when query embedding fails (#9264)
  Feat/new account page (#9236)
  Feat/implement-refresh-tokens (#9233)
  feat: refresh-token (#9286)
  chore: translate i18n files (#9284)
  feat:support baidu vector db (#9185)
  Feat: rerank model verification in front end (#9271)
  Fix/s3 iam add region name (#7819)
  chore: optimize the trace ops slow queries on node executions. (#9282)
  chore: use cache instead of re-querying node record during workflow execution (#9280)
  chore: fix the misclassification of the opensearch-py package (#9266)
  fix: add new domain to whitelist (#9265)
  fix: move exception to debug mode (#9258)
  feat: add supabase object storage (#9229)
  fix: dialog box cannot correctly display LaTeX formulas (#9242)
  Fix/agent external knowledge retrieval (#9241)
  ...
2024-10-14 10:25:18 +08:00
ice yao
d15ba3939d
Add Volcengine VikingDB as new vector provider (#9287)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-10-13 21:26:05 +08:00
-LAN-
f73751843f
Feat/implement-refresh-tokens (#9233) 2024-10-12 23:46:30 +08:00
Shili Cao
2ec6ffe478
feat:support baidu vector db (#9185) 2024-10-12 23:24:17 +08:00
-LAN-
07462727e2 fix: Update down_revision in add_tidb_auth_binding migration 2024-10-12 17:43:33 +08:00
jyong
808b359274 Merge branch 'feat/add-tidb-on-qdrant-type' into deploy/dev
# Conflicts:
#	api/configs/middleware/__init__.py
#	api/controllers/console/datasets/datasets.py
#	api/core/rag/datasource/vdb/vector_factory.py
#	web/app/components/datasets/create/website/index.tsx
#	web/app/components/datasets/create/website/jina-reader/index.tsx
#	web/app/components/datasets/create/website/jina-reader/options.tsx
#	web/app/components/header/account-setting/data-source-page/data-source-website/config-jina-reader-modal.tsx
#	web/i18n/en-US/dataset-creation.ts
#	web/service/datasets.ts
2024-10-12 17:05:02 +08:00
-LAN-
34ce90f53c feat(auth): update access token expiration time to 8 minutes for test 2024-10-12 16:12:32 +08:00
-LAN-
150a217d32 feat(auth): implement refresh tokens and enhance login process
- Introduced `TokenPair` model for managing access and refresh tokens.
- Added `refresh_token` method to generate new tokens upon expiration.
- Updated login/logout processes to handle token pairs and enhanced security.
- Replaced `get_remote_ip` with `extract_remote_ip` for clarity.
- Added endpoint for refreshing tokens to maintain user session continuity.
2024-10-12 16:12:32 +08:00
zhuhao
0115a08f60 feat: add supabase object storage (#9229) 2024-10-12 16:12:32 +08:00
Jyong
a6d387148a Fix/agent external knowledge retrieval (#9241) 2024-10-12 16:12:32 +08:00
zhuhao
7a6970e570
feat: add supabase object storage (#9229) 2024-10-11 22:48:57 +08:00
Jyong
42b02b3a5f
Fix/agent external knowledge retrieval (#9241) 2024-10-11 19:21:03 +08:00
kurokobo
c0b71f8286
feat: respect x-* headers for redirections (#9054) 2024-10-09 14:42:30 +08:00
zhuhao
2571b0c4e3
feat: add baidu obs storage (#9024)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-10-07 11:09:27 +08:00
-LAN-
1f5cc071f8
chore(version): bump to 0.9.1 (#8945)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-09-30 23:22:21 +08:00
-LAN-
7850a28ec8
Revert "chore(version): bump to 0.9.1" (#8944)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-09-30 22:53:32 +08:00
-LAN-
730d3a6d7c
chore(version): bump to 0.9.1 (#8938) 2024-09-30 22:13:38 +08:00
-LAN-
d2ce4960f1
chore(versioning): bump version to 0.9.0 (#8911) 2024-09-30 18:33:20 +08:00
Joe
9f36156514 feat: add ip email code ligin limit 2024-09-30 12:46:20 +08:00
Joe
91d3e43b11 feat: change ALLOW_CREATE_WORKSPACE false 2024-09-29 21:55:17 +08:00
Joe
cd88f27cd5 Merge branch 'main' into feat/new-login
* main: (77 commits)
  feat: add voyage ai as a new model provider (#8747)
  docs: add english versions for the files customizable_model_scale_out and predefined_model_scale_out (#8871)
  fix: #8843 event: tts_message_end always return in api streaming resp… (#8846)
  Add Jamba and Llama3.2 model support (#8878)
  fix(workflow): update tagging logic in GitHub Actions (#8882)
  chore: bump ruff to 0.6.8 for fixing violation in SIM910 (#8869)
  refactor: update Callback to an abstract class (#8868)
  feat: deprecate gte-Qwen2-7B-instruct embedding model (#8866)
  feat: add internlm2.5-20b and qwen2.5-coder-7b model (#8862)
  fix: customize model credentials were invalid despite the provider credentials being active (#8864)
  fix: update qwen2.5-coder-7b model name (#8861)
  fix(workflow/nodes/knowledge-retrieval/use-config): Preserve rerankin… (#8842)
  chore: fix wrong VectorType match case (#8857)
  feat: add min-connection and max-connection for pgvector (#8841)
  feat(Tools): add feishu tools (#8800)
  fix: delete harm catalog settings for gemini (#8829)
  Add Llama3.2 models in Groq provider (#8831)
  feat: deprecate mistral model for siliconflow (#8828)
  fix: AnalyticdbVector retrieval scores (#8803)
  fix: close log status option raise error (#8826)
  ...
2024-09-29 17:15:29 +08:00
jyong
0e8b857fb0 add tidb on qdrant whitelist and batch job 2024-09-27 19:01:55 +08:00
zhuhao
55e6123db9
feat: add min-connection and max-connection for pgvector (#8841)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-09-27 18:16:20 +08:00
jyong
31df381ed2 Merge branch 'mapleeit/main' into feat/add-tidb-on-qdrant-type
# Conflicts:
#	api/configs/feature/__init__.py
#	api/configs/middleware/__init__.py
#	api/controllers/console/datasets/datasets.py
#	api/core/rag/datasource/vdb/vector_type.py
2024-09-27 14:34:30 +08:00
Joe
f6f6bb1051 Merge branch 'main' into feat/new-login
* main: (64 commits)
  chore: Enable Japanese descriptions for Tools (#8646)
  Make WORKFLOW_* configurable as environment variables. (#8644)
  feat: add deepseek-v2.5 for model provider siliconflow (#8639)
  docs: fix predefined_model_scale_out.md redirect error (#8633)
  feat: add qwen2.5 for model provider siliconflow (#8630)
  fix: send message error when chatting with opening statement (#8627)
  fix: llm_generator.py JSONDecodeError (#8504)
  fix: commands.py (#8483)
  fix: redundant check for available_document_count (#8491)
  chore: enhance configuration descriptions (#8624)
  chore: add Gemini newest experimental models (close #7121) (#8621)
  feat: support o1 series models for openrouter (#8358)
  fix: form input add tabIndex (#8478)
  Add model parameter translation (#8509)
  feat(tools/cogview):  Updated cogview tool to support cogview-3 and the latest cogview-3-plus (#8382)
  Add Fireworks AI as new model provider (#8428)
  feat:use xinference tts stream mode (#8616)
  docs: Add Japanese documentation for tools (#8469)
  feat: regenerate in `Chat`, `agent` and `Chatflow` app (#7661)
  feat: update pyproject.toml (#8368)
  ...
2024-09-23 10:46:03 +08:00
Nam Vu
ddf6569dc5
chore: enhance configuration descriptions (#8624) 2024-09-22 13:38:41 +08:00
-LAN-
7f3282ec04
Update version to 0.8.3 in packaging and docker-compose files (#8590) 2024-09-20 18:24:03 +08:00
Joe
3e83be941c feat: add fulfill_login_params_from_env 2024-09-14 16:48:24 +08:00
Joe
cd277aa2d8 Merge branch 'main' into feat/new-login
* main: (40 commits)
  feat: allow users to specify timeout for text generations and workflows by environment variable (#8395)
  Fix: operation postion of answer in logs (#8411)
  fix: when the variable does not exist, an error should be prompted (#8413)
  fix(workflow): the answer node after the iteration node containing the answer was output prematurely (#8419)
  fix:logs and rm unused codes in CacheEmbedding (#8409)
  fix: resolve runtime error when self.folder is None (#8401)
  Fix: Support Bedrock cross region inference #8190 (Update Model name to distinguish between different region groups) (#8402)
  fix(docker): aliyun oss path env key (#8394)
  fix: pyproject.toml typo (#8396)
  fix: o1-mini 65563 -> 65536 (#8388)
  fix: sandbox issue related httpx and requests (#8397)
  chore: improve usage of striping prefix or suffix of string with Ruff 0.6.5 (#8392)
  fix (#8322 followup): resolve the violation of pylint rules (#8391)
  chore: refurish python code by applying Pylint linter rules (#8322)
  support hunyuan-turbo (#8372)
  chore: update firecrawl scrape to V1 api (#8367)
  fix(workflow): both parallel and single branch errors occur in if-else (#8378)
  fix: edit load balancing not pass id (#8370)
  fix: add before send to remove langfuse defaultErrorResponse (#8361)
  fix: when edit load balancing config not pass the empty filed value hidden (#8366)
  ...
2024-09-14 14:53:11 +08:00
Bowen Liang
6613b8f2e0
chore: fix unnecessary string concatation in single line (#8311) 2024-09-13 14:24:49 +08:00
-LAN-
80a322aaa2
chore: update version to 0.8.2 in packaging and docker-compose files (#8352) 2024-09-13 13:45:13 +08:00
-LAN-
c78828ab7c
chore: update Dify version to 0.8.1 (#8329) 2024-09-13 02:48:24 +08:00
Joe
b6abd5b314 Merge branch 'main' into feat/new-login
* main: (141 commits)
  fix(workflow/hooks/use-shortcuts): resolve issue of copy shortcut not working in workflow debug and preview panel (#8249)
  chore: cleanup pycodestyle E rules (#8269)
  let claude models in bedrock support the response_format parameter (#8220)
  enhance: improve empty data display for detail panel (#8266)
  chore: remove useless code (#8198)
  chore: apply pep8-naming rules for naming convention (#8261)
  fix:ollama text embedding 500 error (#8252)
  Update Gitlab query field, add query by path (#8244)
  editor can also create api key (#8214)
  fix: upload img icon mis-align in the chat input area (#8263)
  fix: truthy value (#8208)
  fix(workflow): IF-ELSE nodes connected to the same subsequent node cause execution to stop (#8247)
  fix: workflow parallel limit in ifelse node (#8242)
  fix: CHECK_UPDATE_URL comment (#8235)
  fix:error when adding the ollama embedding model (#8236)
  fix: improving the regionalization of translation (#8231)
  feat: add from_variable_selector for stream chunk / message event (#8228)
  fix(workflow): answers are output simultaneously across different braches in the question classifier node. (#8225)
  fix(workflow): in multi-parallel execution with multiple conditional branches (#8221)
  fix(docker/docker-compose.yaml): Set default value for `REDIS_SENTINEL_SOCKET_TIMEOUT` and `CELERY_SENTINEL_SOCKET_TIMEOUT` (#8218)
  ...
2024-09-12 11:31:17 +08:00
takatost
dabfd74622
feat: Parallel Execution of Nodes in Workflows (#8192)
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Yi <yxiaoisme@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-09-10 15:23:16 +08:00
ice yao
c8df92d0eb
add volcengine tos storage (#8164) 2024-09-10 09:19:47 +08:00
Zhi
d542b15cc0
feat: support redis sentinel mode (#7756) 2024-09-08 13:23:51 +08:00
Nam Vu
2d7954c7da
Fix variable typo (#8084) 2024-09-08 13:14:11 +08:00
ChengZi
2060db8e11
fix: change milvus init args from (host, port) to (url, token) (#8019)
Signed-off-by: ChengZi <chen.zhang@zilliz.com>
2024-09-06 17:32:48 +08:00
zhuhao
e0d3cd91c6
support huawei cloud obs storage (#7980) (#7981) 2024-09-06 14:00:47 +08:00