233 Commits

Author	SHA1	Message	Date
takatost	4ab4bcc074	feat: support openllm embedding (#1293)	2023-10-09 23:09:35 -05:00
takatost	1d4f019de4	feat: add baichuan llm support (#1294) ... Co-authored-by: zxhlyh <jasonapring2015@outlook.com>	2023-10-09 23:09:26 -05:00
takatost	024250803a	feat: move login_required wrapper outside (#1281)	2023-10-08 05:21:32 -05:00
takatost	373e90ee6d	fix: detached model in completion thread (#1269)	2023-10-02 22:27:25 +08:00
takatost	41d4c5b424	fix: count down thread in completion db not commit (#1267)	2023-10-02 10:19:26 +08:00
takatost	8606d80c66	fix: request timeout when openai completion (#1265)	2023-10-01 16:00:23 +08:00
takatost	a31466d34e	fix: db session not commit before long llm call running (#1251)	2023-09-27 21:40:26 +08:00
takatost	d38eac959b	fix: wenxin model name invalid when llm call (#1248)	2023-09-27 16:29:13 +08:00
Jyong	46154c6705	Feat/dataset service api (#1245) ... Co-authored-by: jyong <jyong@dify.ai> Co-authored-by: StyleZhang <jasonapring2015@outlook.com>	2023-09-27 16:06:32 +08:00
Garfield Dai	18c710c906	feat: support binding context var (#1227) ... Co-authored-by: Joel <iamjoel007@gmail.com>	2023-09-27 14:53:22 +08:00
zxhlyh	227f9fb77d	Feat/api jwt (#1212)	2023-09-25 12:49:16 +08:00
Jyong	724e053732	Fix/qdrant data issue (#1203) ... Co-authored-by: jyong <jyong@dify.ai>	2023-09-22 14:21:26 +08:00
Garfield Dai	e409895c02	Feat/huggingface embedding support (#1211) ... Co-authored-by: StyleZhang <jasonapring2015@outlook.com>	2023-09-22 13:59:02 +08:00
takatost	32d9b6181c	fix: transaction not commit during long LLM calls (#1213)	2023-09-22 12:43:06 +08:00
takatost	2b018fade2	fix: transaction hangs due to message commit block during long LLM calls (#1206)	2023-09-21 11:22:10 +08:00
takatost	435f804c6f	fix: gpt-3.5-turbo-instruct context size to 8192 (#1196)	2023-09-19 02:10:22 +08:00
takatost	ae3f1ac0a9	feat: support gpt-3.5-turbo-instruct model (#1195)	2023-09-19 02:05:04 +08:00
Jyong	269a465fc4	Feat/improve vector database logic (#1193) ... Co-authored-by: jyong <jyong@dify.ai>	2023-09-18 18:15:41 +08:00
takatost	827c97f0d3	feat: add zhipuai (#1188)	2023-09-18 17:32:31 +08:00
takatost	c8bd76cd66	fix: inference embedding validate (#1187)	2023-09-16 03:09:36 +08:00
takatost	f9082104ed	feat: add hosted moderation (#1158)	2023-09-12 10:26:12 +08:00
Jyong	642842d61b	Feat:dataset retiever resource (#1123) ... Co-authored-by: jyong <jyong@dify.ai> Co-authored-by: StyleZhang <jasonapring2015@outlook.com>	2023-09-10 15:17:43 +08:00
Joel	2d5ad0d208	feat: support optional query content (#1097) ... Co-authored-by: Garfield Dai <dai.hai@foxmail.com>	2023-09-10 00:12:34 +08:00
takatost	c4d8bdc3db	fix: hf hosted inference check (#1128)	2023-09-09 00:29:48 +08:00
takatost	a7cdb745c1	feat: support spark v2 validate (#1086)	2023-09-01 20:53:32 +08:00
takatost	73c86ee6a0	fix: prompt of title generation (#1084)	2023-09-01 14:55:58 +08:00
takatost	33562a9d8d	feat: optimize prompt (#1080)	2023-09-01 11:46:06 +08:00
takatost	a199fa6388	feat: optimize high load sql query of document segment (#1078)	2023-09-01 10:52:39 +08:00
takatost	4c8608dc61	feat: optimize conversation title generation output must be a valid JSON (#1077)	2023-09-01 10:31:42 +08:00
takatost	df6604a734	feat: optimize generation of conversation title (#1075)	2023-09-01 02:28:37 +08:00
takatost	78e26f8b75	fix: summary no docs (#1073)	2023-08-31 20:19:26 +08:00
takatost	2191312bb9	fix: segments query missing idx hit (#1072)	2023-08-31 19:39:44 +08:00
takatost	fcc6b41ab7	feat: decrease claude model request time by set max top_k to 10 (#1071)	2023-08-31 18:23:44 +08:00
takatost	d75e8aeafa	feat: disable anthropic retry (#1067)	2023-08-31 16:44:46 +08:00
takatost	2eba98a465	feat: optimize anthropic connection pool (#1066)	2023-08-31 16:18:59 +08:00
takatost	a7a7aab7a0	fix: csv import error (#1063)	2023-08-31 15:42:28 +08:00
yezhwi	d33a269548	refactor(file extractor): file extractor (#1059)	2023-08-31 14:45:31 +08:00
yezhwi	8b8e510bfe	fix: handle AttributeError for datasets and index (#1052)	2023-08-30 11:14:16 +08:00
takatost	417c19577a	feat: add LocalAI local embedding model support (#1021) ... Co-authored-by: StyleZhang <jasonapring2015@outlook.com>	2023-08-29 22:22:02 +08:00
Jyong	a43e80dd9c	add qdrant migration (#1046) ... Co-authored-by: jyong <jyong@dify.ai>	2023-08-29 10:37:04 +08:00
WangBooth	ad5f27bc5f	fix openpyxl dimensions error (#1041)	2023-08-29 10:36:48 +08:00
takatost	7b3314c5db	fix: dataset desc (#1045)	2023-08-29 09:07:27 +08:00
Jyong	a55ba6e614	Fix/ignore economy dataset (#1043) ... Co-authored-by: jyong <jyong@dify.ai>	2023-08-29 03:37:45 +08:00
takatost	02452421d5	fix: pub generate message text return null (#1037)	2023-08-28 16:43:54 +08:00
takatost	0796791de5	feat: hf inference endpoint stream support (#1028)	2023-08-26 19:48:34 +08:00
takatost	6c148b223d	fix: dataset query truncated (#1026)	2023-08-26 17:35:17 +08:00
Uranus	2d9616c29c	fix: xinference last token being ignored (#1013)	2023-08-25 18:15:05 +08:00
Jyong	2d604d9330	Fix/filter empty segment (#1004) ... Co-authored-by: jyong <jyong@dify.ai>	2023-08-25 15:50:29 +08:00
Jyong	b1fd1b3ab3	Feat/vector db manage (#997) ... Co-authored-by: jyong <jyong@dify.ai>	2023-08-24 21:27:31 +08:00
takatost	9ae91a2ec3	feat: optimize xinference request max token key and stop reason (#998)	2023-08-24 18:11:15 +08:00
takatost	701e2b334f	feat: remove unnecessary prompt of baichuan (#993)	2023-08-24 15:30:59 +08:00
takatost	bd3a9b2f8d	fix: xinference-chat-stream-response (#991)	2023-08-24 14:39:34 +08:00
takatost	18d3877151	feat: optimize xinference stream (#989)	2023-08-24 13:58:34 +08:00
takatost	53e83d8697	feat: optimize baichuan prompt (#988)	2023-08-24 12:07:10 +08:00
takatost	2c30d19cbe	feat: add baichuan prompt (#985)	2023-08-24 10:22:36 +08:00
takatost	9b247fccd4	feat: adjust hf max tokens (#979)	2023-08-23 22:24:50 +08:00
takatost	a76fde3d23	feat: optimize hf inference endpoint (#975)	2023-08-23 19:47:50 +08:00
Jyong	1fc57d7358	normalize embedding (#974) ... Co-authored-by: jyong <jyong@dify.ai>	2023-08-23 19:10:11 +08:00
takatost	5cba2e7087	fix: web reader tool retrieve content empty (#957)	2023-08-22 18:01:16 +08:00
Jyong	5623839c71	update document segment (#950) ... Co-authored-by: jyong <jyong@dify.ai>	2023-08-22 17:59:24 +08:00
takatost	78d3aa5fcd	fix: embedding init err (#956)	2023-08-22 17:43:59 +08:00
takatost	4f3053a8cc	fix: xinference chat completion error (#952)	2023-08-22 15:58:04 +08:00
takatost	866ee5da91	fix: openllm generate cutoff (#945)	2023-08-22 13:43:36 +08:00
takatost	e0a48c4972	fix: xinference chat support (#939)	2023-08-21 20:44:29 +08:00
Jyong	4b53bb1a32	Feat/token support (#909) ... Co-authored-by: StyleZhang <jasonapring2015@outlook.com> Co-authored-by: jyong <jyong@dify.ai>	2023-08-21 13:57:18 +08:00
takatost	4c49ecedb5	feat: optimize web reader summary in 3.5 (#933)	2023-08-21 11:58:01 +08:00
takatost	6c832ee328	fix: remove openllm pypi package because of this package too large (#931)	2023-08-21 02:12:28 +08:00
takatost	25264e7852	feat: add xinference embedding model support (#930)	2023-08-20 19:35:07 +08:00
takatost	18dd0d569d	fix: xinference max_tokens alisa error (#929)	2023-08-20 19:12:52 +08:00
takatost	3ea8d7a019	feat: add openllm support (#928)	2023-08-20 19:04:33 +08:00
takatost	da3f10a55e	feat: server xinference support (#927)	2023-08-20 17:46:41 +08:00
takatost	95b179fb39	fix: replicate text generation model validate (#923)	2023-08-19 21:40:42 +08:00
takatost	3a0a9e2d8f	fix: embedding get price definition missing (#922)	2023-08-19 21:31:40 +08:00
takatost	0a0d63457d	feat: record price unit in messages (#919)	2023-08-19 18:51:40 +08:00
takatost	920fb6d0e1	fix: embedding price config (#918)	2023-08-19 16:54:08 +08:00
Krasus.Chen	fd0fc8f4fe	Fix/price calc (#862)	2023-08-19 16:41:35 +08:00
takatost	1c552ff23a	fix: azure embedding model credentials include base_model_name is invalid for openai sdk (#917)	2023-08-19 16:24:18 +08:00
takatost	5163dd38e5	fix: run extra model serval ex not return (#916)	2023-08-19 14:35:16 +08:00
takatost	2a27dad2fb	fix: run model serval ex not return (#915)	2023-08-19 14:16:41 +08:00
Jyong	db7156dafd	Feature/mutil embedding model (#908) ... Co-authored-by: JzoNg <jzongcode@gmail.com> Co-authored-by: jyong <jyong@dify.ai> Co-authored-by: StyleZhang <jasonapring2015@outlook.com>	2023-08-18 17:37:31 +08:00
takatost	d9afebe216	feat: optimize output parse (#906)	2023-08-18 17:00:40 +08:00
takatost	1d9cc5ca05	fix: universal chat when default model invalid (#905)	2023-08-18 16:20:42 +08:00
takatost	edb06f6aed	fix: react router agent direct output (#904)	2023-08-18 14:31:20 +08:00
takatost	9adbeadeec	feat: claude paid optimize (#890)	2023-08-17 16:56:20 +08:00
takatost	2f7b234cc5	fix: max token not exist in generate summary when calc rest tokens (#891)	2023-08-17 16:33:32 +08:00
takatost	0cc0b6e052	fix: error raise status code not exist (#888)	2023-08-17 15:33:35 +08:00
takatost	f42e7d1a61	feat: add spark v2 support (#885)	2023-08-17 15:08:57 +08:00
takatost	c4d759dfba	fix: wenxin error not raise when stream mode (#884)	2023-08-17 13:40:00 +08:00
takatost	39574dcf6b	feat: optimize prompt of suggested_questions_after_answer (#881)	2023-08-17 10:46:33 +08:00
takatost	cc2d71c253	feat: optimize override app model config convert (#874)	2023-08-16 20:48:42 +08:00
takatost	2dfb3e95f6	feat: optimize error record in agent (#869)	2023-08-16 15:55:42 +08:00
Jyong	f207e180df	fix multi thread app context (#868) ... Co-authored-by: jyong <jyong@dify.ai>	2023-08-16 15:39:31 +08:00
takatost	948d64bbef	fix: get_num_tokens_from_messages params error (#866)	2023-08-16 14:58:44 +08:00
takatost	7a8590980e	fix: dataset direct output (#860)	2023-08-15 22:27:31 +08:00
takatost	e8c14bb732	feat: rename title in site both rename name in app (#857)	2023-08-15 20:42:32 +08:00
takatost	cc52cdc2a9	Feat/add free provider apply (#829)	2023-08-14 12:44:35 +08:00
takatost	8e15ba6cd6	Fix/no trial provider (#823)	2023-08-13 14:56:32 +08:00
takatost	7898937eae	feat: optimize message return (#822)	2023-08-13 13:51:12 +08:00
takatost	1bd0a76a20	feat: optimize error raise (#820)	2023-08-13 00:59:36 +08:00
takatost	2f179d61dc	fix: completion error when dataset was deleted (#819)	2023-08-13 00:25:05 +08:00