102 Commits

Author	SHA1	Message	Date
Yanlong Wang	33e14e5404	feat: extract text from pdf (#70) ... * feat: pdf * fix * fix	2024-05-30 20:21:33 +08:00
yanlong.wang	7c5712363c	feat: allow custom rate limit per uid	2024-05-23 15:36:09 +08:00
yanlong.wang	8eee95119d	feat: index brief in JSON format	2024-05-23 12:06:07 +08:00
yanlong.wang	4f37de24f6	fix: docs	2024-05-21 17:35:16 +08:00
Yanlong Wang	a8e0628460	feat: links and images summary (#63) ... * wip: dedicated link and image summary * fix * fix * fix * fix: docs * fix * fix * fix	2024-05-21 17:34:19 +08:00
Yanlong Wang	df71c9a534	fix: stop using pool	2024-05-20 01:12:22 +08:00
Yanlong Wang	4077fa7040	fix: geoip encoding	2024-05-17 09:31:22 +08:00
Yanlong Wang	2941be6096	fix: potential unencoded query	2024-05-17 09:15:37 +08:00
Yanlong Wang	ed9e9f43cf	fix: block rough requests	2024-05-16 20:22:26 +08:00
yanlong.wang	8ec8c1e718	fix: logging for search error	2024-05-16 19:01:30 +08:00
yanlong.wang	e0e37ad4d7	fix: potential chargeAmount mismatch	2024-05-16 18:43:41 +08:00
yanlong.wang	8b0916f858	fix: race condition while logging chargeAmount	2024-05-16 18:26:18 +08:00
yanlong.wang	6f4819bc49	chore: tweak deployment	2024-05-16 17:46:53 +08:00
yanlong.wang	322cb86f21	fix: on no results	2024-05-16 17:30:47 +08:00
yanlong.wang	e2698b48bd	fix: rate limit tag for search	2024-05-16 16:58:10 +08:00
yanlong.wang	72e1c46a6c	fix: improve search responsiveness	2024-05-16 15:47:49 +08:00
Yanlong Wang	0583645613	fix: noCache in search	2024-05-16 00:42:30 +08:00
Yanlong Wang	4556954d17	fix: image url	2024-05-16 00:39:24 +08:00
Yanlong Wang	6f65083f8d	feat: control cache tolerance and select target using headers	2024-05-16 00:10:20 +08:00
yanlong.wang	77fc500f41	fix: allow x-return-format header alias	2024-05-15 12:24:46 +08:00
Yanlong Wang	445624c405	fix: early return for search	2024-05-15 08:47:16 +08:00
Yanlong Wang	1cf8e83857	fix: add cache tolerance	2024-05-15 08:06:35 +08:00
Yanlong Wang	d100c3fc5f	fix: search result cache save	2024-05-14 19:57:49 +08:00
Yanlong Wang	ec4ce4fef3	chore: update rate limits	2024-05-14 19:44:35 +08:00
Yanlong Wang	2e3c217479	feat: web search (#57)	2024-05-14 19:39:43 +08:00
Yanlong Wang	f171e54ac9	fix: log charge amount	2024-05-14 17:25:59 +08:00
yanlong.wang	ffc6899acd	chore: reduce resource	2024-05-13 18:35:11 +08:00
yanlong.wang	e417cd8a53	fix: tidyMarkdown feature in turndown rues	2024-05-09 15:15:15 +08:00
Yanlong Wang	36bf5d96b5	fix: remove tidyMarkdown at all	2024-05-09 11:33:56 +08:00
Yanlong Wang	59f807cb7c	fix: tidyMarkdown	2024-05-09 11:32:26 +08:00
Yanlong Wang	6b6774f43b	fix: tidyMarkdown	2024-05-09 11:25:51 +08:00
Yanlong Wang	4bee36ed4a	fix: patch tidyMarkdown	2024-05-09 11:06:20 +08:00
Yanlong Wang	de22127d2f	fix: leak of crippled listeners	2024-05-08 19:51:55 +08:00
Yanlong Wang	62dc75f78e	fix: consider image data-src and make generated alt text optional (#50) ... * fix: image src and alt * fix * docs: doc about x-with-generated-alt * fix: deps	2024-05-08 18:29:11 +08:00
Yanlong Wang	8cfd0d67dc	feat: jina paywall (#49) ... * feat: integrate with jina embeddings paywall	2024-05-08 18:25:26 +08:00
Yanlong Wang	2e025d10cf	fix: the complex regexp caused node.js process to hang ... Co-authored-by: Claude 3 opus	2024-05-05 16:29:39 +08:00
Yanlong Wang	fef1d0faf1	bump: deps	2024-05-05 10:54:11 +08:00
Yanlong Wang	a0d1a7234b	chore: tweak health check	2024-05-02 08:39:54 +08:00
Yanlong Wang	9e02080103	fix: error on browser crashes	2024-05-02 03:23:57 +08:00
Yanlong Wang	55b954ffeb	fix: tweak health check	2024-04-30 18:56:46 +08:00
Yanlong Wang	528b3e5fed	fix: add health check to detect puppeteer stall	2024-04-30 18:30:31 +08:00
Yanlong Wang	ae29055142	chore: tweaks	2024-04-29 20:12:11 +08:00
yanlong.wang	867636d037	fix: apply rate limit to 100qpm per IP	2024-04-29 18:54:51 +08:00
yanlong.wang	15606f38d7	fix: on null element	2024-04-29 17:28:07 +08:00
yanlong.wang	53a4361c23	fix: block firebase runtime intrusion	2024-04-29 17:21:34 +08:00
yanlong.wang	059c8aa61e	fix: remove exposed function before cleanup	2024-04-29 15:51:23 +08:00
yanlong.wang	bfc6d678d8	fix: split report handler from other page preps	2024-04-29 15:19:05 +08:00
Yanlong Wang	036f6dc776	chore: tweak runtime config	2024-04-29 09:49:29 +08:00
Yanlong Wang	6ac2863e89	bump: deps	2024-04-28 22:28:24 +08:00
yanlong.wang	a6a5b7c530	fix: respond with markdown	2024-04-25 18:58:42 +08:00