146 Commits

Author	SHA1	Message	Date
Yanlong Wang	9bcde30f11	fix	2024-07-25 14:56:19 +08:00
Yanlong Wang	09dbbd3b0f	fix: retry for brave search	2024-07-25 08:56:02 +08:00
Yanlong Wang	ec7c2ab52c	fix: scrap timing	2024-07-24 22:59:00 +08:00
yanlong.wang	873994397a	fix: allow POST with url	2024-07-24 15:08:32 +08:00
yanlong.wang	786b1828b7	fix: brave search operators in headers	2024-07-23 15:50:28 +08:00
yanlong.wang	efe7a61e3b	fix: timeout parameter	2024-07-18 12:33:19 +08:00
yanlong.wang	61ff011c13	fix: stop early return when timeout is explicitly defined	2024-07-18 11:41:58 +08:00
yanlong.wang	d0e2920163	feat: expose brave search operators explicitly	2024-07-15 18:11:58 +08:00
Yanlong Wang	336931b5e8	chore: tweak deployment	2024-07-12 15:10:01 +08:00
yanlong.wang	c6634298c4	fix: provide empty content field	2024-07-09 18:14:19 +08:00
Yanlong Wang	f6a183f87a	fix	2024-07-06 01:00:37 +08:00
Yanlong Wang	c69ec77c60	fix	2024-07-06 00:59:37 +08:00
Yanlong Wang	c9ef602a94	fix: potential firebase blockade	2024-07-06 00:25:48 +08:00
yanlong.wang	1bcb5a742e	fix: dos abuse	2024-07-01 18:40:14 +08:00
Yanlong Wang	0a09aeb967	fix	2024-07-01 11:06:30 +08:00
Yanlong Wang	8951578ef1	chore	2024-07-01 00:29:12 +08:00
Yanlong Wang	858e52fe2e	chore: tweak cpu	2024-06-30 22:19:03 +08:00
yanlong.wang	62fb6cff94	feat: keepImgDataUrl	2024-06-24 15:18:53 +08:00
yanlong.wang	1084b16c84	fix: typo	2024-06-20 18:31:56 +08:00
yanlong.wang	579f259cb9	fix: detect when readability does not work	2024-06-20 18:20:13 +08:00
yanlong.wang	eaa06781e3	fix: normalize-url pollution	2024-06-20 14:53:25 +08:00
yanlong.wang	6f37e5d3b4	feat: x-remove-selector	2024-06-18 18:07:38 +08:00
yanlong.wang	ee008ebe10	fix: improved code rules	2024-06-13 16:27:30 +08:00
yanlong.wang	fd9a86bc00	chore: fix abuse timing	2024-06-11 13:57:19 +08:00
Yanlong Wang	70d80bbcfe	fix: abuse condition	2024-06-10 17:41:38 +08:00
Yanlong Wang	5789ae1407	chore: dont abuse our service	2024-06-10 17:23:50 +08:00
yanlong.wang	1e3bae6aad	fix: timeout parsing	2024-06-05 19:50:48 +08:00
yanlong.wang	a9936d322e	fix: search descriptions	2024-06-05 19:47:04 +08:00
yanlong.wang	165cce6c91	refactor: options dto	2024-06-05 18:55:40 +08:00
Yanlong Wang	f0668a96b4	fix: potential circular crawling	2024-06-02 23:23:39 +08:00
Yanlong Wang	be91371b93	fix: ignore blockade for authenticated users	2024-06-02 09:09:21 +08:00
Yanlong Wang	154d8ede45	fix: truncate svg	2024-06-02 08:57:39 +08:00
Yanlong Wang	7a7e49bc00	fix: blockade query	2024-06-01 08:06:46 +08:00
Yanlong Wang	d2bebec60f	fix: abuse blocker	2024-06-01 02:01:12 +08:00
Yanlong Wang	249408df6b	fix	2024-06-01 01:07:50 +08:00
Yanlong Wang	43dee08dcc	security: detect abuse	2024-06-01 00:57:51 +08:00
Yanlong Wang	908157b61e	fix: pdf cache	2024-05-31 19:05:17 +08:00
Yanlong Wang	9c60b4b93d	fix: setup expire for pdf caches	2024-05-31 18:36:23 +08:00
Yanlong Wang	1ba21da0c5	fix: pdf cache	2024-05-31 18:26:05 +08:00
Yanlong Wang	fd0b77285f	fix: firebase fail to save large docs	2024-05-31 18:16:37 +08:00
Yanlong Wang	964b66b6ab	fix: data crunching import	2024-05-31 17:32:16 +08:00
Yanlong Wang	9ac40606d5	fix: bulk fix multiple issues	2024-05-31 17:30:57 +08:00
Yanlong Wang	0c15946874	fix: trimstart url	2024-05-30 20:29:31 +08:00
Yanlong Wang	33e14e5404	feat: extract text from pdf (#70) ... * feat: pdf * fix * fix	2024-05-30 20:21:33 +08:00
yanlong.wang	7c5712363c	feat: allow custom rate limit per uid	2024-05-23 15:36:09 +08:00
yanlong.wang	8eee95119d	feat: index brief in JSON format	2024-05-23 12:06:07 +08:00
yanlong.wang	4f37de24f6	fix: docs	2024-05-21 17:35:16 +08:00
Yanlong Wang	a8e0628460	feat: links and images summary (#63) ... * wip: dedicated link and image summary * fix * fix * fix * fix: docs * fix * fix * fix	2024-05-21 17:34:19 +08:00
Yanlong Wang	df71c9a534	fix: stop using pool	2024-05-20 01:12:22 +08:00
Yanlong Wang	4077fa7040	fix: geoip encoding	2024-05-17 09:31:22 +08:00