1004 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Gergo Moricz	a0b8a6cad3	feat(js-sdk): build both cjs and esm versions	2024-07-18 13:43:36 +02:00
Nicolas	12ec519f9b	Update docker-compose.yaml	2024-07-17 22:44:23 -04:00
Nicolas	2fab2d8d29	Update scrape.ts	2024-07-17 20:44:34 -04:00
Nicolas	6609c1b6e5	Update .env.local	2024-07-17 16:22:27 -04:00
Nicolas	17a1f9b55f	Update .env.example	2024-07-17 16:22:04 -04:00
Caleb Peffer	8d5ebc9b9f	Merge pull request #423 from mendableai/cjp/linksOnPage ... Caleb: Return a list of links on a page by default	2024-07-17 12:36:07 -06:00
Caleb Peffer	5b24d26c84	Caleb; fixed test	2024-07-17 11:33:12 -07:00
Caleb Peffer	c5d1e7260d	Caleb: made changes per Rafaels requests	2024-07-17 11:29:05 -07:00
Rafael Miller	f020048a46	Merge pull request #420 from mendableai/bugfix/empty-tags ... Small fix for empty pageOptions	2024-07-17 10:10:24 -03:00
Caleb Peffer	da3c6bca37	Caleb: added a simple test	2024-07-16 21:23:22 -07:00
Caleb Peffer	0b3c0ede49	Added tests per @nicks request	2024-07-16 21:15:59 -07:00
Caleb Peffer	98c788ca7a	Caleb: added a test to ensure links on page exists and isn't zero on mendable	2024-07-16 21:13:52 -07:00
Nicolas	d7f185428f	Merge pull request #424 from mendableai/nsc/seperate-rate-limit ... Redis Health Checks	2024-07-16 22:53:28 -04:00
Nicolas	2bcbe4f353	Create check-redis.yml	2024-07-16 22:47:34 -04:00
Nicolas	3c3412e893	Update rate-limiter.test.ts	2024-07-16 22:45:12 -04:00
Nicolas	ffc3b7c5fb	Update index.ts	2024-07-16 22:42:40 -04:00
Nicolas	c9073a747c	Nick:	2024-07-16 22:41:13 -04:00
Caleb Peffer	d39d3be649	Caleb: now extracting and returning a list of all links on the page for a customer	2024-07-16 18:38:03 -07:00
rafaelsideguide	dba1fb2dc8	Update removeUnwantedElements.ts	2024-07-16 18:22:56 -03:00
Rafael Miller	db0545014f	Merge pull request #391 from jhoseph88/feat/issue-387 ... [Feat] Pass along current, total, current_step, and current_url in js sdk	2024-07-16 15:56:42 -03:00
Nicolas	548c8c1f28	Merge pull request #417 from mendableai/nsc/seperate-rate-limit ... Separate Rate Limiter from Main Redis	2024-07-16 10:14:08 -04:00
Nicolas	92202de12b	Update rate-limiter.ts	2024-07-16 10:09:49 -04:00
Nicolas	7f596e7a55	Update README.md	2024-07-15 23:01:40 -04:00
Nicolas	8efd444ba2	Merge pull request #399 from mendableai/nsc/sitemap-fix-fire-engine ... Sitemap fallback fixes w/ fire-engine	2024-07-12 23:24:15 -04:00
Nicolas	949791049f	Nick:	2024-07-12 23:20:26 -04:00
Nicolas	d0c8d3ecde	Merge branch 'main' into nsc/sitemap-fix-fire-engine	2024-07-12 22:15:06 -04:00
Nicolas	a3b1703b68	Update fireEngine.ts	2024-07-12 22:15:00 -04:00
Nicolas	09bc2c7a9c	Merge pull request #394 from mendableai/nsc/small-fe-print ... Log Fire-engine page errors	2024-07-12 22:14:04 -04:00
Nicolas	e098e88ea7	Nick:	2024-07-12 22:02:08 -04:00
Nicolas	bfc7f5882e	Update index.ts	2024-07-12 19:57:12 -04:00
Nicolas	da3e6525a9	Merge pull request #398 from mendableai/nsc/slack-alerts-1 ... CI for alerts instead	2024-07-12 19:52:34 -04:00
Nicolas	436e8922a7	Nick: doing on the ci instead	2024-07-12 19:49:38 -04:00
Nicolas	e61e94cb78	Merge pull request #397 from mendableai/nsc/slack-alerts-1 ... Slack Alerts for when queue is over capacity	2024-07-12 19:24:59 -04:00
Nicolas	fc3328f3d1	Update index.ts	2024-07-12 19:12:56 -04:00
Nicolas	fd18f2269b	Nick: slack alerts	2024-07-12 19:07:59 -04:00
Nicolas	214a6ee608	Merge pull request #396 from mendableai/bugfix/crawl-docker ... [BUG] Fixed docker self hosting issue	2024-07-12 16:48:16 -04:00
rafaelsideguide	f453bcf17c	bugfix docker self hosting	2024-07-12 16:51:20 -03:00
Nicolas	f2a08e0ab8	Merge pull request #395 from kun432/kun432/fix-use-db-auth-check-for-selfhost ... Fix USE_DB_AUTHENTICATION checks for self-host	2024-07-12 15:39:35 -04:00
Nicolas	0ddaac6ae0	Nick: fixed the other instances as well	2024-07-12 15:39:10 -04:00
Nicolas	5da03a8fbd	Update fireEngine.ts	2024-07-12 14:59:49 -04:00
Kuniaki Shimizu	bd986a453c	fix USE_DB_AUTHENTICATION checks	2024-07-13 03:50:46 +09:00
Nicolas	b5b75086c1	Update index.ts	2024-07-12 10:44:14 -04:00
Nicolas	c07a1912e9	Merge pull request #393 from mendableai/mog/job-stuck-fix ... fix(bull): requeue jobs after restart	2024-07-12 10:43:02 -04:00
Gergo Moricz	0d3e09e798	fix: try-catch job removal	2024-07-12 16:35:50 +02:00
Gergő Móricz	69d724714f	Merge branch 'main' into mog/job-stuck-fix	2024-07-12 16:33:34 +02:00
Nicolas	c3eecf7b9f	Update index.ts	2024-07-12 10:22:06 -04:00
Gergo Moricz	10957b748b	fix(bull): requeue jobs after restart	2024-07-12 13:55:53 +02:00
Nicolas	961b27811d	Merge pull request #386 from mendableai/feat/fire-engine-fallback-for-sitemap ... [Feat] Added fire-engine fallback for getting sitemaps	2024-07-11 20:38:01 -04:00
Nicolas	84de63dbeb	Merge pull request #375 from StefanTerdell/self-host-qol ... Self-hosting quality of life fixes	2024-07-11 20:37:39 -04:00
Nicolas	30c1118713	Merge pull request #326 from mendableai/feat/save-docs-on-supabase ... [Feat] Added implementation for saving docs on supabase	2024-07-11 20:27:41 -04:00