Commit Graph

1003 Commits

Author SHA1 Message Date
rafaelsideguide
f13ef02a08 Update openapi.json 2024-07-18 10:34:03 -03:00
rafaelsideguide
eda616d728 Merge remote-tracking branch 'origin/main' into docs/update-docs 2024-07-17 16:44:51 -03:00
rafaelsideguide
2b4ce12097 Update openapi.json 2024-07-17 16:43:22 -03:00
Caleb Peffer
8d5ebc9b9f
Merge pull request #423 from mendableai/cjp/linksOnPage
Caleb: Return a list of links on a page by default
2024-07-17 12:36:07 -06:00
Caleb Peffer
5b24d26c84 Caleb; fixed test 2024-07-17 11:33:12 -07:00
Caleb Peffer
c5d1e7260d Caleb: made changes per Rafaels requests 2024-07-17 11:29:05 -07:00
rafaelsideguide
205cd63c2f Update openapi.json 2024-07-17 15:07:06 -03:00
Rafael Miller
f020048a46
Merge pull request #420 from mendableai/bugfix/empty-tags
Small fix for empty pageOptions
2024-07-17 10:10:24 -03:00
Caleb Peffer
da3c6bca37 Caleb: added a simple test 2024-07-16 21:23:22 -07:00
Caleb Peffer
0b3c0ede49 Added tests per @nicks request 2024-07-16 21:15:59 -07:00
Caleb Peffer
98c788ca7a Caleb: added a test to ensure links on page exists and isn't zero on mendable 2024-07-16 21:13:52 -07:00
Nicolas
d7f185428f
Merge pull request #424 from mendableai/nsc/seperate-rate-limit
Redis Health Checks
2024-07-16 22:53:28 -04:00
Nicolas
2bcbe4f353 Create check-redis.yml 2024-07-16 22:47:34 -04:00
Nicolas
3c3412e893 Update rate-limiter.test.ts 2024-07-16 22:45:12 -04:00
Nicolas
ffc3b7c5fb Update index.ts 2024-07-16 22:42:40 -04:00
Nicolas
c9073a747c Nick: 2024-07-16 22:41:13 -04:00
Caleb Peffer
d39d3be649 Caleb: now extracting and returning a list of all links on the page for a customer 2024-07-16 18:38:03 -07:00
rafaelsideguide
dba1fb2dc8 Update removeUnwantedElements.ts 2024-07-16 18:22:56 -03:00
Rafael Miller
db0545014f
Merge pull request #391 from jhoseph88/feat/issue-387
[Feat] Pass along current, total, current_step, and current_url in js sdk
2024-07-16 15:56:42 -03:00
Nicolas
548c8c1f28
Merge pull request #417 from mendableai/nsc/seperate-rate-limit
Separate Rate Limiter from Main Redis
2024-07-16 10:14:08 -04:00
Nicolas
92202de12b Update rate-limiter.ts 2024-07-16 10:09:49 -04:00
Nicolas
7f596e7a55
Update README.md 2024-07-15 23:01:40 -04:00
Nicolas
8efd444ba2
Merge pull request #399 from mendableai/nsc/sitemap-fix-fire-engine
Sitemap fallback fixes w/ fire-engine
2024-07-12 23:24:15 -04:00
Nicolas
949791049f Nick: 2024-07-12 23:20:26 -04:00
Nicolas
d0c8d3ecde Merge branch 'main' into nsc/sitemap-fix-fire-engine 2024-07-12 22:15:06 -04:00
Nicolas
a3b1703b68 Update fireEngine.ts 2024-07-12 22:15:00 -04:00
Nicolas
09bc2c7a9c
Merge pull request #394 from mendableai/nsc/small-fe-print
Log Fire-engine page errors
2024-07-12 22:14:04 -04:00
Nicolas
e098e88ea7 Nick: 2024-07-12 22:02:08 -04:00
Nicolas
bfc7f5882e Update index.ts 2024-07-12 19:57:12 -04:00
Nicolas
da3e6525a9
Merge pull request #398 from mendableai/nsc/slack-alerts-1
CI for alerts instead
2024-07-12 19:52:34 -04:00
Nicolas
436e8922a7 Nick: doing on the ci instead 2024-07-12 19:49:38 -04:00
Nicolas
e61e94cb78
Merge pull request #397 from mendableai/nsc/slack-alerts-1
Slack Alerts for when queue is over capacity
2024-07-12 19:24:59 -04:00
Nicolas
fc3328f3d1 Update index.ts 2024-07-12 19:12:56 -04:00
Nicolas
fd18f2269b Nick: slack alerts 2024-07-12 19:07:59 -04:00
Nicolas
214a6ee608
Merge pull request #396 from mendableai/bugfix/crawl-docker
[BUG] Fixed docker self hosting issue
2024-07-12 16:48:16 -04:00
rafaelsideguide
f453bcf17c bugfix docker self hosting 2024-07-12 16:51:20 -03:00
Nicolas
f2a08e0ab8
Merge pull request #395 from kun432/kun432/fix-use-db-auth-check-for-selfhost
Fix USE_DB_AUTHENTICATION checks for self-host
2024-07-12 15:39:35 -04:00
Nicolas
0ddaac6ae0 Nick: fixed the other instances as well 2024-07-12 15:39:10 -04:00
Nicolas
5da03a8fbd Update fireEngine.ts 2024-07-12 14:59:49 -04:00
Kuniaki Shimizu
bd986a453c fix USE_DB_AUTHENTICATION checks 2024-07-13 03:50:46 +09:00
Nicolas
b5b75086c1 Update index.ts 2024-07-12 10:44:14 -04:00
Nicolas
c07a1912e9
Merge pull request #393 from mendableai/mog/job-stuck-fix
fix(bull): requeue jobs after restart
2024-07-12 10:43:02 -04:00
Gergo Moricz
0d3e09e798 fix: try-catch job removal 2024-07-12 16:35:50 +02:00
Gergő Móricz
69d724714f
Merge branch 'main' into mog/job-stuck-fix 2024-07-12 16:33:34 +02:00
Nicolas
c3eecf7b9f Update index.ts 2024-07-12 10:22:06 -04:00
Gergo Moricz
10957b748b fix(bull): requeue jobs after restart 2024-07-12 13:55:53 +02:00
Nicolas
961b27811d
Merge pull request #386 from mendableai/feat/fire-engine-fallback-for-sitemap
[Feat] Added fire-engine fallback for getting sitemaps
2024-07-11 20:38:01 -04:00
Nicolas
84de63dbeb
Merge pull request #375 from StefanTerdell/self-host-qol
Self-hosting quality of life fixes
2024-07-11 20:37:39 -04:00
Nicolas
30c1118713
Merge pull request #326 from mendableai/feat/save-docs-on-supabase
[Feat] Added implementation for saving docs on supabase
2024-07-11 20:27:41 -04:00
jhoseph88
68828a5b5c Pass along current, total, current_step, and current_url in js sdk 2024-07-11 19:37:09 -04:00