Gergő Móricz
|
e44bdf7a54
|
bad dockerfile
|
2024-09-27 21:07:11 +02:00 |
|
Gergő Móricz
|
f0a1a2e45b
|
fix: increase ulimit -n in docker
|
2024-09-27 20:44:52 +02:00 |
|
Gergő Móricz
|
d5e2a80e4a
|
fix(crawl-status): keep 10 megabyte pages if they're the only thing in the output
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-27 20:41:41 +02:00 |
|
Nicolas
|
975f0575b4
|
Nick: max retries with axios-retry
|
2024-09-27 12:58:57 -04:00 |
|
Nicolas
|
92961cf74f
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
|
2024-09-27 12:23:45 -04:00 |
|
Nicolas
|
1fdff87b3e
|
Update single_url.ts
|
2024-09-27 12:23:44 -04:00 |
|
Gergő Móricz
|
6283e8fc47
|
fix(logger): set default level to trace
|
2024-09-27 17:46:43 +02:00 |
|
Gergő Móricz
|
5e8ef4954e
|
feat(auth): log cache key in acuc update error
|
2024-09-27 17:13:10 +02:00 |
|
Gergő Móricz
|
e98f858eb6
|
fix(api): playground scrape errors
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-26 22:28:14 +02:00 |
|
Nicolas
|
8d44cb33bb
|
Nick: fixed error message
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
2cb493321a
|
fix(ACUC): do not refresh cache every set
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
9bdd344b36
|
fix(redlock): use redlock.using for stability
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
250c3bb5c6
|
fix(auth): move redlock settings
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
81245e68fa
|
fix(auth/redlock): retry cached ACUC lock for 20 seconds
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
0f89f5e7cb
|
fix(billTeam): cache update race condition
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
d13a97f979
|
fix(credit_billing): allow spending of exact credits
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
84bff8add8
|
fix(billTeam): update cached ACUC after billing
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
f22ab5ffaf
|
feat(db): implement bill_team RPC
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
c1f68c3e0a
|
fix(credit_billing): return chunk.remaining_credits
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
2073063fb7
|
fix(db): fix caching and rpc error
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
f8c70fe5dd
|
feat(db): implement auth_credit_usage_chunk RPC
|
2024-09-26 22:15:15 +02:00 |
|
Gergő Móricz
|
29815e084b
|
feat(v1/Document): add warning field
|
2024-09-26 21:19:05 +02:00 |
|
Gergő Móricz
|
095babe70b
|
fix(queue-jobs): jobs with concurrency fails may vanish
|
2024-09-26 21:18:56 +02:00 |
|
Gergő Móricz
|
b696bfc854
|
fix(crawl-status): avoid race conditions where crawl may be deemed failed
|
2024-09-26 21:00:27 +02:00 |
|
Eric Ciarla
|
75e32b0e5c
|
Merge pull request #707 from mendableai/new_examples
o1 job recommender
|
2024-09-26 14:51:45 -04:00 |
|
Eric Ciarla
|
20b998e66a
|
Delete o1_job_recommender.ipynb
|
2024-09-26 14:51:07 -04:00 |
|
Eric Ciarla
|
5c4d436f1e
|
Create o1_job_recommender.py
|
2024-09-26 14:46:48 -04:00 |
|
Gergő Móricz
|
dec4171937
|
fix(queue-worker, queue-jobs): logic fixes
|
2024-09-26 20:39:19 +02:00 |
|
Gergő Móricz
|
d2881927c1
|
fix(queue-worker): remove concurrency entries when done in sentry-less branch
|
2024-09-26 20:29:17 +02:00 |
|
Gergő Móricz
|
53fce67ca1
|
feat(queue-worker): PoC of concurrency limits
|
2024-09-26 20:24:34 +02:00 |
|
Nicolas
|
30058b1da0
|
Nick: increased timeout for chrome-cdp due to smart wait
|
2024-09-26 20:24:34 +02:00 |
|
Eric Ciarla
|
51bc2f25fe
|
remove actions crawler
|
2024-09-26 11:44:55 -04:00 |
|
Eric Ciarla
|
289af6f89e
|
example
|
2024-09-25 21:10:09 -04:00 |
|
Nicolas
|
a9773a24a3
|
Nick: increased timeout for chrome-cdp due to smart wait
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-25 19:27:02 -04:00 |
|
Gergő Móricz
|
953d4fb197
|
fix(redlock): use redlock.using for stability
|
2024-09-25 22:47:42 +02:00 |
|
Gergő Móricz
|
eef116bef8
|
fix(auth): move redlock settings
|
2024-09-25 22:27:51 +02:00 |
|
Gergő Móricz
|
2c96d2eef6
|
fix(auth/redlock): retry cached ACUC lock for 20 seconds
|
2024-09-25 22:25:13 +02:00 |
|
Gergő Móricz
|
1cca9b8ae6
|
fix(billTeam): cache update race condition
|
2024-09-25 22:15:02 +02:00 |
|
Gergő Móricz
|
eb7317c08a
|
fix(credit_billing): allow spending of exact credits
|
2024-09-25 21:44:05 +02:00 |
|
Gergő Móricz
|
e67cbc2ca1
|
fix(billTeam): update cached ACUC after billing
|
2024-09-25 21:37:01 +02:00 |
|
Gergő Móricz
|
5a8eb17a82
|
feat(db): implement bill_team RPC
|
2024-09-25 20:57:45 +02:00 |
|
Gergő Móricz
|
415fd9f333
|
fix(credit_billing): return chunk.remaining_credits
|
2024-09-25 20:37:35 +02:00 |
|
Gergő Móricz
|
417adf8e96
|
fix(db): fix caching and rpc error
|
2024-09-25 19:42:45 +02:00 |
|
Gergő Móricz
|
331e826bca
|
feat(db): implement auth_credit_usage_chunk RPC
|
2024-09-25 19:25:18 +02:00 |
|
Eric Ciarla
|
abdc08edea
|
Merge pull request #679 from h4r5h4/fix/folder-name
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
remove space in the examples/o1_web_crawler folder name
|
2024-09-25 10:40:09 -04:00 |
|
Nicolas
|
1da026b26e
|
Update single_url.ts
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-24 23:29:48 -04:00 |
|
Nicolas
|
b8266cc329
|
Update website_params.ts
|
2024-09-24 23:28:58 -04:00 |
|
Gergő Móricz
|
f00c0b82f9
|
fix(v1/scrape): add total wait specified in request to timeout
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-24 21:56:22 +02:00 |
|
Nicolas
|
3f138e559e
|
Update website_params.ts
|
2024-09-24 15:14:26 -04:00 |
|
Gergő Móricz
|
43730b5db6
|
feat(WebScraper): always report error of last scraper in order
|
2024-09-24 20:03:49 +02:00 |
|