Gergő Móricz
|
3e661a2087
|
fix(v1/crawl-cancel): avoid double authing
|
2024-09-24 20:01:34 +02:00 |
|
Gergő Móricz
|
4194525640
|
fix(blocklist): unblock TikTok Business page
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
This is just a regular business site, not social media.
|
2024-09-24 16:55:19 +02:00 |
|
Gergő Móricz
|
4a623c084a
|
fix(fly): don't use Depot builders (doesn't work)
|
2024-09-24 10:50:30 +02:00 |
|
Gergő Móricz
|
a59b5836d5
|
Revert error tallying
|
2024-09-24 10:27:49 +02:00 |
|
Gergő Móricz
|
a4b128e8b7
|
fix(rust): blocklisted error test
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-23 23:03:00 +02:00 |
|
Gergő Móricz
|
483f97d21b
|
fix(v0/search): don't sent scrape fail errors to Sentry
|
2024-09-23 18:49:27 +02:00 |
|
Gergő Móricz
|
d927cafeea
|
fix(queue-worker): don't send scraping errors to sentry
|
2024-09-23 18:48:01 +02:00 |
|
Gergő Móricz
|
677faa27f3
|
fix(WebScraper): explicitly ignore 404s
|
2024-09-23 18:47:07 +02:00 |
|
Gergő Móricz
|
83d8287c14
|
fix(v0, sentry): don't send all scraping methods failed errors to Sentry
|
2024-09-23 18:40:21 +02:00 |
|
Gergő Móricz
|
d2f7031069
|
fix(WebScraper): fatal error handler triggering for 404s
|
2024-09-23 18:33:10 +02:00 |
|
Nicolas
|
848a2b364a
|
Update package.json
|
2024-09-21 21:11:23 -04:00 |
|
Nicolas
|
dfdbae74c6
|
Update fireEngine.ts
|
2024-09-21 21:10:05 -04:00 |
|
Nicolas
|
fbb5f23016
|
Update index.ts
|
2024-09-21 20:53:33 -04:00 |
|
Nicolas
|
607e46267c
|
Update package.json
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-20 19:46:17 -04:00 |
|
Nicolas
|
db161ac55a
|
Nick: press + write
|
2024-09-20 19:45:23 -04:00 |
|
Nicolas
|
3fc5ce17d2
|
Nick: fixed error handling for v0 scrape
|
2024-09-20 18:35:30 -04:00 |
|
Nicolas
|
0690cfeaad
|
Merge branch 'main' into feat/actions
|
2024-09-20 18:24:13 -04:00 |
|
Gergő Móricz
|
95e4c8920b
|
fix(sdk/rust): license
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-20 21:55:05 +02:00 |
|
Gergő Móricz
|
e1a34b0a99
|
Revert "feat(scrape): scroll down/up with actions if fullpagescreenshot"
This reverts commit 815bfc8f07.
|
2024-09-20 21:43:22 +02:00 |
|
Gergő Móricz
|
815bfc8f07
|
feat(scrape): scroll down/up with actions if fullpagescreenshot
revert this if unneeded
|
2024-09-20 21:42:09 +02:00 |
|
Gergő Móricz
|
d663bbf0ca
|
feat(actions): add scroll
|
2024-09-20 21:41:53 +02:00 |
|
Gergő Móricz
|
3dd912ec91
|
feat(actions): add typeText, pressKey, fix playwright screenshot/waitFor
|
2024-09-20 21:02:53 +02:00 |
|
Gergő Móricz
|
719dfbccbb
|
Update docs
|
2024-09-20 20:30:46 +02:00 |
|
Gergő Móricz
|
939040bf44
|
Update docs and example
|
2024-09-20 20:10:11 +02:00 |
|
Gergő Móricz
|
3ec0bbe28d
|
feat(sdk/rust/crawl): paginate through results
|
2024-09-20 20:10:11 +02:00 |
|
Gergő Móricz
|
a078cdbd9d
|
Rust SDK 1.0.0
|
2024-09-20 20:10:11 +02:00 |
|
Gergő Móricz
|
93a20442e3
|
feat(sdk/rust): first batch of changes for 1.0.0
|
2024-09-20 20:10:11 +02:00 |
|
Gergő Móricz
|
506d5c2716
|
Revert "return links"
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
This reverts commit 2d597672be.
|
2024-09-19 20:07:06 +02:00 |
|
Anjor Kanekar
|
2d597672be
|
return links
|
2024-09-19 20:06:07 +02:00 |
|
anjor
|
c45a132cd5
|
Remove print statement in map
|
2024-09-19 20:06:07 +02:00 |
|
Gergő Móricz
|
01f42b980d
|
feat(scrape): add error tallying instead of empty response
|
2024-09-19 19:21:13 +02:00 |
|
Nicolas
|
b8b8522b33
|
Nick: fixed map exception
|
2024-09-19 12:49:33 -04:00 |
|
Nicolas
|
ef71940429
|
Merge pull request #674 from mendableai/nsc/map-pagination
v1/map improvements + higher limits
|
2024-09-19 11:31:23 -04:00 |
|
Nicolas
|
00bb958b32
|
Update v1-openapi.json
|
2024-09-18 15:59:11 -04:00 |
|
Nicolas
|
03eb47d426
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
|
2024-09-18 15:58:54 -04:00 |
|
Nicolas
|
3a4dd8fc7e
|
Nick: v1 openapi spec
|
2024-09-18 15:58:53 -04:00 |
|
Gergő Móricz
|
712ca31615
|
minor fixes
|
2024-09-18 21:34:09 +02:00 |
|
Gergő Móricz
|
20d1855ad5
|
feat(js-sdk): actions integration
|
2024-09-18 20:47:56 +02:00 |
|
Gergő Móricz
|
093c064bff
|
feat(v1): add public actions api
|
2024-09-18 20:39:25 +02:00 |
|
Gergő Móricz
|
42d677fe3c
|
feat(fire-engine): port waitFor and screenshot to use actions
|
2024-09-18 20:04:54 +02:00 |
|
Gergő Móricz
|
c28e1e2959
|
fix(v1/zod): formats: add error message if both sc and sc@fP
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-18 19:35:38 +02:00 |
|
Nicolas
|
255db84879
|
Update package.json
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
|
2024-09-17 15:06:53 -04:00 |
|
Gergő Móricz
|
b2b7f8d874
|
fix(js-sdk): default type for LLM extract
|
2024-09-17 20:49:01 +02:00 |
|
Nicolas
|
31633317dd
|
Update package.json
|
2024-09-17 12:33:07 -04:00 |
|
rafaelsideguide
|
fb8a2c7549
|
fixed screenshot typo and added test for fullpage screenshot
|
2024-09-17 11:03:33 -04:00 |
|
Nicolas
|
3c2bfe2da2
|
Update single_url.ts
Fly Deploy / Deploy app (push) Waiting to run
|
2024-09-17 01:58:47 -04:00 |
|
Nicolas
|
18b024c238
|
Update single_url.ts
|
2024-09-17 01:41:46 -04:00 |
|
Nicolas
|
a4039bd008
|
Revert "Update single_url.ts"
This reverts commit 0f8c0a570d.
|
2024-09-16 23:36:38 -04:00 |
|
Nicolas
|
0f8c0a570d
|
Update single_url.ts
|
2024-09-16 21:44:56 -04:00 |
|
Nicolas
|
9da3432596
|
Update map.ts
|
2024-09-16 12:03:14 -04:00 |
|