Commit Graph

2147 Commits

Author SHA1 Message Date
Nicolas
ae5ba74e2d
Merge pull request #869 from mendableai/fix/new-url-on-utils-extract-links
[BUG] Added trycatch and removed redundancy
2024-11-05 11:26:26 -05:00
rafaelmmiller
f07bbef78e added trycatch and removed redundancy 2024-11-05 08:11:49 -03:00
Dmitriy Vasilyuk
2fa25cb992
[Fix] Prevent Python Firecrawl logger from interfering with loggers in client applications (#613)
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
* Prevent firecrawl logger from interfering with other loggers

* Always check if logger has handlers

---------

Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
2024-11-05 08:33:39 +01:00
Nicolas
9e22c9a428 Nick: etier1a
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
2024-11-04 18:14:38 -05:00
Eric Ciarla
a5c9823495 haiku example 2024-11-04 14:58:05 -05:00
Nicolas
12c0aa6b4b
Merge pull request #867 from mendableai/fix/remove-base64-images
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
[Feat] Added remove base64 images options (true by default)
2024-11-04 13:17:09 -05:00
Rafael Miller
8297e5beef
Merge branch 'main' into fix/remove-base64-images 2024-11-04 10:35:09 -03:00
rafaelmmiller
4c5bb21a6f added remove base64 images options (true by default) 2024-11-04 10:31:44 -03:00
Eric Ciarla
2eff27ba43
Merge pull request #847 from mendableai/nsc/mobile-support
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
Adds support for mobile web scraping + mobile screenshot
2024-11-02 11:16:33 -04:00
Rafael Miller
45debc9977
Merge pull request #858 from mendableai/nsc/new-actions
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Support for the 2 new actions
2024-11-01 13:22:38 -03:00
rafaelsideguide
61f659190d bumped js-sdk version 2024-11-01 12:44:29 -03:00
rafaelsideguide
28db4dd3b5 fixed zod validation for wait 2024-11-01 12:40:40 -03:00
Nicolas
80beedb46f Update index.ts 2024-10-31 20:03:19 -03:00
Nicolas
446acfccde Nick: support for the new actions 2024-10-31 20:01:52 -03:00
Thomas Kosmas
3911fe1fba Fix
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
2024-10-31 18:14:20 +02:00
Thomas Kosmas
6e5c95d5e7 fix bug 2024-10-31 17:55:43 +02:00
Thomas Kosmas
3eb79f1293 Fix dockerfile 2024-10-31 17:52:38 +02:00
Thomas Kosmas
c8b8a761a9
Merge pull request #856 from mendableai/feat/iframe-support
Fix go parser
2024-10-31 17:49:40 +02:00
Thomas Kosmas
ae919ad896 Fix go parser 2024-10-31 17:36:32 +02:00
Rafael Miller
2ae2931b75
Merge pull request #855 from mendableai/feat/iframe-support
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
[feat] Iframe support
2024-10-31 11:22:25 -03:00
rafaelsideguide
367af9512f added iframe links to extractLinksFromHTML 2024-10-31 10:53:47 -03:00
Thomas Kosmas
fe02101a12 Iframe support 2024-10-31 14:40:33 +02:00
Nicolas
728d6a16de Merge branch 'mog/concurrency-limit-2'
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
2024-10-30 17:19:48 -03:00
Nicolas
47d276d3b5 Update rate-limiter.ts 2024-10-30 17:19:37 -03:00
Nicolas
f5c58e0c51
Merge pull request #824 from mendableai/mog/concurrency-limit-2
concurrency limit fix
2024-10-30 17:14:20 -03:00
Nicolas
ea85b1d602 Merge branch 'main' into mog/concurrency-limit-2 2024-10-30 17:05:40 -03:00
Nicolas
96c579f1cd Nick: etier2c
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
2024-10-29 21:01:43 -03:00
Eric Ciarla
0b409d7609 Merge branch 'main' of https://github.com/mendableai/firecrawl
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
2024-10-29 15:38:59 -04:00
Eric Ciarla
983f344fa8 Create claude_stock_analyzer.py 2024-10-29 15:38:57 -04:00
Nicolas
e0ba339c50 Update auth.ts 2024-10-29 16:06:12 -03:00
Nicolas
6948ca6fe1 Revert "Update auth.ts"
This reverts commit 7152ac8856.
2024-10-29 16:02:21 -03:00
Nicolas
7152ac8856 Update auth.ts 2024-10-29 15:58:20 -03:00
Nicolas
c00cd21308 Nick: adds support for mobile web scraping 2024-10-29 14:10:40 -03:00
Nicolas
c96b36d045
Merge pull request #830 from mendableai/nsc/geo-to-location
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Geo-location rename to location
2024-10-28 20:28:30 -03:00
Nicolas
6d38c65466 Update package.json 2024-10-28 20:25:28 -03:00
Nicolas
07e76f2ba5 Merge branch 'main' into nsc/geo-to-location 2024-10-28 20:24:29 -03:00
Nicolas
b6ce49e5bb Update index.ts 2024-10-28 20:24:16 -03:00
Nicolas
3d1bb82aa2 Nick: languages support 2024-10-28 20:16:11 -03:00
Nicolas
0bad436061 Nick: fixed the batch scrape + llm extract billing
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
2024-10-28 17:04:42 -03:00
Nicolas
726430c2e6 Nick: llm extract in batch scrape 2024-10-28 16:51:49 -03:00
Nicolas
298a343a90
Merge pull request #831 from twlite/patch-1
chore(README.md): use `satisfies` instead of `as` for ts example
2024-10-28 16:06:41 -03:00
Nicolas
d2d5c0b6c0
Merge pull request #838 from mendableai/nsc/rm-wait-before-click
RM wait before interacting
2024-10-28 16:06:31 -03:00
Nicolas
a13c2442e6
Merge pull request #628 from SearchApi/feature/add-searchapi-search
Add SearchApi as a Web Search Tool
2024-10-28 16:04:56 -03:00
Nicolas
ea0f458b9f
Merge pull request #739 from s-smits/main
Bump to gemini-1.5-pro-002 website_qa_with_gemini_caching.ipynb and add flash example
2024-10-28 15:49:04 -03:00
Nicolas
19ed042181
Merge pull request #829 from mendableai/nsc/prevent-single-url-logs
Remove ph logs for single_urls
2024-10-28 15:47:44 -03:00
Nicolas
fa8875d64d Update single_url.ts 2024-10-28 15:09:50 -03:00
Nicolas
007e3edfc5
Update README.md 2024-10-28 12:40:04 -03:00
Eric Ciarla
e3e8375c7d Add AgentOps Monitoring 2024-10-28 11:13:33 -04:00
Twilight
b48eed5716
chore(README.md): use satisfies instead of as for ts example 2024-10-28 09:40:35 +05:45
Nicolas
877d5e4383 Update types.ts 2024-10-27 23:17:20 -03:00