Austin/firecrawl
1
0
Fork 0
mirror of https://github.com/mendableai/firecrawl.git synced 2024-11-16 03:32:22 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,087 Commits 273 Branches 1 Tag 48 MiB
97b8d6c333
Commit Graph

2087 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
rafaelsideguide
aed11e72a6 fix encoding if error 2024-10-18 11:50:58 -03:00
Eric Ciarla
6ebfcc85cf
Merge pull request #790 from rishi-raj-jain/patch-1
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
Details 
Update requirements.txt
 2024-10-18 10:19:33 -04:00
Nicolas
79e65f31ef Update v1.ts
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
Details
2024-10-17 17:57:44 -03:00
Rishi Raj Jain
7d8df7d53b
Update requirements.txt 2024-10-18 02:11:15 +05:30
Rishi Raj Jain
a110fdeb85
Update requirements.txt 2024-10-18 02:10:39 +05:30
Eric Ciarla
dff71a8179 Delete README.md 2024-10-17 15:48:36 -04:00
Eric Ciarla
5f69358ce8 Swarm Extractor Example 2024-10-17 15:47:28 -04:00
Gergő Móricz
03b37998fd feat: bulk scrape 2024-10-17 19:40:18 +02:00
Nicolas
081d7407b3
Merge pull request #788 from mendableai/nsc/log-extractpr-options
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
Extractor options logging v1 fix
 2024-10-16 23:51:22 -03:00
Nicolas
06b8d24a4c Update scrape.ts 2024-10-16 23:50:21 -03:00
Nicolas
a73b06589c
Merge pull request #785 from mendableai/nsc/support-for-all-metadata 
Return all the website metadata
 2024-10-16 23:37:26 -03:00
Nicolas
2ac50a16f5 Update metadata.ts 2024-10-16 23:37:07 -03:00
Nicolas
8974230db4 Nick: formatting + error handling 2024-10-16 23:35:03 -03:00
Nicolas
c0384ea381 Nick: added tests 2024-10-16 23:32:44 -03:00
Nicolas
417c7697c3 Update metadata.ts 2024-10-16 23:26:46 -03:00
Nicolas
ff906f7750 Update excludeTags.ts
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-16 13:40:34 -03:00
Nicolas
2c1a98f019 Update excludeTags.ts 2024-10-16 13:37:40 -03:00
Nicolas
cf8fe93281 Update credit_billing.ts
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-16 01:09:57 -03:00
Nicolas
e5a5ca2446 Update credit_billing.ts 2024-10-16 01:06:10 -03:00
Nicolas
ffbf16048f
Merge pull request #784 from mendableai/nsc/geolocation
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
Geolocation support for Firecrawl
 2024-10-15 21:49:16 -03:00
Nicolas
027158fa44 Nick: 2024-10-15 21:47:27 -03:00
Nicolas
795e5a9228 Update metadata.ts 2024-10-15 21:36:13 -03:00
Nicolas
b4f6a0f919 Nick: geolocation 2024-10-15 21:12:33 -03:00
Nicolas
f49552e413
Merge pull request #783 from mendableai/nsc/admin-notifications 
Admin alerts for high usage
 2024-10-15 18:00:57 -03:00
Nicolas
54a54b9f33 Nick: admin init 2024-10-15 17:28:28 -03:00
Nicolas
7b1df22698 Delete check-queues.yml
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-15 13:31:29 -03:00
Nicolas
784aa789cb
Merge pull request #780 from mendableai/feat/improv-filter-perfomance 
[Feat] Performance improvements crawl status filters
 2024-10-15 12:33:30 -03:00
rafaelsideguide
4afcd16e02 performance improv for ws 2024-10-15 10:12:27 -03:00
rafaelsideguide
3afaab13d9 feat/improv-crawl-status-filters 2024-10-14 18:14:00 -03:00
Nicolas
ca84491ccb
Merge pull request #779 from mendableai/fix/check-files
Some checks failed
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
Check Queues / clean-jobs (push) Has been cancelled
Details 
[BUG] added check files on crawl
 2024-10-14 16:02:01 -03:00
rafaelsideguide
180801225b fix/check files on crawl 2024-10-14 15:44:45 -03:00
Nicolas
e40036caf7 Merge branch 'main' of https://github.com/mendableai/firecrawl
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-14 12:24:45 -03:00
Nicolas
c3a9630e33 Reapply "Merge pull request #773 from mendableai/nsc/retries-acuc-price-credits-fallback" 
This reverts commit a6888ce17b.
 2024-10-14 12:24:34 -03:00
rafaelsideguide
2bf7b433e2 fixed file blocking process 2024-10-14 12:18:26 -03:00
rafaelsideguide
a6888ce17b Revert "Merge pull request #773 from mendableai/nsc/retries-acuc-price-credits-fallback" 
This reverts commit ba9ad1ef7f, reversing
changes made to 666082a7dd.
 2024-10-14 10:32:09 -03:00
Nicolas
ba9ad1ef7f
Merge pull request #773 from mendableai/nsc/retries-acuc-price-credits-fallback
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
Retries for ACUC RPC + Price credits fallback
 2024-10-13 22:34:30 -03:00
Nicolas
821c62c575 Update credit_billing.ts 2024-10-13 22:30:11 -03:00
Nicolas
78b6127d88 Nick: retries for acuc 2024-10-13 22:27:38 -03:00
Nicolas
666082a7dd Nick: bump python patch to 1.3.1 2024-10-13 14:03:19 -03:00
Nicolas
ec238a8349 Update firecrawl.py 2024-10-13 14:01:25 -03:00
Nicolas
03287821c2 Update index.ts
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
Details
2024-10-12 19:49:37 -03:00
Nicolas
d3856371c9 Update index.ts
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-12 19:36:49 -03:00
Nicolas
af06b42cb2 Update fireEngine.ts 2024-10-12 18:18:38 -03:00
Nicolas
35b15f1ee6 Update fireEngine.ts 2024-10-12 17:59:50 -03:00
Nicolas
961b1010cf Nick: rm the cache for map for 24hrs 2024-10-12 17:48:37 -03:00
Nicolas
2eff7c29bb Nick: refactor openai swarm example 2024-10-12 16:12:12 -03:00
Nicolas
c2d79e1842 Create .env.example 2024-10-12 16:00:37 -03:00
Nicolas
3315648a0f Nick: open ai swarm and firecrawl 2024-10-12 16:00:14 -03:00
Nicolas
ca85feb9d0
Merge pull request #768 from Ruhi14/patch-1 
ADDED : Contributors and Back to top
 2024-10-12 14:00:57 -03:00
RuhiJain
cee124dc46
Update README.md 2024-10-12 16:28:29 +05:30