Austin/firecrawl
1
0
Fork 0
mirror of https://github.com/mendableai/firecrawl.git synced 2024-11-16 11:42:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
601 Commits 273 Branches 1 Tag 48 MiB
5ae4d1caf5
Commit Graph

601 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
youqiang
c47dae13a9 update: wait until body attached in playwright-service 2024-05-21 14:53:57 +08:00
Nicolas
7f64fe884a Update blocklist.ts 2024-05-20 17:26:01 -07:00
Nicolas
756f54466d Nick: allowed keywords for now 2024-05-20 17:24:21 -07:00
Nicolas
01783dc336 Update openapi.json 2024-05-20 17:10:55 -07:00
Nicolas
77a79b5a79 Nick: max num tokens for llm extract (for now) + slice the max 2024-05-20 17:07:38 -07:00
Nicolas
2644e1c029 Update .env.example 2024-05-20 13:36:51 -07:00
Nicolas
9e61d431f0 Nick: hyper dx integration init 2024-05-20 13:36:34 -07:00
Nicolas
d5d0d48848 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-05-20 10:06:52 -07:00
Nicolas
60002e79b8 Nick: python sdk bump 2024-05-20 10:06:48 -07:00
Nicolas
4bb536e5b3
Merge pull request #166 from mattjoyce/main 
Allow override of API URL
 2024-05-20 09:44:47 -07:00
Matt Joyce
7e5ef4dec4 Allow override of API URL 
Allows python sdk to be used with local installs.
 2024-05-20 18:46:32 +10:00
Nicolas
c74f757b53 Update rate-limiter.ts 2024-05-19 13:05:36 -07:00
Nicolas
842e197fd7
Merge pull request #151 from mendableai/feat/rate-limits 
[Feat] Added rate limits
 2024-05-19 13:01:37 -07:00
Nicolas
98a39b39ab Nick: increased rate limits 2024-05-19 12:59:29 -07:00
Nicolas
18fa15df25 Update index.test.ts 2024-05-19 12:50:06 -07:00
Nicolas
614c073af0 Nick: improvements 2024-05-19 12:45:46 -07:00
Nicolas
f473793ba3 Merge branch 'main' into feat/rate-limits 2024-05-19 12:23:34 -07:00
Nicolas
713f16fdc1
Update README.md 2024-05-19 00:41:12 -07:00
Nicolas
0dc108cd33
Update README.md 2024-05-18 11:32:13 -07:00
Nicolas
43d0309b09
Merge pull request #160 from elimisteve/patch-1 
Update README.md: Typo fix
 2024-05-18 11:24:23 -07:00
Steve Phillips
81563130e3
Update README.md: Typo fix 
Don't scrap, scrape!
 2024-05-18 03:58:17 +02:00
Nicolas
fae8954eeb
Update SELF_HOST.md 2024-05-17 18:46:59 -07:00
rafaelsideguide
a480595aa7 Update index.test.ts 2024-05-17 15:41:27 -03:00
rafaelsideguide
54049be539 Added e2e tests 2024-05-17 15:37:47 -03:00
Nicolas
6feb21cc35 Update website_params.ts 2024-05-17 11:21:26 -07:00
Nicolas
2a1f2e396a
Merge pull request #29 from mendableai/detect-pdfs 
Fixes pdfs not found if .pdf is not present
 2024-05-17 10:47:08 -07:00
Nicolas
5be208f595 Nick: fixed 2024-05-17 10:40:44 -07:00
Nicolas
eb88447e8b Update index.test.ts 2024-05-17 10:00:05 -07:00
Nicolas
df6c3d1e7d Merge branch 'main' into detect-pdfs 2024-05-17 09:55:51 -07:00
Nicolas
5c1e6d188c
Merge pull request #158 from mendableai/nsc/docx-support 
feat: Docx Support
 2024-05-16 12:03:16 -07:00
Nicolas
9d635cb2a3 Nick: docx support 2024-05-16 11:48:02 -07:00
Nicolas
d407ec76dd Merge branch 'test/crawl-options' 2024-05-16 11:03:43 -07:00
Nicolas
bcce0544e7 Update openapi.json 2024-05-16 11:03:32 -07:00
Nicolas
a31459092e
Merge pull request #153 from mendableai/test/crawl-options 
[Tests] Added crawl test suite -> crawl improvements
 2024-05-15 17:40:59 -07:00
Nicolas
80250fb54f Update index.test.ts 2024-05-15 17:40:46 -07:00
Nicolas
098db17913 Update index.ts 2024-05-15 17:37:09 -07:00
Nicolas
93b1f0334e Update index.test.ts 2024-05-15 17:35:06 -07:00
Nicolas
123fb784ca Update index.test.ts 2024-05-15 17:29:22 -07:00
Nicolas
4a6cfb6097 Update index.test.ts 2024-05-15 17:22:29 -07:00
Nicolas
6ca368327f Merge branch 'main' into test/crawl-options 2024-05-15 17:18:25 -07:00
Nicolas
24be4866c5 Nick: 2024-05-15 17:16:20 -07:00
Nicolas
ade4e05cff Nick: working 2024-05-15 17:13:04 -07:00
Nicolas
bfccaf670d Nick: fixes most of it 2024-05-15 15:30:37 -07:00
rafaelsideguide
d91043376c not working yet 2024-05-15 18:54:40 -03:00
rafaelsideguide
fa014defc7 Fixing child links only bug 2024-05-15 18:35:09 -03:00
Nicolas
2ba743fb1a
Merge pull request #27 from eltociear/patch-1 
refactor: fix typo in WebScraper/index.ts
 2024-05-15 13:28:38 -07:00
Nicolas
0663d78324
Merge pull request #119 from chand1012/main 
Add Docker Compose for easy self hosting
 2024-05-15 13:27:40 -07:00
Nicolas
eb36d4b3bd
Update SELF_HOST.md 2024-05-15 13:25:39 -07:00
rafaelsideguide
da8d94105d fixed for testing the crawl algorithm only 2024-05-15 17:16:03 -03:00
Nicolas
95ffaa2236 Update crawl.test.ts 2024-05-15 12:58:02 -07:00