358 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Nicolas	4efebf7a4b	Merge branch 'test/load-testing' of https://github.com/mendableai/firecrawl into test/load-testing	2024-05-19 12:22:51 -07:00
Nicolas	5792cd022c	Update fly.staging.toml	2024-05-19 12:22:49 -07:00
rafaelsideguide	d667e1417b	added fly staging load test ... - being rate limited. Need to add the token to the rate-limit functions	2024-05-17 19:09:19 -03:00
Nicolas	7630565c26	Create fly.staging.toml	2024-05-17 14:33:59 -07:00
rafaelsideguide	7297b21dcd	Added load testing using artillery	2024-05-17 18:32:44 -03:00
rafaelsideguide	a480595aa7	Update index.test.ts	2024-05-17 15:41:27 -03:00
rafaelsideguide	54049be539	Added e2e tests	2024-05-17 15:37:47 -03:00
rafaelsideguide	d4574851be	Added rpc definition	2024-05-15 08:40:21 -03:00
rafaelsideguide	47c20c80ab	Update auth.ts	2024-05-15 08:34:49 -03:00
Nicolas	7d8ceab6de	Merge branch 'feat/rate-limits' of https://github.com/mendableai/firecrawl into feat/rate-limits	2024-05-14 14:48:01 -07:00
Nicolas	0e0faa28b3	Update auth.ts	2024-05-14 14:47:36 -07:00
rafaelsideguide	672eddb999	updated rpc	2024-05-14 18:47:21 -03:00
Nicolas	4761ea510b	Update rate-limiter.ts	2024-05-14 14:26:42 -07:00
rafaelsideguide	40ad97dee8	added rate limits	2024-05-14 18:08:31 -03:00
Nicolas	e26008a833	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-05-13 19:54:13 -07:00
Nicolas	512449e1aa	Nick: v21	2024-05-13 19:54:12 -07:00
Nicolas	bd27b0e17e	Merge pull request #142 from mendableai/doc/crawl-limit-default ... [Doc] Added default value for crawlOptions.limit	2024-05-13 18:38:09 -07:00
Nicolas	aa0c8188c9	Nick: 408 handling	2024-05-13 18:34:00 -07:00
Nicolas	999176d576	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-05-13 13:57:34 -07:00
Nicolas	f3ec21d9c4	Update runWebScraper.ts	2024-05-13 13:57:22 -07:00
Nicolas	c9133f3d15	Merge pull request #145 from mendableai/nsc/timeout-scrape ... Timeout on /scrape	2024-05-13 13:07:25 -07:00
Nicolas	65d89afba9	Nick:	2024-05-13 13:01:43 -07:00
Nicolas	3f090ffd7c	Merge pull request #144 from mendableai/feat/gpt-4o ... Update models.ts	2024-05-13 12:24:30 -07:00
Eric Ciarla	4cc46d4af8	Update models.ts	2024-05-13 15:23:31 -04:00
Nicolas	2ce045912f	Nick: disable vision right now	2024-05-13 10:56:08 -07:00
rafaelsideguide	df16890f84	Added default value for crawlOptions.limit	2024-05-10 11:59:33 -03:00
Nicolas	66bd1e4020	Update website_params.ts	2024-05-09 18:41:15 -07:00
Nicolas	c02a82c282	Update main.py	2024-05-09 18:02:34 -07:00
Nicolas	efc6fcb474	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-05-09 18:01:04 -07:00
Nicolas	73687822ad	Update main.py	2024-05-09 18:00:58 -07:00
Nicolas	f94b6053ad	Merge pull request #139 from mendableai/nsc/refactor-scraping-order ... Nsc/refactor scraping order	2024-05-09 17:57:01 -07:00
Nicolas	d21091bb06	Update single_url.ts	2024-05-09 17:52:46 -07:00
Nicolas	be85008622	Nick: better	2024-05-09 17:48:11 -07:00
Nicolas	73e8da9185	Merge branch 'main' into nsc/refactor-scraping-order	2024-05-09 17:45:20 -07:00
Nicolas	be5661a768	Nick: a lot better	2024-05-09 17:45:16 -07:00
Caleb Peffer	08d6c59a78	Merge pull request #134 from mendableai/cjp/switch-license-to-AGPL ... Switching to AGPL - We Need Your Consent!	2024-05-09 16:47:03 -07:00
Nicolas	5ab97bbe23	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-05-09 15:29:59 -07:00
Nicolas	fce17e6beb	Update credit_billing.ts	2024-05-09 15:29:58 -07:00
Nicolas	53ab33c287	Update README.md	2024-05-09 10:27:10 -07:00
Nicolas	832a4f53e0	Merge pull request #137 from mendableai/nsc/llm-extraction-zod-integration ... [Docs] Updated examples	2024-05-09 09:24:36 -07:00
rafaelsideguide	f4d8b2c89a	Updated docs	2024-05-09 10:36:56 -03:00
Nicolas	c02d7aeebd	Merge pull request #135 from mendableai/nsc/llm-extraction-zod-integration ... Adds Zod Integration for LLM Extraction in the Firecrawl JS SDK	2024-05-08 18:15:12 -07:00
Nicolas	d6b4904ef1	Update README.md	2024-05-08 18:10:43 -07:00
Nicolas	3b5f71c1e8	Update README.md	2024-05-08 17:46:35 -07:00
Nicolas	1033034201	Update README.md	2024-05-08 17:45:19 -07:00
Nicolas	aa6b84c5fa	Nick: readme	2024-05-08 17:41:15 -07:00
Nicolas	d9da4b53f8	Update example.py	2024-05-08 17:36:40 -07:00
Nicolas	4c88d5da66	Nick: v8 python	2024-05-08 17:35:16 -07:00
Nicolas	e6dbbf1bab	Nick: fixes js and pydantic implementation	2024-05-08 17:16:59 -07:00
Nicolas	c89964b230	Nick:	2024-05-08 16:38:49 -07:00