307 Commits

Author	SHA1	Message	Date
Nicolas	3aa5f26627	Update main.py	2024-05-22 10:45:43 -07:00
Nicolas	3e63985e53	Update main.py	2024-05-22 10:40:47 -07:00
youqiang	c47dae13a9	update: wait until body attached in playwright-service	2024-05-21 14:53:57 +08:00
Nicolas	01783dc336	Update openapi.json	2024-05-20 17:10:55 -07:00
Nicolas	77a79b5a79	Nick: max num tokens for llm extract (for now) + slice the max	2024-05-20 17:07:38 -07:00
Nicolas	d5d0d48848	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-05-20 10:06:52 -07:00
Nicolas	60002e79b8	Nick: python sdk bump	2024-05-20 10:06:48 -07:00
Matt Joyce	7e5ef4dec4	Allow override of API URL ... Allows python sdk to be used with local installs.	2024-05-20 18:46:32 +10:00
Nicolas	c74f757b53	Update rate-limiter.ts	2024-05-19 13:05:36 -07:00
Nicolas	98a39b39ab	Nick: increased rate limits	2024-05-19 12:59:29 -07:00
Nicolas	18fa15df25	Update index.test.ts	2024-05-19 12:50:06 -07:00
Nicolas	614c073af0	Nick: improvements	2024-05-19 12:45:46 -07:00
Nicolas	f473793ba3	Merge branch 'main' into feat/rate-limits	2024-05-19 12:23:34 -07:00
rafaelsideguide	a480595aa7	Update index.test.ts	2024-05-17 15:41:27 -03:00
rafaelsideguide	54049be539	Added e2e tests	2024-05-17 15:37:47 -03:00
Nicolas	6feb21cc35	Update website_params.ts	2024-05-17 11:21:26 -07:00
Nicolas	5be208f595	Nick: fixed	2024-05-17 10:40:44 -07:00
Nicolas	eb88447e8b	Update index.test.ts	2024-05-17 10:00:05 -07:00
Nicolas	df6c3d1e7d	Merge branch 'main' into detect-pdfs	2024-05-17 09:55:51 -07:00
Nicolas	9d635cb2a3	Nick: docx support	2024-05-16 11:48:02 -07:00
Nicolas	bcce0544e7	Update openapi.json	2024-05-16 11:03:32 -07:00
Nicolas	80250fb54f	Update index.test.ts	2024-05-15 17:40:46 -07:00
Nicolas	098db17913	Update index.ts	2024-05-15 17:37:09 -07:00
Nicolas	93b1f0334e	Update index.test.ts	2024-05-15 17:35:06 -07:00
Nicolas	123fb784ca	Update index.test.ts	2024-05-15 17:29:22 -07:00
Nicolas	4a6cfb6097	Update index.test.ts	2024-05-15 17:22:29 -07:00
Nicolas	6ca368327f	Merge branch 'main' into test/crawl-options	2024-05-15 17:18:25 -07:00
Nicolas	24be4866c5	Nick:	2024-05-15 17:16:20 -07:00
Nicolas	ade4e05cff	Nick: working	2024-05-15 17:13:04 -07:00
Nicolas	bfccaf670d	Nick: fixes most of it	2024-05-15 15:30:37 -07:00
rafaelsideguide	d91043376c	not working yet	2024-05-15 18:54:40 -03:00
rafaelsideguide	fa014defc7	Fixing child links only bug	2024-05-15 18:35:09 -03:00
Nicolas	2ba743fb1a	Merge pull request #27 from eltociear/patch-1 ... refactor: fix typo in WebScraper/index.ts	2024-05-15 13:28:38 -07:00
Nicolas	0663d78324	Merge pull request #119 from chand1012/main ... Add Docker Compose for easy self hosting	2024-05-15 13:27:40 -07:00
rafaelsideguide	da8d94105d	fixed for testing the crawl algorithm only	2024-05-15 17:16:03 -03:00
Nicolas	95ffaa2236	Update crawl.test.ts	2024-05-15 12:58:02 -07:00
Nicolas	f15b8f855e	Update crawl.json	2024-05-15 12:57:24 -07:00
Nicolas	98dd672d0a	Update crawl.json	2024-05-15 12:55:04 -07:00
Nicolas	499671c87f	Update crawl.test.ts	2024-05-15 12:50:13 -07:00
Nicolas	58053eb423	Update rate-limiter.ts	2024-05-15 12:47:35 -07:00
Nicolas	4745d114be	Update crawl.test.ts	2024-05-15 12:42:14 -07:00
Nicolas	1601e93d69	Merge branch 'main' into test/crawl-options	2024-05-15 12:34:47 -07:00
Nicolas	3678d3c986	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-05-15 12:11:18 -07:00
Nicolas	fd82982a31	Nick:	2024-05-15 12:11:16 -07:00
rafaelsideguide	4925ee59f6	added crawl test suite	2024-05-15 15:50:50 -03:00
Nicolas	1b0d6341d3	Update index.ts	2024-05-15 11:48:12 -07:00
Nicolas	d10f81e7fe	Nick: fixes	2024-05-15 11:28:20 -07:00
Nicolas	87570bdfa1	Update index.ts	2024-05-15 11:06:03 -07:00
rafaelsideguide	d4574851be	Added rpc definition	2024-05-15 08:40:21 -03:00
rafaelsideguide	47c20c80ab	Update auth.ts	2024-05-15 08:34:49 -03:00