521 Commits

Author	SHA1	Message	Date
rafaelsideguide	afee5684a3	Fixed tests' message and updated version	2024-06-14 11:05:19 -03:00
Rafael Miller	5a5c532bea	Merge branch 'main' into py-sdk-improve-response-handling	2024-06-14 10:42:51 -03:00
Rafael Miller	cc2e3f05b0	Merge pull request #256 from mattjoyce/feat-254-sdk-py-logging ... Added logging to python sdk FIRECRAWL_LOGGING_LEVEL	2024-06-14 10:22:40 -03:00
rafaelsideguide	6963a490f1	Updated version	2024-06-14 10:21:44 -03:00
Nicolas	6fc1ee32fd	Merge pull request #275 from mendableai/feat/issue-273 ... Added pageOptions.removeTags	2024-06-13 13:27:01 -07:00
rafaelsideguide	676d6e8ab5	Added pageOptions.removeTags	2024-06-13 10:51:05 -03:00
Nicolas	182f8d4d6c	Update index.ts	2024-06-12 18:07:05 -07:00
Nicolas	11b6d5afa5	Update fly.toml	2024-06-12 18:00:22 -07:00
Nicolas	67dc46b454	Nick: clusters	2024-06-12 17:53:04 -07:00
rafaelsideguide	d20af257ba	Added jobId to webhook data	2024-06-12 15:38:41 -03:00
rafaelsideguide	01c9f071fa	fixed	2024-06-12 11:27:06 -03:00
rafaelsideguide	dc6acbf1f0	Merge remote-tracking branch 'origin/main' into feat/allowbackwardcrawling-option	2024-06-12 11:01:05 -03:00
Nicolas	f93231499f	Merge pull request #265 from mendableai/feat/issue-264 ... [Feat] Added route to clean completed jobs and a github action cron that triggers every 24h	2024-06-11 21:33:52 -07:00
Nicolas	45dee63943	Merge pull request #262 from mendableai/nsc/webhook-self-host-fix ... Only fetch webhook from db if self host webhook not set and using db auth	2024-06-11 15:46:57 -07:00
rafaelsideguide	157fbe4a1e	added bull auth key	2024-06-11 17:52:01 -03:00
rafaelsideguide	df3a678cf4	getting back the cancel test, this should work	2024-06-11 17:46:56 -03:00
rafaelsideguide	def2ba9987	added tests	2024-06-11 17:46:25 -03:00
Nicolas	1e3e06a1d5	Update replacePaths.test.ts	2024-06-11 13:02:39 -07:00
Nicolas	2239e03269	Update replacePaths.test.ts	2024-06-11 12:54:02 -07:00
Nicolas	520739c9f4	Nick: fixed bugs associated with absolute path replacements	2024-06-11 12:43:16 -07:00
Nicolas	b87725c683	Update openapi.json	2024-06-11 12:08:49 -07:00
rafaelsideguide	ee282c3d55	Added allowBackwardCrawling option	2024-06-11 15:24:39 -03:00
rafaelsideguide	a9f93c2f1e	Added route to clean completed jobs and a github action cron that triggers every 24h	2024-06-11 14:18:05 -03:00
Nicolas	da38dad9a7	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-06-10 18:26:31 -07:00
Nicolas	9390816c1b	Update openapi.json	2024-06-10 18:26:25 -07:00
Nicolas	f6b06ac27a	Nick: ignoreSitemap, better crawling algo	2024-06-10 18:12:41 -07:00
Nicolas	1bd0327e1a	Merge branch 'main' into nsc/pageoptions-crawler	2024-06-10 17:15:10 -07:00
Nicolas	99f2ffd6d5	Update webhook.ts	2024-06-10 17:03:10 -07:00
Nicolas	7ae9778642	Update single_url.ts	2024-06-10 16:57:31 -07:00
Nicolas	913c1dd568	Nick: fetch -> axios and fix timeouts	2024-06-10 16:49:03 -07:00
Nicolas	3091f0134c	Nick:	2024-06-10 16:27:10 -07:00
Matt Joyce	827354a116	Added logging to python sdk FIRECRAWL_LOGGING_LEVEL ... Instantiates the logger early and depends on env to set.	2024-06-10 21:21:23 +10:00
Nicolas	aafd23fa8a	Merge pull request #252 from mattjoyce/fix-208-py-sdk-interval-poll-name ... Fix 208 py sdk interval poll name	2024-06-08 21:33:17 -07:00
Matt Joyce	6fd9ce1c89	type hints and linting	2024-06-08 11:46:52 +10:00
Matt Joyce	7477c5e5bd	Use error handler consistently	2024-06-08 11:28:51 +10:00
Matt Joyce	9f306736af	More detailed error handling	2024-06-08 11:18:30 +10:00
Matt Joyce	c71ea7a795	Prepare headers consistently	2024-06-08 11:08:26 +10:00
Matt Joyce	8f9a165c2f	Lint - whitespace	2024-06-08 08:03:02 +10:00
Matt Joyce	5f0df596ec	Align param name with JS SDK ... timeout becomes poll_interval	2024-06-08 07:37:08 +10:00
Nicolas	f24ca76618	Nick: removing rate limit emails for now	2024-06-07 10:39:11 -07:00
Nicolas	98d82c4cec	Update search.ts	2024-06-06 20:02:21 -07:00
Nicolas	5e80f8af87	Nick: llm extract 50	2024-06-06 18:35:44 -07:00
rafaelsideguide	7b7a6f8a39	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-06-06 17:51:28 -03:00
rafaelsideguide	f2695df215	updated sdk versions	2024-06-06 17:51:12 -03:00
rafaelsideguide	560f256a35	fixing minor problems on workflow	2024-06-06 17:36:48 -03:00
rafaelsideguide	f5318ea7d7	Update index.test.ts	2024-06-06 16:50:20 -03:00
rafaelsideguide	cd7f9abcec	Update index.test.ts	2024-06-06 16:44:46 -03:00
rafaelsideguide	7b9b668b95	Update index.test.ts	2024-06-06 16:36:51 -03:00
rafaelsideguide	82e0ed4cd3	Update index.test.ts	2024-06-06 16:33:27 -03:00
rafaelsideguide	dac7612be2	Merge branch 'main' of https://github.com/mendableai/firecrawl into 194-sdk-ci-pipeline-for-publishing-pythonnode-sdk	2024-06-06 16:07:25 -03:00