1129 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Caleb Peffer	e6b46178dd	Caleb: added .env.example	2024-04-20 19:53:27 -07:00
Caleb Peffer	b361a76282	Caleb: added logging improvement	2024-04-20 19:53:04 -07:00
Nicolas	08e9654344	Merge pull request #38 from mendableai/more-logging ... Logging	2024-04-20 19:41:07 -07:00
Nicolas	9b31e68a7e	Update queue-worker.ts	2024-04-20 19:38:44 -07:00
Nicolas	0db0874b00	Nick:	2024-04-20 19:37:45 -07:00
Nicolas	19cba43ee4	Merge pull request #37 from mendableai/refactor-index ... Refactor api routes	2024-04-20 19:06:33 -07:00
Nicolas	4543c57e4e	Nick:	2024-04-20 19:04:27 -07:00
Nicolas	5b8aed26dd	Update scrape.ts	2024-04-20 18:55:39 -07:00
Nicolas	23b2190e5d	Nick:	2024-04-20 16:38:05 -07:00
Nicolas	d201a4e58d	Merge pull request #31 from mendableai/feat/js-sdk-v0011 ... [Feat] Added type declarations	2024-04-20 14:15:16 -07:00
Nicolas	acec76680a	Merge pull request #35 from mendableai/nsc/job-logs ... Better logging	2024-04-20 14:12:44 -07:00
Nicolas	d4e77740ba	Merge pull request #36 from mendableai/nsc/rate-limit-fixes ... Rate limit fixes for crawl status	2024-04-20 14:12:10 -07:00
Nicolas	5b3c75b06e	Nick:	2024-04-20 14:10:29 -07:00
Nicolas	43c2e877e7	Update index.ts	2024-04-20 14:05:01 -07:00
Nicolas	408c7a479f	Nick: rate limit fixes	2024-04-20 14:02:22 -07:00
Nicolas	6aa3cc3ce8	Nick:	2024-04-20 13:53:11 -07:00
Nicolas	1a3aa2999d	Nick: return the only list of urls	2024-04-20 11:59:42 -07:00
Nicolas	ddf9ff9c9a	Nick:	2024-04-20 11:46:06 -07:00
Caleb Peffer	39dca60241	Merge pull request #32 from mendableai/cjp/doc-fix ... Caleb: fixing some documentation and rebuilding the server	2024-04-20 09:21:22 -07:00
Caleb Peffer	389ac90f51	Caleb: fixing some documentation and rebuilding the server	2024-04-20 09:19:09 -07:00
Nicolas	f1dd97af0f	Update index.ts	2024-04-19 15:37:27 -07:00
Nicolas	84cebf618b	Nick:	2024-04-19 15:36:00 -07:00
Nicolas	005ac8f839	Merge branch 'main' into detect-pdfs	2024-04-19 15:13:32 -07:00
Nicolas	5b93799149	Nick: a bit faster	2024-04-19 15:13:17 -07:00
rafaelsideguide	890bde686f	added type declarations	2024-04-19 19:10:05 -03:00
Nicolas	de1e13d79d	Merge pull request #30 from mendableai/bugfix/scrape-test-failing ... [Bugfix] Fixed scrape preview test	2024-04-19 15:03:50 -07:00
rafaelsideguide	37ef8a015c	fixing scrape preview test	2024-04-19 17:55:35 -03:00
Nicolas	c5cb268b61	Update pdfProcessor.ts	2024-04-19 13:13:42 -07:00
Nicolas	43cfcec326	Nick: disabling in crawl and sitemap for now	2024-04-19 13:12:08 -07:00
Nicolas	140529c609	Nick: fixes pdfs not found	2024-04-19 13:05:21 -07:00
Nicolas	15cfc01f5d	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-04-19 12:23:14 -07:00
Nicolas	a144e13e30	Update rate-limiter.ts	2024-04-19 12:23:13 -07:00
rafaelsideguide	384fb1db18	updating version	2024-04-19 15:27:54 -03:00
Rafael Miller	3c14b02f8b	Merge pull request #25 from mendableai/feat/replace-all-paths-to-absolute-paths ... Added option to replace all relative paths with absolute paths	2024-04-19 15:18:50 -03:00
Rafael Miller	be258ea1c5	Merge pull request #28 from mendableai/feat/better-types-for-jssdk ... [Feat] Added TSDocs and types for js-sdk	2024-04-19 15:14:17 -03:00
rafaelsideguide	3ddff62a56	adding better doc and types for js-sdk	2024-04-19 14:49:35 -03:00
Ikko Eltociear Ashimine	9e9d66f7a3	refactor: fix typo in WebScraper/index.ts ... breakign -> breaking	2024-04-20 02:27:53 +09:00
rafaelsideguide	72e1dadccd	adding option to replace all relative paths with absolute paths	2024-04-19 11:47:20 -03:00
Nicolas	2c0660653d	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-04-18 13:56:25 -07:00
Nicolas	be35b32306	Nick: preview token tests	2024-04-18 13:55:55 -07:00
Rafael Miller	e19874bbe1	Merge pull request #22 from mendableai/feat/ci-cd-env-secrets ... adding env secrets	2024-04-18 17:50:00 -03:00
rafaelsideguide	7049780426	adding all tests	2024-04-18 17:47:15 -03:00
rafaelsideguide	1c8ffc9faa	fixing deploy workflow	2024-04-18 17:44:33 -03:00
rafaelsideguide	c627d22179	all working now	2024-04-18 17:41:23 -03:00
rafaelsideguide	dab0568c43	testing tests	2024-04-18 17:38:12 -03:00
rafaelsideguide	4018d7ca17	fixing workflow	2024-04-18 17:35:00 -03:00
rafaelsideguide	4f1179db99	fixing workflow	2024-04-18 17:32:28 -03:00
rafaelsideguide	ca8c8b87dc	fixing workflow	2024-04-18 17:29:06 -03:00
rafaelsideguide	3f833737f3	fixing test	2024-04-18 17:25:25 -03:00
rafaelsideguide	efbb4e8905	fixing jest parameters	2024-04-18 17:18:15 -03:00