829 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
rafaelsideguide	9c539e9113	Fixed includeHTML to use cleanedHtml as response	2024-06-18 16:26:54 -03:00
Nicolas	1c5a1dd487	Merge pull request #297 from AndyMik90/feat/removeTags-regex ... [Feat] Added support for RegEx in removeTags	2024-06-18 14:03:41 -04:00
Rafael Miller	f5a9acc4c6	Merge branch 'main' into feat/removeTags-regex	2024-06-18 14:39:59 -03:00
rafaelsideguide	9f7afd1e88	fix for some complex cases	2024-06-18 14:36:51 -03:00
Nicolas	8db8997daf	Nick: test suite + fly	2024-06-18 13:34:44 -04:00
Nicolas	d0c05accf6	Nick:	2024-06-18 13:21:50 -04:00
Nicolas	818751a256	Merge pull request #294 from mendableai/tests/e2e-to-unit ... [Test] Transcribed from e2e to unit tests for many cases	2024-06-18 13:09:22 -04:00
Nicolas	a3115004af	Merge pull request #296 from NeevJewalkar/sdk-update ... Added local host support for the javascript SDK	2024-06-18 13:03:37 -04:00
Nicolas	754c9fa08d	Update package.json	2024-06-18 12:58:57 -04:00
Nicolas	90a807c547	Update index.ts	2024-06-18 12:56:13 -04:00
Nicolas	26e8bfc23a	Merge branch 'main' into pr/296	2024-06-18 12:55:45 -04:00
Nicolas	b53ba58bc0	Merge pull request #282 from mendableai/nsc/rate-limiter-tests ... test: Rate Limit Unit Tests	2024-06-18 11:01:28 -04:00
Nicolas	3b6c9a8557	Merge pull request #298 from mendableai/feat/type-improvements ... [Feat] Improvements on response document types	2024-06-18 11:00:02 -04:00
rafaelsideguide	727e5de8c5	Update index.test.ts	2024-06-18 11:54:10 -03:00
rafaelsideguide	c54e797eb1	(╯°□°)╯︵ ┻━┻	2024-06-18 11:51:28 -03:00
rafaelsideguide	6e32522fa2	Improvements on response document types	2024-06-18 11:43:06 -03:00
rafaelsideguide	3c1af0aa33	Update ci.yml	2024-06-18 11:03:57 -03:00
rafaelsideguide	20f14bcf7f	Added some types	2024-06-18 10:55:07 -03:00
rafaelsideguide	c2fc69af1c	removed some e2e tests that are making the ci get stuck	2024-06-18 09:57:05 -03:00
rafaelsideguide	6c726a02eb	Moved to utils/removeUnwantedElements, added unit tests	2024-06-18 09:46:42 -03:00
AndyMik90	8b3c3aae91	Added support for RegEx in removeTags	2024-06-18 07:31:46 +02:00
neev jewalkar	e5ffda1eec	Added local host support for the javascript SDK	2024-06-18 05:42:25 +05:30
rafaelsideguide	b2bd562bb2	transcribed from e2e to unit tests for many cases	2024-06-17 17:09:44 -03:00
Nicolas	ab038051e9	Merge branch 'main' into nsc/rate-limiter-tests	2024-06-17 15:06:12 -04:00
rafaelsideguide	a20d002a6b	Delete test-run-report.json	2024-06-17 09:25:29 -03:00
Eric Ciarla	d236fe9a1e	Merge pull request #285 from mendableai/feat/maxDepthRelative ... Feat/max depth relative	2024-06-15 17:23:20 -04:00
Eric Ciarla	519ab1aecb	Update unit tests	2024-06-15 17:14:09 -04:00
Eric Ciarla	f0d4146b42	Merge branch 'feat/maxDepthRelative' of https://github.com/mendableai/firecrawl into feat/maxDepthRelative	2024-06-15 16:52:00 -04:00
Eric Ciarla	ff7b52cab1	Delete one more e2e test	2024-06-15 16:51:50 -04:00
Eric Ciarla	b1eb608295	Merge branch 'main' into feat/maxDepthRelative	2024-06-15 16:50:27 -04:00
Eric Ciarla	34e37c5671	Add unit tests to replace e2e	2024-06-15 16:43:37 -04:00
Eric Ciarla	2b40729cc2	Update index.test.ts	2024-06-15 08:56:32 -04:00
Eric Ciarla	f22759b2e7	Update index.test.ts	2024-06-14 19:42:11 -04:00
Eric Ciarla	a6b7197737	Fix for maxDepth	2024-06-14 19:40:37 -04:00
Nicolas	4ec863718b	Merge pull request #283 from mendableai/nsc/crawler-fixes ... Fixes crawler getting confused with base paths that contain www.	2024-06-14 13:50:32 -07:00
Nicolas	43767360d8	Merge branch 'main' into nsc/rate-limiter-tests	2024-06-14 13:50:21 -07:00
Nicolas	e88cb314c8	Update crawler.ts	2024-06-14 13:44:54 -07:00
Rafael Miller	361cba4119	Merge pull request #175 from mendableai/test/load-testing ... Test/load testing	2024-06-14 17:39:01 -03:00
Nicolas	7b11ace87d	Create rate-limiter.test.ts	2024-06-14 12:31:42 -07:00
rafaelsideguide	e369d1dd0e	Update index.test.ts	2024-06-14 16:17:54 -03:00
Nicolas	e37aa3db57	Nick: fixed rate limit on status	2024-06-14 12:13:02 -07:00
rafaelsideguide	a6ed2e693f	Update index.test.ts	2024-06-14 15:22:52 -03:00
rafaelsideguide	ad7795f973	Merge remote-tracking branch 'origin/main' into test/load-testing	2024-06-14 15:14:01 -03:00
Rafael Miller	0ec26576d6	Merge pull request #277 from mendableai/feat/maxDepthRelative ... Make maxDepth relative to the entered url	2024-06-14 13:07:23 -03:00
rafaelsideguide	354712a8a3	just changed the name for the test?	2024-06-14 13:02:04 -03:00
Eric Ciarla	2c5f5c0ea2	Merge branch 'main' into feat/maxDepthRelative	2024-06-14 11:49:12 -04:00
Eric Ciarla	80c10393b4	Update index.test.ts	2024-06-14 11:32:30 -04:00
Eric Ciarla	42ed1f4479	Update index.test.ts	2024-06-14 11:20:24 -04:00
Rafael Miller	52d6201c42	Merge pull request #276 from mendableai/feat/issue-266 ... [Feat] Added metadata.pageStatusCode and metadata.pageError properties	2024-06-14 12:19:24 -03:00
Eric Ciarla	8830acce07	Update index.test.ts	2024-06-14 11:11:58 -04:00