mirror of
https://github.com/mendableai/firecrawl.git
synced 2024-11-16 11:42:24 +08:00
ad3e73b445
Bumps the prod-deps group in /apps/test-suite with 6 updates: | Package | From | To | | --- | --- | --- | | [@anthropic-ai/sdk](https://github.com/anthropics/anthropic-sdk-typescript) | `0.20.8` | `0.24.3` | | [@dqbd/tiktoken](https://github.com/dqbd/tiktoken) | `1.0.14` | `1.0.15` | | [@supabase/supabase-js](https://github.com/supabase/supabase-js) | `2.43.1` | `2.44.2` | | [openai](https://github.com/openai/openai-node) | `4.40.2` | `4.52.2` | | [playwright](https://github.com/microsoft/playwright) | `1.43.1` | `1.45.0` | | [ts-jest](https://github.com/kulshekhar/ts-jest) | `29.1.2` | `29.1.5` | Updates `@anthropic-ai/sdk` from 0.20.8 to 0.24.3 - [Release notes](https://github.com/anthropics/anthropic-sdk-typescript/releases) - [Changelog](https://github.com/anthropics/anthropic-sdk-typescript/blob/main/CHANGELOG.md) - [Commits](https://github.com/anthropics/anthropic-sdk-typescript/compare/sdk-v0.20.8...sdk-v0.24.3) Updates `@dqbd/tiktoken` from 1.0.14 to 1.0.15 - [Release notes](https://github.com/dqbd/tiktoken/releases) - [Changelog](https://github.com/dqbd/tiktoken/blob/main/CHANGELOG.md) - [Commits](https://github.com/dqbd/tiktoken/compare/@dqbd/tiktoken@1.0.14...@dqbd/tiktoken@1.0.15) Updates `@supabase/supabase-js` from 2.43.1 to 2.44.2 - [Release notes](https://github.com/supabase/supabase-js/releases) - [Changelog](https://github.com/supabase/supabase-js/blob/master/RELEASE.md) - [Commits](https://github.com/supabase/supabase-js/compare/v2.43.1...v2.44.2) Updates `openai` from 4.40.2 to 4.52.2 - [Release notes](https://github.com/openai/openai-node/releases) - [Changelog](https://github.com/openai/openai-node/blob/master/CHANGELOG.md) - [Commits](https://github.com/openai/openai-node/compare/v4.40.2...v4.52.2) Updates `playwright` from 1.43.1 to 1.45.0 - [Release notes](https://github.com/microsoft/playwright/releases) - [Commits](https://github.com/microsoft/playwright/compare/v1.43.1...v1.45.0) Updates `ts-jest` from 29.1.2 to 29.1.5 - [Release notes](https://github.com/kulshekhar/ts-jest/releases) - [Changelog](https://github.com/kulshekhar/ts-jest/blob/main/CHANGELOG.md) - [Commits](https://github.com/kulshekhar/ts-jest/compare/v29.1.2...v29.1.5) --- updated-dependencies: - dependency-name: "@anthropic-ai/sdk" dependency-type: direct:production update-type: version-update:semver-minor dependency-group: prod-deps - dependency-name: "@dqbd/tiktoken" dependency-type: direct:production update-type: version-update:semver-patch dependency-group: prod-deps - dependency-name: "@supabase/supabase-js" dependency-type: direct:production update-type: version-update:semver-minor dependency-group: prod-deps - dependency-name: openai dependency-type: direct:production update-type: version-update:semver-minor dependency-group: prod-deps - dependency-name: playwright dependency-type: direct:production update-type: version-update:semver-minor dependency-group: prod-deps - dependency-name: ts-jest dependency-type: direct:production update-type: version-update:semver-patch dependency-group: prod-deps ... Signed-off-by: dependabot[bot] <support@github.com> |
||
|---|---|---|
| .. | ||
| data | ||
| load-test-results | ||
| tests | ||
| utils | ||
| .env.example | ||
| jest.config.js | ||
| jest.setup.js | ||
| load-test.yml | ||
| package.json | ||
| pnpm-lock.yaml | ||
| README.md | ||
| tsconfig.json | ||
Test Suite for Firecrawl
This document provides an overview of the test suite for the Firecrawl project. It includes instructions on how to run the tests and interpret the results.
Overview
The test suite is designed to ensure the reliability and performance of the Firecrawl system. It includes a series of automated tests that check various functionalities and performance metrics.
Running the Tests
To run the tests, navigate to the test-suite directory and execute the following command:
npm install
npx playwright install
npm run test
Running Load Tests with Artillery
To run load tests using Artillery, follow these steps:
- Install Artillery globally if you haven't already:
npm install -g artillery
- Run the load test:
artillery run load-test.yml
Test Results
The tests are designed to cover various aspects of the system, including:
- Crawling accuracy
- Response time
- Error handling
Example Test Case
- Test Name: Accuracy Test
- Description: This test checks the accuracy of the scraping mechanism with 100 pages and a fuzzy threshold of 0.8.
- Expected Result: Accuracy >= 0.9
- Received Result: Accuracy between 0.2 and 0.3
Troubleshooting
If you encounter any failures or unexpected results, please check the following:
- Ensure your network connection is stable.
- Verify that all dependencies are correctly installed.
- Review the error logs for any specific error messages.
Contributing
Contributions to the test suite are welcome. Please refer to the project's main CONTRIBUTING.md file for guidelines on how to contribute.