Commit Graph

2068 Commits

Author SHA1 Message Date
Nicolas
66e505317e Merge branch 'main' into mog/bulk-scrape 2024-10-23 14:36:26 -03:00
Nicolas
e0d3b761fc
Merge pull request #808 from mendableai/feat/skipTlsVerification
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
feat: skipTlsVerification
2024-10-22 20:47:13 -03:00
Nicolas
7432f25523
Merge pull request #807 from mendableai/mog/acuc-cache-clear
feat: clear ACUC cache endpoint based on team ID
2024-10-22 20:43:18 -03:00
Nicolas
d375bca167 Update acuc-cache-clear.ts 2024-10-22 20:42:59 -03:00
Thomas Kosmas
acde353e56 skipTlsVerification on robots.txt scraping 2024-10-23 01:07:03 +03:00
Thomas Kosmas
bd55464b52 skipTlsVerification 2024-10-22 22:28:02 +03:00
Gergő Móricz
6ed3104eb6 feat: clear ACUC cache endpoint based on team ID 2024-10-22 20:28:10 +02:00
Gergő Móricz
3cd328cf93 feat(bulk/scrape): add node and python SDK integration + docs 2024-10-22 18:58:48 +02:00
Nicolas
76c0073829 Nick: grok 2 example
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
2024-10-21 16:27:15 -03:00
Nicolas
d2344aa14b Revert "Nick: improved map ranking algorithm"
This reverts commit 7acd8d2edb.
2024-10-21 16:11:32 -03:00
Eric Ciarla
edac6850c6
Merge pull request #797 from rishi-raj-jain/patch-2
examples: sales web crawler
2024-10-21 12:05:00 -04:00
Eric Ciarla
22d375ad29 Updates 2024-10-21 12:01:09 -04:00
Nicolas
9ab922837c
Merge pull request #796 from mendableai/fix/issue-663
[BUG-SDK] missing error in response
2024-10-21 12:24:57 -03:00
Nicolas
d31b85fa91
Merge pull request #793 from mendableai/fix/issue-665
[Bug] encoding error for special token
2024-10-21 12:24:46 -03:00
Nicolas
9a2658768e
Merge pull request #799 from Mefisto04/contribute
Fix Typos and Grammar in `SELF_HOST.md`
2024-10-21 12:23:56 -03:00
Nicolas
e1d8e1584e
Update SELF_HOST.md 2024-10-21 12:23:27 -03:00
Nicolas
209bbd1346
Merge pull request #798 from mendableai/nsc/improved-map-search
Improved /map ranking algorithm for search queries
2024-10-21 12:22:19 -03:00
Rishi Raj Jain
cf98d69bbb
Update requirements.txt 2024-10-20 18:09:38 +05:30
Rishi Raj Jain
d113199a29
Update app.py 2024-10-20 18:08:38 +05:30
Mayur Kawale
2b0c52ff67
Update SELF_HOST.md 2024-10-20 12:33:45 +05:30
Nicolas
7acd8d2edb Nick: improved map ranking algorithm 2024-10-19 13:27:47 -03:00
Rishi Raj Jain
8a4ee4482d
Create output_01f6efd5-1297-4745-94b5-5972c10f17d6.json 2024-10-19 03:54:14 +05:30
Rishi Raj Jain
42ec08c76e
Update websites.csv 2024-10-19 03:53:41 +05:30
Rishi Raj Jain
7d8519218a
Update app.py 2024-10-19 02:27:39 +05:30
Rishi Raj Jain
2022db7f0a
Update websites.csv 2024-10-19 02:27:25 +05:30
Rishi Raj Jain
f5af938ea2
Update requirements.txt 2024-10-19 02:27:17 +05:30
Rishi Raj Jain
ba3ee8ead6
Create .env.example 2024-10-19 00:52:47 +05:30
Rishi Raj Jain
adfc493c9b
Create websites.csv 2024-10-19 00:52:26 +05:30
Rishi Raj Jain
11fd630e55
Create requirements.txt 2024-10-19 00:52:14 +05:30
Rishi Raj Jain
10381b5d3c
Create app.py 2024-10-19 00:51:18 +05:30
rafaelsideguide
18f69c90b1 fix/missing error in response 2024-10-18 15:18:57 -03:00
rafaelsideguide
aed11e72a6 fix encoding if error 2024-10-18 11:50:58 -03:00
Eric Ciarla
6ebfcc85cf
Merge pull request #790 from rishi-raj-jain/patch-1
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
Update requirements.txt
2024-10-18 10:19:33 -04:00
Nicolas
79e65f31ef Update v1.ts
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
2024-10-17 17:57:44 -03:00
Rishi Raj Jain
7d8df7d53b
Update requirements.txt 2024-10-18 02:11:15 +05:30
Rishi Raj Jain
a110fdeb85
Update requirements.txt 2024-10-18 02:10:39 +05:30
Eric Ciarla
dff71a8179 Delete README.md 2024-10-17 15:48:36 -04:00
Eric Ciarla
5f69358ce8 Swarm Extractor Example 2024-10-17 15:47:28 -04:00
Gergő Móricz
03b37998fd feat: bulk scrape 2024-10-17 19:40:18 +02:00
Nicolas
081d7407b3
Merge pull request #788 from mendableai/nsc/log-extractpr-options
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Extractor options logging v1 fix
2024-10-16 23:51:22 -03:00
Nicolas
06b8d24a4c Update scrape.ts 2024-10-16 23:50:21 -03:00
Nicolas
a73b06589c
Merge pull request #785 from mendableai/nsc/support-for-all-metadata
Return all the website metadata
2024-10-16 23:37:26 -03:00
Nicolas
2ac50a16f5 Update metadata.ts 2024-10-16 23:37:07 -03:00
Nicolas
8974230db4 Nick: formatting + error handling 2024-10-16 23:35:03 -03:00
Nicolas
c0384ea381 Nick: added tests 2024-10-16 23:32:44 -03:00
Nicolas
417c7697c3 Update metadata.ts 2024-10-16 23:26:46 -03:00
Nicolas
ff906f7750 Update excludeTags.ts
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
2024-10-16 13:40:34 -03:00
Nicolas
2c1a98f019 Update excludeTags.ts 2024-10-16 13:37:40 -03:00
Nicolas
cf8fe93281 Update credit_billing.ts
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
2024-10-16 01:09:57 -03:00
Nicolas
e5a5ca2446 Update credit_billing.ts 2024-10-16 01:06:10 -03:00