Benchmark · Directional
Footprint of a scrape or crawl
One Webfold scrape took 90 ms with 14.9 MB of peak memory. A local 50-page crawl ran about 11.7 times faster than Crawl4AI 0.9.3. That is 90.6 against 8.2 documents a second. Both figures are directional.
Memory for one scrape. Speed on a local crawl against Crawl4AI.
What question does this benchmark ask?
How light is Webfold to run? How does it compare with a Python crawler on a local test?
How was it run?
- Single scrape and headless run: one 16-core Linux host, directional.
- Local HTTP crawl: 5 repeats of 50 pages against Crawl4AI 0.9.3, no network involved.
What are the results?
Peak memory, megabytesShorter is better
Idle headless instance
5.5 MB
One-shot headless run
7.1 MB
Single scrape
14.9 MB
Local crawl, documents per secondLonger is better
Webfold
90.6
Crawl4AI 0.9.3
8.2
| Measurement | Result |
|---|---|
| Single scrape, peak memory | 14.9 MB |
| Single scrape, wall time | 90 ms |
| One-shot headless run, peak memory | 7.1 MB |
| Idle headless instance | about 5.5 MB |
| Local crawl vs Crawl4AI, paired median | about 11.7 times faster |
| Local crawl memory, sampled | 27,284 KiB vs 120,124 KiB |
Webfold is small enough to run beside an application or in a short-lived job.
What does this not show?
Know the limits
- Directional: one host, not a standard instance, and a marker-smoke check for quality in the crawl comparison.
- These figures do not cover coverage, cost or whole-service latency.
Which other benchmarks are there?
- HTML to Markdown conversion Measured
- Document conversion Measured
- Main-content extraction quality Measured
- Web archive extraction Measured
- PII detection against Presidio Measured
- Localisation extraction Directional
- PDF text extraction with OCR Directional
- PDF extraction against other extractors Directional
- LaTeX conversion with BibTeX Directional
- A whole site to Markdown Directional
- Agent-browser compatibility (Lexbench) Measured
- Headless engine over CDP Directional
- Search-results parsing Directional
- Folder search Directional
Check it on your own pages.
Run the command-line tool on your content.