Product · Archive
Capture the web as WARC. Extract it. Replay it.
Save pages to standard web-archive files. Run extraction over archives at volume. Replay any record as a single audit file. Keep the exact bytes you read.
See it work
Try it from wherever you work.
1webfold capture https://example.com -o example.warc.gz --tlp AMBER --retention-days 365
2webfold warc example.warc.gz
3webfold replay example.warc.gz --out replay.html
What you get
What Archive does.
Standard archive files
WARC with a CDX index, including request, response and metadata records.
Extraction at volume
Run clean-text extraction over a Common Crawl-scale archive with a thread count you choose.
Replay as one file
Join each record's raw HTML with its extracted text into a single HTML audit artefact.
Handling labels
Mark captures with a traffic-light protocol level and a retention period.
How it works
Three steps.
- 1
Capture
Fetch through the native backend into WARC and CDX.
- 2
Extract
Run extraction across the archive.
- 3
Replay
Open a record as an audit file.
Limits up front.
Know the limits
- Throughput figures depend on configuration. See the Archive benchmark for each one.
- Tor is not available in the main binary.
Keep reading.
FAQ
Questions.
Why keep the raw bytes?
So you can show exactly what a page said when you read it, for audit and evidence.
Use Archive with Webfold.
Run the command-line tool today. Join the waitlist for the hosted API.