Warqube

Quality assurance, validation and analysis tooling for web archives.

Warqube - coming soon!

About Warqube

Warqube analyses your WARC files and presents the results in a local dashboard webapp. Warqube is build in R programming language with some Python and SQL thrown in. It uses JHOVE for valdiation and characterisation, WARCIO for indexing the content and pywb for playback. Under the hood it uses DuckDB as an analytical processing database. The data is stored in a .duckdb file for reuse in later sessions.

Features

WARC validation
Policy checking
Pywb playback
PII detection