WarcDB: Web crawl data as SQLite databases.
created at May 29, 2022, 11:09 a.m.
A commandline tool and Python library for archiving data from Facebook using the Graph API.
created at Feb. 14, 2017, 11:45 p.m.
A Rails engine supporting the discovery of web archives.
created at Aug. 3, 2017, 5:45 p.m.
Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
created at March 9, 2015, 8:32 p.m.
A dockerized, queued high fidelity web archiver based on Squidwarc
created at July 21, 2018, 8:31 a.m.
A robust web archive analytics toolkit
created at June 22, 2021, 9:03 a.m.
A list of things related to software, literature, and other content for 🕣 Memento
created at Sept. 16, 2016, 1:33 a.m.
Various Jupyter notebooks about Common Crawl data
created at July 19, 2019, 11:38 a.m.
🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.
created at Sept. 20, 2022, 6:50 p.m.