aut by archivesunleashed

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

updated at June 21, 2024, 9:23 p.m.

15 +0

135 +1

33 +0

arch by internetarchive

Web application for distributed compute analysis of Archive-It web archive collections.

updated at June 17, 2024, 9:16 p.m.

19 +0

13 +0

4 +0

ArchiveSpark by helgeho

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

updated at June 12, 2024, 4:19 p.m.

14 +0

143 +0

19 +0

Sparkling by internetarchive

Internet Archive's Sparkling Data Processing Library

updated at June 5, 2024, 8:32 p.m.

17 +0

10 +0

2 +0

Web2Warc by helgeho

An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)

updated at Oct. 22, 2023, 8:37 p.m.

3 +0

24 +0

4 +0

twut by archivesunleashed

An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.

updated at June 12, 2023, 7:59 a.m.

4 +0

9 +0

2 +0