playback by wabarc

Playback webpages from Wayback Machine

created at April 8, 2021, 2:21 p.m.

4 +0

6 +0

1 +0

browsertrix-crawler by webrecorder

Run a high-fidelity browser-based crawler in a single Docker container

created at Nov. 2, 2020, 4:37 a.m.

25 +0

576 +4

71 +0

warcprox by internetarchive

WARC writing MITM HTTP/S proxy

created at Oct. 25, 2013, 11:27 p.m.

33 +0

368 +1

54 +0

Zotero-Robust-Links-Extension by lanl

Create Robust Links from within Zotero

created at June 28, 2021, 9:38 p.m.

3 +0

17 +0

2 +0

zotero-memento by leonkt

Zotero extension that combats link rot by archiving webpages and journal articles.

created at Aug. 29, 2019, 5:51 p.m.

7 +0

278 +0

15 +0

gowarcserver by nlnwa

None

created at Jan. 15, 2021, 10:42 a.m.

7 +0

12 +0

1 +0

wayback by wabarc

An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, IPFS, Telegraph, and file systems.

created at June 13, 2020, 10:08 a.m.

9 +0

1,692 +7

62 -1

warc2html by iipc

Converts WARC files to static HTML

created at Nov. 8, 2021, 4:09 a.m.

10 +0

38 +0

3 +0

chatnoir-resiliparse by chatnoir-eu

A robust web archive analytics toolkit

created at June 22, 2021, 9:03 a.m.

9 +0

49 +1

8 +0

unwarcit by emmadickson

None

created at Dec. 11, 2021, 7:19 p.m.

5 +0

7 +1

0 +0

waybackpy by akamhy

Wayback Machine API interface & a command-line tool

created at May 2, 2020, 9:19 a.m.

10 +0

447 +2

32 +0

web-archiving-course by vphill

Web Archiving Course

created at Feb. 22, 2022, 2:33 a.m.

1 +0

19 +0

6 +0

Sparkling by internetarchive

Internet Archive's Sparkling Data Processing Library

created at April 28, 2022, 2:28 p.m.

17 +0

10 +0

2 +0

arch by internetarchive

Web application for distributed compute analysis of Archive-It web archive collections.

created at April 28, 2022, 3:18 p.m.

19 +0

13 +0

4 +0

auto-archiver by bellingcat

Automatically archive links to videos, images, and social media content from Google Sheets (and more).

created at Jan. 15, 2021, 10:30 a.m.

20 +0

486 +3

53 +0

warcrefs by arcalex

Web archive deduplication tools

created at April 22, 2014, 8:02 a.m.

5 +0

6 +0

1 +0

scoop by harvard-lil

🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.

created at Sept. 20, 2022, 6:50 p.m.

7 +0

104 +2

5 +0

crau by turicas

Easy-to-use Web archiver

created at Oct. 26, 2019, 7:21 p.m.

4 +0

55 +1

9 +0

gogetcrawl by karust

Extract web archive data using Wayback Machine and Common Crawl

created at June 14, 2019, 7:02 p.m.

5 +0

135 +0

15 +0

cc-notebooks by commoncrawl

Various Jupyter notebooks about Common Crawl data

created at July 19, 2019, 11:38 a.m.

16 +0

40 +0

8 +0