warc-safe by natliblux

A tool for detecting viruses and NSFW material in WARC files

created at May 3, 2024, 6:24 a.m.

NEW!

4 +0

5 +0

0 +0

scoop by harvard-lil

🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.

created at Sept. 20, 2022, 6:50 p.m.

7 -1

100 +1

5 +1

WarcDB by Florents-Tselai

WarcDB: Web crawl data as SQLite databases.

created at May 29, 2022, 11:09 a.m.

10 -1

384 +0

11 +0

arch by internetarchive

Web application for distributed compute analysis of Archive-It web archive collections.

created at April 28, 2022, 3:18 p.m.

19 +0

13 +0

4 +0

Sparkling by internetarchive

Internet Archive's Sparkling Data Processing Library

created at April 28, 2022, 2:28 p.m.

17 +0

10 +0

2 +0

web-archiving-course by vphill

Web Archiving Course

created at Feb. 22, 2022, 2:33 a.m.

1 +0

19 +0

6 +0

unwarcit by emmadickson

None

created at Dec. 11, 2021, 7:19 p.m.

5 +0

6 +0

0 +0

warc2html by iipc

Converts WARC files to static HTML

created at Nov. 8, 2021, 4:09 a.m.

10 +0

38 +0

3 +0

browsertrix by webrecorder

Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!

created at June 28, 2021, 10:46 p.m.

10 +0

127 +3

26 +0

Zotero-Robust-Links-Extension by lanl

Create Robust Links from within Zotero

created at June 28, 2021, 9:38 p.m.

3 +0

17 +0

2 +0

chatnoir-resiliparse by chatnoir-eu

A robust web archive analytics toolkit

created at June 22, 2021, 9:03 a.m.

9 +0

44 +2

8 +0

playback by wabarc

Playback webpages from Wayback Machine

created at April 8, 2021, 2:21 p.m.

4 +0

6 +0

1 +0

gowarcserver by nlnwa

None

created at Jan. 15, 2021, 10:42 a.m.

7 +0

12 +0

1 +0

auto-archiver by bellingcat

Automatically archive links to videos, images, and social media content from Google Sheets (and more).

created at Jan. 15, 2021, 10:30 a.m.

19 +0

474 +4

53 +0

browsertrix-crawler by webrecorder

Run a high-fidelity browser-based crawler in a single Docker container

created at Nov. 2, 2020, 4:37 a.m.

23 +0

551 +4

69 +1

cairn by wabarc

NPM package and CLI tool for saving web page as single HTML file

created at Oct. 8, 2020, 7:18 a.m.

4 +0

37 +0

2 +0

wayback by wabarc

An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, IPFS, Telegraph, and file systems.

created at June 13, 2020, 10:08 a.m.

9 -2

1,658 +8

59 -1

waybackpy by akamhy

Wayback Machine API interface & a command-line tool

created at May 2, 2020, 9:19 a.m.

10 +0

435 +2

33 +0

obelisk by go-shiori

Go package and CLI tool for saving web page as single HTML file

created at March 29, 2020, 12:53 a.m.

11 +0

241 +3

15 +0

DownloadNet by dosyago

💾 DownloadNet - All content you browse online available offline. Search through the full-text of all pages in your browser history. ⭐️ Star to support our work!

created at Dec. 20, 2019, 9:47 a.m.

42 +0

3,654 +4

137 +0