scoop by harvard-lil

🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.

updated at Sept. 22, 2024, 12:52 p.m.

7 +0

114 +3

7 +0

monolith by Y2Z

⬛️ CLI tool for saving complete web pages as a single HTML file

updated at Sept. 22, 2024, 12:03 p.m.

61 +0

10,918 +15

315 +2

flameshot by flameshot-org

Powerful yet simple to use screenshot software :desktop_computer: :camera_flash:

updated at Sept. 22, 2024, 6:27 a.m.

208 +0

24,612 +53

1,577 +4

SingleFile by gildas-lormeau

Web Extension for saving a faithful copy of a complete web page in a single HTML file

updated at Sept. 22, 2024, 5:49 a.m.

117 +0

14,847 +50

972 +1

zotero-memento by leonkt

Zotero extension that combats link rot by archiving webpages and journal articles.

updated at Sept. 22, 2024, 1:40 a.m.

7 +0

288 +2

14 +0

badger by dgraph-io

Fast key-value DB in Go.

updated at Sept. 21, 2024, 11:30 p.m.

231 +0

13,793 +29

1,173 +0

ArchiveBox by ArchiveBox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

updated at Sept. 21, 2024, 9:57 p.m.

177 +0

20,927 +136

1,116 +3

wayback by wabarc

An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.

updated at Sept. 21, 2024, 8:33 p.m.

11 +0

1,758 +8

65 +0

chrome-remote-interface by cyrus-and

Chrome Debugging Protocol interface for Node.js

updated at Sept. 21, 2024, 6:04 p.m.

79 -2

4,266 +6

305 +0

dn by dosyago

💾 dn - offline full-text search and archiving for your Chromium-based browser.

updated at Sept. 21, 2024, 2:34 p.m.

42 +0

3,757 +1

142 +0

Squidwarc by N0taN3rd

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

updated at Sept. 21, 2024, 12:51 p.m.

10 +0

167 +1

26 +0

internetarchive by jjjake

A Python and Command-Line Interface to Archive.org

updated at Sept. 21, 2024, 10:32 a.m.

56 +0

1,584 +3

217 +0

browsertrix-crawler by webrecorder

Run a high-fidelity browser-based web archiving crawler in a single Docker container

updated at Sept. 21, 2024, 6:18 a.m.

24 +0

612 +2

79 +0

xdotool by jordansissel

fake keyboard/mouse input, window management, and more

updated at Sept. 20, 2024, 8:59 p.m.

58 +0

3,176 +8

316 +0

browsertrix by webrecorder

Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!

updated at Sept. 20, 2024, 6:53 p.m.

12 +0

170 +4

32 +2

chatnoir-resiliparse by chatnoir-eu

A robust web archive analytics toolkit

updated at Sept. 20, 2024, 1:34 p.m.

9 +0

79 +6

11 +0

archivenow by oduwsdl

A Tool To Push Web Resources Into Web Archives

updated at Sept. 20, 2024, 7:58 a.m.

21 +0

405 +1

42 +0

pywb by webrecorder

Core Python Web Archiving Toolkit for replay and recording of web archives

updated at Sept. 20, 2024, 3:24 a.m.

61 +0

1,362 +1

212 +0

grab-site by ArchiveTeam

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

updated at Sept. 20, 2024, 3:24 a.m.

40 +0

1,339 +4

134 +2

ArchiveSpark by helgeho

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

updated at Sept. 19, 2024, 11:56 a.m.

14 +0

143 +0

19 +0