grab-site in iipc/awesome-web-archiving

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

created at Feb. 5, 2015, 5:01 a.m.

40 +0

1,398 +4

135 +0

wpull in iipc/awesome-web-archiving

Wget-compatible web downloader and crawler.

created at Dec. 7, 2013, 1:03 p.m.

23 +0

557 +2

77 +0