grab-site in iipc/awesome-web-archiving

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

created at Feb. 5, 2015, 5:01 a.m.

Python

40 +0

1,398 +4

135 +0

GitHub