keyvalue
id42886103
nameRobotsDisallowed
full_namedanielmiessler/RobotsDisallowed
html_urlhttps://github.com/danielmiessler/RobotsDisallowed
descriptionA curated list of the most common and most interesting robots.txt disallowed directories.
created_atSept. 21, 2015, 6:34 p.m.
updated_atMarch 25, 2019, 11:56 p.m.
pushed_atMarch 24, 2019, 7:12 a.m.
size216,083
stargazers_count618
watchers_count50
forks_count170
open_issues0
languageShell