Reply to this post | Go Back

View Post [edit]

Poster:	DKL3	Date:	Oct 28, 2015 7:00pm
Forum:	general	Subject:	4chan.org and Subdomain Exclusion

Hi Internet Archive Staff,

I noticed that 4chan and its subdomains were excluded from the Wayback Machine (Sorry. This URL has been excluded from the Wayback Machine.) Is there any particular reason for this? If it's the content on there, then you guys can simply exclude the offending urls but not the site altogether.

But if it was requested by the site owner, then it's his choice on what to do with the site.

Thanks,

DKL3

Reply to this post

Reply [edit]

Poster:	Gameboy Genius (nitro2k01)	Date:	Jan 21, 2016 2:07pm
Forum:	general	Subject:	Re: 4chan.org and Subdomain Exclusion

4chan specified this themselves in their robots.txt file.

https://www.4chan.org/robots.txt