Host: archive.ph

User-agent: *
Crawl-delay: 2
Allow: /
Disallow: /faq.html$
Disallow: /*.xml$
Allow: /*sitemap*.xml$
Disallow: /*/abuse$
Disallow: /*/share$
Disallow: /*/image$
Disallow: /download/
Disallow: /link:
Disallow: /timegate/
Disallow: /timemap/