飛び先のチェック (ver 0.04) by ぴょん基地の友達
解析
飛び先のURL
http://www.billion.co.jp/robots.txt
code = 200
base = http://www.billion.co.jp/robots.txt
body =
User-Agent: *
Disallow: /Demo/
Disallow: /Documentation/
Disallow: /gif/
Disallow: /GIFDATA/
Disallow: /IBJC/
Disallow: /img/
Disallow: /images/
Disallow: /Infomation/
Disallow: /Instance/
Disallow: /logs/
Disallow: /PNFIconGraphics/
Disallow: /ton/
Disallow: /ton9/
Disallow: /Tools & Examples/
Disallow: /Sites/
Disallow: /atest.pl