Web-Sniffer 1.0.28 by Lingo4you - Sprachen Online Lernen

View HTTP Request and Response Header

For more information on HTTP see RFC 2616

HTTP(S)-URL: (IDN allowed)

HTTP version:

• Request type:

HTTP Request Header

Connect to 216.143.70.108 on port 80 ... ok

GET /robots.txt HTTP/1.1[CRLF]
Host: www.siteadvisor.com[CRLF]
Connection: close[CRLF]
Accept-Charset: ISO-8859-1,UTF-8;q=0.7,*;q=0.7[CRLF]
Cache-Control: no[CRLF]
Accept-Language: de,en;q=0.7,en-us;q=0.3[CRLF]
Referer: http://web-sniffer.net/[CRLF]
[CRLF]

HTTP Response Header

NameValueDelim
HTTP Status Code: HTTP/1.1 200 OK
Date:Fri, 31 Oct 2008 06:57:46 GMT
Server:Apache
Last-Modified:Wed, 09 Jul 2008 02:03:21 GMT
ETag:"ad80bc-167-b6812c40"
Accept-Ranges:bytes
Content-Length:359
Connection:close
Content-Type:text/plain

Content (0.35 KiB)

User-agent: Googlebot
Disallow: /cgi-bin/

User-agent: Slurp
Disallow: /cgi-bin/

User-agent: Yahoo-NewsCrawler
Disallow: /cgi-bin/

User-agent: msnbot
Disallow: /cgi-bin/

User-agent: Teoma
Disallow: /cgi-bin/

User-agent: *
Disallow: /cgi-bin/
Disallow: /sites/
Disallow: /dynamic/
Disallow: /lookup/
Disallow: /reports/
Disallow: /dossiers/
Disallow: /map/