[Skip to Content]

Text File

URL: http://www.crunchyroll.com/robots.txt
HTTP Status: 200 OK
MIME Type: text/plain
Last Modified: Fri, 21 Mar 2014 02:44:59 GMT
Download Time: Less than a second
Cookies: None
Size: 1 KB
HTTP Headers: View Headers 6 headers
Links In: View Links 0 pages
Links Out: View Links 0 links
Images: View Images 0 images
CSS: View CSS Files 0 files
JavaScript: View JavaScript Files 0 files
  
OK Issues: No issues found
sitemap: http://www.crunchyroll.com/sitemap
User-agent: *
Disallow: /showtag
Disallow: /search
Disallow: /facebook
Disallow: /css/
Disallow: /js/
Disallow: /ajax/
Disallow: /files/
Disallow: /captchas/
Disallow: /tmp/
Disallow: /flash/
Disallow: /server/
Disallow: /sitedown/
Disallow: /ads/
Disallow: /status/
Disallow: /client/
Disallow: /common/
Disallow: /getitem
Disallow: /user