[Skip to Content]

Text File

URL: http://www.pahl-4u.de/robots.txt
HTTP Status: 200 OK
MIME Type: text/plain
Last Modified: Tue, 24 Dec 2013 16:42:18 GMT
Download Time: Less than a second
Cookies: None
Size: 1 KB
HTTP Headers: View Headers 9 headers
Links In: View Links 0 pages
Links Out: View Links 0 links
Images: View Images 0 images
CSS: View CSS Files 0 files
JavaScript: View JavaScript Files 0 files
  
OK Issues: No issues found

1# http://www.pahl-4u.de/robots.txt

2

3User-agent: ia_archiver

4Disallow:

5

6

7# Das gilt für alle Crawler - bei mehreren Anweisungen muss die Wild-Card * letzte sein

8User-agent: *

9Disallow:

10

11

12# ------------------ Sitemaps -------------------------- #

13#

14Sitemap: http://www.pahl-4u.de/sitemap.xml

15Sitemap: http://www.pahl-4u.de/sitemap/sitemap.html

16Sitemap: http://www.pahl-4u.de/imagemap.xml

17#

18# ----------------------------------------------------- #

19

20

21