Skip to Content

Text File

URL: http://esvai.ru/robots.txt
HTTP Status: 200 OK
MIME Type: text/plain
Last Modified: Mon, 01 Jan 1601 00:00:00 GMT
Download Time: Less than a second
Cookies: None
Size: 1 KB
HTTP Headers:  5 headers
Links In:  0 pages
Links Out:  0 links
Images:  0 images
CSS:  0 files
JavaScript:  0 files
OK Issues: No issues found

1User-agent: *

2Disallow: /my/

3Disallow: /thumb/*/d/fgs16_*

4Disallow: /d/fgs16_*

5Disallow: /thumb/*/d/tpl25_*

6Disallow: /d/tpl25_*

7Disallow: /thumb/*/d/stp25_*

8Disallow: /d/stp25_*

9Sitemap: https://esvai.ru/sitemap.5201492.xml.gz

10Clean-param: etext

11

12User-Agent: Yandex

13Allow: /

14Disallow: /my/

15Disallow: /thumb/*/d/fgs16_*

16Disallow: /d/fgs16_*

17Disallow: /thumb/*/d/tpl25_*

18Disallow: /d/tpl25_*

19Disallow: /thumb/*/d/stp25_*

20Disallow: /d/stp25_*

21Host: https://esvai.ru

22Sitemap: https://esvai.ru/sitemap.5201492.xml.gz

23Clean-param: etext

24User-agent: msnbot

25Crawl-delay: 10

26

27User-agent: MJ12bot

28Disallow: /

29

30User-agent: AhrefsBot

31Disallow: /

32

33User-agent: SemrushBot

34Disallow: /

35

36User-agent: SemrushBot-SA

37Disallow: /

38

39User-agent: DotBot

40Disallow: /

...

</html>