Файл robots.txt

Источник Robots.txt: на сайте http://vidkupe.ru/robots.txt на момент обработки проекта.

User-agent: *
Allow: /images/
Disallow: /*mailto*
Disallow: /*start*
Disallow: /search/
Disallow: /*.pdf
Disallow: /*print=1
Disallow: /*pop=
Disallow: /*format=
Disallow: /*type=atom
Disallow: /*type=rss
Disallow: /*task=rss
Disallow: /*?*
Disallow: /index.php*
Disallow: /*%
Disallow: /*&
Disallow: /*tag
Disallow: /*item*
Disallow: /*category

User-agent: Googlebot
Allow: *.css
Allow: *.js
Allow: /images/
Disallow: /*mailto*
Disallow: /*start*
Disallow: /search/
Disallow: /*.pdf
Disallow: /*print=1
Disallow: /*pop=
Disallow: /*format=
Disallow: /*type=atom
Disallow: /*type=rss
Disallow: /*task=rss
Disallow: /*?*
Disallow: /index.php*
Disallow: /*%
Disallow: /*&
Disallow: /*tag
Disallow: /*item*
Disallow: /*category

User-agent: Yandex
Allow: /images/
Disallow: /*mailto*
Disallow: /*start*
Disallow: /search/
Disallow: /*.pdf
Disallow: /*print=1
Disallow: /*pop=
Disallow: /*format=
Disallow: /*type=atom
Disallow: /*type=rss
Disallow: /*task=rss
Disallow: /*?*
Disallow: /index.php*
Disallow: /*%
Disallow: /*&
Disallow: /*tag
Disallow: /*item*
Disallow: /*category
Sitemap: https://vidkupe.ru/sitemap.xml