Файл robots.txt

Источник Robots.txt: на сайте http://eg-online.ru/robots.txt
Содержимое:

User-agent: Yandex
Disallow: /product/article2pay.php*
Disallow: */?*
Disallow: /product/dos/*
Disallow: /product/bp/*
Disallow: /product/ks/*
Disallow: /product/vpk/*
Disallow: /product/eg/*
Allow: /product/all/*
Disallow: /admin/
Disallow: /personal/
Disallow: /search/
Disallow: /bitrix/
Disallow: /rating/
Disallow: /my/
Disallow: *search.php
Disallow: /tools/
Disallow: /transactions/
Allow: /bitrix/cache/
Allow: /bitrix/js/
Allow: /bitrix/templates/
Allow: /bitrix/panel/
Allow: /bitrix/components/
Allow: /bitrix/tools/
Allow: /bitrix/images/
Host: https://www.eg-online.ru

User-agent: Googlebot
Disallow: *?bxrand*
Disallow: /product/article2pay.php*
Disallow: */?*
Disallow: /product/dos/*
Disallow: /product/bp/*
Disallow: /product/ks/*
Disallow: /product/vpk/*
Disallow: /product/eg/*
Allow: /product/all/*
Disallow: /admin/
Disallow: /m/
Disallow: /mobile/
Disallow: /personal/
Disallow: /search/
Disallow: /bitrix/
Disallow: /rating/
Disallow: /my/
Disallow: *search.php
Disallow: /tools/
Disallow: /transactions/
Allow: /bitrix/cache/
Allow: /bitrix/js/
Allow: /bitrix/templates/
Allow: /bitrix/panel/
Allow: /bitrix/components/
Allow: /bitrix/tools/
Allow: /bitrix/images/

User-agent: *
Disallow: /product/article2pay.php*
Disallow: */?*
Disallow: /product/dos/*
Disallow: /product/bp/*
Disallow: /product/ks/*
Disallow: /product/vpk/*
Disallow: /product/eg/*
Allow: /product/all/*
Disallow: /admin/
Disallow: /personal/
Disallow: /search/
Disallow: /bitrix/
Disallow: /rating/
Disallow: /my/
Disallow: *search.php
Disallow: /tools/
Disallow: /transactions/
Allow: /bitrix/cache/
Allow: /bitrix/js/
Allow: /bitrix/templates/
Allow: /bitrix/panel/
Allow: /bitrix/components/
Allow: /bitrix/tools/
Allow: /bitrix/images/

Sitemap: https://www.eg-online.ru/sitemap.xml