Файл robots.txt

Источник Robots.txt: на сайте http://idamag.ru/robots.txt на момент обработки проекта.

User-agent: *
Disallow: /*sort
Disallow: /*available
Disallow: /*search
Disallow: /*offerid
Disallow: /*newscategory
Disallow: /*shoppingcart
Disallow: /*sendrequestonproduct
Disallow: /*wishlist
Disallow: /*Password
Disallow: /*registration
Disallow: /*login
Disallow: /*subscribedeactivate
Disallow: *?brand=*
Disallow: /*indepth
Disallow: /*compareproducts
Disallow: /*oldBrowser
Disallow: /fogotpassword
Disallow: /forgotpassword
Disallow: /compare
Disallow: /myaccount
Disallow: /checkout
Disallow: /registration
Disallow: /cart
Disallow: /wishlist
Disallow: /checkout/billing
Disallow: /preorder
Disallow: /login
Disallow: /*redirectTo=*

User-agent: Yandex
Disallow: /*sort
Disallow: /*available
Disallow: /*search
Disallow: /*offerid
Disallow: /*newscategory
Disallow: /*shoppingcart
Disallow: /*sendrequestonproduct
Disallow: /*wishlist
Disallow: /*Password
Disallow: /*registration
Disallow: /*login
Disallow: /*subscribedeactivate
Disallow: *?brand=*
Disallow: /*indepth
Disallow: /*compareproducts
Disallow: /*oldBrowser
Disallow: /fogotpassword
Disallow: /forgotpassword
Disallow: /compare
Disallow: /myaccount
Disallow: /checkout
Disallow: /registration
Disallow: /cart
Disallow: /wishlist
Disallow: /checkout/billing
Disallow: /preorder
Disallow: /login
Disallow: /*redirectTo=*
Host: https://idamag.ru

Sitemap: https://idamag.ru/sitemap.xml