Файл robots.txt

Источник Robots.txt: на сайте http://blackobelisk.ru/robots.txt
Содержимое:

User-agent: *
Disallow: /bitrix/
Disallow: /vote*.php
Disallow: /*.css
Disallow: /*.js
Disallow: /*register=yes
Disallow: /*forgot_password=yes
Disallow: /*login=yes
Disallow: /*auth=yes
Disallow: /*action=ADD2BASKET
Disallow: /*IBLOCK_ID=*
Disallow: /*SECTION_ID=*
Disallow: /*action=ADD_TO_COMPARE_LIST
Disallow: /*action=DELETE_FROM_COMPARE_LIST
Disallow: /*action=BUY
Disallow: /*bitrix_*=
Disallow: /*backurl=*
Disallow: /*BACKURL=*
Disallow: /*back_url=*
Disallow: /*BACK_URL=*
Disallow: /*back_url_admin=*

User-agent: Yandex
Disallow: /bitrix/
Disallow: /*.css
Disallow: /*.js
Disallow: /*register=yes
Disallow: /*forgot_password=yes
Disallow: /*login=yes
Disallow: /*auth=yes
Disallow: /*action=ADD2BASKET
Disallow: /*IBLOCK_ID=*
Disallow: /*SECTION_ID=*
Disallow: /*action=ADD_TO_COMPARE_LIST
Disallow: /*action=DELETE_FROM_COMPARE_LIST
Disallow: /*action=BUY
Disallow: /*bitrix_*=
Disallow: /*backurl=*
Disallow: /*BACKURL=*
Disallow: /*back_url=*
Disallow: /*BACK_URL=*
Disallow: /*back_url_admin=*

User-Agent: MJ12bot
Disallow: /
Disallow: *