Файл robots.txt

Источник Robots.txt: на сайте http://torg.mail.ru/robots.txt
Содержимое:

User-Agent: *
Disallow: *page=*
Disallow: /go/
Disallow: /sell/
Disallow: /click/
Disallow: /account/
Disallow: /auth
Disallow: /ecb_account/
Disallow: /partners/*
Disallow: /review/edit/*
Disallow: /review/*page=*sort=*
Disallow: /res/*
Disallow: /forum/add/*
Disallow: /client/rating/add/*
Disallow: /user/*
Disallow: /info/
Disallow: /error_msg/
Disallow: /price_index/*/
Disallow: /article/*tab_id=7*
Disallow: /article/*/*cat_id=*
Disallow: /news/*tab_id=7*
Disallow: *search/
Disallow: *p3[*]=*
Disallow: *%*
Disallow: *proc=*
Disallow: *sort=*
Disallow: *order=*
Disallow: *pg=*
Disallow: *way=*
Disallow: *group=*
Disallow: *tab_id2=*
Disallow: *date1=*
Disallow: *date2=*
Disallow: *tmpl=*
Disallow: *sell_id=*
Disallow: *tab_id=*
Disallow: *show_all_market_info=*
Disallow: *fromcontent=*
Disallow: *fromsearch=*
Disallow: *cl_page=*
Disallow: *rw_client_id=*
Disallow: *loglink=*
Disallow: *_openstat*
Disallow: *client_id=*
Disallow: *similar_model_id=*
Disallow: /?csell=*
Disallow: *all/?price=*
Disallow: *pageSize=*
Disallow: *onpage=*
Disallow: *po=*
Disallow: *ayear=*
Disallow: *prev=*
Disallow: *prtnr=*
Disallow: *pid=*
Disallow: *click=*
Disallow: *use_model_name=*
Disallow: *vn_id=*
Disallow: *model_id=*
Disallow: *blok3questions=*
Disallow: *catalog_id=*
Disallow: *iframe=*
Disallow: *width=*
Disallow: *height=*
Disallow: *state=*
Disallow: *sort_id=*
Disallow: *price_from=*
Disallow: *path_id=*
Disallow: *item=*
Disallow: *print=*
Disallow: *review_id=*
Disallow: *review_page=
Disallow: *tagtext=*
Disallow: /trendypeople/*
Disallow: /prochee*
Disallow: /news/*/?cat_id=*

Host: https://torg.mail.ru
Sitemap: https://torg.mail.ru/files/sitemap/https/sitemap_index.xml