Файл robots.txt

Источник Robots.txt: на сайте http://net-agenta.ru/robots.txt
Содержимое:

User-agent: *
Allow: /$
Disallow: /administrator/
Disallow: /cache/
Allow: /components/com_adv/assets/css
Disallow: /components/
Disallow: /component/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Allow: /media/system/css
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Allow: /templates/system/css
Allow: /templates/net_agenta/css
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
Disallow: /edit/
Disallow: /edit*
Disallow: /*unsubscribe*
Disallow: /index.php*
Disallow: /*PHPSESSID*
Disallow: /*exchange*
Disallow: /*msk_and_mo*
Disallow: /*service*
Disallow: /*?sitelink*
Disallow: /*metroid*
Disallow: /*elitnye*
Disallow: /*moscow.html*
Disallow: /*kompleksy*
Disallow: /*poselki*
Disallow: /*akvroom*
Disallow: /*acom-other*
Disallow: /*acom-free*
Disallow: /*acom-ofis*
Disallow: /*acom-sklad*
Disallow: /*acom-production*
Disallow: /*aforeign-flat*
Disallow: /*aforeign-house*
Disallow: /*aforeign-sector*
Disallow: /*asuburban-house*
Disallow: /*agarage*
Disallow: /*aposutochno*
Disallow: /*aother*
Disallow: /*atorg*
Disallow: /*agent.html$
Disallow: /*com/rent*
Disallow: /*kvartiri/$
Disallow: /*kvartiri/offers.html$
Disallow: /*hires-elit.html$
Disallow: /*/10.html$
Disallow: /*/20.html$
Disallow: /*/40.html$
Disallow: /*/50.html$
Disallow: /*/80.html$
Disallow: /*/100.html$
Disallow: /*/140.html$
Disallow: /*/160.html$
Disallow: /*/170.html$
Disallow: /*/190.html$
Disallow: /*/200.html$
Disallow: /*pagenoindex*
Disallow: /auth.html?return=*
Disallow: /*kottedzhej/prodazha.html$
Disallow: /forum*
Host: www.net-agenta.ru