User-agent: * Disallow: /*? Disallow: /*.js$ Disallow: /*.css$ Disallow: /404/ Disallow: /admin/ Disallow: /api/ Disallow: /app/ Disallow: /downloader/ Disallow: /js/ Disallow: /lib/ Disallow: /media/ Disallow: /pkginfo/ Disallow: /report/ Disallow: /skin/ Disallow: /var/ #FAIRRANK - 10.08.2010 - AW User-agent: SurveyBot Disallow: / User-agent: WebsiteWiki Disallow: / User-agent: ShopWiki Disallow: / User-agent: Jakarta Commons-HttpClient Disallow: / User-Agent: AboutUsBot Disallow: / User-agent: Semager Disallow: /