#Yandex User-agent: YandexSomething/1.0 disallow # Alexa User-agent: ia_archiver allow: # Ask Jeeves User-agent: Teoma allow: # Google User-agent: googlebot allow: # MSN User-agent: msnbot allow: # Yahoo! User-agent: Slurp allow: # BigClique User-agent: BigCliqueBOT allow: # Convera User-agent: ConveraCrawler allow: # DailyOrbit.com User-agent: Orbiter allow: # GoForIt User-agent: Goforitbot allow: # IBM User-agent: Crawler allow: # IRL User-agent: IRLbot allow: # Local.com User-agent: LocalcomBot allow: # Nameprotect User-agent: NPBot allow: