# Robots.txt file created by http://www.webtoolcentral.com # For domain: http://twojjs.com # All robots will spider the domain except shopwiki User-agent: ShopWiki Disallow: / User-agent: SBider Disallow: /User-agent: SBIder/SBIder-0.8.2-dev Disallow: / User-agent: Nutch Disallow: / #User-agent: * #Disallow: User-agent: TurnitinBot Disallow: / #User-agent: Exabot #Disallow: / User-agent: Java/ Disallow: / User-agent: Java/1.4.1_04 Disallow: / User-agent: ZyBorg Disallow: / #User-agent: Gigabot/2.0 #Disallow: / #User-agent: Gigabot #Disallow:/ User-agent: psbot/0.1 Disallow: / User-agent: psbot Disallow: / User-agent: RLbot/3.0 Disallow: / User-agent: RLbot Disallow: /