# WB robots.txt file to limit spiders and search engines # addresses all robots by using wild card * User-agent: * # exclude all spiders Disallow: /