# Robots.txt file from http://www.dgndlyb.com # All robots will spider the domain User-agent: * Disallow: /admin/ Disallow: /db/ Disallow: /page/ Disallow: /template/