# All robots will spider the domain User-agent: * Disallow: # Disallow footer links except the sitemap User-agent: * Disallow: * Disallow: *