#Example /robots.txt file Sitemap: http://www.vpi.us/sitemap.gz User-agent: * Disallow: /logs # Disallow: /cgi-bin User-agent: MSNBot Disallow: /