User-agent: * Disallow: /blog/ Disallow: /Scripts/ Disallow: /db/ Disallow: /index.htm Disallow: /home.html Disallow: /page.html