# Disallow directories User-agent: * Disallow: /private/ Disallow: /sd/private/ Disallow: /cgi-bin/ Disallow: /test/ # Disallow known harmful web bots User-agent: WebCopier v4.3 Disallow: / # Allow Googlebot to post results for /private/ User-agent: Googlebot Disallow: /private/stats/ Disallow: /cgi-bin/ Disallow: /test/ # add allow statement 3_24_08 Allow: /private/mktg