User-agent: * Disallow: /private/ Disallow: /cgi-script/ Disallow: /video/ Disallow: /css/