# This is for every spider! User-agent: * Disallow: /admin/ Disallow: /webtrends/ Disallow: /cgi-bin/ Disallow: /_vti_cnf/ Disallow: /_derived/ Disallow: /_vti_pvt/ Disallow: /_private/