User-agent: * Disallow: /access-log/ Disallow: /cgi-bin/ Disallow: /cgi-ergostoreonline/ Disallow: /data/ Disallow: /logs/ Disallow: /media/ Disallow: /scripts/ Disallow: /smarthtml/ Disallow: /stats/ User-agent: googlebot Disallow: