User-agent: Google-Extended Disallow: / User-agent: test Disallow: / User-agent: beta Disallow: / # everybody else is ok, but restrict directories User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /dont.index/ Disallow: /temp/ Disallow: /data/ Disallow: /scripts/ Disallow: /bin/ User-agent: claudebot Disallow: /