# Alow search engines to walk though site User-agent: * Disallow: /cgi-bin Disallow: /ratrap