User-Agent: * Disallow: /assets/images/ Disallow: /assets/docs/ Disallow: /assets/docs/private/ Disallow: /assets/files/ Disallow: /cgi_bin/ Disallow: /manager/ Disallow: /tempdocs/ User-agent: atSpider Disallow: / User-agent: cherrypicker Disallow: / User-agent: DSurf Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: Roverbot Disallow: / User-agent: WebEmailExtrac Disallow: /