User-agent: * Disallow: /admin/ User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: YodaoBot Disallow: / User-agent: Slurp Disallow: / User-agent: Teoma Disallow: / User-agent: ia_archiver Disallow: / User-agent: twiceler Disallow: / User-agent: MSNBot Disallow: / User-agent: Scrubby Disallow: / User-agent: Robozilla Disallow: / User-agent: Gigabot Disallow: /