# All Spiders User-agent: * Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /errors/ Disallow: /logs/ Disallow: /usage/ Disallow: /pictures/ # Image Spiders User-agent: vscooter User-agent: DittoSpyder User-Agent: Googlebot-Image User-Agent: psbot Disallow: / # Google (filetypes) User-agent: Googlebot Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$ Disallow: /*.doc$ # Internet Archiver User-Agent: ia_archiver Disallow: /