User-agent: DittoSpyder User-agent: vscooter User-Agent: Googlebot-Image User-Agent: Googlebot User-Agent: autoemailspider User-Agent: ia_archiver User-Agent: WinampMPEG User-Agent: Nutch User-Agent: Yahoo-Image User-Agent: Yahoo-MMCrawler/3.x User-Agent: msnbot/0.3 User-Agent: MSNBot User-Agent: Inktomi Slurp User-Agent: WISENutbot User-Agent: Voila User-Agent: Nutch User-Agent: Scooter/3.3 User-Agent: Scooter User-Agent: AskJeeves User-Agent: LinkWalker User-Agent: NaverBot-1.0 User-Agent: ia_archiver User-Agent: Alexa User-Agent: Mozilla/3.01 User-Agent: Mozilla/4.0 User-Agent: Mozilla/5.0 User-Agent: Mozilla/6.0 User-Agent: HenryTheMiragoRobot User-Agent: appie 1.1 User-Agent: IRLbot/1.0 User-Agent: Popdexter/1.0 User-Agent: WebRingChecker/1.71 LWP/5.65 User-Agent: NutchCVS/0.06-dev User-agent: * Disallow: /robots.txt Disallow: /_private Disallow: /images Disallow: /contact* Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.jpe$ Disallow: /*.png$ Disallow: /*.zip$ Disallow: /*.wav$ Disallow: /*.mp3$ Disallow: /*.html$ Disallow: /*.htm$ Disallow: /*.exe$ Disallow: /404* Disallow: /911* Disallow: /abuse* Disallow: /adoption* Disallow: /aids-hiv* Disallow: /angelrings* Disallow: /autism* Disallow: /bookstore* Disallow: /b-tch* Disallow: /cancer* Disallow: /cgi-bin* Disallow: /christmas99* Disallow: /domesticviolence* Disallow: /dreamer* Disallow: /drinking-driving* Disallow: /holidays* Disallow: /holidays/Christmas* Disallow: /holidays/MothersDay* Disallow: /holidays/StPatrick* Disallow: /holidays/Thanksgiving* Disallow: /holidays/Valentines* Disallow: /holidays/VeteransDay* Disallow: /homeless* Disallow: /* Disallow: /