User-agent: Alligator User-agent: autoemailspider User-agent: DSurf User-agent: DBrowse User-agent: DDD User-agent: Demo Bot User-agent: dlman User-agent: Download Demon User-agent: Download Express User-agent: Download Wonder User-agent: EBrowse User-agent: eCatch User-agent: EmailSiphon User-agent: EmailWolf User-agent: ESurf User-agent: ExtractorPro User-agent: FileHound User-agent: FlashGet User-agent: FSurf User-agent: Full Web Bot User-agent: GetBot User-agent: GetRight User-agent: Go!Zilla User-agent: Go-Ahead-Got-It User-agent: iGetter User-agent: Irvine User-agent: JBH Agent User-agent: JoBo User-agent: LeechGet User-agent: LightningDownload User-agent: Mass Downloader User-agent: MetaProducts Download Express User-agent: WebCapture User-agent: Advanced Email Extractor User-agent: DnloadMage User-agent: MyGetRight User-agent: NetAnts User-agent: NetPumper User-agent: Nitro Downloader User-agent: Octopus User-agent: Offline Explorer User-agent: PBrowse User-agent: PEval User-agent: RealDownload User-agent: RSurf User-agent: SmartDownload User-agent: SpeedDownload User-agent: SSurf User-agent: Stamina User-agent: Star Downloader User-agent: SuperBot User-agent: Teleport Pro User-agent: The Expert HTML Source Viewer User-agent: UtilMind User-agent: WebAuto User-agent: WebDownloader User-agent: WebReaper User-agent: WebStripper User-agent: WebZIP User-agent: WWWOFFLE User-agent: CDSource User-agent: Hotbar User-agent: turnitinbot User-agent: Mozilla.*NEWT User-agent: Crescent User-agent: CherryPicker User-agent: WebBandit User-agent: NICErsPRO User-agent: EmailCollector Disallow: / User-agent: * Disallow: # set to disallow e-mail harvesting and website downloading tools # does NOT disable link harvesting or parsing robots