User-Agent: *
ah-ha.com crawler 
Crayon Crawler
FAST FAST-WebCrawler
FreeFind.com-SiteSearchEngine
Gulliver 
Libwww
ListBidBot  
Lycos Lycos_Spider_(modspider) 
MicrosoftPrototypeCrawler 
Mozilla/3.0 Mozilla/4.0 Mozilla/4.7 Mozilla/5.0
MSIECrawler
NationalDirectory-WebSpider
NetResearchServer 
oBot
Openbot
Openfind data gatherer
OWR_Crawler 
parallelContextFocusCrawler 
Rex 
Roadrunner
Scooter Scooter-ARS-1.1 Scooter-3.2.EX Scooter-3.2.NIV Scooter-W3.1.2
Sidewinder 
Slurp Slurp/Cat 
Szukacz
T-Rex  
TurnitinBot 
Whizbang
Disallow: