49 different robots | Hits |
Inktomi Slurp | 469566+16037 |
Unknown robot (identified by 'crawl') | 74866+2410 |
Voila | 27055+26178 |
Unknown robot (identified by 'robot') | 20444+1234 |
Unknown robot (identified by hit on 'robots.txt') | 0+20034 |
Yandex bot | 8642+61 |
EchO! | 6813+1 |
LinkScan | 6475 |
Googlebot | 3540+38 |
arks | 2219 |
MSIECrawler | 1401+215 |
Turn It In | 1187+4 |
Grub.org | 970+156 |
Alexa (IA Archiver) | 3+921 |
Digger | 707 |
LinkWalker | 545+3 |
Voyager | 371+49 |
Unknown robot (identified by 'spider') | 181+121 |
SurveyBot | 235+52 |
MSNBot | 117+119 |
WISENutbot | 228 |
AskJeeves | 90+109 |
The Python Robot | 111+87 |
Web Core / Roots | 193 |
LinkChecker | 174 |
larbin | 126+33 |
Scooter | 50+100 |
BBot | 129+2 |
Internet Shinchakubin | 119 |
Holmes | 12+96 |
UCSD Crawl | 87+7 |
StackRambler | 39+44 |
Motor | 76+5 |
Ingrid | 17+29 |
Walhello appie | 19+14 |
ht://Dig | 14+14 |
TITAN | 19 |
Fish search | 19 |
Pita (webmaster@pita.stanford.edu) | 15 |
Templeton | 12 |
Combine System | 1+6 |
Fluid Dynamics Search Engine robot | 3+3 |
Netcraft | 6 |
LinkBot | 4 |
GigaBot | 1+2 |
Robozilla | 3 |
GetURL | 2 |
WebWatch | 0+1 |
JoBo Java Web Robot | 1 |