40 different robots | Hits |
Unknown robot (identified by 'crawl') | 475871+3870 |
Inktomi Slurp | 281528+4859 |
Voyager | 97521+5 |
Voila | 37643+981 |
Unknown robot (identified by 'robot') | 27049+2365 |
Unknown robot (identified by hit on 'robots.txt') | 0+10471 |
Yandex bot | 7712+775 |
LinkScan | 7864 |
Googlebot | 6807+24 |
arks | 5323 |
MSIECrawler | 3879+90 |
Turn It In | 2905+19 |
Tarantula | 1014 |
Unknown robot (identified by 'spider') | 466+201 |
Alexa (IA Archiver) | 0+345 |
larbin | 168+130 |
SurveyBot | 246+35 |
The Python Robot | 202+10 |
Motor | 141 |
StackRambler | 91+48 |
Web Core / Roots | 104+1 |
BBot | 83+6 |
Grub.org | 65 |
Scooter | 55 |
LinkChecker | 24 |
Holmes | 4+17 |
Fish search | 18+2 |
EchO! | 17 |
mnoGoSearch search engine software | 10+4 |
Netcraft | 11 |
gammaSpider, FocusedCrawler | 9 |
Digger | 2+5 |
MSNBot | 6 |
WISENutbot | 5 |
UCSD Crawl | 5 |
DNAbot | 2+2 |
AskJeeves | 4 |
Robozilla | 2 |
JBot Java Web Robot | 1 |
Pita (webmaster@pita.stanford.edu) | 1 |