40 different robots | Hits |
Inktomi Slurp | 280153+4203 |
Unknown robot (identified by 'crawl') | 207396+3275 |
Voyager | 55819 |
Voila | 19497+1028 |
LinkScan | 9179 |
Unknown robot (identified by 'robot') | 8676+467 |
Unknown robot (identified by hit on 'robots.txt') | 0+8345 |
arks | 6942 |
MSIECrawler | 4174+58 |
Googlebot | 3968+14 |
Motor | 3207 |
Turn It In | 2355+6 |
legs | 912+394 |
BBot | 546+16 |
LinkWalker | 490+2 |
The Python Robot | 332+74 |
SurveyBot | 217+31 |
larbin | 129+86 |
Alexa (IA Archiver) | 1+160 |
Unknown robot (identified by 'spider') | 123+19 |
StackRambler | 43+35 |
Web Core / Roots | 51+1 |
Holmes | 9+28 |
AskJeeves | 17+9 |
Fish search | 15 |
InfoSeek Robot 1.0 | 11 |
LinkChecker | 10 |
UCSD Crawl | 9 |
TITAN | 8 |
mnoGoSearch search engine software | 8 |
XGET | 7 |
Netcraft | 6 |
DNAbot | 2+1 |
InternetSeer | 3 |
WallPaper (alias crawlpaper) | 2 |
Scooter | 0+2 |
Digger | 0+1 |
LinkBot | 1 |
JCrawler | 0+1 |
EchO! | 1 |