75 different robots | Hits |
Googlebot | 117881+1830 |
Unknown robot (identified by 'spider') | 94413+161 |
Pita (webmaster@pita.stanford.edu) | 65621+16 |
MSNBot | 37945+1039 |
Inktomi Slurp | 29110+6458 |
WISENutbot | 27109+165 |
AskJeeves | 26394+702 |
Unknown robot (identified by 'robot') | 25026+139 |
Yahoo Vertical Crawler | 21102+75 |
Grub.org | 17518+140 |
Scooter | 10358+2455 |
MSIECrawler | 11023+1552 |
LinkScan | 12128 |
Alexa (IA Archiver) | 10722+869 |
Fast-Webcrawler | 11299+170 |
Unknown robot (identified by 'crawl') | 9022+1678 |
Unknown robot (identified by hit on 'robots.txt') | 0+8002 |
InternetSeer | 6597+2 |
psbot | 4472+87 |
Fish search | 4183 |
Pompos | 3956+66 |
Turn It In | 2741+24 |
ComputingSite Robi/1.0 | 2305+10 |
Walhello appie | 921+1221 |
GigaBot | 1146+584 |
Speedy Spider | 1634+26 |
ht://Dig | 1088+16 |
ZealBot | 924 |
arks | 822+75 |
Openfind data gatherer | 673+110 |
BaiDuSpider | 485+55 |
larbin | 430+101 |
Voila | 212+305 |
Bumblebee (relevare.com) | 184+176 |
LinkWalker | 67+258 |
InfoSeek Robot 1.0 | 212+76 |
LinkChecker | 256 |
Internet Shinchakubin | 107 |
SurveyBot | 52+41 |
The Python Robot | 63+24 |
BSpider | 0+41 |
Calif | 34 |
Ingrid | 33 |
The World Wide Web Worm | 30 |
Mirago | 20+5 |
Combine System | 12+12 |
spider_monkey | 12+12 |
Antibot | 8+14 |
UdmSearch | 18+1 |
MOMspider | 9+9 |
LinkBot | 17 |
CyberSpyder Link Test | 9+8 |
ObjectsSearch | 8+8 |
Nomad | 15 |
Netcraft | 14 |
SpiderMan | 11+3 |
Templeton | 11 |
bright.net caching robot | 10 |
RoboCrawl Spider | 9+1 |
Robozilla | 10 |
Holmes | 2+6 |
JoBo Java Web Robot | 6+1 |
Mercator | 3+2 |
Pioneer | 4 |
mnoGoSearch search engine software | 4 |
ExactSeek Crawler | 1+2 |
Lycos | 1+1 |
NetMechanic | 1+1 |
Motor | 1+1 |
Snooper | 1+1 |
ASpider (Associative Spider) | 0+1 |
Aport | 1 |
Emacs-w3 Search Engine | 1 |
MetaGer LinkChecker | 1 |
gazz | 0+1 |