72 different robots | Hits |
Inktomi Slurp | 384114+64351 |
Unknown robot (identified by 'crawl') | 50755+1635 |
LinkScan | 20303 |
Unknown robot (identified by 'robot') | 17769+158 |
Pita (webmaster@pita.stanford.edu) | 15732+5 |
WISENutbot | 12771+46 |
Unknown robot (identified by hit on 'robots.txt') | 0+8694 |
InternetSeer | 4889 |
MSIECrawler | 3850+782 |
Alexa (IA Archiver) | 1410+1928 |
Googlebot | 3014+19 |
Voila | 598+2278 |
GigaBot | 1621+783 |
Fast-Webcrawler | 2250+32 |
Voyager | 1989+175 |
larbin | 1543+248 |
Walhello appie | 1384+188 |
Turn It In | 1452+14 |
arks | 841 |
LinkWalker | 687+115 |
AskJeeves | 616+175 |
Unknown robot (identified by 'spider') | 207+224 |
The Python Robot | 317+114 |
Ingrid | 373+49 |
Scooter | 289+121 |
Yandex bot | 378 |
Digger | 300+2 |
Pompos | 286+11 |
LinkChecker | 156 |
SurveyBot | 98+54 |
Harvest | 142+4 |
Grub.org | 140 |
InfoSeek Robot 1.0 | 58+78 |
ZealBot | 115 |
StackRambler | 65+30 |
ExactSeek Crawler | 90+2 |
Combine System | 34+57 |
Fish search | 84 |
UdmSearch | 56+5 |
EchO! | 60+1 |
UCSD Crawl | 49 |
ht://Dig | 31+15 |
Speedy Spider | 40+5 |
NetMechanic | 19+18 |
Patric | 35 |
Web Core / Roots | 32 |
SpiderMan | 27 |
Ultraseek | 22+1 |
BSpider | 1+16 |
Esther | 13+1 |
Motor | 13 |
ObjectsSearch | 7+4 |
RoboCrawl Spider | 1+9 |
BBot | 9+1 |
ComputingSite Robi/1.0 | 8 |
Antibot | 3+5 |
Netcraft | 7 |
LinkBot | 6 |
Nomad | 5 |
ASpider (Associative Spider) | 1+4 |
SpiderBot | 2+2 |
Checkbot | 0+3 |
Fluid Dynamics Search Engine robot | 2 |
Magpie | 2 |
Robozilla | 2 |
CyberSpyder Link Test | 1+1 |
Calif | 2 |
Internet Shinchakubin | 1 |
mnoGoSearch search engine software | 1 |
XGET | 1 |
Bloodhound | 1 |
fido | 1 |