90 different robots | Hits |
Googlebot | 98742+2819 |
Unknown robot (identified by 'spider') | 59828+106 |
Scooter | 28476+8221 |
Inktomi Slurp | 18723+5671 |
AskJeeves | 21132+186 |
Unknown robot (identified by 'robot') | 16376+365 |
LinkScan | 14308 |
Grub.org | 13493+31 |
Fast-Webcrawler | 12967+435 |
Alexa (IA Archiver) | 10653+2644 |
WISENutbot | 9107+98 |
Unknown robot (identified by 'crawl') | 7784+899 |
MSIECrawler | 5396+1496 |
Turn It In | 6116+70 |
InternetSeer | 5797+18 |
psbot | 3834+48 |
Pita (webmaster@pita.stanford.edu) | 3581+2 |
Unknown robot (identified by hit on 'robots.txt') | 0+3391 |
Mercator | 2491+139 |
Openfind data gatherer | 1779+67 |
MSNBot | 1783+5 |
larbin | 1236+234 |
ZealBot | 891 |
LinkWalker | 577+292 |
arks | 846 |
Walhello appie | 187+434 |
ComputingSite Robi/1.0 | 470+8 |
BSpider | 324+149 |
GigaBot | 272+121 |
The Python Robot | 244+30 |
Pompos | 156+55 |
Internet Shinchakubin | 177 |
BaiDuSpider | 118+39 |
Collective | 123 |
LinkChecker | 118 |
Voila | 75+42 |
NetMechanic | 53+61 |
Ultraseek | 99+4 |
Gulper Bot | 67+30 |
InfoSeek Robot 1.0 | 60+29 |
The World Wide Web Worm | 60 |
Motor | 56 |
Combine System | 30+25 |
gazz | 32+18 |
Bumblebee (relevare.com) | 44+3 |
Checkbot | 41 |
Calif | 41 |
Templeton | 34 |
CyberSpyder Link Test | 16+16 |
CoolBot | 17+15 |
MOMspider | 19+12 |
LinkBot | 30 |
SpiderMan | 21+7 |
Ingrid | 28 |
SurveyBot | 24 |
Netcraft | 23 |
ht://Dig | 8+12 |
Robozilla | 20 |
RuLeS | 20 |
moget | 19+1 |
Antibot | 5+11 |
Web Core / Roots | 16 |
mnoGoSearch search engine software | 1+7 |
Speedy Spider | 3+3 |
XYLEME Robot | 2+3 |
RoboCrawl Spider | 2+3 |
BBot | 2+3 |
Fish search | 4 |
bright.net caching robot | 4 |
MetaGer LinkChecker | 4 |
UCSD Crawl | 3 |
Lycos | 3 |
spider_monkey | 1+1 |
Alkaline | 1+1 |
Northern Light Gulliver | 1+1 |
WebClipping.com | 2 |
WWWC Ver 0.2.5 | 2 |
ChristCrawler.com | 2 |
ExactSeek Crawler | 1+1 |
Nomad | 1 |
WebBandit Web Spider | 1 |
TITAN | 0+1 |
JoBo Java Web Robot | 1 |
WebReaper | 0+1 |
Perman surfer | 0+1 |
Kilroy | 1 |
ASpider (Associative Spider) | 0+1 |
JCrawler | 0+1 |
Fluid Dynamics Search Engine robot | 1 |
StackRambler | 0+1 |