39 different robots | Hits |
Inktomi Slurp | 108985+689 |
Unknown robot (identified by 'crawl') | 29831+1588 |
LinkScan | 18653 |
Googlebot | 16144+3 |
Unknown robot (identified by hit on 'robots.txt') | 0+13203 |
Unknown robot (identified by 'spider') | 4060+334 |
Unknown robot (identified by 'robot') | 462+3714 |
The Python Robot | 651+2232 |
Turn It In | 2063+7 |
Voila | 1114+34 |
Phantom | 475 |
arks | 372 |
larbin | 210+6 |
SurveyBot | 182+26 |
MSIECrawler | 161 |
Alexa (IA Archiver) | 2+152 |
SpiderBot | 44+59 |
Raven Search | 81 |
StackRambler | 79 |
Yandex bot | 70 |
Checkbot | 42 |
Tarantula | 40 |
Web Core / Roots | 15+3 |
EchO! | 18 |
LinkChecker | 8+8 |
Speedy Spider | 8+4 |
mnoGoSearch search engine software | 6+3 |
ExactSeek Crawler | 5+3 |
Pioneer | 8 |
Motor | 7 |
WallPaper (alias crawlpaper) | 4 |
MSNBot | 2+1 |
BaiDuSpider | 3 |
JoBo Java Web Robot | 3 |
UdmSearch | 2 |
BSpider | 2 |
churl | 1 |
XYLEME Robot | 1 |
Fish search | 1 |