37 different robots | Hits |
Voila | 78624+503 |
Inktomi Slurp | 46093+760 |
Unknown robot (identified by 'crawl') | 41740+1382 |
Unknown robot (identified by hit on 'robots.txt') | 0+18680 |
Googlebot | 14569+6 |
Turn It In | 4343+12 |
The Python Robot | 866+2336 |
Unknown robot (identified by 'spider') | 2045+535 |
legs | 1789+167 |
Unknown robot (identified by 'robot') | 1001+804 |
Phantom | 1281 |
BBot | 371+12 |
arks | 342 |
SurveyBot | 203+29 |
LinkScan | 156 |
Tarantula | 71 |
StackRambler | 55 |
MSIECrawler | 47 |
GigaBot | 40 |
Raven Search | 27 |
Alexa (IA Archiver) | 20+4 |
larbin | 20+1 |
Muncher | 20 |
Web Core / Roots | 10 |
fido | 9 |
ExactSeek Crawler | 0+8 |
JCrawler | 3+5 |
Speedy Spider | 3+2 |
mnoGoSearch search engine software | 4 |
EchO! | 4 |
WallPaper (alias crawlpaper) | 3 |
LinkChecker | 2 |
Motor | 1+1 |
Yandex bot | 2 |
NHSE Web Forager | 1 |
Monster | 1 |
Fish search | 1 |