36 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 578+190 | 5.93 MB | 30 Sep 2006 - 23:57 |
Harvest | 586 | 8.84 MB | 30 Sep 2006 - 01:50 |
MSNBot | 276+227 | 2.89 MB | 30 Sep 2006 - 23:45 |
Java (Often spam bot) | 471 | 2.54 MB | 30 Sep 2006 - 08:58 |
Yahoo Slurp | 230+216 | 2.24 MB | 30 Sep 2006 - 19:21 |
Ask | 179+35 | 1.35 MB | 30 Sep 2006 - 13:10 |
Heritrix | 185+3 | 4.67 MB | 28 Sep 2006 - 14:38 |
Googlebot | 131+26 | 816.25 KB | 30 Sep 2006 - 23:23 |
NutchCVS | 125+5 | 998.62 KB | 21 Sep 2006 - 10:19 |
LinkChecker | 100+2 | 780.89 KB | 30 Sep 2006 - 14:47 |
MSNBot-media | 47+12 | 300.99 KB | 29 Sep 2006 - 20:27 |
Findlinks | 33+15 | 211.89 KB | 30 Sep 2006 - 19:27 |
IBM Almaden Research Center WebFountain™ | 17+11 | 113.27 KB | 24 Sep 2006 - 02:13 |
Perl tool | 25 | 167.60 KB | 26 Sep 2006 - 05:24 |
Unknown robot (identified by empty user agent string) | 5+16 | 14.16 KB | 28 Sep 2006 - 14:00 |
Voyager | 14+6 | 82.62 KB | 24 Sep 2006 - 20:00 |
Alexa (IA Archiver) | 9+5 | 29.71 KB | 07 Sep 2006 - 21:02 |
Unknown robot (identified by 'bot*') | 7+7 | 21.77 KB | 29 Sep 2006 - 01:08 |
Nutch | 8+5 | 14.25 KB | 29 Sep 2006 - 07:49 |
Shim-Crawler | 7+5 | 18.51 KB | 29 Sep 2006 - 11:28 |
larbin | 8+4 | 28.83 KB | 25 Sep 2006 - 00:32 |
Turn It In | 10+1 | 1.19 MB | 27 Sep 2006 - 03:07 |
BaiDuSpider | 5+4 | 15.47 KB | 28 Sep 2006 - 09:39 |
Unknown robot (identified by hit on 'robots.txt') | 0+8 | 704 Bytes | 30 Sep 2006 - 08:00 |
Voila | 3+3 | 9.33 KB | 19 Sep 2006 - 20:21 |
ichiro | 2+2 | 6.48 KB | 25 Sep 2006 - 11:27 |
MSRBOT | 2+1 | 3.54 KB | 27 Sep 2006 - 19:59 |
MJ12bot | 2+1 | 94.66 KB | 18 Sep 2006 - 23:43 |
Unknown robot (identified by 'spider') | 2 | 3.45 KB | 29 Sep 2006 - 18:21 |
GigaBot | 1+1 | 3.11 KB | 27 Sep 2006 - 15:19 |
MSIECrawler | 0+2 | 88 Bytes | 22 Sep 2006 - 06:24 |
Sogou Spider | 1+1 | 3.11 KB | 30 Sep 2006 - 03:03 |
Cfetch | 1 | 0 | 17 Sep 2006 - 06:09 |
WGet tools | 0+1 | 0 | 15 Sep 2006 - 15:03 |
Exabot | 0+1 | 88 Bytes | 12 Sep 2006 - 03:19 |
Others | 0 | 0 | |