33 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 1013+265 | 14.70 MB | 30 Sep 2006 - 22:37 |
Yahoo Slurp | 223+207 | 4.98 MB | 30 Sep 2006 - 16:21 |
MSNBot | 225+191 | 10.51 MB | 30 Sep 2006 - 23:02 |
Java (Often spam bot) | 402 | 1.57 MB | 29 Sep 2006 - 22:18 |
Heritrix | 296+5 | 28.70 MB | 29 Sep 2006 - 16:27 |
Ask | 218+55 | 1.28 MB | 30 Sep 2006 - 13:20 |
Googlebot | 144+26 | 5.53 MB | 30 Sep 2006 - 15:24 |
NutchCVS | 127+2 | 806.47 KB | 20 Sep 2006 - 05:43 |
LinkChecker | 118+2 | 712.84 KB | 30 Sep 2006 - 14:58 |
MSNBot-media | 52+10 | 298.42 KB | 28 Sep 2006 - 18:36 |
ZyBorg | 55+1 | 211.36 KB | 30 Sep 2006 - 06:57 |
ichiro | 54+2 | 311.58 KB | 25 Sep 2006 - 11:52 |
Findlinks | 40+15 | 284.25 KB | 30 Sep 2006 - 17:07 |
Unknown robot (identified by 'bot*') | 35+4 | 5.40 MB | 27 Sep 2006 - 11:21 |
Shim-Crawler | 15+4 | 50.46 KB | 29 Sep 2006 - 10:57 |
Harvest | 19 | 32.40 KB | 26 Sep 2006 - 16:34 |
Unknown robot (identified by empty user agent string) | 0+16 | 1.38 KB | 28 Sep 2006 - 14:00 |
Yahoo-MMCrawler | 0+12 | 1.03 KB | 29 Sep 2006 - 09:27 |
larbin | 7+2 | 27.29 KB | 11 Sep 2006 - 05:55 |
Perl tool | 8 | 15.74 KB | 27 Sep 2006 - 07:55 |
Nutch | 4+4 | 13.36 KB | 29 Sep 2006 - 09:14 |
Voila | 4+4 | 10.54 KB | 19 Sep 2006 - 21:23 |
Sogou Spider | 4+3 | 79.68 KB | 30 Sep 2006 - 00:55 |
Unknown robot (identified by hit on 'robots.txt') | 0+5 | 440 Bytes | 30 Sep 2006 - 08:00 |
Girafabot | 2+2 | 6.65 KB | 30 Sep 2006 - 09:41 |
Turn It In | 2+1 | 6.39 KB | 18 Sep 2006 - 16:08 |
Exabot | 1+1 | 2.98 KB | 29 Sep 2006 - 15:42 |
BetaBot | 1+1 | 3.34 KB | 19 Sep 2006 - 10:26 |
Voyager | 1+1 | 3.17 KB | 17 Sep 2006 - 16:39 |
GigaBot | 1+1 | 2.70 KB | 05 Sep 2006 - 19:28 |
WGet tools | 0+1 | 0 | 15 Sep 2006 - 15:17 |
MSIECrawler | 0+1 | 0 | 07 Sep 2006 - 10:06 |
BaiDuSpider | 0+1 | 88 Bytes | 25 Sep 2006 - 02:11 |
|