35 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 12433+421 | 16.35 MB | 30 Sep 2009 - 23:58 |
MSNBot | 497+403 | 7.37 MB | 30 Sep 2009 - 23:29 |
Googlebot | 487+39 | 10.20 MB | 30 Sep 2009 - 14:11 |
Yahoo Slurp | 414+87 | 3.89 MB | 30 Sep 2009 - 23:19 |
Harvest | 317 | 397.39 KB | 30 Sep 2009 - 18:30 |
Heritrix | 150+2 | 9.90 MB | 29 Sep 2009 - 18:33 |
Java (Often spam bot) | 113+1 | 497.12 KB | 28 Sep 2009 - 02:37 |
Ask | 64+29 | 5.83 MB | 29 Sep 2009 - 20:02 |
Jakarta commons-httpclient | 86 | 279.41 KB | 30 Sep 2009 - 12:53 |
Unknown robot (identified by 'bot*') | 64+15 | 644.65 KB | 30 Sep 2009 - 15:30 |
BaiDuSpider | 34+18 | 92.63 KB | 29 Sep 2009 - 11:20 |
twiceler | 9+28 | 30.15 KB | 30 Sep 2009 - 20:43 |
Unknown robot (identified by hit on 'robots.txt') | 0+32 | 2.75 KB | 30 Sep 2009 - 08:49 |
Voila | 17+10 | 36.46 KB | 30 Sep 2009 - 15:55 |
Exabot | 15+11 | 29.65 KB | 28 Sep 2009 - 08:59 |
Custo | 11+8 | 33.75 KB | 29 Sep 2009 - 13:26 |
Speedy Spider | 10+8 | 11.99 KB | 29 Sep 2009 - 07:40 |
Python-urllib | 17 | 350.98 KB | 29 Sep 2009 - 08:01 |
Yandex bot | 9+8 | 29.96 KB | 29 Sep 2009 - 07:04 |
Turn It In | 12+2 | 831.95 KB | 23 Sep 2009 - 00:47 |
GigaBot | 7+7 | 23.37 KB | 25 Sep 2009 - 09:25 |
larbin | 6+6 | 20.03 KB | 29 Sep 2009 - 19:11 |
Unknown robot (identified by empty user agent string) | 7+4 | 24.08 KB | 24 Sep 2009 - 15:22 |
Nutch | 3+4 | 11.15 KB | 07 Sep 2009 - 10:15 |
Voyager | 0+5 | 440 Bytes | 11 Sep 2009 - 06:06 |
Unknown robot (identified by 'discovery') | 2+2 | 6.68 KB | 29 Sep 2009 - 03:07 |
yacy | 2+1 | 6.59 KB | 28 Sep 2009 - 13:42 |
Perl tool | 3 | 47.02 KB | 06 Sep 2009 - 20:19 |
psbot | 1+1 | 88 Bytes | 11 Sep 2009 - 16:23 |
Alexa (IA Archiver) | 1+1 | 3.34 KB | 05 Sep 2009 - 04:32 |
BBot | 2 | 189.93 KB | 04 Sep 2009 - 14:22 |
MJ12bot | 1+1 | 3.34 KB | 06 Sep 2009 - 06:31 |
Netcraft | 2 | 6.51 KB | 07 Sep 2009 - 15:25 |
Unknown robot (identified by 'robot') | 0+1 | 88 Bytes | 08 Sep 2009 - 02:17 |
Sogou Spider | 1 | 0 | 14 Sep 2009 - 04:30 |