26 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 148416+1871 | 1.75 GB | 31 Dec 2011 - 23:56 |
Googlebot | 5019+57 | 100.13 MB | 31 Dec 2011 - 22:04 |
BaiDuSpider | 925+39 | 7.39 MB | 31 Dec 2011 - 17:48 |
Unknown robot (identified by 'bot*') | 488+239 | 69.41 MB | 31 Dec 2011 - 14:49 |
Unknown robot (identified by 'discovery') | 522+14 | 132.91 MB | 30 Dec 2011 - 08:07 |
MSNBot | 450+14 | 8.39 MB | 31 Dec 2011 - 01:20 |
Unknown robot (identified by 'robot') | 193+9 | 3.20 MB | 30 Dec 2011 - 23:27 |
Feedfetcher-Google | 196 | 1.45 MB | 31 Dec 2011 - 21:02 |
GigaBot | 98+78 | 1.38 MB | 31 Dec 2011 - 10:06 |
larbin | 77+7 | 1.30 MB | 11 Dec 2011 - 03:59 |
Jakarta commons-httpclient | 62 | 132.99 KB | 31 Dec 2011 - 09:12 |
Unknown robot (identified by empty user agent string) | 54+4 | 59.85 MB | 31 Dec 2011 - 13:00 |
CFNetwork | 54 | 812.16 KB | 14 Dec 2011 - 03:32 |
Heritrix | 50+1 | 1.06 MB | 02 Dec 2011 - 00:13 |
Java (Often spam bot) | 27 | 594.87 KB | 12 Dec 2011 - 01:45 |
Nutch | 14+7 | 187.73 KB | 31 Dec 2011 - 04:27 |
Yandex bot | 12+7 | 106.05 KB | 31 Dec 2011 - 16:21 |
Unknown robot (identified by '*bot') | 5+10 | 39.18 KB | 31 Dec 2011 - 18:03 |
Sogou Spider | 13 | 9.37 MB | 30 Dec 2011 - 06:29 |
Exabot | 6+3 | 75.76 KB | 31 Dec 2011 - 07:39 |
Unknown robot (identified by hit on 'robots.txt') | 0+9 | 279 Bytes | 22 Dec 2011 - 08:34 |
DoCoMo | 2+2 | 29.52 KB | 10 Dec 2011 - 16:11 |
MSNBot-media | 2+1 | 34.36 KB | 15 Dec 2011 - 15:01 |
Unknown robot (identified by 'spider') | 2 | 13.76 KB | 04 Dec 2011 - 01:20 |
Python-urllib | 2 | 23.61 KB | 30 Dec 2011 - 12:29 |
Netcraft | 2 | 6.56 KB | 29 Dec 2011 - 21:52 |