32 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 176089+12514 | 2.31 GB | 31 May 2012 - 23:33 |
Googlebot | 4980+31 | 1.05 GB | 31 May 2012 - 23:27 |
Unknown robot (identified by 'bot*') | 1638+312 | 225.36 MB | 31 May 2012 - 20:25 |
legs | 590+172 | 8.87 MB | 26 May 2012 - 14:56 |
Yandex bot | 495+48 | 37.39 MB | 31 May 2012 - 22:53 |
Unknown robot (identified by hit on 'robots.txt') | 0+267 | 8.08 KB | 31 May 2012 - 23:05 |
Sogou Spider | 144+1 | 8.71 MB | 31 May 2012 - 16:41 |
BaiDuSpider | 95+27 | 1.57 MB | 31 May 2012 - 09:53 |
Unknown robot (identified by empty user agent string) | 95+7 | 16.42 MB | 30 May 2012 - 02:36 |
Unknown robot (identified by 'robot') | 80+13 | 6.43 MB | 31 May 2012 - 09:41 |
Unknown robot (identified by 'discovery') | 52+10 | 3.33 MB | 27 May 2012 - 10:16 |
Jakarta commons-httpclient | 60 | 202.91 KB | 31 May 2012 - 09:16 |
Nutch | 27+15 | 199.74 KB | 29 May 2012 - 19:27 |
Unknown robot (identified by 'spider') | 17+3 | 885.14 KB | 28 May 2012 - 21:38 |
Exabot | 8+7 | 117.94 KB | 26 May 2012 - 15:18 |
MSNBot-media | 8+4 | 380.03 KB | 30 May 2012 - 05:39 |
Phantom | 11 | 343.64 KB | 11 May 2012 - 21:58 |
Mail.ru bot | 3+7 | 2.20 MB | 31 May 2012 - 10:31 |
Findlinks | 5+5 | 26.09 KB | 30 May 2012 - 01:45 |
Perl tool | 9 | 41.71 KB | 30 May 2012 - 18:39 |
Unknown robot (identified by '*bot') | 3+3 | 117.82 KB | 22 May 2012 - 00:15 |
Harvest | 5 | 473.24 KB | 30 May 2012 - 11:25 |
Alexa (IA Archiver) | 2+2 | 47.93 KB | 28 May 2012 - 05:15 |
ichiro | 3+1 | 114.15 KB | 28 May 2012 - 03:45 |
DoCoMo | 2+1 | 29.49 KB | 07 May 2012 - 17:36 |
Python-urllib | 0+3 | 93 Bytes | 31 May 2012 - 20:11 |
archive.org bot | 2+1 | 74.44 KB | 25 May 2012 - 19:20 |
FaceBook bot | 2 | 34.33 KB | 09 May 2012 - 13:04 |
yacy | 2 | 464.74 KB | 28 May 2012 - 00:38 |
larbin | 2 | 9.59 KB | 21 May 2012 - 20:15 |
Netcraft | 2 | 6.56 KB | 03 May 2012 - 07:46 |
CFNetwork | 1 | 212.21 KB | 07 May 2012 - 14:31 |