41 different robots | Hits | Bandwidth | Last visit |
Perl tool | 105 | 588.75 KB | 31 Oct 2011 - 17:59 |
Unknown robot (identified by 'discovery') | 21 | 83.78 KB | 31 Oct 2011 - 17:54 |
Googlebot | 4971+197 | 591.20 MB | 31 Oct 2011 - 17:48 |
Unknown robot (identified by 'crawl') | 19314+1749 | 276.51 MB | 31 Oct 2011 - 17:45 |
Unknown robot (identified by 'bot*') | 632+348 | 159.60 MB | 31 Oct 2011 - 17:14 |
Voila | 136+52 | 9.78 MB | 31 Oct 2011 - 16:34 |
Unknown robot (identified by empty user agent string) | 173+2 | 3.57 MB | 31 Oct 2011 - 16:33 |
BaiDuSpider | 568+84 | 8.61 MB | 31 Oct 2011 - 16:11 |
Unknown robot (identified by hit on 'robots.txt') | 0+122 | 10.48 KB | 31 Oct 2011 - 15:51 |
Unknown robot (identified by 'spider') | 207+29 | 8.54 MB | 31 Oct 2011 - 15:43 |
Yandex bot | 417+30 | 93.51 MB | 31 Oct 2011 - 14:38 |
Custo | 547+36 | 20.38 MB | 31 Oct 2011 - 13:19 |
Jakarta commons-httpclient | 192 | 8.11 MB | 31 Oct 2011 - 12:15 |
Unknown robot (identified by '*bot') | 12+23 | 52.13 KB | 31 Oct 2011 - 11:52 |
MJ12bot | 55+69 | 292.50 KB | 31 Oct 2011 - 11:23 |
Harvest | 81 | 189.99 KB | 31 Oct 2011 - 08:26 |
Sogou Spider | 372+4 | 6.89 MB | 31 Oct 2011 - 08:11 |
DoCoMo | 1+7 | 4.62 KB | 30 Oct 2011 - 20:43 |
Speedy Spider | 59+55 | 620.69 KB | 30 Oct 2011 - 20:17 |
HTTrack off-line browser | 2+2 | 8.22 KB | 30 Oct 2011 - 11:24 |
Pioneer | 1 | 4.02 KB | 30 Oct 2011 - 10:13 |
Unknown robot (identified by 'robot') | 2092+22 | 96.49 MB | 29 Oct 2011 - 22:02 |
psbot | 301+9 | 7.80 MB | 29 Oct 2011 - 20:13 |
Yahoo Slurp | 3241+92 | 657.54 MB | 29 Oct 2011 - 09:43 |
Netcraft | 12 | 28.16 KB | 28 Oct 2011 - 21:03 |
Nutch | 120+46 | 9.62 MB | 28 Oct 2011 - 19:38 |
HTMLParser | 3 | 12.07 KB | 27 Oct 2011 - 19:33 |
Unknown robot (identified by 'checker') | 3 | 0 | 27 Oct 2011 - 15:10 |
OutfoxBot/YodaoBot | 21+1 | 72.49 KB | 26 Oct 2011 - 10:53 |
Findlinks | 6+6 | 33.63 KB | 26 Oct 2011 - 07:38 |
Alexa (IA Archiver) | 2+3 | 12.69 KB | 25 Oct 2011 - 01:01 |
GigaBot | 0+4 | 352 Bytes | 22 Oct 2011 - 06:11 |
Java (Often spam bot) | 61 | 952.77 KB | 21 Oct 2011 - 10:41 |
WGet tools | 5 | 1.28 MB | 20 Oct 2011 - 23:06 |
larbin | 2+1 | 12.87 KB | 20 Oct 2011 - 21:23 |
MSNBot-media | 6+3 | 26.19 KB | 20 Oct 2011 - 04:39 |
Python-urllib | 3 | 12.07 KB | 17 Oct 2011 - 08:18 |
Exabot | 3+6 | 16.32 KB | 17 Oct 2011 - 04:39 |
yacy | 2+2 | 9.09 KB | 13 Oct 2011 - 21:09 |
Heritrix | 558+1 | 257.39 MB | 12 Oct 2011 - 11:42 |
archive.org bot | 1+1 | 4.11 KB | 12 Oct 2011 - 03:47 |