41 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 65734+884 | 187.76 MB | 31 May 2009 - 17:07 |
Yahoo Slurp | 3661+121 | 578.25 MB | 31 May 2009 - 23:57 |
MSNBot | 1497+805 | 264.45 MB | 31 May 2009 - 23:48 |
Googlebot | 1407+52 | 621.02 MB | 31 May 2009 - 22:06 |
Ocelli | 874+2 | 271.52 MB | 19 May 2009 - 15:44 |
Yandex bot | 735+33 | 117.79 MB | 31 May 2009 - 08:58 |
Unknown robot (identified by hit on 'robots.txt') | 0+468 | 40.22 KB | 31 May 2009 - 19:32 |
Turn It In | 452+6 | 107.53 MB | 27 May 2009 - 08:41 |
Unknown robot (identified by 'spider') | 432+11 | 1.36 MB | 30 May 2009 - 21:07 |
Custo | 382+52 | 23.84 MB | 31 May 2009 - 12:55 |
Harvest | 363 | 247.95 KB | 31 May 2009 - 17:30 |
Ask | 293+67 | 53.44 MB | 31 May 2009 - 22:13 |
MSNBot-media | 215+67 | 1.37 MB | 31 May 2009 - 17:00 |
Unknown robot (identified by 'bot*') | 241+17 | 181.39 MB | 30 May 2009 - 22:32 |
BaiDuSpider | 152+36 | 889.10 KB | 31 May 2009 - 11:24 |
Unknown robot (identified by 'robot') | 131+16 | 3.11 MB | 31 May 2009 - 20:57 |
Voila | 119+26 | 88.32 MB | 31 May 2009 - 19:12 |
Nutch | 44+31 | 131.49 KB | 31 May 2009 - 03:04 |
GigaBot | 35+34 | 136.67 KB | 30 May 2009 - 10:42 |
twiceler | 45+20 | 336.79 KB | 31 May 2009 - 22:12 |
Speedy Spider | 37+27 | 2.09 MB | 31 May 2009 - 20:55 |
Exabot | 35+17 | 136.20 KB | 31 May 2009 - 10:04 |
Java (Often spam bot) | 49 | 41.08 MB | 24 May 2009 - 02:14 |
Unknown robot (identified by empty user agent string) | 25+21 | 4.68 MB | 31 May 2009 - 00:34 |
larbin | 26+20 | 121.36 KB | 31 May 2009 - 00:30 |
Perl tool | 25 | 109.58 KB | 20 May 2009 - 12:00 |
BSpider | 10+4 | 59.69 KB | 29 May 2009 - 09:30 |
WGet tools | 12 | 9.11 MB | 25 May 2009 - 12:52 |
psbot | 3+3 | 18.58 KB | 18 May 2009 - 01:49 |
OutfoxBot/YodaoBot | 4+2 | 11.75 KB | 30 May 2009 - 06:54 |
Sogou Spider | 5 | 79.10 KB | 29 May 2009 - 15:22 |
Alexa (IA Archiver) | 2+2 | 15.86 KB | 10 May 2009 - 23:53 |
Jakarta commons-httpclient | 2 | 918.80 KB | 19 May 2009 - 10:34 |
Unknown robot (identified by '*bot') | 1+1 | 2.58 KB | 28 May 2009 - 05:50 |
NutchCVS | 1+1 | 3.91 KB | 15 May 2009 - 01:51 |
Metaspinner | 1+1 | 3.91 KB | 16 May 2009 - 15:16 |
Voyager | 0+2 | 176 Bytes | 05 May 2009 - 23:40 |
Powermarks | 1 | 5.32 KB | 11 May 2009 - 17:42 |
lwp-trivial | 1 | 3.13 MB | 29 May 2009 - 11:47 |
lwp-request | 1 | 0 | 23 May 2009 - 21:47 |
Netcraft | 1 | 3.82 KB | 04 May 2009 - 17:52 |