30 different robots | Hits | Bandwidth | Last visit |
MSNBot | 604+652 | 4.95 MB | 31 Aug 2009 - 23:59 |
Yahoo Slurp | 382+88 | 1.15 MB | 31 Aug 2009 - 23:00 |
twiceler | 17+26 | 56.42 KB | 31 Aug 2009 - 21:32 |
Unknown robot (identified by 'crawl') | 2101+315 | 11.52 MB | 31 Aug 2009 - 21:31 |
GigaBot | 10+10 | 31.10 KB | 31 Aug 2009 - 20:34 |
Java (Often spam bot) | 265 | 512.17 KB | 31 Aug 2009 - 19:57 |
Googlebot | 193+25 | 4.06 MB | 31 Aug 2009 - 18:55 |
Voila | 15+5 | 158.93 KB | 31 Aug 2009 - 16:10 |
Unknown robot (identified by empty user agent string) | 7+6 | 474.70 KB | 31 Aug 2009 - 16:05 |
Exabot | 8+8 | 704 Bytes | 31 Aug 2009 - 16:01 |
Yandex bot | 6+8 | 18.83 KB | 31 Aug 2009 - 13:28 |
WGet tools | 3 | 280.45 KB | 31 Aug 2009 - 10:36 |
BaiDuSpider | 58+18 | 221.34 KB | 31 Aug 2009 - 09:21 |
Unknown robot (identified by hit on 'robots.txt') | 0+41 | 3.52 KB | 31 Aug 2009 - 02:42 |
Harvest | 86 | 203.41 KB | 31 Aug 2009 - 00:50 |
Ask | 23+9 | 192.78 KB | 30 Aug 2009 - 22:34 |
Unknown robot (identified by 'bot*') | 58+38 | 378.37 KB | 30 Aug 2009 - 18:15 |
Speedy Spider | 11+11 | 16.55 KB | 29 Aug 2009 - 07:34 |
Python-urllib | 153 | 2.37 MB | 28 Aug 2009 - 07:25 |
Heritrix | 7+1 | 45.37 KB | 25 Aug 2009 - 16:11 |
psbot | 3+1 | 23.92 KB | 23 Aug 2009 - 06:44 |
OutfoxBot/YodaoBot | 2+2 | 6.22 KB | 23 Aug 2009 - 06:08 |
larbin | 5+5 | 15.55 KB | 22 Aug 2009 - 14:37 |
Gaisbot | 2+2 | 6.48 KB | 21 Aug 2009 - 04:45 |
Sogou Spider | 2 | 0 | 18 Aug 2009 - 03:34 |
Jakarta commons-httpclient | 10 | 10.74 KB | 17 Aug 2009 - 19:47 |
Nutch | 5+2 | 14.82 KB | 13 Aug 2009 - 01:41 |
Turn It In | 6+1 | 1.02 MB | 09 Aug 2009 - 11:22 |
Netcraft | 1 | 3.02 KB | 06 Aug 2009 - 09:01 |
yacy | 1+1 | 3.11 KB | 02 Aug 2009 - 05:47 |