29 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 597+316 | 18.99 MB | 31 Mar 2005 - 12:14 |
Java (Often spam bot) | 602+2 | 2.33 MB | 31 Mar 2005 - 07:07 |
MSNBot | 394+106 | 20.40 MB | 30 Mar 2005 - 20:33 |
Googlebot | 399+66 | 13.20 MB | 31 Mar 2005 - 20:53 |
Unknown robot (identified by 'crawl') | 261+71 | 1.35 MB | 31 Mar 2005 - 19:04 |
Python-urllib | 290 | 46.83 MB | 23 Mar 2005 - 11:57 |
Harvest | 186 | 883.95 KB | 30 Mar 2005 - 18:57 |
YahooSeeker Yahoo! Blog crawler | 86+5 | 504.57 KB | 27 Mar 2005 - 05:47 |
Unknown robot (identified by 'bot*') | 55+2 | 337.42 KB | 31 Mar 2005 - 00:19 |
ZyBorg | 36+2 | 233.36 KB | 31 Mar 2005 - 20:27 |
BecomeBot | 13+5 | 53.89 KB | 29 Mar 2005 - 22:47 |
Turn It In | 13+1 | 80.76 KB | 14 Mar 2005 - 03:36 |
Grub.org | 13 | 73.03 KB | 27 Mar 2005 - 15:03 |
Unknown robot (identified by 'spider') | 8+1 | 50.48 KB | 20 Mar 2005 - 05:18 |
Alexa (IA Archiver) | 4+3 | 10.16 KB | 12 Mar 2005 - 13:48 |
NutchCVS | 4+2 | 37.42 KB | 29 Mar 2005 - 03:56 |
Perl tool | 4 | 13.01 KB | 18 Mar 2005 - 04:36 |
Findlinks | 4 | 13.17 KB | 24 Mar 2005 - 20:37 |
Voila | 2+2 | 3.86 KB | 23 Mar 2005 - 22:16 |
Holmes | 1+2 | 176 Bytes | 17 Mar 2005 - 07:57 |
Unknown robot (identified by hit on 'robots.txt') | 0+3 | 264 Bytes | 18 Mar 2005 - 13:34 |
MJ12bot | 1+2 | 3.34 KB | 01 Mar 2005 - 03:08 |
Fast-Webcrawler | 3 | 32.40 KB | 03 Mar 2005 - 14:34 |
Pompos | 1+1 | 3.34 KB | 02 Mar 2005 - 07:55 |
HTTrack off-line browser | 2 | 0 | 18 Mar 2005 - 06:41 |
Mirago | 1+1 | 3.34 KB | 21 Mar 2005 - 21:42 |
MSIECrawler | 0+2 | 0 | 06 Mar 2005 - 11:05 |
Unknown robot (identified by empty user agent string) | 1 | 6.42 KB | 09 Mar 2005 - 18:06 |
GigaBot | 0+1 | 88 Bytes | 02 Mar 2005 - 21:19 |