35 different robots | Hits | Bandwidth | Last visit |
Java (Often spam bot) | 3259 | 13.24 MB | 28 Feb 2006 - 04:22 |
Unknown robot (identified by 'crawl') | 830+333 | 5.62 MB | 28 Feb 2006 - 23:07 |
Googlebot | 520+66 | 5.53 MB | 28 Feb 2006 - 23:01 |
MSNBot | 289+188 | 15.64 MB | 28 Feb 2006 - 23:53 |
Yahoo Slurp | 284+193 | 10.88 MB | 28 Feb 2006 - 22:21 |
Python-urllib | 191 | 650.52 KB | 24 Feb 2006 - 13:57 |
Unknown robot (identified by 'bot*') | 136+13 | 9.66 MB | 26 Feb 2006 - 18:25 |
ZyBorg | 109+1 | 672.72 KB | 28 Feb 2006 - 17:02 |
Ask | 83+11 | 1.00 MB | 28 Feb 2006 - 17:47 |
psbot | 50+7 | 318.12 KB | 15 Feb 2006 - 21:55 |
Unknown robot (identified by 'discovery') | 55 | 8.77 KB | 25 Feb 2006 - 12:52 |
Findlinks | 35+13 | 276.76 KB | 28 Feb 2006 - 19:04 |
Harvest | 38 | 108.93 KB | 28 Feb 2006 - 15:34 |
Alexa (IA Archiver) | 29+3 | 8.89 MB | 25 Feb 2006 - 00:42 |
BecomeBot | 16+3 | 96.40 KB | 10 Feb 2006 - 14:02 |
Exabot | 9+7 | 65.41 KB | 23 Feb 2006 - 13:33 |
Unknown robot (identified by empty user agent string) | 1+9 | 4.03 KB | 26 Feb 2006 - 12:02 |
Perl tool | 8 | 15.74 KB | 22 Feb 2006 - 06:35 |
IBM Almaden Research Center WebFountain™ | 4+4 | 13.36 KB | 27 Feb 2006 - 15:43 |
NutchCVS | 3+3 | 10.02 KB | 25 Feb 2006 - 05:11 |
Yahoo-MMCrawler | 4+1 | 88 Bytes | 03 Feb 2006 - 01:49 |
Unknown robot (identified by hit on 'robots.txt') | 0+5 | 440 Bytes | 27 Feb 2006 - 19:34 |
Girafabot | 2+2 | 6.65 KB | 23 Feb 2006 - 13:16 |
Voila | 2+2 | 3.86 KB | 23 Feb 2006 - 04:30 |
GigaBot | 2+2 | 6.84 KB | 24 Feb 2006 - 02:55 |
Unknown robot (identified by 'robot') | 2+2 | 6.68 KB | 25 Feb 2006 - 17:54 |
larbin | 2+2 | 6.68 KB | 15 Feb 2006 - 14:42 |
IRLbot | 2+2 | 6.68 KB | 18 Feb 2006 - 18:17 |
Hylanda | 2+1 | 6.56 KB | 08 Feb 2006 - 03:24 |
Geniebot | 1+1 | 3.50 KB | 01 Feb 2006 - 23:10 |
ConveraCrawler | 1+1 | 88 Bytes | 01 Feb 2006 - 22:38 |
Scumbot | 1+1 | 3.34 KB | 25 Feb 2006 - 13:16 |
HTTrack off-line browser | 2 | 0 | 08 Feb 2006 - 04:09 |
Sogou Spider | 1 | 449 Bytes | 06 Feb 2006 - 10:39 |
Fast-Webcrawler | 1 | 3.02 KB | 28 Feb 2006 - 02:05 |