63 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 5659+1102 | 784.30 MB | 30 Apr 2006 - 03:04 |
Unknown robot (identified by 'crawl') | 3034+494 | 101.49 MB | 30 Apr 2006 - 02:58 |
Ask | 612+60 | 28.87 MB | 30 Apr 2006 - 02:46 |
Googlebot | 4292+28 | 189.43 MB | 30 Apr 2006 - 02:00 |
MSNBot | 1047+373 | 479.69 MB | 30 Apr 2006 - 00:36 |
Unknown robot (identified by 'spider') | 4+4 | 15.63 KB | 29 Apr 2006 - 23:32 |
Nutch | 150+16 | 1.20 MB | 29 Apr 2006 - 23:09 |
Unknown robot (identified by empty user agent string) | 596+48 | 7.01 MB | 29 Apr 2006 - 21:26 |
Java (Often spam bot) | 3822+7 | 16.10 MB | 29 Apr 2006 - 18:22 |
Unknown robot (identified by hit on 'robots.txt') | 0+28 | 2.32 KB | 29 Apr 2006 - 16:08 |
Harvest | 926 | 794.17 KB | 29 Apr 2006 - 15:30 |
yacy | 0+1 | 88 Bytes | 29 Apr 2006 - 12:59 |
ichiro | 101+3 | 810.39 KB | 29 Apr 2006 - 11:43 |
Unknown robot (identified by 'robot') | 399+3 | 235.60 MB | 29 Apr 2006 - 11:00 |
Findlinks | 41+11 | 416.14 KB | 28 Apr 2006 - 19:35 |
MSIECrawler | 29+3 | 335.50 KB | 28 Apr 2006 - 17:56 |
BecomeBot | 193+47 | 1.29 MB | 28 Apr 2006 - 16:41 |
NutchCVS | 22+22 | 84.47 KB | 28 Apr 2006 - 14:48 |
Robozilla | 1 | 3.82 KB | 28 Apr 2006 - 14:46 |
Unknown robot (identified by 'discovery') | 7 | 1.30 KB | 28 Apr 2006 - 10:00 |
GigaBot | 132+117 | 1.96 MB | 28 Apr 2006 - 08:24 |
Unknown robot (identified by 'bot*') | 318+26 | 30.57 MB | 28 Apr 2006 - 05:33 |
IBM Almaden Research Center WebFountain™ | 13+15 | 68.40 KB | 27 Apr 2006 - 19:11 |
Openfind data gatherer | 3 | 8.97 KB | 26 Apr 2006 - 23:29 |
Turn It In | 2+2 | 124.64 KB | 26 Apr 2006 - 20:55 |
LinkChecker | 170+1 | 1.31 MB | 26 Apr 2006 - 12:51 |
Exabot | 42+9 | 220.92 KB | 25 Apr 2006 - 21:46 |
noxtrumbot | 182+1 | 44.30 MB | 25 Apr 2006 - 21:23 |
Voyager | 25+9 | 287.29 KB | 25 Apr 2006 - 20:25 |
WGet tools | 0+1 | 0 | 25 Apr 2006 - 15:39 |
BaiDuSpider | 2+1 | 7.73 KB | 25 Apr 2006 - 08:20 |
Voila | 18+24 | 73.08 KB | 25 Apr 2006 - 01:43 |
lwp-trivial | 3 | 25.50 KB | 23 Apr 2006 - 22:10 |
NPBot | 1+1 | 3.91 KB | 23 Apr 2006 - 19:51 |
larbin | 19+5 | 72.03 KB | 22 Apr 2006 - 23:00 |
Unknown robot (identified by '*bot') | 0+1 | 88 Bytes | 22 Apr 2006 - 02:58 |
ConveraCrawler | 2+2 | 3.99 KB | 22 Apr 2006 - 01:00 |
Heritrix | 457+1 | 249.97 MB | 21 Apr 2006 - 23:30 |
Custo | 4 | 1.75 MB | 21 Apr 2006 - 05:06 |
Geniebot | 1+1 | 3.91 KB | 20 Apr 2006 - 01:02 |
Perl tool | 25 | 822.12 KB | 19 Apr 2006 - 06:20 |
Spiderman | 1 | 3.82 KB | 19 Apr 2006 - 00:07 |
Sogou Spider | 3 | 6.18 KB | 18 Apr 2006 - 04:14 |
Yahoo-MMCrawler | 4+2 | 176 Bytes | 17 Apr 2006 - 17:17 |
ConveraMultiMediaCrawler | 1+1 | 5.25 KB | 17 Apr 2006 - 03:55 |
Ocelli | 376+1 | 116.95 MB | 16 Apr 2006 - 05:54 |
MJ12bot | 13+6 | 54.50 KB | 15 Apr 2006 - 02:31 |
lanshanbot | 6+5 | 23.36 KB | 14 Apr 2006 - 09:40 |
HTTrack off-line browser | 4+2 | 3.92 KB | 14 Apr 2006 - 09:26 |
Girafabot | 5+2 | 21.08 KB | 14 Apr 2006 - 08:03 |
HTMLParser | 5 | 19.11 KB | 14 Apr 2006 - 02:55 |
BBot | 2 | 5.85 MB | 13 Apr 2006 - 15:18 |
ZyBorg | 5+2 | 15.94 KB | 11 Apr 2006 - 11:20 |
UdmSearch | 2 | 4.67 KB | 08 Apr 2006 - 21:07 |
nicebot | 1 | 3.82 KB | 08 Apr 2006 - 13:09 |
CFNetwork | 1 | 647.08 KB | 07 Apr 2006 - 07:20 |
ExactSeek Crawler | 1+1 | 3.91 KB | 06 Apr 2006 - 21:57 |
Fast-Webcrawler | 0+1 | 88 Bytes | 06 Apr 2006 - 11:02 |
Python-urllib | 114 | 356.29 KB | 05 Apr 2006 - 14:45 |
Vagabondo-WAP | 1 | 3.82 KB | 03 Apr 2006 - 20:40 |
Vagabondo | 0+1 | 88 Bytes | 03 Apr 2006 - 20:40 |
SynooBot | 1+1 | 3.91 KB | 01 Apr 2006 - 19:29 |