52 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 3021+953 | 383.74 MB | 30 Apr 2005 - 21:32 |
Unknown robot (identified by 'crawl') | 3076+428 | 31.50 MB | 30 Apr 2005 - 23:17 |
MSNBot | 1592+166 | 650.35 MB | 30 Apr 2005 - 23:36 |
Googlebot | 1143+80 | 607.94 MB | 30 Apr 2005 - 23:55 |
YahooSeeker Yahoo! Blog crawler | 948+34 | 4.81 MB | 30 Apr 2005 - 23:54 |
IRLbot | 679+137 | 1.73 MB | 30 Apr 2005 - 04:16 |
Ask | 520+37 | 28.86 MB | 30 Apr 2005 - 21:49 |
ZyBorg | 321+11 | 3.24 MB | 30 Apr 2005 - 23:32 |
Turn It In | 228+2 | 308.57 KB | 26 Apr 2005 - 15:23 |
WGet tools | 202+1 | 46.38 MB | 12 Apr 2005 - 23:24 |
Java (Often spam bot) | 188+2 | 697.10 KB | 27 Apr 2005 - 18:18 |
NutchCVS | 162+18 | 72.59 MB | 27 Apr 2005 - 12:23 |
Harvest | 170 | 3.84 MB | 30 Apr 2005 - 16:02 |
aipbot | 142+14 | 1.20 MB | 29 Apr 2005 - 08:29 |
Nutch | 111+1 | 916.90 KB | 22 Apr 2005 - 16:29 |
Speedy Spider | 72+34 | 145.32 KB | 30 Apr 2005 - 05:39 |
LinkWalker | 60+20 | 108.11 KB | 28 Apr 2005 - 22:17 |
Unknown robot (identified by empty user agent string) | 42+24 | 110.18 KB | 30 Apr 2005 - 21:44 |
IBM Almaden Research Center WebFountain™ | 54+7 | 482.28 KB | 22 Apr 2005 - 17:41 |
Grub.org | 38+12 | 457.96 KB | 26 Apr 2005 - 05:28 |
Alexa (IA Archiver) | 23+11 | 121.97 KB | 30 Apr 2005 - 04:40 |
Unknown robot (identified by 'robot') | 22+7 | 175.71 KB | 23 Apr 2005 - 09:48 |
NG 2.x (Exalead) | 25+3 | 214.27 KB | 22 Apr 2005 - 19:11 |
Voila | 12+13 | 61.20 KB | 28 Apr 2005 - 08:03 |
Perl tool | 17 | 32.10 KB | 27 Apr 2005 - 02:03 |
Unknown robot (identified by 'spider') | 7+6 | 4.34 KB | 28 Apr 2005 - 03:50 |
BecomeBot | 10+3 | 76.01 KB | 27 Apr 2005 - 00:32 |
HTTrack off-line browser | 10+1 | 4.34 KB | 20 Apr 2005 - 20:44 |
GigaBot | 0+6 | 528 Bytes | 28 Apr 2005 - 16:24 |
Unknown robot (identified by hit on 'robots.txt') | 0+5 | 440 Bytes | 28 Apr 2005 - 20:42 |
ConveraMultiMediaCrawler | 3+2 | 16.92 KB | 15 Apr 2005 - 20:31 |
Openfind data gatherer | 2+2 | 4.76 KB | 07 Apr 2005 - 17:03 |
Gaisbot | 1+2 | 3.99 KB | 30 Apr 2005 - 21:30 |
PEERbot | 1+2 | 3.99 KB | 27 Apr 2005 - 21:22 |
BaiDuSpider | 2+1 | 7.73 KB | 14 Apr 2005 - 17:36 |
Google AdSense | 3 | 428.50 KB | 27 Apr 2005 - 05:11 |
Unknown robot (identified by 'bot*') | 3 | 11.46 KB | 20 Apr 2005 - 10:53 |
Netcraft | 3 | 0 | 20 Apr 2005 - 15:46 |
Cfetch | 2 | 4.67 KB | 01 Apr 2005 - 16:58 |
UdmSearch | 2 | 29.69 KB | 02 Apr 2005 - 04:13 |
IlTrovatore-Setaccio | 1+1 | 3.91 KB | 29 Apr 2005 - 17:14 |
mnoGoSearch search engine software | 1+1 | 3.91 KB | 04 Apr 2005 - 07:23 |
lwp-trivial | 2 | 7.14 KB | 20 Apr 2005 - 14:03 |
larbin | 1+1 | 3.91 KB | 28 Apr 2005 - 03:36 |
MSIECrawler | 0+2 | 176 Bytes | 12 Apr 2005 - 14:12 |
Jakarta commons-httpclient | 1 | 658.91 KB | 29 Apr 2005 - 21:03 |
Unknown robot (identified by '*bot') | 0+1 | 88 Bytes | 30 Apr 2005 - 23:55 |
Holmes | 0+1 | 88 Bytes | 01 Apr 2005 - 16:54 |
ASPseek | 1 | 3.82 KB | 25 Apr 2005 - 01:50 |
Mirago | 0+1 | 88 Bytes | 30 Apr 2005 - 02:54 |
Walhello appie | 0+1 | 88 Bytes | 20 Apr 2005 - 23:06 |
Others | 0 | 1 Bytes | |