58 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 5582+303 | 49.15 MB | 30 Sep 2005 - 22:21 |
Yahoo Slurp | 2410+652 | 229.46 MB | 30 Sep 2005 - 23:45 |
Googlebot | 2215+89 | 1.09 GB | 30 Sep 2005 - 23:06 |
MSNBot | 1214+125 | 448.02 MB | 30 Sep 2005 - 23:29 |
Heritrix | 456+3 | 249.96 MB | 06 Sep 2005 - 09:24 |
Java (Often spam bot) | 442+2 | 1.55 MB | 30 Sep 2005 - 10:41 |
Unknown robot (identified by 'bot*') | 232+44 | 19.10 MB | 30 Sep 2005 - 18:51 |
BecomeBot | 213+33 | 1.40 MB | 29 Sep 2005 - 05:16 |
Nutch | 178+8 | 1.43 MB | 18 Sep 2005 - 23:28 |
ConveraCrawler | 168+2 | 99.91 MB | 07 Sep 2005 - 04:35 |
Python-urllib | 110+1 | 911.97 KB | 23 Sep 2005 - 18:57 |
aipbot | 105+4 | 847.96 KB | 30 Sep 2005 - 11:56 |
Ask | 80+17 | 542.06 KB | 30 Sep 2005 - 15:38 |
LinkWalker | 63+21 | 113.51 KB | 30 Sep 2005 - 02:03 |
Harvest | 77 | 112.20 KB | 30 Sep 2005 - 15:30 |
NutchCVS | 41+17 | 284.99 KB | 22 Sep 2005 - 05:29 |
Unknown robot (identified by 'robot') | 55+3 | 455.57 KB | 26 Sep 2005 - 08:48 |
Unknown robot (identified by empty user agent string) | 25+27 | 4.36 MB | 29 Sep 2005 - 09:29 |
Turn It In | 48+1 | 142.93 KB | 24 Sep 2005 - 22:45 |
Grub.org | 49 | 530.70 KB | 30 Sep 2005 - 20:08 |
Jakarta commons-httpclient | 26 | 7.76 MB | 29 Sep 2005 - 12:25 |
Perl tool | 25 | 542.34 KB | 29 Sep 2005 - 20:16 |
Voila | 10+12 | 48.50 KB | 17 Sep 2005 - 21:43 |
IBM Almaden Research Center WebFountain™ | 10+12 | 37.01 KB | 28 Sep 2005 - 10:28 |
MJ12bot | 13+4 | 74.10 KB | 29 Sep 2005 - 07:57 |
NG 2.x (Exalead) | 12+1 | 52.47 KB | 21 Sep 2005 - 12:20 |
Unknown robot (identified by 'spider') | 6+6 | 23.44 KB | 28 Sep 2005 - 17:44 |
InternetArchive | 8+3 | 71.93 KB | 28 Sep 2005 - 14:59 |
sohu-search | 5+5 | 19.54 KB | 27 Sep 2005 - 08:18 |
nicebot | 9 | 247.32 KB | 21 Sep 2005 - 13:18 |
Unknown robot (identified by hit on 'robots.txt') | 0+9 | 704 Bytes | 26 Sep 2005 - 00:07 |
psbot | 4+4 | 8.99 KB | 14 Sep 2005 - 13:44 |
WGet tools | 8 | 1.22 MB | 28 Sep 2005 - 13:16 |
Alexa (IA Archiver) | 2+6 | 19.23 KB | 30 Sep 2005 - 20:43 |
updated | 3+3 | 11.72 KB | 23 Sep 2005 - 01:22 |
Girafabot | 5+1 | 20.99 KB | 09 Sep 2005 - 01:05 |
Cfetch | 3+1 | 7.22 KB | 12 Sep 2005 - 11:50 |
Walhello appie | 0+3 | 264 Bytes | 26 Sep 2005 - 23:46 |
Findlinks | 1+2 | 3.99 KB | 29 Sep 2005 - 03:07 |
wume crawler | 2+1 | 11.08 KB | 21 Sep 2005 - 09:11 |
UdmSearch | 2 | 4.67 KB | 11 Sep 2005 - 15:42 |
Digger | 1+1 | 3.91 KB | 14 Sep 2005 - 06:45 |
IlTrovatore-Setaccio | 1+1 | 3.91 KB | 11 Sep 2005 - 00:48 |
Metaspinner | 1+1 | 3.91 KB | 25 Sep 2005 - 12:46 |
BaiDuSpider | 1+1 | 3.91 KB | 11 Sep 2005 - 16:14 |
twiceler | 0+2 | 176 Bytes | 26 Sep 2005 - 15:19 |
SBIder | 1+1 | 3.91 KB | 13 Sep 2005 - 05:49 |
Pompos | 0+1 | 88 Bytes | 29 Sep 2005 - 05:16 |
DoCoMo | 0+1 | 88 Bytes | 24 Sep 2005 - 15:25 |
Google AdSense | 1 | 7.82 KB | 12 Sep 2005 - 01:28 |
ActiveBookmark | 1 | 3.82 KB | 10 Sep 2005 - 19:00 |
GigaBot | 0+1 | 88 Bytes | 08 Sep 2005 - 11:17 |
larbin | 1 | 443 Bytes | 13 Sep 2005 - 15:04 |
MSIECrawler | 0+1 | 88 Bytes | 14 Sep 2005 - 11:01 |
Fast-Webcrawler | 1 | 3.82 KB | 26 Sep 2005 - 21:33 |
Others | 0 | 31 Bytes | |