60 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 2347+568 | 186.12 MB | 31 Dec 2005 - 23:56 |
Googlebot | 2266+94 | 701.44 MB | 31 Dec 2005 - 23:46 |
Unknown robot (identified by 'crawl') | 1684+325 | 19.33 MB | 31 Dec 2005 - 23:39 |
Java (Often spam bot) | 1919 | 391.09 MB | 31 Dec 2005 - 12:04 |
MSNBot | 1226+175 | 691.27 MB | 31 Dec 2005 - 23:29 |
Unknown robot (identified by 'bot*') | 555+8 | 207.44 MB | 31 Dec 2005 - 01:30 |
Python-urllib | 552 | 226.18 MB | 14 Dec 2005 - 11:46 |
Nutch | 210+12 | 1.69 MB | 31 Dec 2005 - 20:41 |
BecomeBot | 189+31 | 1.29 MB | 30 Dec 2005 - 18:12 |
Harvest | 190 | 738.40 KB | 31 Dec 2005 - 16:15 |
Jakarta commons-httpclient | 26+116 | 209.04 KB | 20 Dec 2005 - 13:01 |
Ask | 43+20 | 92.09 MB | 29 Dec 2005 - 22:41 |
NutchCVS | 39+22 | 214.22 KB | 31 Dec 2005 - 21:12 |
LinkWalker | 36+12 | 64.86 KB | 19 Dec 2005 - 06:30 |
Unknown robot (identified by empty user agent string) | 27+13 | 2.86 MB | 30 Dec 2005 - 10:58 |
Unknown robot (identified by 'robot') | 28+2 | 225.96 KB | 30 Dec 2005 - 19:14 |
Voila | 13+15 | 73.79 KB | 28 Dec 2005 - 20:54 |
G2Crawler | 23+4 | 206.96 KB | 26 Dec 2005 - 21:25 |
Alexa (IA Archiver) | 18+5 | 5.07 MB | 28 Dec 2005 - 13:13 |
Unknown robot (identified by 'spider') | 11+11 | 42.98 KB | 30 Dec 2005 - 03:08 |
Findlinks | 13+8 | 80.92 KB | 31 Dec 2005 - 15:05 |
larbin | 18+3 | 96.13 KB | 28 Dec 2005 - 09:28 |
ZyBorg | 19+1 | 195.73 KB | 05 Dec 2005 - 14:18 |
Voyager | 11+9 | 108.84 KB | 28 Dec 2005 - 01:28 |
IBM Almaden Research Center WebFountain™ | 9+11 | 33.10 KB | 29 Dec 2005 - 22:49 |
Perl tool | 11 | 37.85 KB | 31 Dec 2005 - 23:15 |
Unknown robot (identified by hit on 'robots.txt') | 0+11 | 880 Bytes | 29 Dec 2005 - 17:45 |
Yahoo-MMCrawler | 7+1 | 88 Bytes | 12 Dec 2005 - 19:31 |
MJ12bot | 7+1 | 45.97 KB | 25 Dec 2005 - 08:41 |
BaiDuSpider | 5+2 | 18.28 KB | 28 Dec 2005 - 05:08 |
ConveraCrawler | 5+2 | 11.64 KB | 29 Dec 2005 - 12:09 |
ichiro | 5+2 | 19.28 KB | 17 Dec 2005 - 17:01 |
Girafabot | 5+1 | 20.99 KB | 24 Dec 2005 - 00:25 |
Geniebot | 3+2 | 18.80 KB | 31 Dec 2005 - 09:35 |
Turn It In | 3+2 | 14.63 KB | 17 Dec 2005 - 01:55 |
sohu agent | 5 | 15.33 KB | 30 Dec 2005 - 13:15 |
MSIECrawler | 5 | 317.55 KB | 31 Dec 2005 - 00:13 |
NG 2.x (Exalead) | 3+2 | 176 Bytes | 21 Dec 2005 - 11:59 |
Custo | 4 | 15.07 KB | 04 Dec 2005 - 17:10 |
Unknown robot (identified by 'discovery') | 4 | 0 | 03 Dec 2005 - 02:25 |
nicebot | 4 | 98.98 KB | 30 Dec 2005 - 07:44 |
xirq | 2+2 | 7.81 KB | 17 Dec 2005 - 04:25 |
GigaBot | 2+2 | 7.81 KB | 30 Dec 2005 - 10:56 |
HTTrack off-line browser | 3 | 414.78 KB | 29 Dec 2005 - 12:29 |
VORTEX | 1+2 | 8.46 KB | 31 Dec 2005 - 14:00 |
sohu-search | 1+1 | 3.91 KB | 07 Dec 2005 - 10:17 |
Accoona-AI-Agent | 1+1 | 3.19 KB | 22 Dec 2005 - 13:27 |
Pompos | 0+2 | 176 Bytes | 31 Dec 2005 - 19:36 |
HTMLParser | 2 | 7.64 KB | 26 Dec 2005 - 11:35 |
Gaisbot | 1+1 | 3.91 KB | 17 Dec 2005 - 20:47 |
SynooBot | 1+1 | 3.91 KB | 12 Dec 2005 - 13:11 |
WGet tools | 2 | 447.40 KB | 02 Dec 2005 - 05:16 |
Walhello appie | 0+2 | 176 Bytes | 15 Dec 2005 - 16:07 |
twiceler | 0+2 | 176 Bytes | 18 Dec 2005 - 07:44 |
lwp-trivial | 2 | 15.12 KB | 18 Dec 2005 - 06:37 |
SBIder | 1+1 | 3.91 KB | 03 Dec 2005 - 14:54 |
Speedy Spider | 1+1 | 3.91 KB | 20 Dec 2005 - 03:48 |
LinkChecker | 1 | 3.82 KB | 16 Dec 2005 - 12:46 |
psbot | 0+1 | 88 Bytes | 21 Dec 2005 - 06:55 |
Others | 0 | 18 Bytes | |