49 different robots | Hits | Bandwidth | Last visit |
Googlebot | 1910+84 | 735.71 MB | 28 Feb 2005 - 23:52 |
MSNBot | 1636+127 | 707.95 MB | 28 Feb 2005 - 23:46 |
Unknown robot (identified by 'crawl') | 2664+249 | 130.66 MB | 28 Feb 2005 - 23:41 |
Harvest | 749 | 18.16 MB | 28 Feb 2005 - 23:02 |
Yahoo Slurp | 3332+1000 | 311.65 MB | 28 Feb 2005 - 22:56 |
LinkWalker | 60+20 | 108.11 KB | 28 Feb 2005 - 22:53 |
ConveraMultiMediaCrawler | 12+4 | 33.66 KB | 28 Feb 2005 - 21:24 |
Voila | 9+17 | 52.82 KB | 28 Feb 2005 - 21:17 |
Java (Often spam bot) | 181 | 1.52 MB | 28 Feb 2005 - 19:25 |
Unknown robot (identified by empty user agent string) | 39+1 | 25.30 MB | 28 Feb 2005 - 15:19 |
Findlinks | 5 | 22.28 KB | 28 Feb 2005 - 14:55 |
MSIECrawler | 3+1 | 88 Bytes | 28 Feb 2005 - 14:16 |
Ask | 528+36 | 3.22 MB | 28 Feb 2005 - 09:58 |
Unknown robot (identified by 'bot*') | 96+35 | 402.58 KB | 28 Feb 2005 - 08:26 |
Perl tool | 24 | 83.84 KB | 28 Feb 2005 - 07:17 |
Unknown robot (identified by 'spider') | 10+6 | 52.70 KB | 27 Feb 2005 - 22:55 |
YahooSeeker Yahoo! Blog crawler | 289+28 | 1.30 MB | 27 Feb 2005 - 14:06 |
IRLbot | 16+12 | 58.58 KB | 27 Feb 2005 - 11:59 |
NutchCVS | 22+10 | 123.43 KB | 27 Feb 2005 - 09:12 |
Unknown robot (identified by hit on 'robots.txt') | 0+12 | 968 Bytes | 27 Feb 2005 - 07:56 |
psbot | 5+4 | 22.67 KB | 27 Feb 2005 - 07:53 |
Grub.org | 3 | 22.89 KB | 27 Feb 2005 - 04:40 |
Jakarta commons-httpclient | 3 | 22.11 KB | 27 Feb 2005 - 01:15 |
webcrawl.net | 11+5 | 63.74 KB | 25 Feb 2005 - 22:31 |
IBM Almaden Research Center WebFountain™ | 4+4 | 15.63 KB | 24 Feb 2005 - 22:13 |
sohu-search | 46+2 | 108.40 KB | 24 Feb 2005 - 20:37 |
UdmSearch | 1+1 | 0 | 24 Feb 2005 - 19:01 |
JoBo Java Web Robot | 0+1 | 88 Bytes | 24 Feb 2005 - 10:02 |
GoForIt.com | 1+1 | 3.91 KB | 24 Feb 2005 - 02:51 |
BecomeBot | 21+10 | 147.54 KB | 24 Feb 2005 - 01:13 |
Openfind data gatherer | 5+5 | 17.37 KB | 23 Feb 2005 - 20:32 |
Unknown robot (identified by 'robot') | 2+2 | 7.81 KB | 23 Feb 2005 - 18:30 |
Yahoo Vertical Crawler | 0+8 | 704 Bytes | 23 Feb 2005 - 12:55 |
Gaisbot | 2+2 | 9.31 KB | 21 Feb 2005 - 09:01 |
Holmes | 1 | 0 | 19 Feb 2005 - 14:07 |
GigaBot | 0+3 | 264 Bytes | 18 Feb 2005 - 22:30 |
Speedy Spider | 2+1 | 3.91 KB | 18 Feb 2005 - 00:19 |
Fast-Search-Engine (not fastsearch.com) | 10 | 57.91 KB | 14 Feb 2005 - 01:40 |
Fast-Webcrawler | 7+1 | 531 Bytes | 13 Feb 2005 - 20:26 |
Netcraft | 1 | 0 | 13 Feb 2005 - 01:16 |
BaiDuSpider | 1 | 3.82 KB | 09 Feb 2005 - 11:22 |
ZyBorg | 12+2 | 67.53 KB | 07 Feb 2005 - 21:41 |
Alexa (IA Archiver) | 2+2 | 7.81 KB | 06 Feb 2005 - 14:39 |
Python-urllib | 1 | 8.30 KB | 05 Feb 2005 - 20:39 |
ActiveBookmark | 1 | 3.82 KB | 04 Feb 2005 - 15:33 |
Unknown robot (identified by 'checker') | 4 | 0 | 04 Feb 2005 - 12:45 |
Turn It In | 528+3 | 191.01 MB | 03 Feb 2005 - 01:51 |
Yahoo-MMCrawler | 0+1 | 88 Bytes | 01 Feb 2005 - 15:24 |
Others | 0 | 5 Bytes | |