48 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 3359+1124 | 727.44 MB | 31 Jan 2005 - 23:58 |
Unknown robot (identified by 'crawl') | 2609+172 | 1.11 GB | 30 Jan 2005 - 22:21 |
MSNBot | 1524+170 | 469.39 MB | 31 Jan 2005 - 23:45 |
Googlebot | 835+72 | 424.69 MB | 31 Jan 2005 - 22:47 |
Harvest | 669 | 15.28 MB | 31 Jan 2005 - 20:12 |
Unknown robot (identified by 'bot*') | 351+130 | 1.60 MB | 29 Jan 2005 - 02:20 |
Ask | 352+60 | 451.29 MB | 29 Jan 2005 - 11:57 |
ConveraCrawler | 395+8 | 2.13 MB | 23 Jan 2005 - 22:50 |
Ocelli | 358+2 | 1.91 MB | 10 Jan 2005 - 02:29 |
Java (Often spam bot) | 221 | 1014.31 KB | 31 Jan 2005 - 15:43 |
WGet tools | 212+1 | 47.19 MB | 24 Jan 2005 - 12:27 |
ZyBorg | 187+7 | 1.52 MB | 31 Jan 2005 - 21:21 |
YahooSeeker Yahoo! Blog crawler | 141+34 | 719.88 KB | 31 Jan 2005 - 23:12 |
ichiro | 158+1 | 1.29 MB | 20 Jan 2005 - 10:38 |
LinkWalker | 54+18 | 97.29 KB | 31 Jan 2005 - 03:45 |
sohu-search | 41+3 | 185.18 KB | 27 Jan 2005 - 12:51 |
IBM Almaden Research Center WebFountain™ | 31+7 | 258.05 KB | 29 Jan 2005 - 20:48 |
Unknown robot (identified by empty user agent string) | 36+1 | 1000.39 KB | 29 Jan 2005 - 21:41 |
gazz | 30+1 | 228.46 KB | 05 Jan 2005 - 19:24 |
Grub.org | 24+5 | 76.03 KB | 29 Jan 2005 - 10:37 |
IRLbot | 14+14 | 52.31 KB | 29 Jan 2005 - 19:41 |
Voila | 9+14 | 23.79 KB | 30 Jan 2005 - 23:46 |
NutchCVS | 10+10 | 39.07 KB | 30 Jan 2005 - 19:25 |
Unknown robot (identified by hit on 'robots.txt') | 0+15 | 1.29 KB | 31 Jan 2005 - 12:32 |
Alexa (IA Archiver) | 9+4 | 65.62 KB | 24 Jan 2005 - 17:49 |
NPBot | 6+6 | 751.10 KB | 20 Jan 2005 - 19:44 |
Girafabot | 10+2 | 41.99 KB | 14 Jan 2005 - 12:03 |
Openfind data gatherer | 6+6 | 21.16 KB | 20 Jan 2005 - 20:05 |
Yahoo-MMCrawler | 7+4 | 352 Bytes | 25 Jan 2005 - 13:46 |
MJ12bot | 9+2 | 54.76 KB | 15 Jan 2005 - 14:38 |
Perl tool | 9 | 10.63 KB | 22 Jan 2005 - 17:53 |
BecomeBot | 5+3 | 37.59 KB | 12 Jan 2005 - 20:19 |
Unknown robot (identified by 'spider') | 3+3 | 10.39 KB | 29 Jan 2005 - 13:22 |
Holmes | 0+4 | 352 Bytes | 15 Jan 2005 - 12:31 |
Nutch | 2+2 | 7.81 KB | 23 Jan 2005 - 16:10 |
BaiDuSpider | 2+1 | 7.73 KB | 29 Jan 2005 - 07:59 |
HTTrack off-line browser | 1+2 | 3.99 KB | 02 Jan 2005 - 16:15 |
updated | 1+1 | 3.91 KB | 29 Jan 2005 - 00:38 |
IlTrovatore-Setaccio | 1+1 | 3.91 KB | 13 Jan 2005 - 09:23 |
Gaisbot | 2 | 0 | 04 Jan 2005 - 23:06 |
PEERbot | 1+1 | 3.91 KB | 01 Jan 2005 - 09:11 |
INFOMINE VLCrawler | 1+1 | 3.91 KB | 30 Jan 2005 - 21:22 |
Fast-Webcrawler | 0+2 | 176 Bytes | 19 Jan 2005 - 19:21 |
GigaBot | 0+1 | 88 Bytes | 30 Jan 2005 - 06:14 |
Tarantula | 0+1 | 88 Bytes | 07 Jan 2005 - 06:09 |
Fluid Dynamics Search Engine robot | 1 | 3.82 KB | 08 Jan 2005 - 08:16 |
Others | 0 | 0 | |