| 54 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 9539+168 | 1.45 GB | 31 Jul 2007 - 23:56 |
| Unknown robot (identified by 'crawl') | 3217+599 | 105.54 MB | 31 Jul 2007 - 23:49 |
| Googlebot | 2373+44 | 1.09 GB | 31 Jul 2007 - 20:36 |
| MSNBot | 944+620 | 153.52 MB | 31 Jul 2007 - 21:45 |
| Heritrix | 1374+5 | 738.14 MB | 23 Jul 2007 - 22:29 |
| Ocelli | 739+2 | 223.34 MB | 18 Jul 2007 - 20:53 |
| archive.org bot | 450+6 | 250.39 MB | 16 Jul 2007 - 20:37 |
| Unknown robot (identified by 'bot*') | 405+45 | 14.05 MB | 31 Jul 2007 - 20:55 |
| Ask | 176+52 | 1016.47 KB | 31 Jul 2007 - 10:28 |
| Nutch | 152+60 | 1.72 MB | 30 Jul 2007 - 20:28 |
| Voila | 74+74 | 553.93 KB | 31 Jul 2007 - 07:14 |
| Java (Often spam bot) | 133 | 82.49 MB | 18 Jul 2007 - 01:05 |
| MSNBot-media | 74+27 | 424.56 KB | 25 Jul 2007 - 00:14 |
| BaiDuSpider | 56+33 | 186.26 KB | 31 Jul 2007 - 19:09 |
| Harvest | 73 | 377.39 KB | 31 Jul 2007 - 16:36 |
| noxtrumbot | 67+1 | 595.86 KB | 25 Jul 2007 - 01:26 |
| Unknown robot (identified by empty user agent string) | 31+27 | 1.98 MB | 31 Jul 2007 - 03:58 |
| BecomeBot | 24+27 | 139.01 KB | 31 Jul 2007 - 22:05 |
| Unknown robot (identified by hit on 'robots.txt') | 0+40 | 1.89 KB | 30 Jul 2007 - 00:52 |
| MJ12bot | 25+3 | 130.37 KB | 26 Jul 2007 - 20:01 |
| Sogou Spider | 14+10 | 1.22 MB | 26 Jul 2007 - 03:52 |
| Unknown robot (identified by 'spider') | 9+7 | 34.99 KB | 31 Jul 2007 - 22:29 |
| Yahoo-MMCrawler | 14+2 | 176 Bytes | 21 Jul 2007 - 14:29 |
| Alexa (IA Archiver) | 9+6 | 257.12 KB | 23 Jul 2007 - 04:20 |
| Speedy Spider | 9+6 | 714.62 KB | 31 Jul 2007 - 19:37 |
| Jakarta commons-httpclient | 13+1 | 36.78 MB | 29 Jul 2007 - 21:13 |
| YahooSeeker Yahoo! Blog crawler | 11+3 | 56.76 KB | 31 Jul 2007 - 13:01 |
| NutchCVS | 7+5 | 13.69 MB | 28 Jul 2007 - 05:35 |
| MSIECrawler | 6+5 | 25.07 KB | 27 Jul 2007 - 13:41 |
| LinkChecker | 7+1 | 25.07 KB | 19 Jul 2007 - 16:09 |
| Perl tool | 8 | 15.32 KB | 26 Jul 2007 - 08:40 |
| WGet tools | 6+1 | 15.49 KB | 30 Jul 2007 - 08:49 |
| GigaBot | 3+4 | 422.26 KB | 26 Jul 2007 - 14:48 |
| VWbot | 3+3 | 29.54 KB | 11 Jul 2007 - 21:58 |
| Gaisbot | 4+2 | 16.10 KB | 28 Jul 2007 - 08:40 |
| Exabot | 4+2 | 21.01 KB | 23 Jul 2007 - 18:38 |
| Voyager | 4+2 | 15.62 KB | 13 Jul 2007 - 21:56 |
| IRLbot | 6 | 21.16 KB | 13 Jul 2007 - 07:41 |
| yacy | 2+2 | 4.43 KB | 02 Jul 2007 - 08:37 |
| ConveraCrawler | 2+2 | 176 Bytes | 27 Jul 2007 - 08:51 |
| Holmes | 1+2 | 3.99 KB | 28 Jul 2007 - 04:19 |
| nicebot | 2+1 | 10.52 KB | 04 Jul 2007 - 18:28 |
| Bloodhound | 1+1 | 3.91 KB | 03 Jul 2007 - 16:03 |
| boitho.com-dc | 1+1 | 3.40 KB | 09 Jul 2007 - 11:44 |
| psbot | 1+1 | 9.35 KB | 02 Jul 2007 - 09:00 |
| Girafabot | 0+2 | 176 Bytes | 31 Jul 2007 - 18:59 |
| twiceler | 0+2 | 176 Bytes | 30 Jul 2007 - 19:10 |
| Unknown robot (identified by 'robot') | 1+1 | 3.40 KB | 27 Jul 2007 - 06:08 |
| larbin | 1+1 | 3.91 KB | 13 Jul 2007 - 16:37 |
| ichiro | 1+1 | 3.91 KB | 10 Jul 2007 - 12:01 |
| Zeus Webster Pro | 1 | 78.67 KB | 26 Jul 2007 - 07:48 |
| QihooBot | 1 | 3.82 KB | 07 Jul 2007 - 09:42 |
| Unknown robot (identified by 'checker') | 1 | 0 | 14 Jul 2007 - 03:06 |