| 47 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 2342+159 | 354.65 MB | 31 Jul 2008 - 23:56 |
| Harvest | 224 | 20.48 MB | 31 Jul 2008 - 23:55 |
| Unknown robot (identified by 'crawl') | 3560+646 | 57.87 MB | 31 Jul 2008 - 23:47 |
| BaiDuSpider | 182+33 | 633.35 KB | 31 Jul 2008 - 23:04 |
| MSNBot | 3013+667 | 169.48 MB | 31 Jul 2008 - 23:02 |
| The web archive (IA Archiver) | 0+2 | 176 Bytes | 31 Jul 2008 - 23:00 |
| Googlebot | 1748+40 | 888.58 MB | 31 Jul 2008 - 22:59 |
| Unknown robot (identified by 'bot*') | 154+75 | 44.57 MB | 31 Jul 2008 - 22:00 |
| YahooSeeker Yahoo! Blog crawler | 0+20 | 1.72 KB | 31 Jul 2008 - 21:10 |
| Nutch | 303+20 | 255.43 MB | 31 Jul 2008 - 16:40 |
| Unknown robot (identified by empty user agent string) | 30+31 | 8.47 MB | 31 Jul 2008 - 15:24 |
| Ask | 335+55 | 3.95 MB | 31 Jul 2008 - 09:28 |
| BSpider | 27+6 | 4.34 KB | 30 Jul 2008 - 21:46 |
| Speedy Spider | 18+14 | 105.84 KB | 30 Jul 2008 - 14:08 |
| WGet tools | 1+1 | 3.91 KB | 30 Jul 2008 - 07:28 |
| Sogou Spider | 12+3 | 103.14 KB | 30 Jul 2008 - 04:11 |
| Unknown robot (identified by hit on 'robots.txt') | 0+83 | 7.13 KB | 29 Jul 2008 - 22:48 |
| DoCoMo | 0+1 | 88 Bytes | 29 Jul 2008 - 21:37 |
| Yandex bot | 350+14 | 191.70 MB | 29 Jul 2008 - 16:59 |
| GigaBot | 65+60 | 220.34 KB | 29 Jul 2008 - 15:57 |
| Unknown robot (identified by 'spider') | 3+6 | 11.98 KB | 29 Jul 2008 - 13:13 |
| twiceler | 0+20 | 1.72 KB | 29 Jul 2008 - 04:49 |
| CFNetwork | 3 | 10.06 MB | 29 Jul 2008 - 01:29 |
| Unknown robot (identified by 'robot') | 37+17 | 151.35 KB | 28 Jul 2008 - 22:21 |
| Gaisbot | 2+2 | 9.31 KB | 28 Jul 2008 - 13:01 |
| Custo | 1 | 319.57 KB | 28 Jul 2008 - 06:02 |
| Voila | 103+38 | 59.85 MB | 28 Jul 2008 - 02:56 |
| boitho.com-dc | 4+1 | 12.93 KB | 27 Jul 2008 - 21:56 |
| Raven Search | 1 | 240.86 KB | 27 Jul 2008 - 20:57 |
| Holmes | 1+3 | 4.08 KB | 27 Jul 2008 - 15:19 |
| MJ12bot | 38+2 | 310.93 KB | 27 Jul 2008 - 07:10 |
| Turn It In | 673+6 | 263.62 MB | 27 Jul 2008 - 05:54 |
| MSIECrawler | 4 | 28.70 KB | 26 Jul 2008 - 04:57 |
| Unknown robot (identified by 'discovery') | 0+3 | 264 Bytes | 25 Jul 2008 - 17:10 |
| BBot | 12 | 88.31 KB | 25 Jul 2008 - 00:24 |
| Heritrix | 2+2 | 7.81 KB | 24 Jul 2008 - 18:42 |
| MSNBot-media | 149+41 | 855.83 KB | 24 Jul 2008 - 16:55 |
| Java (Often spam bot) | 95 | 7.51 MB | 23 Jul 2008 - 22:50 |
| Jakarta commons-httpclient | 5 | 29.08 KB | 23 Jul 2008 - 15:29 |
| OutfoxBot/YodaoBot | 2+1 | 88 Bytes | 21 Jul 2008 - 02:05 |
| larbin | 10+2 | 57.22 KB | 20 Jul 2008 - 10:15 |
| Geniebot | 29+3 | 260.18 KB | 20 Jul 2008 - 03:19 |
| MSRBOT | 3+3 | 10.20 KB | 15 Jul 2008 - 06:47 |
| Ocelli | 446+1 | 146.84 MB | 12 Jul 2008 - 00:12 |
| Metaspinner | 1+1 | 3.91 KB | 07 Jul 2008 - 22:28 |
| yacy | 1+1 | 2.44 KB | 07 Jul 2008 - 16:30 |
| Web Core / Roots | 1 | 3.14 KB | 01 Jul 2008 - 08:04 |