| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| YahooSeeker Yahoo! Blog crawler | 2120+67 | 763.65 MB | 30 Jun 2005 - 23:49 |
| Yahoo Slurp | 1360+540 | 157.07 MB | 30 Jun 2005 - 22:48 |
| Googlebot | 1430+102 | 677.58 MB | 30 Jun 2005 - 20:15 |
| MSNBot | 1139+155 | 307.75 MB | 30 Jun 2005 - 23:47 |
| Ask | 631+34 | 112.77 MB | 30 Jun 2005 - 22:23 |
| Java (Often spam bot) | 498+2 | 2.57 MB | 30 Jun 2005 - 23:59 |
| Python-urllib | 442 | 225.29 MB | 10 Jun 2005 - 12:42 |
| Ocelli | 384+1 | 1.65 MB | 12 Jun 2005 - 15:40 |
| Unknown robot (identified by 'bot*') | 239+94 | 1.11 MB | 30 Jun 2005 - 17:31 |
| aipbot | 216+14 | 1.99 MB | 26 Jun 2005 - 19:47 |
| BecomeBot | 178+32 | 1.19 MB | 30 Jun 2005 - 17:10 |
| ZyBorg | 205+4 | 2.14 MB | 23 Jun 2005 - 13:19 |
| Harvest | 147 | 972.26 KB | 30 Jun 2005 - 15:30 |
| Turn It In | 127+2 | 527.54 KB | 21 Jun 2005 - 12:07 |
| IRLbot | 80+19 | 149.78 KB | 16 Jun 2005 - 15:46 |
| Grub.org | 90+5 | 826.77 KB | 30 Jun 2005 - 23:02 |
| Unknown robot (identified by empty user agent string) | 52+40 | 7.20 MB | 29 Jun 2005 - 11:32 |
| ConveraCrawler | 81+2 | 539.29 KB | 23 Jun 2005 - 08:00 |
| Unknown robot (identified by 'crawl') | 46+35 | 90.21 KB | 30 Jun 2005 - 03:13 |
| noxtrumbot | 72+2 | 578.86 KB | 30 Jun 2005 - 11:45 |
| LinkWalker | 45+15 | 81.08 KB | 29 Jun 2005 - 23:14 |
| NutchCVS | 24+18 | 119.97 KB | 30 Jun 2005 - 23:58 |
| IBM Almaden Research Center WebFountain™ | 11+11 | 34.66 KB | 28 Jun 2005 - 08:00 |
| Voila | 8+9 | 35.40 KB | 29 Jun 2005 - 14:43 |
| Unknown robot (identified by 'spider') | 13+3 | 123.40 KB | 28 Jun 2005 - 01:02 |
| Alexa (IA Archiver) | 8+7 | 56.46 KB | 30 Jun 2005 - 01:57 |
| Custo | 13 | 495.79 KB | 18 Jun 2005 - 05:02 |
| sohu-search | 6+6 | 23.44 KB | 27 Jun 2005 - 15:41 |
| Girafabot | 10+2 | 41.99 KB | 07 Jun 2005 - 12:41 |
| larbin | 8+4 | 24.08 KB | 29 Jun 2005 - 07:09 |
| updated | 7+3 | 29.06 KB | 22 Jun 2005 - 14:06 |
| Nutch | 9+1 | 2.08 MB | 20 Jun 2005 - 22:23 |
| Yahoo-MMCrawler | 7+3 | 264 Bytes | 26 Jun 2005 - 21:14 |
| WGet tools | 3+5 | 944.14 KB | 25 Jun 2005 - 16:48 |
| Perl tool | 7 | 41.31 KB | 09 Jun 2005 - 05:32 |
| UdmSearch | 6 | 7.67 KB | 23 Jun 2005 - 14:43 |
| Openfind data gatherer | 3+3 | 7.04 KB | 16 Jun 2005 - 18:57 |
| Unknown robot (identified by hit on 'robots.txt') | 0+5 | 440 Bytes | 28 Jun 2005 - 07:08 |
| nicebot | 3+1 | 16.28 KB | 26 Jun 2005 - 14:34 |
| NG 2.x (Exalead) | 2+2 | 3.49 KB | 14 Jun 2005 - 08:34 |
| Cfetch | 2+1 | 7.73 KB | 30 Jun 2005 - 18:52 |
| Unknown robot (identified by 'robot') | 2+1 | 7.73 KB | 16 Jun 2005 - 18:01 |
| Pompos | 1+1 | 3.91 KB | 10 Jun 2005 - 23:12 |
| Checkbot | 2 | 0 | 27 Jun 2005 - 08:10 |
| Mirago | 1+1 | 531 Bytes | 21 Jun 2005 - 17:51 |
| Gaisbot | 1+1 | 3.91 KB | 07 Jun 2005 - 14:26 |
| Walhello appie | 0+2 | 176 Bytes | 30 Jun 2005 - 22:19 |
| BaiDuSpider | 1+1 | 3.91 KB | 08 Jun 2005 - 01:42 |
| MojeekBot | 1+1 | 3.91 KB | 24 Jun 2005 - 17:44 |
| ActiveBookmark | 2 | 7.64 KB | 25 Jun 2005 - 14:23 |
| Yandex bot | 2 | 10.73 KB | 03 Jun 2005 - 10:04 |
| Jakarta commons-httpclient | 1 | 527.12 KB | 17 Jun 2005 - 09:49 |
| ASPseek | 1 | 3.82 KB | 13 Jun 2005 - 15:10 |
| ProjectWF-java-test-crawler | 0+1 | 88 Bytes | 01 Jun 2005 - 23:09 |
| Findlinks | 1 | 3.82 KB | 13 Jun 2005 - 19:16 |
| GigaBot | 0+1 | 88 Bytes | 13 Jun 2005 - 19:13 |
| Robozilla | 1 | 3.82 KB | 20 Jun 2005 - 15:13 |
| HTTrack off-line browser | 1 | 0 | 27 Jun 2005 - 18:58 |
| Others | 0 | 0 | |