Robots |
1 | 281 | 19.45 | Yahoo! Slurp |
2 | 222 | 15.36 | msnbot/1.0 (+http://search.msn.com/msnbo... |
3 | 132 | 9.13 | Gigabot/3.0 (http://www.gigablast.com/sp... |
4 | 86 | 5.95 | Python-urllib/2.5 |
5 | 84 | 5.81 | Googlebot/2.1 |
6 | 72 | 4.98 | Lycos_Spider_(modspider) |
7 | 63 | 4.36 | msnbot/1.1 (+http://search.msn.com/msnbo... |
8 | 61 | 4.22 | Speedy Spider (http://www.entireweb.com/... |
9 | 60 | 4.15 | Baiduspider+(+http://www.baidu.com/searc... |
10 | 59 | 4.08 | compatible Mozilla/5.0 |
11 | 34 | 2.35 | Ask Jeeves/Teoma |
12 | 30 | 2.08 | msnbot-media/1.0 (+http://search.msn.com... |
13 | 29 | 2.01 | NaverBot/1.0 |
14 | 29 | 2.01 | Exabot/3.0 |
15 | 27 | 1.87 | Firefox/2.0.0.11 |
16 | 19 | 1.31 | - |
17 | 17 | 1.18 | Firefox/2.0.0.12 |
18 | 16 | 1.11 | Firefox/2.0.0.9 |
19 | 15 | 1.04 | MSRBOT (http://research.microsoft.com/re... |
20 | 14 | 0.97 | psbot/0.1 (+http://www.picsearch.com/bot... |
21 | 9 | 0.62 | Yahoo! Slurp China |
22 | 8 | 0.55 | panscient.com |
23 | 8 | 0.55 | compatible Mozilla/2.0 |
24 | 7 | 0.48 | SurveyBot/2.3 (Whois Source) |
25 | 7 | 0.48 | Yeti/0.01 (nhn/1noon, yetibot@naver.com,... |
26 | 6 | 0.42 | Sosospider+(+http://help.soso.com/webspi... |
27 | 5 | 0.35 | Baiduspider+(+http://www.baidu.com/searc... |
28 | 5 | 0.35 | MJ12bot/v1.2.1 |
29 | 4 | 0.28 | NextGenSearchBot 1 (for information visi... |
30 | 4 | 0.28 | Ubuntu/7.10 |
31 | 4 | 0.28 | SBIder/SBIder-0.8.2-dev (http://www.site... |
32 | 4 | 0.28 | Pingdom GIGRIB (http://www.pingdom.com) |
33 | 3 | 0.21 | VadixBot |
34 | 2 | 0.14 | TurnitinBot/2.1 (http://www.turnitin.com... |
35 | 2 | 0.14 | GurujiBot/1.0 (+http://www.guruji.com/en... |
36 | 2 | 0.14 | Seekbot/1.0 (http://www.seekbot.net/bot.... |
37 | 2 | 0.14 | Nokia6680/1.0 ((4.04.07) SymbianOS/8.0 S... |
38 | 2 | 0.14 | Googlebot/2.1 (+http://www.google.com/bo... |
39 | 2 | 0.14 | Fedora/1.0.7 |
40 | 2 | 0.14 | Yahoo-MMCrawler/3.x (mms dash mmcrawler ... |
41 | 2 | 0.14 | ia_archiver-web.archive.org |
42 | 1 | 0.07 | NG/2.0 |
43 | 1 | 0.07 | MSIE 6.0 |
44 | 1 | 0.07 | multicrawler (+http://sw.deri.org/2006/0... |
45 | 1 | 0.07 | IITD/Nutch-0.8 (CSE) |
46 | 1 | 0.07 | EnaBot/1.1 (http://www.enaball.com/crawl... |