Robots |
1 | 143 | 23.71 | Googlebot/2.1 |
2 | 114 | 18.91 | MSIE 8.0 |
3 | 77 | 12.77 | compatible Mozilla/5.0 |
4 | 45 | 7.46 | YandexBot/3.0 |
5 | 40 | 6.63 | MJ12bot/v1.4.5 |
6 | 33 | 5.47 | bingbot/2.0 |
7 | 19 | 3.15 | Linux x86_64 |
8 | 19 | 3.15 | Twitterbot/1.0 |
9 | 18 | 2.99 | Yahoo! Slurp |
10 | 13 | 2.16 | Exabot/3.0 |
11 | 8 | 1.33 | DomainAppender /1.0 |
12 | 7 | 1.16 | - |
13 | 6 | 1.00 | BLEXBot/1.0 |
14 | 6 | 1.00 | meanpathbot/1.0 |
15 | 6 | 1.00 | SearchmetricsBot |
16 | 4 | 0.66 | CB/Nutch-1.7 |
17 | 4 | 0.66 | spbot/4.4.2 |
18 | 4 | 0.66 | CCBot/2.0 (http://commoncrawl.org/faq/) |
19 | 4 | 0.66 | Apache-HttpClient/4.2.2 (java 1.5) |
20 | 3 | 0.50 | SEOkicks-Robot |
21 | 3 | 0.50 | archive.org_bot |
22 | 3 | 0.50 | Screaming Frog SEO Spider/3.3 |
23 | 3 | 0.50 | AhrefsBot/5.0 |
24 | 2 | 0.33 | rogerbot/1.0 (http://moz.com/help/pro/wh... |
25 | 2 | 0.33 | msnbot-media/1.1 (+http://search.msn.com... |
26 | 2 | 0.33 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
27 | 2 | 0.33 | LSSRocketCrawler/1.0 LightspeedSystems |
28 | 2 | 0.33 | XoviBot/2.0 |
29 | 2 | 0.33 | Kraken/0.1 |
30 | 2 | 0.33 | InAGist URL Resolver (http://inagist.com... |
31 | 2 | 0.33 | ShowyouBot (http://showyou.com/crawler) |
32 | 1 | 0.17 | Python-urllib/1.17 |
33 | 1 | 0.17 | nutch-1.4/Nutch-1.4 |
34 | 1 | 0.17 | aiHitBot/2.9 |
35 | 1 | 0.17 | SemrushBot-SA/0.97 |
36 | 1 | 0.17 | Lipperhey-Kaus-Australis/5.0 |