Telling the humans from the bots — across 41 live websites. Right now.
Visitors yesterday
4,427
real · referred + return
Page views yesterday
6,727
served to humans
Bots filtered yesterday
69,907
spiders · unknown · blocked
Who’s really visiting · yesterday, across the fleet
11,613 human19,556 good crawlers (Google, Bing… welcomed)50,351 bad bots blocked · 86% non-human
The dyad — two views of the same traffic · yesterday
81,520
Requests the servers saw
8,535
Human pages (server log)
6,727
Human pages (JS beacon)
21%
Difference
2 Jul
3
4
5
6
7
8
9
10
11
12
13
14
15
beacon page viewsserver-log human pages
Both count the same thing — human page requests — measured two ways. The server log uses our corpus only, so a bot that behaves like a browser is counted as human. The JS beacon needs JavaScript, so it misses visitors who don’t run it. The real figure is between the two: the gap is an upper bound on behavioural bots, not a count. Assets, and the 86% that wasn’t human, don’t reach a JavaScript tracker.
Who’s crawling the network — last 30 days
Petal Search190,932
Bing112,133
Amazon56,744
ByteDance29,384
OpenAI / ChatGPT29,048
Google27,321
TikTok18,756
DataForSEO4,914
Apple4,864
Sogou2,618
489,327 crawler visits classified · welcomed, never counted as human traffic
What our humans browse with — last 30 days
Chrome75%
Safari19%
Firefox5%
Internet Explorer0%
Other0%
Opera0%
share of 245,601 classified human page views
Where our humans come from — last 30 days
fewermore visitors
🇬🇧 United Kingdom54%
🇸🇬 Singapore10%
🇺🇸 United States9%
🇳🇱 Netherlands6%
🇨🇳 China4%
🇸🇪 Sweden4%
🇩🇪 Germany2%
🇫🇷 France2%
🇮🇳 India2%
🇷🇺 Russia0%
🇨🇦 Canada0%
🇮🇩 Indonesia0%
top countries by unique engaged visitors · geolocated (DB-IP), CDN/cloud excluded · map: simple-world-map (CC BY-SA)
Defenses — the curated corpus
99
IP bans
217
Referrer rules
390
User-agent rules
191
URI rules
897 live block rules · and 300 search engines & 310 crawler signatures & 58 browsers classified.
Firewall — attacks blocked, last 30 days
4,043
Attacks blocked
2,339
Attacker IPs
3,080
SSH brute-force
963
Web probes
Where attacks come from · 98 countries
🇨🇳 China309
🇺🇸 United States302
🇮🇳 India135
🇸🇬 Singapore134
🇭🇰 Hong Kong121
🇮🇩 Indonesia119
🇰🇷 South Korea105
🇧🇷 Brazil104
🇩🇪 Germany94
🇯🇵 Japan79
Daily traffic — last 14 days, all sites
2 Jul
3
4
5
6
7
8
9
10
11
12
13
14
15
visitspage views
live · 41 sites · figures to 15 Jul · page generated 23:01