Telling the humans from the bots — across 40 live websites. Right now.
Visitors yesterday
2,235
real · referred + return
Page views yesterday
13,421
served to humans
Bots filtered yesterday
94,095
spiders · unknown · blocked
Who’s really visiting · yesterday, across the fleet
36,225 human29,108 good crawlers (Google, Bing… welcomed)64,987 bad bots blocked · 72% non-human
The dyad — two views of the same traffic · yesterday
130,320
Requests the servers saw
29,401
Human pages (server log)
13,421
Human pages (JS beacon)
54%
Difference
17 Aug
18
19
20
21
22
23
24
25
26
27
28
29
30
beacon page viewsserver-log human pages
Both count the same thing — human page requests — measured two ways. The server log uses our corpus only, so a bot that behaves like a browser is counted as human. The JS beacon needs JavaScript, so it misses visitors who don’t run it. The real figure is between the two: the gap is an upper bound on behavioural bots, not a count. Assets, and the 72% that wasn’t human, don’t reach a JavaScript tracker.
Who’s crawling the network — last 30 days
Petal Search210,999
Amazon78,782
Bing70,432
Google46,964
OpenAI / ChatGPT42,796
ByteDance35,450
Serpstat18,396
Apple8,987
TikTok5,331
Sogou5,018
543,726 crawler visits classified · welcomed, never counted as human traffic
What our humans browse with — last 30 days
Chrome69%
Safari20%
Firefox10%
Internet Explorer0%
Other0%
Opera0%
share of 261,119 classified human page views
Where our humans come from — last 30 days
fewermore visitors
🇬🇧 United Kingdom55%
🇺🇸 United States10%
🇨🇳 China8%
🇳🇱 Netherlands5%
🇩🇪 Germany4%
🇸🇪 Sweden2%
🇮🇳 India2%
🇫🇷 France1%
🇨🇦 Canada1%
🇦🇩 Andorra1%
🇷🇺 Russia1%
🇮🇩 Indonesia1%
top countries by unique engaged visitors · geolocated (DB-IP), CDN/cloud excluded · map: simple-world-map (CC BY-SA)
Defenses — the curated corpus
99
IP bans
217
Referrer rules
390
User-agent rules
191
URI rules
897 live block rules · and 300 search engines & 310 crawler signatures & 58 browsers classified.
Firewall — attacks blocked, last 30 days
1,699
Attacks blocked
866
Attacker IPs
263
SSH brute-force
1,436
Web probes
Where attacks come from · 55 countries
🇺🇸 United States237
🇨🇦 Canada65
🇩🇪 Germany45
🇸🇬 Singapore42
🇳🇱 Netherlands40
🇫🇷 France31
🇨🇳 China27
🇨🇭 Switzerland25
🇦🇩 Andorra25
🇵🇱 Poland24
Daily traffic — last 14 days, all sites
17 Aug
18
19
20
21
22
23
24
25
26
27
28
29
30
visitspage views
live · 40 sites · figures to 30 Aug · page generated 04:05