Telling the humans from the bots — across 41 live websites. Right now.
Visitors yesterday
2,585
real · referred + return
Page views yesterday
18,930
served to humans
Bots filtered yesterday
67,983
spiders · unknown · blocked
Who’s really visiting · yesterday, across the fleet
71,194 human31,442 good crawlers (Google, Bing… welcomed)36,541 bad bots blocked · 49% non-human
The dyad — two views of the same traffic · yesterday
139,177
Requests the servers saw
20,973
Human pages (server log)
18,930
Human pages (JS beacon)
10%
Difference
5 Oct
6
7
8
9
10
11
12
13
14
15
16
17
18
beacon page viewsserver-log human pages
Both count the same thing — human page requests — measured two ways. The server log uses our corpus only, so a bot that behaves like a browser is counted as human. The JS beacon needs JavaScript, so it misses visitors who don’t run it. The real figure is between the two: the gap is an upper bound on behavioural bots, not a count. Assets, and the 49% that wasn’t human, don’t reach a JavaScript tracker.
Who’s crawling the network — last 30 days
Petal Search229,832
Bing82,236
Google72,739
Amazon68,616
ByteDance42,831
OpenAI / ChatGPT24,383
Exa (exa.ai)20,456
Sogou20,123
Sonar / Perplexity15,255
Apple14,005
650,270 crawler visits classified · welcomed, never counted as human traffic
What our humans browse with — last 30 days
Chrome89%
Safari8%
Firefox3%
Internet Explorer0%
Other0%
Opera0%
share of 787,381 classified human page views
Where our humans come from — last 30 days
fewermore visitors
🇺🇸 United States26%
🇬🇧 United Kingdom23%
🇧🇩 Bangladesh4%
🇹🇷 Turkey4%
🇳🇱 Netherlands3%
🇩🇪 Germany3%
🇻🇪 VE3%
🇨🇦 Canada2%
🇺🇿 UZ2%
🇰🇪 Kenya2%
🇨🇳 China2%
🇫🇷 France2%
top countries by unique engaged visitors · geolocated (DB-IP), CDN/cloud excluded · map: simple-world-map (CC BY-SA)
Defenses — the curated corpus
100
IP bans
217
Referrer rules
390
User-agent rules
191
URI rules
898 live block rules · and 306 search engines & 316 crawler signatures & 58 browsers classified.
Firewall — attacks blocked, last 30 days
3,954
Attacks blocked
2,231
Attacker IPs
2,972
SSH brute-force
982
Web probes
Where attacks come from · 97 countries
🇨🇳 China384
🇺🇸 United States316
🇮🇳 India129
🇭🇰 Hong Kong114
🇰🇷 South Korea107
🇸🇬 Singapore103
🇳🇱 Netherlands98
🇮🇩 Indonesia92
🇻🇳 Vietnam83
🇩🇪 Germany76
Daily traffic — last 14 days, all sites
5 Oct
6
7
8
9
10
11
12
13
14
15
16
17
18
visitspage views
live · 41 sites · figures to 18 Oct · page generated 06:11