Edge traffic
Every request to the projects on the front page, rolled up from the access log of the Traefik edge proxy in front of them. Most of it is crawlers. Updated every 10 minutes, last 9 min ago.
- Served
- 504K
- 94.7%
- Challenged
- 18K
- 3.4%
- Blocked
- 6.9K
- 1.3%
- Not found / other
- 3.1K
- 0.6%
- Server error
- 0
- 0.0%
Last 24 hours
Requests per hour, by outcome. Hours in UTC.
- Served
- Challenged
- Blocked
- Not found / other
- Server error
Daily
One bar per complete UTC day, kept indefinitely. History starts 2026-10-02: older raw logs had already rotated away.
- Served
- Challenged
- Blocked
- Not found / other
- Server error
Who is crawling
Grouped by the user agent each request claims, which is not verified: a scraper posing as Googlebot counts as Googlebot. The challenge page checks IPs instead, so impostors tend to show up as challenged. Served counts pages only: a crawler reading /robots.txt is counted under robots.txt, since that file is where disallowed bots are told to stay out. Last 24 hours.
| user agent | kind | requests | share | served | robots.txt | challenged | blocked | |
|---|---|---|---|---|---|---|---|---|
| Applebot | search | 236,563 | 44.4% | 100.0% | 39 | — | — | |
| meta-webindexer | ai search | 165,071 | 31.0% | 99.9% | — | — | — | |
| Claude-SearchBot | ai search | 82,130 | 15.4% | 100.0% | 14 | — | — | |
| browsers & other | 36,872 | 6.9% | 24.3% | 119 | 18,019 | 6,861 | ||
| Amazonbot | ai search | 5,243 | 1.0% | 99.8% | 1 | — | — | |
| Bingbot | search | 3,570 | 0.7% | 99.5% | 12 | — | — | |
| Baiduspider | search | 1,186 | 0.2% | 99.7% | — | 4 | — | |
| ExaSearchBot | ai search | 548 | 0.1% | 99.3% | 4 | — | — | |
| facebookexternalhit | preview | 326 | <0.1% | 94.5% | 17 | — | — | |
| Claude-User | ai fetch | 159 | <0.1% | 100.0% | — | — | — | |
| SEO tools | seo | 128 | <0.1% | 62.5% | 44 | — | — | |
| Googlebot | search | 114 | <0.1% | 83.3% | 18 | — | — | |
| ClaudeBot | training | 95 | <0.1% | 53.7% | 44 | — | — | |
| OAI-SearchBot | ai search | 72 | <0.1% | 70.8% | 21 | — | — | |
| Bytespider | training | 62 | <0.1% | 93.5% | 4 | — | — | |
| meta-externalagent | training | 48 | <0.1% | 68.8% | — | — | — | |
| GPTBot | training | 28 | <0.1% | 100.0% | — | — | — | |
| ChatGPT-User | ai fetch | 26 | <0.1% | 100.0% | — | — | — | |
| PerplexityBot | ai search | 26 | <0.1% | 61.5% | 7 | — | — | |
| DuckDuckBot | search | 21 | <0.1% | 66.7% | — | — | — | |
| YandexBot | search | 12 | <0.1% | 66.7% | 4 | — | — |
Tracked: residential-proxy scraper
Last 24 hours.
6 user agents · 5 blocked · 1 slowed (22-bit) · checked 9 min ago
- Pages taken
- 31
- served page loads
- Blocked
- 2.5K
- 65.6%
- Challenged
- 88
- 2.3%
- IPs
- 1.4K
- distinct, last 24 h
- Networks
- 473
- distinct /24s
- Solve time
- —
- none solved
- Served
- Challenged
- Blocked
- Not found / other
- Server error
- 10-13 11:09 UTC · Chrome UA now blocked
- 10-13 03:12 UTC · Chrome UA now blocked
- 10-13 03:12 UTC · Chrome UA now blocked
- 10-13 03:03 UTC · Chrome UA added, blocked · low-volume UA
- 10-13 03:03 UTC · Chrome UA added, blocked · low-volume UA
- 10-13 03:03 UTC · Firefox UA added, slowed · low-volume UA
- 10-13 03:03 UTC · Chrome UA added, slowed · set by hand
- 10-13 03:03 UTC · Chrome UA added, slowed · set by hand
By site
The projects on the front page. Blocked includes challenged. Latency is for served requests only. Last 24 hours.
| site | requests | served | blocked | 5xx | p50 | p95 |
|---|---|---|---|---|---|---|
| npiradar.com | 525,853 | 95.0% | 24,884 | — | 30 ms | 68 ms |
| camberstack.io | 3,030 | 60.7% | — | — | 3 ms | 1039 ms |
| theqrcode.io | 1,929 | 90.2% | — | — | 19 ms | 259 ms |
| redbudway.com | 787 | 74.7% | — | — | 1 ms | 52 ms |
| centurylate.com | 701 | 79.0% | — | — | 1 ms | 259 ms |