Indexed this run
266,357
continuous · 455,713 requests
Pages per second
210.2
182.7 average this run
Queue
1,000,189
449,590 hosts resolving
Parallel fetches
305
adaptive limit 512 of max 512 · 83,035 servers
Index
1,022,856
pages · 14.1 GB
Locked out
1,569
78 with scam signals
Pages indexed per second
Request outcomes this run
OK (2xx)
283,784
Redirects, queued
123,217
Not HTML
2,881
Client errors (4xx)
46,529
Server errors (5xx)
2,261
Network errors
13,078
Blocked by robots.txt
22,617
Server asked to slow down
5,677
Index quality
0.0 · slopquality1.0 · clean
60 % of pages score 0.7 or higher.
Average site reputation 0.29 · 22 segments
Busiest sites this run
github.com
355 pages
tagesschau.de
319 pages
syncaine.com
286 pages
abendblatt.de
277 pages
bigthink.com
266 pages
inquiryintoinquiry.com
266 pages
pcgamer.com
265 pages
steamcommunity.com
265 pages
pxhere.com
256 pages
coreyrobin.com
249 pages