Crawler access
95.1%

95.1% of the 974 scored sites in Cities are gated: AI crawlers are turned away by their robots.txt (RCH-1) or by their security (RCH-2). A further 24 refused the scanner and are not counted.

Sites
926 of 974 scored sites
Group
Cities
Test
RCH-1
Test
RCH-2
Edition
Census Q4 2026, Index 12.1, computed 2026-11-06
Caveat
A public roster, not a random sample of the web; says nothing about sites outside Cities.

How to check

Link to this claim: https://readinessindex.io/census/2026-Q4/us/claims/city-gated

Cite as TEN7 Readiness Index Census 2026-Q4

Source reply: Source: TEN7 Readiness Index Census 2026-Q4 (Index 12.1). Cities, United States, n = 974. Public rosters, not a random sample of the web. Figures are CC BY 4.0. Data: https://readinessindex.io/census/2026-Q4/us/claims/city-gated