0.4%
0.4% of the 974 scored sites in Cities fail the test of whether robots.txt lets AI search crawlers in (RCH-1). A further 24 refused the scanner and are not counted.
- Sites
- 4 of 974 scored sites
- Group
- Cities
- Test
- RCH-1: Can the AI tools that search the web read your site?
- Edition
- Census Q4 2026, Index 12.1, computed 2026-11-06
- Caveat
- A public roster, not a random sample of the web; says nothing about sites outside Cities.
How to check
- The group and its sites: Cities.
- How the census is run: methodology.
- The figures: summary.json or claims.json.
- Every published figure: all claims for the United States.
Link to this claim: https://readinessindex.io/census/2026-Q4/us/claims/city-rch1-fail
Cite as TEN7 Readiness Index Census 2026-Q4
Source reply: Source: TEN7 Readiness Index Census 2026-Q4 (Index 12.1). Cities, United States, n = 974. Public rosters, not a random sample of the web. Figures are CC BY 4.0. Data: https://readinessindex.io/census/2026-Q4/us/claims/city-rch1-fail