1.1%
1.1% of the 1,745 scored sites in Public companies fail the test of whether robots.txt lets AI search crawlers in (RCH-1). A further 449 refused the scanner and are not counted.
- Sites
- 20 of 1,745 scored sites
- Group
- Public companies
- Test
- RCH-1: Can the AI tools that search the web read your site?
- Edition
- Census Q4 2026, Index 12.1, computed 2026-11-06
- Caveat
- A public roster, not a random sample of the web; says nothing about sites outside Public companies.
How to check
- The group and its sites: Public companies.
- How the census is run: methodology.
- The figures: summary.json or claims.json.
- Every published figure: all claims for the United States.
Link to this claim: https://readinessindex.io/census/2026-Q4/us/claims/public-companies-rch1-fail
Cite as TEN7 Readiness Index Census 2026-Q4
Source reply: Source: TEN7 Readiness Index Census 2026-Q4 (Index 12.1). Public companies, United States, n = 1,745. Public rosters, not a random sample of the web. Figures are CC BY 4.0. Data: https://readinessindex.io/census/2026-Q4/us/claims/public-companies-rch1-fail