US Public Companies
public-companies
Every SEC-registered operating company with a security listed on a US exchange, each with the vertical its SIC code gives.
Median score
53
across 1745 sites
Middle half
44–59
spread around the median
Full range
18–77
lowest to highest
Gated
700 of 1745
block AI crawlers outright
Middle of 14 cohorts. All cohorts 50 · best cohort 58.
Where this list came from
The source, and how we filtered it
| Source | SEC company tickers by exchange, with EDGAR submissions (SIC code, website) and, for the S&P 500 flag, the Wikipedia constituent list, US Securities and Exchange Commission (SEC), with Wikidata and Wikipedia (2026-10-11) |
|---|---|
| License | SEC filings and the SEC's published data files are a work of the United States federal government and carry no domestic copyright (17 U.S.C. § 105). Web addresses found nowhere on EDGAR come from Wikidata (CC0) or from our own crawl of the S&P 500 list, disclosed per row. Membership of the S&P 500 comes from Wikipedia's constituent list, CC BY-SA 4.0, the same license this cohort goes out under; “S&P 500” is a registered trademark of S&P Dow Jones Indices LLC, naming the constituents is descriptive use, and nothing here is endorsed by or affiliated with S&P. |
| How we filtered it | Every CIK the SEC lists with a security on Nasdaq, NYSE, CBOE or TXSE (OTC and unlisted entries are not listed securities and are left out), read against its EDGAR submissions record for the SIC code, the company's own website and its tickers. Excluded as not operating companies: SIC 6221 (commodity pools and trusts), 6726 (unit investment trusts and investment vehicles), 6189 (asset-backed issuers), 6770 (blank-check shells), registrants with no SIC code (ETFs and grantor trusts) and registrants whose name says fund or exchange-traded product. A company with several share classes is one row. The web address is EDGAR's own `website` where it has one; else the address found by crawling for the S&P 500 list; else Wikidata's official website (P856) for the entity whose SEC CIK property (P5531) matches; else the row stays with a note. Each row says which. The vertical of each row is its SIC code's, through one table with ticker overrides (ten7_air/census/build_public_companies.py). Companies that share a website are all kept and measured once. The roster is as of the build date, and rows are in CIK order because the SEC data carries no measure of size to rank by. See scripts/prepare_public_companies.py. |
| Instead of | The S&P 500 alone, which this replaces: a list of 500 chosen by a committee, where the SEC's is every listed company and the 500 stay identifiable inside it. |
| Built | 2026-10-11 |
The filtering is ours and is disclosed as ours. The source published a list; the decision about which rows of it belong in a cohort was a judgment call, and it is written down so somebody can disagree with it.
Distribution
Where the 1745 sites land
| Grade | Share of the cohort | Sites | Share |
|---|---|---|---|
| Adequate | 427 | 24.5% | |
| Not ready | 315 | 18.1% | |
| Weak | 996 | 57.1% | |
| Strong | 7 | 0.4% |
By dimension
What the cohort earns, dimension by dimension
The mean share of each dimension’s available points that this cohort earned. Low here means the whole sector is weak on it, not that one site dragged an average down. The per-site spread is in the dataset.
| Dimension | Mean share earned | Mean |
|---|---|---|
| #1 · Reach
These parameters determine the fundamental ease of access that AI has to your site information. |
72% | |
| #2 · Read
AI generally turns off JavaScript. Does your site information survive without it? |
45% | |
| #3 · Understand
Does a machine know who and what you are? |
29% | |
| #4 · Act
Sitemaps, redirects, 404s, licensing terms, and not wasting the crawl budget. |
63% |
How much of each site we read
The cap is 32 URLs and it is a ceiling, not a promise. A portal whose every link points at a different host yields one page; a university yields the full sample. The median here is 32, the range 1–32, published so that "we sampled 32 URLs per site" cannot become a claim the data does not support.
51 sites in this cohort served a certificate we could not verify. They were read anyway and scored normally, because reporting no response for a site every browser loads would describe our TLS stack rather than the site, and each one carries the finding in its row.
Where this cohort fails
2 tests almost nobody in this cohort passes
Universal — nobody passes these
Near-universal — 95% and above
| Test | What it asks | Failing | Of | Points |
|---|---|---|---|---|
| EXT-12 | Do you tell search engines the moment a page changes? | 1745 | 0 | |
| EXT-16 | Do you publish a card or a skills list for the agents you run? | 1745 | 0 | |
| EXT-11 | Have you marked the part of a page that answers a spoken question? | 1745 | 0 | |
| PST-2 | Have you posted a Content Signals statement about what AI may do with your content? | 1745 | 0 | |
| EXT-2 | Do you list your APIs and agent tools where agents look for them? | 259 | 0 | |
| RED-10 | Do you offer a plain-text (Markdown) copy of your pages? | 1272 | 2 | |
| EXT-14 | Does your site offer its actions to AI browsers as tools? | 1603 | 0 | |
| RED-12 | If a machine asks for Markdown, does your site give it? | 1745 | 2 | |
| EXT-18 | Do you tell AI shoppers how they can pay? | 188 | 0 | |
| RED-5 | Do your PDFs and images have their own rules for search and quoting? | 1147 | 1 | |
| EXT-15 | Can an AI agent find out how to sign in to your site? | 21 | 0 |
Common — 90 to 95%
Coral bars mark tests worth 2 points or more, the failures that actually move a score.
Every site
Every 5,239, named, with a report for each
Whether or not it has been scanned. Rows with no website on record, sites that were unreachable and sites that turned us away stay in the table with the reason on them, and none of them enters an average: dropping them would shrink the population to the part that was easy to measure. A few points between two neighbors is noise. The box filters every row in the cohort, not only the page you are on; click a header to sort the rows on this page by name or by score.
Showing 1,501–1,600 of 5,239 · page 16 of 53
| Site | Score | Gated | Pages read | Report |
|---|---|---|---|---|
| Peabody Energy Corp peabodyenergy.comBTU · Bituminous Coal & Lignite Surface Mining (SIC 1221); web address from Wikidata (P856), not EDGAR | 58 | No | 32 | |
| Centrus Energy Corp no website on recordLEU · Mining & Quarrying of Nonmetallic Minerals (No Fuels) (SIC 1400); no web address found | — | No | — | |
| Network-1 Technologies, Inc. no website on recordNTIP · Patent Owners & Lessors (SIC 6794); no web address found | — | No | — | |
| Ebay Inc ebayinc.comblockedEBAY · Services-Business Services, NEC (SIC 7389); S&P 500 · Consumer Discretionary; vertical set by hand: an online marketplace, which SIC files under business services; web address found by crawling for the S&P 500 list, not carried by EDGAR; not measured: HTTP 403 | — | No | — | |
| Netflix Inc netflix.comNFLX · Services-Video Tape Rental (SIC 7841); S&P 500 · Communication Services; web address found by crawling for the S&P 500 list, not carried by EDGAR | 60 | No | 32 | |
| Lkq Corp lkqcorp.comLKQ · Wholesale-Motor Vehicles & Motor Vehicle Parts & Supplies (SIC 5010); web address from Wikidata (P856), not EDGAR | 50 | No | 32 | |
| Telefonica Brasil S.a. telefonica.com.brVIV · Telephone Communications (No Radiotelephone) (SIC 4813); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| EGAIN Corp egain.comEGAN · Services-Prepackaged Software (SIC 7372); web address from Wikidata (P856), not EDGAR | 47 | Gated | 32 | |
| Bimergen Energy Corp no website on recordBESS, BESS-WT · Electric Services (SIC 4911); no web address found | — | No | — | |
| Future FinTech Group Inc. no website on recordFTFT · Services-Business Services, NEC (SIC 7389); no web address found | — | No | — | |
| Cracker Barrel Old Country Store, Inc crackerbarrel.comblockedCBRL · Retail-Eating Places (SIC 5812); web address from Wikidata (P856), not EDGAR; not measured: HTTP 429 (rate limited) at every rate tried, after 4 attempts | — | No | — | |
| Infosys Ltd infosys.comINFY · Services-Computer Programming Services (SIC 7371); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| United Rentals, Inc. unitedrentals.comblockedURI · Services-Equipment Rental & Leasing, NEC (SIC 7359); S&P 500 · Industrials; web address found by crawling for the S&P 500 list, not carried by EDGAR; not measured: HTTP 403 (Cloudflare) | — | No | — | |
| Berkshire Hathaway Inc berkshirehathaway.comBRK-B, BRK-A · Fire, Marine & Casualty Insurance (SIC 6331); S&P 500 · Financials; web address found by crawling for the S&P 500 list, not carried by EDGAR | 50 | Gated | 1 | |
| Prosperity Bancshares Inc prosperitybankusa.comPB · State Commercial Banks (SIC 6022); web address from Wikidata (P856), not EDGAR | 38 | No | 1 | |
| East West Bancorp Inc eastwestbank.comEWBC · State Commercial Banks (SIC 6022); web address from Wikidata (P856), not EDGAR | 69 | No | 32 | |
| Axon Enterprise, Inc. axon.comAXON · Ordnance & Accessories, (No Vehicles/Guided Missiles) (SIC 3480); S&P 500 · Industrials; web address found by crawling for the S&P 500 list, not carried by EDGAR | 37 | Gated | 32 | |
| Lennox International Inc lennox.comLII · Air-Cond & Warm Air Heatg Equip & Comm & Indl Refrig Equip (SIC 3585); S&P 500 · Industrials; web address found by crawling for the S&P 500 list, not carried by EDGAR | 38 | No | 1 | |
| Kratos Defense & Security Solutions, Inc. sat.comblockedKTOS · Guided Missiles & Space Vehicles & Parts (SIC 3760); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 | — | No | — | |
| Flexible Solutions International Inc no website on recordFSI · Miscellaneous Chemical Products (SIC 2890); no web address found | — | No | — | |
| Filana Therapeutics, Inc. no website on recordFLNA · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| Rgc Resources Inc rgcresources.comRGCO · Natural Gas Transmisison & Distribution (SIC 4923); web address from Wikidata (P856), not EDGAR | 74 | No | 1 | |
| Trex Co Inc trex.comTREX · Lumber & Wood Products (No Furniture) (SIC 2400); web address from Wikidata (P856), not EDGAR | 43 | Gated | 32 | |
| Phibro Animal Health Corp no website on recordPAHC · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| Ptc Therapeutics, Inc. ptcbio.comPTCT · Pharmaceutical Preparations (SIC 2834); web address from Wikidata (P856), not EDGAR | 66 | No | 32 | |
| BLACKBERRY Ltd blackberry.comBB · Services-Prepackaged Software (SIC 7372); web address from Wikidata (P856), not EDGAR | 65 | No | 30 | |
| First Capital Inc no website on recordFCAP · Savings Institution, Federally Chartered (SIC 6035); no web address found | — | No | — | |
| Orix Corp orix.co.jpIX · Miscellaneous Business Credit Institution (SIC 6159); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| CNX Resources Corp consolenergy.comCNX · Crude Petroleum & Natural Gas (SIC 1311); web address from Wikidata (P856), not EDGAR | 71 | No | 1 | |
| Plains All American Pipeline LP no website on recordPAA · Pipe Lines (No Natural Gas) (SIC 4610); no web address found | — | No | — | |
| Acadia Pharmaceuticals Inc acadia-pharm.comACAD · Pharmaceutical Preparations (SIC 2834); web address from Wikidata (P856), not EDGAR | 72 | No | 1 | |
| Greene County Bancorp Inc no website on recordGCBC · Savings Institutions, Not Federally Chartered (SIC 6036); no web address found | — | No | — | |
| Cf Bankshares Inc. no website on recordCFBK · National Commercial Banks (SIC 6021); no web address found | — | No | — | |
| Host Hotels & Resorts, Inc. hosthotels.comHST · Real Estate Investment Trusts (SIC 6798); S&P 500 · Real Estate; web address found by crawling for the S&P 500 list, not carried by EDGAR | 33 | Gated | 1 | |
| CoreCivic, Inc. corecivic.comCXW · Real Estate Investment Trusts (SIC 6798); web address from Wikidata (P856), not EDGAR | 55 | No | 32 | |
| Red River Bancshares Inc no website on recordRRBI · State Commercial Banks (SIC 6022); no web address found | — | No | — | |
| Turkcell Iletisim Hizmetleri a S turkcell.com.trTKC · Telephone Communications (No Radiotelephone) (SIC 4813); web address from Wikidata (P856), not EDGAR | 62 | No | 32 | |
| Braskem Sa braskem.com.brBAK · Industrial Organic Chemicals (SIC 2860); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| Centene Corp centene.comCNC · Hospital & Medical Service Plans (SIC 6324); S&P 500 · Health Care; web address found by crawling for the S&P 500 list, not carried by EDGAR | 47 | Gated | 32 | |
| KINGSWAY Corp no website on recordKWY · Fire, Marine & Casualty Insurance (SIC 6331); no web address found | — | No | — | |
| Gerdau S.a. gerdau.com.brGGB · Steel Works, Blast Furnaces & Rolling & Finishing Mills (SIC 3310); web address from Wikidata (P856), not EDGAR | 31 | Gated | 1 | |
| USBC, Inc. no website on recordUSBC · Finance Services (SIC 6199); no web address found | — | No | — | |
| Modular Medical, Inc. no website on recordMODD · Surgical & Medical Instruments & Apparatus (SIC 3841); no web address found | — | No | — | |
| Lcnb Corp no website on recordLCNB · National Commercial Banks (SIC 6021); no web address found | — | No | — | |
| Thomson Reuters Corp /Can/ thomsonreuters.comTRI · Miscellaneous Publishing (SIC 2741); web address from Wikidata (P856), not EDGAR | 70 | No | 32 | |
| Diversified Healthcare Trust no website on recordDHC, DHCNI, DHCNL · Real Estate Investment Trusts (SIC 6798); no web address found | — | No | — | |
| Booking Holdings Inc. bookingholdings.comBKNG · Transportation Services (SIC 4700); S&P 500 · Consumer Discretionary; web address found by crawling for the S&P 500 list, not carried by EDGAR | 48 | No | 32 | |
| Crexendo, Inc. no website on recordCXDO · Telephone Communications (No Radiotelephone) (SIC 4813); no web address found | — | No | — | |
| Kazia Therapeutics Ltd no website on recordKZIA · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| Cemex Sab DE Cv cemex.comblockedCX · Cement, Hydraulic (SIC 3241); web address from Wikidata (P856), not EDGAR; not measured: challenge page (Imperva) | — | No | — | |
| Novanta Inc no website on recordNOVT, NOVTU · Miscellaneous Electrical Machinery, Equipment & Supplies (SIC 3690); no web address found | — | No | — | |
| Neogenomics Inc neogenomics.comNEO · Services-Testing Laboratories (SIC 8734); web address from Wikidata (P856), not EDGAR | 55 | No | 32 | |
| Texas Capital Bancshares Inc/TX texascapitalbank.comTCBI, TCBIO · State Commercial Banks (SIC 6022); web address from Wikidata (P856), not EDGAR | 66 | No | 32 | |
| HOOKER FURNISHINGS Corp no website on recordHOFT · Household Furniture (SIC 2510); no web address found | — | No | — | |
| Netscout Systems Inc netscout.comNTCT · Services-Computer Integrated Systems Design (SIC 7373); web address from Wikidata (P856), not EDGAR | 53 | Gated | 32 | |
| Extreme Networks Inc extremenetworks.comEXTR · Computer Communications Equipment (SIC 3576); web address from Wikidata (P856), not EDGAR | 62 | No | 32 | |
| Innoviva, Inc. no website on recordINVA · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| Manhattan Bridge Capital, Inc no website on recordLOAN · Real Estate Investment Trusts (SIC 6798); no web address found | — | No | — | |
| Presidio Property Trust, Inc. no website on recordSQFT, SQFTP, SQFTW · Real Estate Investment Trusts (SIC 6798); no web address found | — | No | — | |
| Intellinetics, Inc. no website on recordINLX · Services-Prepackaged Software (SIC 7372); no web address found | — | No | — | |
| VirnetX Holding Corp virnetx.comVHC · Patent Owners & Lessors (SIC 6794); web address from Wikidata (P856), not EDGAR | 49 | Gated | 30 | |
| UNITED THERAPEUTICS Corp no website on recordUTHR · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| XCel Brands, Inc. no website on recordXELB · Patent Owners & Lessors (SIC 6794); no web address found | — | No | — | |
| Terawulf Inc. no website on recordWULF · Finance Services (SIC 6199); no web address found | — | No | — | |
| Astrana Health, Inc. no website on recordASTH · Services-Management Consulting Services (SIC 8742); no web address found | — | No | — | |
| Flux Power Holdings, Inc. no website on recordFLUX · Miscellaneous Electrical Machinery, Equipment & Supplies (SIC 3690); no web address found | — | No | — | |
| Ziff Davis, Inc. j2global.comZD · Telegraph & Other Message Communications (SIC 4822); web address from Wikidata (P856), not EDGAR | 51 | No | 1 | |
| Sinovac Biotech Ltd sinovac.comSVA · Pharmaceutical Preparations (SIC 2834); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| LIGHTBRIDGE Corp no website on recordLTBR · Industrial Inorganic Chemicals (SIC 2810); no web address found | — | No | — | |
| Resources Connection, Inc. no website on recordRGP · Services-Business Services, NEC (SIC 7389); no web address found | — | No | — | |
| 1 800 Flowers Com Inc no website on recordFLWS · Retail-Retail Stores, NEC (SIC 5990); no web address found | — | No | — | |
| Encore Capital Group Inc encorecapital.comECPG · Short-Term Business Credit Institutions (SIC 6153); web address from Wikidata (P856), not EDGAR | 48 | No | 32 | |
| Natural Gas Services Group Inc no website on recordNGS · Oil & Gas Field Services, NEC (SIC 1389); no web address found | — | No | — | |
| VirTra, Inc no website on recordVTSI · Miscellaneous Manufacturing Industries (SIC 3990); no web address found | — | No | — | |
| Akamai Technologies Inc akamai.comblockedAKAM · Services-Business Services, NEC (SIC 7389); S&P 500 · Information Technology; web address found by crawling for the S&P 500 list, not carried by EDGAR; not measured: HTTP 403 | — | No | — | |
| Audiocodes Ltd audiocodes.comAUDC · Telephone & Telegraph Apparatus (SIC 3661); web address from Wikidata (P856), not EDGAR | 61 | Gated | 32 | |
| Alliance Resource Partners LP no website on recordARLP · Bituminous Coal & Lignite Surface Mining (SIC 1221); no web address found | — | No | — | |
| Fabric.AI, Inc. wpcs.comFABC · Communications Services, NEC (SIC 4899); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| Manulife Financial Corp manulife.cablockedMFC · Life Insurance (SIC 6311); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 | — | No | — | |
| Cumberland Pharmaceuticals Inc no website on recordCPIX · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| Usio, Inc. no website on recordUSIO · Functions Related To Depository Banking, NEC (SIC 6099); no web address found | — | No | — | |
| Corcept Therapeutics Inc corcept.comCORT · Pharmaceutical Preparations (SIC 2834); web address from Wikidata (P856), not EDGAR | 54 | Gated | 32 | |
| Dick's Sporting Goods, Inc. dickssportinggoods.comblockedDKS · Retail-Miscellaneous Shopping Goods Stores (SIC 5940); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 (Akamai) | — | No | — | |
| Hsbc Holdings Plc hsbc.comHSBC · Savings Institution, Federally Chartered (SIC 6035); web address from Wikidata (P856), not EDGAR | 76 | No | 32 | |
| Gaia, Inc gaia.comGAIA · Services-Motion Picture & Video Tape Production (SIC 7812); web address from Wikidata (P856), not EDGAR | 48 | No | 32 | |
| SWK Holdings Corp no website on recordSWKHL · Miscellaneous Business Credit Institution (SIC 6159); no web address found | — | No | — | |
| Southern First Bancshares Inc no website on recordSFST · National Commercial Banks (SIC 6021); no web address found | — | No | — | |
| Devon Energy Corp/DE devonenergy.comDVN · Crude Petroleum & Natural Gas (SIC 1311); S&P 500 · Energy; web address found by crawling for the S&P 500 list, not carried by EDGAR | 53 | Gated | 32 | |
| Lamar Advertising Co/New lamar.comLAMR · Real Estate Investment Trusts (SIC 6798); web address from Wikidata (P856), not EDGAR | 53 | No | 32 | |
| United Parcel Service Inc ups.comUPS · Trucking & Courier Services (No Air) (SIC 4210); S&P 500 · Industrials; web address found by crawling for the S&P 500 list, not carried by EDGAR | 46 | No | 1 | |
| Agilent Technologies, Inc. agilent.comblockedA · Laboratory Analytical Instruments (SIC 3826); S&P 500 · Health Care; web address found by crawling for the S&P 500 list, not carried by EDGAR; not measured: HTTP 403 (Akamai) | — | No | — | |
| Materialise Nv materialise.comMTLS · Services-Prepackaged Software (SIC 7372); web address from Wikidata (P856), not EDGAR | 52 | No | 32 | |
| Charter Communications, Inc. /Mo/ charter.comCHTR, CHTRP · Cable & Other Pay Television Services (SIC 4841); S&P 500 · Communication Services; web address found by crawling for the S&P 500 list, not carried by EDGAR | 33 | Gated | 1 | |
| Sps Commerce Inc spscommerce.comSPSC · Services-Prepackaged Software (SIC 7372); web address from Wikidata (P856), not EDGAR | 51 | Gated | 32 | |
| Smith & Wesson Brands, Inc. no website on recordSWBI · Ordnance & Accessories, (No Vehicles/Guided Missiles) (SIC 3480); no web address found | — | No | — | |
| Dexcom Inc dexcom.comDXCM · Surgical & Medical Instruments & Apparatus (SIC 3841); S&P 500 · Health Care; web address found by crawling for the S&P 500 list, not carried by EDGAR | 49 | Gated | 32 | |
| Peoples Bancorp of North Carolina Inc no website on recordPEBK · State Commercial Banks (SIC 6022); no web address found | — | No | — | |
| Plug Power Inc plugpower.comPLUG · Electrical Industrial Apparatus (SIC 3620); web address from Wikidata (P856), not EDGAR | 49 | Gated | 32 | |
| Marker Therapeutics, Inc. no website on recordMRKR · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| Teledyne Technologies Inc teledyne.comTDY · Search, Detection, Navigation, Guidance, Aeronautical Sys (SIC 3812); S&P 500 · Information Technology; web address found by crawling for the S&P 500 list, not carried by EDGAR | 50 | No | 1 |
Scores are for the population, not for ranking two named sites against each other. A few points between neighbors is noise. See what these numbers can and cannot support. Data: sites.csv · checks.csv · summary.json