US Public Companies
public-companies
Every SEC-registered operating company with a security listed on a US exchange, each with the vertical its SIC code gives.
Median score
53
across 1745 sites
Middle half
44–59
spread around the median
Full range
18–77
lowest to highest
Gated
700 of 1745
block AI crawlers outright
Middle of 14 cohorts. All cohorts 50 · best cohort 58.
Where this list came from
The source, and how we filtered it
| Source | SEC company tickers by exchange, with EDGAR submissions (SIC code, website) and, for the S&P 500 flag, the Wikipedia constituent list, US Securities and Exchange Commission (SEC), with Wikidata and Wikipedia (2026-10-11) |
|---|---|
| License | SEC filings and the SEC's published data files are a work of the United States federal government and carry no domestic copyright (17 U.S.C. § 105). Web addresses found nowhere on EDGAR come from Wikidata (CC0) or from our own crawl of the S&P 500 list, disclosed per row. Membership of the S&P 500 comes from Wikipedia's constituent list, CC BY-SA 4.0, the same license this cohort goes out under; “S&P 500” is a registered trademark of S&P Dow Jones Indices LLC, naming the constituents is descriptive use, and nothing here is endorsed by or affiliated with S&P. |
| How we filtered it | Every CIK the SEC lists with a security on Nasdaq, NYSE, CBOE or TXSE (OTC and unlisted entries are not listed securities and are left out), read against its EDGAR submissions record for the SIC code, the company's own website and its tickers. Excluded as not operating companies: SIC 6221 (commodity pools and trusts), 6726 (unit investment trusts and investment vehicles), 6189 (asset-backed issuers), 6770 (blank-check shells), registrants with no SIC code (ETFs and grantor trusts) and registrants whose name says fund or exchange-traded product. A company with several share classes is one row. The web address is EDGAR's own `website` where it has one; else the address found by crawling for the S&P 500 list; else Wikidata's official website (P856) for the entity whose SEC CIK property (P5531) matches; else the row stays with a note. Each row says which. The vertical of each row is its SIC code's, through one table with ticker overrides (ten7_air/census/build_public_companies.py). Companies that share a website are all kept and measured once. The roster is as of the build date, and rows are in CIK order because the SEC data carries no measure of size to rank by. See scripts/prepare_public_companies.py. |
| Instead of | The S&P 500 alone, which this replaces: a list of 500 chosen by a committee, where the SEC's is every listed company and the 500 stay identifiable inside it. |
| Built | 2026-10-11 |
The filtering is ours and is disclosed as ours. The source published a list; the decision about which rows of it belong in a cohort was a judgment call, and it is written down so somebody can disagree with it.
Distribution
Where the 1745 sites land
| Grade | Share of the cohort | Sites | Share |
|---|---|---|---|
| Adequate | 427 | 24.5% | |
| Not ready | 315 | 18.1% | |
| Weak | 996 | 57.1% | |
| Strong | 7 | 0.4% |
By dimension
What the cohort earns, dimension by dimension
The mean share of each dimension’s available points that this cohort earned. Low here means the whole sector is weak on it, not that one site dragged an average down. The per-site spread is in the dataset.
| Dimension | Mean share earned | Mean |
|---|---|---|
| #1 · Reach
These parameters determine the fundamental ease of access that AI has to your site information. |
72% | |
| #2 · Read
AI generally turns off JavaScript. Does your site information survive without it? |
45% | |
| #3 · Understand
Does a machine know who and what you are? |
29% | |
| #4 · Act
Sitemaps, redirects, 404s, licensing terms, and not wasting the crawl budget. |
63% |
How much of each site we read
The cap is 32 URLs and it is a ceiling, not a promise. A portal whose every link points at a different host yields one page; a university yields the full sample. The median here is 32, the range 1–32, published so that "we sampled 32 URLs per site" cannot become a claim the data does not support.
51 sites in this cohort served a certificate we could not verify. They were read anyway and scored normally, because reporting no response for a site every browser loads would describe our TLS stack rather than the site, and each one carries the finding in its row.
Where this cohort fails
2 tests almost nobody in this cohort passes
Universal — nobody passes these
Near-universal — 95% and above
| Test | What it asks | Failing | Of | Points |
|---|---|---|---|---|
| EXT-12 | Do you tell search engines the moment a page changes? | 1745 | 0 | |
| EXT-16 | Do you publish a card or a skills list for the agents you run? | 1745 | 0 | |
| EXT-11 | Have you marked the part of a page that answers a spoken question? | 1745 | 0 | |
| PST-2 | Have you posted a Content Signals statement about what AI may do with your content? | 1745 | 0 | |
| EXT-2 | Do you list your APIs and agent tools where agents look for them? | 259 | 0 | |
| RED-10 | Do you offer a plain-text (Markdown) copy of your pages? | 1272 | 2 | |
| EXT-14 | Does your site offer its actions to AI browsers as tools? | 1603 | 0 | |
| RED-12 | If a machine asks for Markdown, does your site give it? | 1745 | 2 | |
| EXT-18 | Do you tell AI shoppers how they can pay? | 188 | 0 | |
| RED-5 | Do your PDFs and images have their own rules for search and quoting? | 1147 | 1 | |
| EXT-15 | Can an AI agent find out how to sign in to your site? | 21 | 0 |
Common — 90 to 95%
Coral bars mark tests worth 2 points or more, the failures that actually move a score.
Every site
Every 5,239, named, with a report for each
Whether or not it has been scanned. Rows with no website on record, sites that were unreachable and sites that turned us away stay in the table with the reason on them, and none of them enters an average: dropping them would shrink the population to the part that was easy to measure. A few points between two neighbors is noise. The box filters every row in the cohort, not only the page you are on; click a header to sort the rows on this page by name or by score.
Showing 1,301–1,400 of 5,239 · page 14 of 53
| Site | Score | Gated | Pages read | Report |
|---|---|---|---|---|
| Wintrust Financial Corp wintrust.comblockedWTFC, WTFCN · State Commercial Banks (SIC 6022); web address from Wikidata (P856), not EDGAR; not measured: HTTP 406 | — | No | — | |
| Outdoor Holding Co no website on recordPOWW, POWWP · Services-Business Services, NEC (SIC 7389); no web address found | — | No | — | |
| Sk Telecom Co Ltd sktelecom.comSKM · Radiotelephone Communications (SIC 4812); web address from Wikidata (P856), not EDGAR | 50 | Gated | 1 | |
| Aware Inc /Ma/ no website on recordAWRE · Services-Prepackaged Software (SIC 7372); no web address found | — | No | — | |
| Qiagen N.v. qiagen.comQGEN · Biological Products, (No Diagnostic Substances) (SIC 2836); web address from Wikidata (P856), not EDGAR | 41 | No | 32 | |
| Check Point Software Technologies Ltd checkpoint.comCHKP · Services-Prepackaged Software (SIC 7372); web address from Wikidata (P856), not EDGAR | 51 | No | 1 | |
| Carriage Services Inc no website on recordCSV · Services-Personal Services (SIC 7200); no web address found | — | No | — | |
| Radcom Ltd radcom.comRDCM · Computer Peripheral Equipment, NEC (SIC 3577); web address from Wikidata (P856), not EDGAR | 57 | Gated | 32 | |
| Transact Technologies Inc no website on recordTACT · Computer Peripheral Equipment, NEC (SIC 3577); no web address found | — | No | — | |
| CANADIAN NATURAL RESOURCES Ltd no website on recordCNQ · Crude Petroleum & Natural Gas (SIC 1311); no web address found | — | No | — | |
| Willis Lease Finance Corp no website on recordWLFC · Wholesale-Machinery, Equipment & Supplies (SIC 5080); no web address found | — | No | — | |
| Amazon Com Inc amazon.comblockedAMZN · Retail-Catalog & Mail-Order Houses (SIC 5961); S&P 500 · Consumer Discretionary; web address found by crawling for the S&P 500 list, not carried by EDGAR; not measured: HTTP 429 (rate limited) at every rate tried, after 4 attempts | — | No | — | |
| Abercrombie & Fitch Co /DE/ abercrombie.comANF · Retail-Family Clothing Stores (SIC 5651); web address from Wikidata (P856), not EDGAR | 42 | Gated | 32 | |
| Ati Inc atimetals.comATI · Steel Pipe & Tubes (SIC 3317); web address from Wikidata (P856), not EDGAR | 42 | Gated | 1 | |
| Amerisafe Inc no website on recordAMSF · Fire, Marine & Casualty Insurance (SIC 6331); no web address found | — | No | — | |
| Bio Key International Inc no website on recordBKYI · Services-Prepackaged Software (SIC 7372); no web address found | — | No | — | |
| Penske Automotive Group, Inc. penskeautomotive.comblockedPAG · Retail-Auto Dealers & Gasoline Stations (SIC 5500); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 (Cloudflare) | — | No | — | |
| Cerus Corp no website on recordCERS · Surgical & Medical Instruments & Apparatus (SIC 3841); no web address found | — | No | — | |
| Iron Mountain Inc ironmountain.comblockedIRM · Real Estate Investment Trusts (SIC 6798); S&P 500 · Real Estate; web address found by crawling for the S&P 500 list, not carried by EDGAR; not measured: HTTP 429 (rate limited) at every rate tried, after 4 attempts | — | No | — | |
| Dxp Enterprises Inc no website on recordDXPE · Wholesale-Industrial Machinery & Equipment (SIC 5084); no web address found | — | No | — | |
| United Natural Foods Inc unfi.comUNFI · Wholesale-Groceries, General Line (SIC 5141); web address from Wikidata (P856), not EDGAR | 53 | No | 1 | |
| Nu Skin Enterprises, Inc. nuskin.comNUS · Wholesale-Drugs, Proprietaries & Druggists' Sundries (SIC 5122); web address from Wikidata (P856), not EDGAR | 49 | No | 32 | |
| Oge Energy Corp. oge.comOGE · Electric Services (SIC 4911); web address from Wikidata (P856), not EDGAR | 62 | No | 32 | |
| NOV Inc. nov.comNOV · Oil & Gas Field Machinery & Equipment (SIC 3533); web address from Wikidata (P856), not EDGAR | 56 | No | 32 | |
| Quest Diagnostics Inc questdiagnostics.comDGX · Services-Medical Laboratories (SIC 8071); S&P 500 · Health Care; web address found by crawling for the S&P 500 list, not carried by EDGAR | 56 | Gated | 32 | |
| Genesis Energy LP no website on recordGEL · Pipe Lines (No Natural Gas) (SIC 4610); no web address found | — | No | — | |
| Eplus Inc eplus.comPLUS · Wholesale-Computers & Peripheral Equipment & Software (SIC 5045); web address from Wikidata (P856), not EDGAR | 69 | No | 32 | |
| Inseego Corp. no website on recordINSG · Communications Equipment, NEC (SIC 3669); no web address found | — | No | — | |
| Steel Dynamics Inc steeldynamics.comSTLD · Steel Works, Blast Furnaces & Rolling Mills (Coke Ovens) (SIC 3312); S&P 500 · Materials; web address found by crawling for the S&P 500 list, not carried by EDGAR | 40 | No | 31 | |
| Sumitomo Mitsui Financial Group, Inc. smfg.co.jpSMFG · Commercial Banks, NEC (SIC 6029); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| Ani Pharmaceuticals Inc no website on recordANIP · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| Lithia Motors Inc lithia.comLAD · Retail-Auto Dealers & Gasoline Stations (SIC 5500); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| Forrester Research, Inc. forrester.comFORR · Services-Engineering, Accounting, Research, Management (SIC 8700); web address from Wikidata (P856), not EDGAR | 61 | Gated | 32 | |
| Simulations Plus, Inc. simulations-plus.comSLP · Services-Computer Integrated Systems Design (SIC 7373); web address from Wikidata (P856), not EDGAR | 59 | No | 32 | |
| Drdgold Ltd drd.co.zaDRD · Gold and Silver Ores (SIC 1040); web address from Wikidata (P856), not EDGAR | 59 | No | 32 | |
| Harmony Gold Mining Co Ltd harmony.co.zablockedHMY · Gold and Silver Ores (SIC 1040); web address from Wikidata (P856), not EDGAR; not measured: challenge page (Imperva) | — | No | — | |
| Xtl Biopharmaceuticals Ltd xtlbio.comXTLB · Pharmaceutical Preparations (SIC 2834); web address from Wikidata (P856), not EDGAR | 63 | No | 32 | |
| 8X8 Inc /DE/ 8x8.comblockedEGHT · Services-Computer Processing & Data Preparation (SIC 7374); web address from Wikidata (P856), not EDGAR; not measured: HTTP 429 (rate limited) at every rate tried, after 4 attempts | — | No | — | |
| Olenox Industries Inc. no website on recordOLOX · Wholesale-Lumber & Other Construction Materials (SIC 5030); no web address found | — | No | — | |
| Coty Inc. coty.comCOTY · Perfumes, Cosmetics & Other Toilet Preparations (SIC 2844); vertical set by hand: a consumer brand that sells direct online; its SIC code is the factory's; web address from Wikidata (P856), not EDGAR | 61 | No | 32 | |
| Rockwell Automation, Inc rockwellautomation.comROK · Measuring & Controlling Devices, NEC (SIC 3829); S&P 500 · Industrials; web address found by crawling for the S&P 500 list, not carried by EDGAR | 47 | No | 32 | |
| Eltek Ltd no website on recordELTK · Printed Circuit Boards (SIC 3672); no web address found | — | No | — | |
| Helios Technologies, Inc. no website on recordHLIO · Miscellaneous Fabricated Metal Products (SIC 3490); no web address found | — | No | — | |
| W. P. Carey Inc. wpcarey.comWPC · Real Estate Investment Trusts (SIC 6798); web address from Wikidata (P856), not EDGAR | 47 | No | 32 | |
| Enterprise Financial Services Corp no website on recordEFSC, EFSCP · State Commercial Banks (SIC 6022); no web address found | — | No | — | |
| Kilroy Realty Corp no website on recordKRC · Real Estate Investment Trusts (SIC 6798); no web address found | — | No | — | |
| Core Molding Technologies Inc no website on recordCMT · Plastics Products, NEC (SIC 3089); no web address found | — | No | — | |
| Euro Tech Holdings Co Ltd no website on recordCLWT · Wholesale-Professional & Commercial Equipment & Supplies (SIC 5040); no web address found | — | No | — | |
| Highway Holdings Ltd no website on recordHIHO · Miscellaneous Fabricated Metal Products (SIC 3490); no web address found | — | No | — | |
| Asia Pacific Wire & Cable Corp Ltd no website on recordAPWC · Drawing & Insulating of Nonferrous Wire (SIC 3357); no web address found | — | No | — | |
| Banco Santander Chile santander.clBSAC · Commercial Banks, NEC (SIC 6029); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| Elbit Systems Ltd elbitsystems.comESLT · Aircraft Parts & Auxiliary Equipment, NEC (SIC 3728); web address from Wikidata (P856), not EDGAR | 54 | No | 32 | |
| Tactile Systems Technology Inc no website on recordTCMD · Surgical & Medical Instruments & Apparatus (SIC 3841); no web address found | — | No | — | |
| Euronet Worldwide, Inc. euronet.comEEFT · Functions Related To Depository Banking, NEC (SIC 6099); web address from Wikidata (P856), not EDGAR | 51 | No | 32 | |
| Idaho Strategic Resources, Inc. no website on recordIDR · Gold and Silver Ores (SIC 1040); no web address found | — | No | — | |
| Ofg Bancorp ofgbancorp.comblockedOFG · State Commercial Banks (SIC 6022); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 (Cloudflare) | — | No | — | |
| Utstarcom Holdings Corp. utstar.com.cnblockedUTSI · Communications Equipment, NEC (SIC 3669); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 | — | No | — | |
| Celestica Inc celestica.comCLS · Printed Circuit Boards (SIC 3672); web address from Wikidata (P856), not EDGAR | 35 | Gated | 32 | |
| Group 1 Automotive Inc group1auto.comblockedGPI · Retail-Auto Dealers & Gasoline Stations (SIC 5500); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 | — | No | — | |
| Global Self Storage, Inc. no website on recordSELF · Real Estate Investment Trusts (SIC 6798); no web address found | — | No | — | |
| Firstenergy Corp firstenergycorp.comFE · Electric Services (SIC 4911); S&P 500 · Utilities; web address found by crawling for the S&P 500 list, not carried by EDGAR | 52 | Gated | 32 | |
| Bentley Systems Inc bentley.comBSY · Services-Prepackaged Software (SIC 7372); web address from Wikidata (P856), not EDGAR | 67 | No | 32 | |
| Franklin Street Properties Corp /Ma/ no website on recordFSP · Real Estate Investment Trusts (SIC 6798); no web address found | — | No | — | |
| SLM Corp no website on recordSLM, SLMBP · Personal Credit Institutions (SIC 6141); no web address found | — | No | — | |
| Sempra sempra.comSRE, SREA · Gas & Other Services Combined (SIC 4932); S&P 500 · Utilities; web address found by crawling for the S&P 500 list, not carried by EDGAR | 52 | Gated | 32 | |
| Maximus, Inc. maximus.comMMS · Services-Business Services, NEC (SIC 7389); web address from Wikidata (P856), not EDGAR | 67 | No | 32 | |
| Logitech International S.a. logitech.comLOGI · Computer Peripheral Equipment, NEC (SIC 3577); web address from Wikidata (P856), not EDGAR | 56 | No | 32 | |
| United Microelectronics Corp umc.comblockedUMC · Semiconductors & Related Devices (SIC 3674); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 (Cloudflare) | — | No | — | |
| Sba Communications Corp sbasite.comSBAC · Real Estate Investment Trusts (SIC 6798); S&P 500 · Real Estate; web address found by crawling for the S&P 500 list, not carried by EDGAR | 50 | Gated | 31 | |
| Autoliv Inc autoliv.comblockedALV · Motor Vehicle Parts & Accessories (SIC 3714); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 (Cloudflare) | — | No | — | |
| Widepoint Corp no website on recordWYY · Services-Computer Integrated Systems Design (SIC 7373); no web address found | — | No | — | |
| Rigel Pharmaceuticals Inc no website on recordRIGL · Pharmaceutical Preparations (SIC 2834); no web address found | — | No | — | |
| Cresud Inc no website on recordCRESY · Real Estate (SIC 6500); no web address found | — | No | — | |
| Valero Energy Corp/TX valero.comVLO · Petroleum Refining (SIC 2911); S&P 500 · Energy; web address found by crawling for the S&P 500 list, not carried by EDGAR | 74 | No | 32 | |
| Shore Bancshares Inc no website on recordSHBI · National Commercial Banks (SIC 6021); no web address found | — | No | — | |
| California Water Service Group no website on recordCWT · Water Supply (SIC 4941); no web address found | — | No | — | |
| Intuitive Surgical Inc intuitive.comISRG · Orthopedic, Prosthetic & Surgical Appliances & Supplies (SIC 3842); S&P 500 · Health Care; web address found by crawling for the S&P 500 list, not carried by EDGAR | 21 | Gated | 1 | |
| Eloxx Pharmaceuticals, Inc. no website on recordELOX · Biological Products, (No Diagnostic Substances) (SIC 2836); no web address found | — | No | — | |
| Alexandria Real Estate Equities, Inc. are.comARE · Real Estate Investment Trusts (SIC 6798); S&P 500 · Real Estate; web address found by crawling for the S&P 500 list, not carried by EDGAR | 50 | No | 1 | |
| Comfort Systems USA Inc comfortsystemsusa.comFIX · Electrical Work (SIC 1731); S&P 500 · Industrials; web address found by crawling for the S&P 500 list, not carried by EDGAR | 29 | Gated | 1 | |
| INVE Technologies, Inc. no website on recordINVE · Computer Peripheral Equipment, NEC (SIC 3577); no web address found | — | No | — | |
| Intest Corp no website on recordINTT · Instruments For Meas & Testing of Electricity & Elec Signals (SIC 3825); no web address found | — | No | — | |
| Ralph Lauren Corp ralphlauren.comRL · Men's & Boys' Furnishgs, Work Clothg, & Allied Garments (SIC 2320); S&P 500 · Consumer Discretionary; vertical set by hand: a consumer brand that sells direct online; its SIC code is the factory's; web address found by crawling for the S&P 500 list, not carried by EDGAR | 39 | Gated | 32 | |
| BXP, Inc. bxp.comBXP · Real Estate Investment Trusts (SIC 6798); S&P 500 · Real Estate; web address found by crawling for the S&P 500 list, not carried by EDGAR | 64 | No | 32 | |
| Mettler Toledo International Inc/ mt.comblockedMTD · Laboratory Analytical Instruments (SIC 3826); S&P 500 · Health Care; web address found by crawling for the S&P 500 list, not carried by EDGAR; not measured: HTTP 406 | — | No | — | |
| Ametek Inc/ ametek.comAME · Industrial Instruments For Measurement, Display, and Control (SIC 3823); S&P 500 · Industrials; web address found by crawling for the S&P 500 list, not carried by EDGAR | 31 | Gated | 1 | |
| Jones Lang Lasalle Inc jll.deblockedJLL · Real Estate Agents & Managers (For Others) (SIC 6531); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 (Akamai) | — | No | — | |
| Silicon Laboratories Inc. silabs.comblockedSLAB · Semiconductors & Related Devices (SIC 3674); web address from Wikidata (P856), not EDGAR; not measured: HTTP 403 (Akamai) | — | No | — | |
| Ryanair Holdings Plc ryanair.comRYAAY · Air Transportation, Scheduled (SIC 4512); web address from Wikidata (P856), not EDGAR | 47 | No | 1 | |
| Smartfinancial Inc. no website on recordSMBK · National Commercial Banks (SIC 6021); no web address found | — | No | — | |
| Osi Systems Inc osi-systems.comOSIS · Semiconductors & Related Devices (SIC 3674); web address from Wikidata (P856), not EDGAR | 46 | No | 32 | |
| Netsol Technologies Inc no website on recordNTWK · Services-Prepackaged Software (SIC 7372); no web address found | — | No | — | |
| Formfactor Inc no website on recordFORM · Semiconductors & Related Devices (SIC 3674); no web address found | — | No | — | |
| Oneok Inc /New/ oneok.comOKE · Natural Gas Transmisison & Distribution (SIC 4923); S&P 500 · Energy; web address found by crawling for the S&P 500 list, not carried by EDGAR | 54 | No | 32 | |
| Ing Groep Nv ing.comING · Commercial Banks, NEC (SIC 6029); web address from Wikidata (P856), not EDGAR | 54 | No | 32 | |
| American National Group Inc. no website on recordANG-PD · Life Insurance (SIC 6311); no web address found | — | No | — | |
| Petmed Express Inc 1800petmeds.comPETS · Retail-Drug Stores and Proprietary Stores (SIC 5912); web address from Wikidata (P856), not EDGAR | 63 | No | 32 | |
| Pixelworks, Inc pixelworks.comPXLW · Services-Prepackaged Software (SIC 7372); web address from Wikidata (P856), not EDGAR | 33 | Gated | 1 | |
| Aehr Test Systems aehr.comAEHR · Instruments For Meas & Testing of Electricity & Elec Signals (SIC 3825); web address from Wikidata (P856), not EDGAR | 50 | Gated | 32 | |
| Ryman Hospitality Properties, Inc. rymanhp.comRHP · Real Estate Investment Trusts (SIC 6798); web address from Wikidata (P856), not EDGAR | 71 | No | 32 |
Scores are for the population, not for ranking two named sites against each other. A few points between neighbors is noise. See what these numbers can and cannot support. Data: sites.csv · checks.csv · summary.json