Spyglasses Research

When AI consults a website directly, it is usually not the brand you asked about. The sites it picks form a measurable authority club.

Spyglasses Research · September 1, 2026 · spec & code

Key findings

Why we asked

Since late July 2026, ChatGPT’s grounding searches sometimes carry an explicit site:domain.com operator. That is the model electing to consult one specific site rather than search the open web. The arrival of this behavior has been widely noted in the AI-visibility community. What had not been examined is the question that matters for anyone deciding where to spend content and PR effort: who receives these consultations, and what do the chosen sites have in common?

We had a prediction going in. A direct consultation skips open-web ranking entirely, so the model must choose the site from its own prior sense of who is authoritative. If that is right, the consulted list should skew toward authority the model saw in training, such as position in the web’s link graph, rather than simply tracking current search rankings.

Methods in brief

We evaluated 97,377 grounding-search executions recorded for ChatGPT in this study. 6,923 of them carried a site: scope. We classified each scoped search against the triggering brand’s current identity as own, competitor, or third-party. We also classified every consulted domain into a fourteen-kind taxonomy (2,934 domains including brand-panel domains). That classification was AI-assisted, worked from the bare domain only, and the highest-volume domains were reviewed by hand. The full mapping is committed for reproducibility.

For the authority contrast, we built a pool per answer on category-level prompts: every third-party domain the model either consulted directly or cited without consulting. That gave us 363,028 (answer, domain) pairs across 70,090 distinct domains evaluated in this study. We compared the two classes on Common Crawl harmonic-centrality rank and on the AI Placement Value Score, computed with the production scorer. AIPVS coverage for the cited-only class comes from a seeded random sample of 5,000 domains. Sampling the control class this way leaves odds ratios consistent; it only shifts the intercept.

Model estimates come from a conditional logit that compares domains within the same answer, with bootstrap intervals clustered by domain. We landed on that estimator because our own placebo gate forced a repair; the Results section tells that story, and the spec records it as deviation D1. The full pre-registration is in the frozen spec (commit 065e37d). One label up front: we examined the joint distributions before the freeze to select predictors, so we report the model results as exploratory with a disclosed selection step, not as clean confirmatory pre-registration.

Results

Who gets consulted

Paired horizontal bars comparing observed vs sector-balanced shares of third-party consultations by kind. Government and courts lead at 23% observed, 22% sector-balanced.

Government and court sites lead the third-party list. Ordinary businesses come next, and many of those are competitors the asking brand does not track. AI and software vendors, law firms, and professional associations follow.

Our client panel is law-heavy. Law-firm clients trigger 30% of third-party consultations. So the orange series re-weights every client sector equally. Under that balancing, law firms drop from 10% to 5%. Government and courts barely move, from 23% to 22%. The institutional skew survives the panel correction.

The authority contrast

Two stacked bars of AI Placement Value tiers: consulted directly vs cited but never consulted. Premium plus Strong: 62% vs 41%.
metric (domain level)consultedcited-only
Ranked in Common Crawl graph62.9%42.9%
Median graph rank#485k#2.33M
Median AIPVS6044
AIPVS Premium + Strong62.4%41.0%

Our controls earned their keep here, and we report that plainly. The label-shuffle placebo came back non-null under the pooled estimator we froze. That told us part of the pooled association was leaking in from differences between answers, not from the model’s choice of domain within an answer. Per the gate, we stopped. We repaired the estimator to a conditional logit that compares domains only within the same answer. The spec records this as deviation D1, and the pooled run stays in the repository. Under the repaired estimator every placebo is null. The within-answer results:

The positive control passed: the government and professional-association cohort consults at 9.9 times the pool base rate, against a gate of 3. The domain-name-length placebo was null.

What triggers a consultation

Bar chart: share of answers with a direct site consultation. Brand-comparison prompts 20%, brand-identity 9%, category-level 8%.

Brand-comparison prompts consulted a site directly in 20% of answers. Brand-identity prompts did so in 9%, and category-level prompts in 8%. The model goes to primary sources when it weighs one brand against another. That makes factual, non-superlative comparison pages the content format most directly tied to consultation behavior.

The precursor behavior

Monthly lines: share of open-web grounding searches naming a brand, ChatGPT, Gemini and Claude, rising from about 3% in February to 11-15% in August 2026.

Before the operator existed, models did the same thing by naming a brand inside an open-web search. That behavior appears on every platform in this study. It reaches back to at least February 2026 on Gemini, and it roughly tripled over the summer, to 11% to 15% of open-web grounding searches in August.

What we can and cannot claim

This design measures a conditional association, not a cause. Among domains the model retrieved or cited for category-level prompts, the ones it consults directly sit higher on public authority metrics. No one assigned authority at random. We cannot say that raising a domain’s centrality or AIPVS causes consultations.

The pool conditions on retrieval. Every domain in the contrast was already surfaced by the model for that prompt. Domains the model never retrieves are invisible to this design. Nothing here describes the chance that an arbitrary site gets consulted.

The taxonomy is AI-assisted. A language model classified domain kinds from the bare domain name. We reviewed the highest-volume domains by hand and committed the full mapping. Residual classification error exists. It mostly blurs the boundaries between the business categories, not the institutional ones.

Panel mix shapes the raw shares. Our clients skew toward certain industries. We publish the sector-balanced series alongside the observed one, and every headline claim above survives the balancing.

The model results carry a disclosed selection step. We chose predictors after examining joint distributions, before the freeze. The odds ratios are exploratory with disclosure, not confirmatory. The direction of every reported effect was stable throughout.

Sample sizes throughout are counts evaluated in this study. They are not statements about the Spyglasses database.

Data and reproducibility

The extraction SQL, classification pipeline, frozen spec (commit 065e37d), model code, and figure code live in the experiment directory 007-site-consultations-observational of our research repository. Figures carry their provenance. Raw grounding-search text is customer data and is never published. A derived-features dataset release is under review.