Chinese AI Search Is Hallucinating Your Competitors Into Existence

Chinese AI Search Is Hallucinating Your Competitors Into Existence

Generative search engines are now the gatekeepers of brand visibility in China — and they’re making up contact information 71% of the time. If your business depends on being found, cited, or called, this paper is a fire alarm.

What happened

Researchers ran a controlled, large-scale audit of four mainstream Chinese-language generative search platforms (Web and App interfaces — eight interface variants total), firing 614 queries across three replications each. From 214,119 raw records, they built a clean dataset of 160,860 citation-level observations and dissected how these systems select sources, attribute credit, and surface brand information in generated answers. The headline numbers are brutal: the overall brand-selection rate from the citation pool was just 8.3%, meaning the vast majority of retrieved sources never appear in the answer the user actually sees. More alarming for anyone running a local or service business: 71% of contact-information exposures (phone numbers, addresses) shown in answers could not be matched to the crawled body text of cited pages — a textbook hallucination problem layered directly onto source attribution. The study also found that AI visibility decays fast: fitted content half-lives were roughly 39 days for high-timeliness queries and 68 days for low-timeliness queries. And GEO practitioners take note: Baidu’s own composite quality score was not the leading predictor for any of the outcomes examined — content fit, cross-source occurrence count, and semantic role mattered more.

Cold read

This is a China-specific study of four unnamed platforms — the methodology is rigorous, but direct applicability to Google AI Overviews, Perplexity, or Western RAG products is an assumption, not a finding. The “71% of contact-information exposures unmatched to crawled text” figure sounds catastrophic, but the crawl methodology matters enormously: if pages were crawled at a different time than the query was run, or if JavaScript-rendered content was missed, some of that gap may be a measurement artifact rather than pure hallucination. The study covers query snapshots from a fixed period; benchmark contamination or platform-side A/B testing during the study window could introduce noise. Finally, 13% of brand exposures unmatched to the citation pool is striking, but without knowing how often those phantom brands are correct versus fabricated, the business risk is ambiguous — it could be signal (the model knows things the crawler missed) or pure confabulation.

What it means for you

  • Signal maturity: 4/5 — Large-scale, controlled design with real numbers; limited only by geographic and platform scope
  • Who gets hurt: Local service businesses, healthcare providers, and any brand relying on accurate contact details appearing in AI-generated answers in Chinese-language markets
  • What breaks if this is true: Your entire GEO / LLMO strategy built around “get cited = get surfaced” collapses — citation and answer inclusion are largely decoupled, and optimizing for citation rate vs. mention rate becomes non-negotiable
  • Why it might not land: Western operators may dismiss this as a China problem; platform behavior is also a moving target — these systems are updated constantly, and a 39-day content half-life means the study’s specific citation patterns may already be stale
  • Watch for: Any Western replication of this methodology on Perplexity, Google AI Overviews, or ChatGPT Search; specifically, whether the Web/App interface divergence finding holds — if it does, every brand audit needs to be run twice

Forecast as of 2026-07-20

By Q2 2027, at least two major Western generative search audits using comparable methodology will document contact-information hallucination rates above 40% on at least one mainstream platform, forcing a public response from the platform (correction features, citation verification labels, or explicit disclaimers) — this is too legally and reputationally exposed to stay invisible.


Source: What Do Chinese-Language Generative Search Engines Cite and Surface? A Large-Scale Empirical Study — Tao Zhen, Yue Liu, Gege Zhang, Yixuan Niu. https://arxiv.org/abs/2607.15771v1

Similar Posts