This article contains affiliate links to Semrush. AI Eating The World may earn a commission on qualifying purchases, at no extra cost to you.

Summary

ChatGPT's August model change moved citations toward documentation and how-to pages and away from landing pages, listicles and social posts. Here's how to keep AI visibility reporting honest when single answers can't be trusted.

ChatGPT changed what it cites, almost overnight

If your brand's ChatGPT citations looked healthy in July and thin by late August, you aren't imagining it. Around August 8, 2026, ChatGPT changed how it searches the web before it answers, and the mix of pages it cites moved with it. That's a headache for anyone who reports on AI visibility. It's also a fair test of AI visibility tools, because a tool that only takes snapshots can't tell you whether a drop is real or just a bad day.

Promptwatch, which tracks ChatGPT's citations every day, published the clearest numbers for the month. Documentation rose from 3.3% of ChatGPT's citations in the first week of August to 8.2% over the last nine days, and how-to pages from 4.3% to 9.1%. Landing pages fell from about 20% to under 12%, and social posts dropped from 4.4% to under 1% after August 14. Peec AI data, published by Lily Ray, shows listicles, a format a lot of GEO playbooks were built on, falling from 15.8% of ChatGPT's citations to 7.8% after the GPT-5.6 release.

Paired bar chart of ChatGPT citation share by content type, first week of August 2026 versus the end of the month: landing pages about 20% to under 12%, documentation 3.3% to 8.2%, how-to pages 4.3% to 9.1%, social posts 4.4% to under 1%
Source: Promptwatch, "What Type of Content Does ChatGPT Cite the Most? August 2026," September 25, 2026. Landing-page values and the end-of-month social value are approximate, as reported.

One detail gets less attention than it should. On August 8, Promptwatch saw the average number of background searches (fan-out queries) ChatGPT runs per answer rise from about 1.08 to 1.83, roughly 70% more. It didn't start citing more pages to match. Seer Interactive's comparison of GPT-5.6 Luna with GPT-5.5 found it ran far more site-targeted searches while its inline citations fell about 13%. ChatGPT reads more and cites less, so getting into an answer got harder, even for brands that changed nothing.

Other datasets show the same break. Search Engine Land reported tracking data in which Reddit's share of ChatGPT search citations fell from 3.83% to 0.52% within a week of August 8. Timing alone doesn't prove cause, and OpenAI hasn't explained the change. Still, every source I've read points the same way: fewer forum threads and roundups, more pages that come straight from whoever owns the facts.

Why one ChatGPT answer can't settle anything

August wasn't the first swing this year. When ChatGPT's default model changed on May 22-23, Search Engine Journal covered data from 3.8 million German-language responses showing citation patterns shifted 47%, against a normal daily drift of 1-2%. Earlier, Seer Interactive, tracking a fixed set of prompts across about 2 million citations, saw ChatGPT's citations per response slide from a December peak of 11.96 to 9.18 by late January.

Put that together and the lesson is uncomfortable. Ask ChatGPT the same question twice in an hour and you can get two different verdicts with two different source lists. Teams have watched AI referral traffic fall from thousands of visits a day to a trickle and then struggled to say how much was the model, how much was seasonality and how much was their own site.

So stop treating any single answer as a measurement. No AI visibility tracking setup can give you the true share of ChatGPT answers that mention your brand, because the space of possible prompts is enormous and the answers keep moving. What a good setup can do is ask the same prompts, in the same way, on a schedule. The absolute number might be off. The direction and the sudden step changes are reliable, and those are what you need when a client asks why their AI visibility dropped in August.

Table comparing one-off prompt checks with a fixed prompt set tracked over time, across four questions: a changed answer, a model swap, competitor gains and client reporting
AI Eating The World, October 2026.

This matters most for US agencies and in-house teams that now get asked for a monthly AI search visibility report. Write the method down before the next model change: which prompts, which platforms, which locations, how often. A baseline only means something if you can run it again the same way.

Answer engine optimization now starts on your own site

The sourcing shift is good news for brands with useful pages on their own domain. If ChatGPT now leans toward documentation, help centers, pricing pages and primary data, answer engine optimization starts to look a lot like keeping your own facts complete, current and easy to fetch.

Start with the pages that answer buying questions. Can ChatGPT find your current pricing on your site, or does it have to piece it together from a review site or a competitor's comparison page? Pricing that only lives in a PDF, or behind a "contact sales" button, tends to get described by somebody else.

Then look at documentation and product pages. Specs, limits, integrations and changelogs are exactly the verifiable material that gained ground. Put those facts in plain HTML text with dates on them, not inside images or tabs that need JavaScript to open.

Check access, too. A page can be perfect and still invisible if a firewall rule returns a 403 to OpenAI's crawlers, and nothing in your analytics will flag it. Our piece on AI crawler access covers what to check before any other AI search optimization work, and the llms.txt explainer covers whether that file is worth your time.

Don't walk away from third-party presence either. Seer's data showed listicles holding steady in Google's AI Overviews while they slipped in ChatGPT, and reviews still shape what people believe. The risk is concentration. If your LLM visibility depended mostly on landing in other people's roundups, one model's preferences can now erase it.

Where AI visibility tools earn their keep

Doing all this by hand, with a spreadsheet of prompts and a weekly copy-and-paste session, works until it doesn't. Answers vary too much to sample manually, and you can't go back and check last month. This is the job a proper tracker exists for, and it's why I'd point most teams to Semrush's AI Visibility Toolkit before they build another DIY script.

The toolkit shows how your brand appears in ChatGPT, Gemini, Perplexity, Google AI Mode and AI Overviews. Visibility Overview gives you an AI visibility score alongside mentions, citations and the specific pages being cited. Prompt Tracking reruns the same prompts daily on ChatGPT, Google AI Mode and Gemini, which is the steady method described above. Brand Performance updates weekly with share of voice and sentiment against competitors, so you can tell whether a drop hit only you or the whole category. (Semrush's documentation lists the full report set.)

Semrush AI Visibility Toolkit Visibility Overview report showing an AI Visibility score, mentions, citations and cited pages, with mentions split across ChatGPT, AI Overview, AI Mode and Gemini
Semrush AI Visibility Toolkit, Visibility Overview report. Screenshot: Semrush, 2026.
Semrush AI Visibility Toolkit Brand Performance report comparing share of voice and favorable sentiment against competitors
Semrush AI Visibility Toolkit, Brand Performance report. Screenshot: Semrush, 2026.

Two more checks after a model change

Two more pieces matter after an event like August 8. Site Audit checks whether your domain blocks AI crawlers such as OAI-SearchBot and ChatGPT-User, which catches the silent 403 problem. And Semrush One bundles the AI Visibility Toolkit with the SEO Toolkit, so your AI mentions sit next to rankings and site health instead of in a separate dashboard. If you need more, Semrush's Traffic Analytics puts an AI referral dip in context with your other channels, and the SEO Writing Assistant and Topic Finder help with the fact-heavy, documentation-style pages ChatGPT now cites more often.

Semrush Knowledge Base page for Semrush One, explaining that it combines the SEO and AI Visibility toolkits in one subscription, with a graphic of its features
Semrush Knowledge Base, Semrush One page. Captured October 11, 2026.

Semrush One comes with a 7-day free trial. That's enough time to load a prompt list, run a first visibility check on your brand and see which of your pages ChatGPT already cites. If you'd rather query the data from Claude, our Semrush MCP guide shows how to connect it.

A reporting routine that outlasts the next model change

  • Freeze a set of 25-50 prompts your buyers actually ask, and don't edit it mid-quarter.
  • Track the same platforms and locations every week, and mark model releases on the chart as they happen.
  • Report direction and share of voice against two or three named competitors, not a lone citation count.
  • Review pricing, docs and help pages each quarter so the facts ChatGPT pulls are yours and current.
  • Recheck AI crawler access after any CDN, firewall or bot-management change.
  • When a number drops, compare it with the category before you call it a loss.

Sources