How ChatGPT Search Works (and Why Its Answers Differ)

Updated · Citepoint · 5 min read

Short answer

ChatGPT decides for each question whether to search the web. When it does, it rewrites your question into targeted search queries, sends them to search providers, reads the results and writes an answer with citations. When it doesn't, it answers from what it learned in training. OAI-SearchBot is the crawler that makes a site eligible for ChatGPT's search answers. Answers differ because the decision to search, the rewritten queries and the results all vary.

Key takeaways

  • ChatGPT may search automatically when a question would benefit from current information, or you can start a search yourself.
  • Sites that opt out of OAI-SearchBot aren't shown in ChatGPT search answers, though they can still appear as navigational links. Blocking GPTBot doesn't change that.
  • In a 2026 study, there was less than a 1 in 100 chance that two ChatGPT answers to the same prompt listed the same brands.
  • In Citepoint's October 2026 index, 70% of ChatGPT's citations pointed at the websites of the brands it recommended.

Does ChatGPT search the web for every question?

No. OpenAI's help center says ChatGPT may search the web automatically when a question would benefit from current information, and you can start a search yourself from the tools menu. When OpenAI launched ChatGPT search in October 2024, it described the same split: ChatGPT chooses to search based on what you ask, or you choose to search manually.

So a given answer comes from one of two places: what the model learned in training, or what it found by searching. For questions about products, prices and comparisons, which change often, search is the one to plan for.

What happens when ChatGPT searches?

According to OpenAI:

  1. It rewrites your question. ChatGPT typically turns your message into one or more targeted queries. If memory is on, it may use relevant saved memories when rewriting, and it may use your approximate location.
  2. It sends the queries to search providers. OpenAI says ChatGPT search sometimes partners with other search providers, and its help page points to Microsoft's and Shopify's privacy policies for how those providers handle queries. At launch it also said it uses content provided directly by partners.
  3. It may search again. After reviewing the first results, ChatGPT may send more specific queries.
  4. It answers with citations. Responses can include citations you can open, and a Sources view lists the cited pages and other relevant links.

OpenAI is plain that placement isn't guaranteed: ChatGPT ranks results using multiple factors. It also warns that search results and citations can be incomplete, outdated or incorrect.

Which OpenAI crawlers matter?

User agent What it's for What blocking it does
OAI-SearchBot Surfaces sites in ChatGPT's search features Your site isn't shown in ChatGPT search answers, though it can still appear as a navigational link
GPTBot Collects content that may be used to train OpenAI's models Signals your content shouldn't be used for training. Doesn't affect search
ChatGPT-User Fetches a page when a user's action in ChatGPT calls for it OpenAI says robots.txt rules may not apply to these user-initiated requests

OpenAI recommends allowing OAI-SearchBot in robots.txt and allowing requests from its published IP ranges, which matters if a CDN or firewall sits in front of your site. Its settings are independent, so you can allow search and disallow training. Changes can take about 24 hours to take effect. OpenAI's publisher FAQ adds that any public website can appear in ChatGPT search. If it learns the URL of a disallowed page from a search provider or from other pages, it may still show just the link and title in ChatGPT Atlas, its browser. To prevent that, it recommends a noindex meta tag, which the crawler must be allowed to read.

The free AI Crawler Checker shows which AI crawlers your robots.txt lets in. More in robots.txt for AI crawlers.

Why do ChatGPT's answers differ between people and runs?

Several things change from one answer to the next:

  • Whether it searched at all. The decision is made per question.
  • How the query was rewritten. Memory, location and wording all feed in.
  • Which pages it opens and cites. The sources can differ even for the same question.
  • Randomness in generation. SparkToro and Gumshoe asked 600 volunteers to run 12 prompts through ChatGPT, Claude and Google's AI a combined 2,961 times. There was less than a 1 in 100 chance that ChatGPT or Google's AI would give the same list of brands twice, and less than a 1 in 1,000 chance of the same order.

The same study found that which brands appear is more stable than their order. Across 994 responses to 142 differently worded headphone prompts, the top brands showed up 55% to 77% of the time. Its conclusion was that visibility, measured across many prompts and runs, is a reasonable metric, while "ranking position in AI" is not. That's why we measure shares, not positions. See why AI answers change.

What does ChatGPT cite?

It depends on the question. For software buying questions, Citepoint's AI Recommendation Index found ChatGPT averaged 3.7 citations per answer, and 70% of them went to the websites of the brands it recommended: pricing pages, feature pages and comparisons. Across all kinds of US queries, Ahrefs' September 2026 ranking of ChatGPT's most-cited sites put Reddit first with a 16.8% mention share (its share of citations among the top-cited sources) and Wikipedia second with 7.0%. For buying questions about your product, your own pages matter most. For broader questions, community and reference sites carry more weight.

How do you make your pages eligible and quotable?

  1. Allow OAI-SearchBot, and check that your CDN or firewall isn't blocking OpenAI's published IP ranges.
  2. Check that Bing can see you too. OpenAI's help page points to Microsoft's privacy statement for its search providers, so make sure your pages are indexed in Bing. Bing Webmaster Tools shows this.
  3. Publish an answer-first page for each buyer question, with a fair comparison table, current prices and sources. See how to get recommended by ChatGPT.
  4. Track visits. ChatGPT adds the parameter utm_source=chatgpt.com to links in search results, so ChatGPT referrals can be seen in analytics. See how to track AI traffic in GA4.
  5. Measure across many answers, not one screenshot.

Frequently asked questions

Does blocking GPTBot remove me from ChatGPT search?

No. GPTBot is OpenAI's training crawler. ChatGPT search eligibility depends on OAI-SearchBot, and OpenAI says each setting is independent of the others.

Does ChatGPT use Bing?

OpenAI says ChatGPT search sometimes partners with other search providers, and its help page links Microsoft's privacy statement alongside Shopify's. It doesn't say which provider handles any given question, so make sure you're visible in Bing as well as Google.

Does robots.txt apply to ChatGPT-User?

OpenAI says robots.txt rules may not apply to ChatGPT-User, because its visits are initiated by a user. To manage search opt-outs, it points to OAI-SearchBot.

How long after I change robots.txt does ChatGPT notice?

OpenAI says it can take about 24 hours for its systems to adjust.

Why did a colleague get a different answer to the same question?

ChatGPT decides per question whether to search, rewrites queries using context such as memory and location, and generates text that varies run to run. In one 2026 study, repeated runs of the same prompt almost never returned the same list of brands.

Sources

  1. OpenAI Help Center: Searching the web with ChatGPT
  2. OpenAI Help Center: Publishers and Developers FAQ
  3. OpenAI: Overview of OpenAI crawlers
  4. OpenAI: Introducing ChatGPT search
  5. SparkToro and Gumshoe: AIs are highly inconsistent when recommending brands or products
  6. Ahrefs: The 50 Most-Cited Websites in ChatGPT
  7. Citepoint AI Recommendation Index, October 2026