AIO guide · Nov 2026

How to Allow AI Search Crawlers in Shopify robots.txt.liquid (OAI-SearchBot, PerplexityBot, Claude-SearchBot) — 2026 Guide for US & EU Stores

LEVERAFE LAB team · ~6 min read · 閱讀中文版 →

Short answer: on most Shopify stores, AI search crawlers are already allowed — Shopify’s default robots.txt opens with User-agent: * and Allow: / for public pages[1]. What actually hides stores from ChatGPT, Perplexity or Claude search is usually an old robots.txt.liquid customization, a plain-text replacement file, or a proxy/bot rule. Check /robots.txt, keep OAI-SearchBot, PerplexityBot and Claude-SearchBot under the default rules[3][4][5], and if you want to opt out of AI training, block only GPTBot, ClaudeBot and Google-Extended[3][5][6].

Why does robots.txt matter for AI answers in the US and EU?

AI assistants are becoming a product-research step for shoppers in the US, UK and EU, and each one decides what it can cite partly from your robots.txt. OpenAI is explicit: sites opted out of OAI-SearchBot “will not be shown in ChatGPT search answers,” though they can still appear as navigational links[3]. Perplexity says PerplexityBot surfaces and links sites in its results and is not used to train foundation models[4]; Anthropic says disabling Claude-SearchBot may reduce your visibility in user search results[5]. In other words, one stray Disallow: / can cost you citations in three answer engines at once.

Which AI user agents should a Shopify store allow or block?

User agentCompany & purposeOur default for US/EU stores
OAI-SearchBotOpenAI — surfaces sites in ChatGPT search[3]Allow (via default rules)
GPTBotOpenAI — content that may be used for model training[3]Your choice; blocking doesn’t affect ChatGPT search[3]
ChatGPT-UserOpenAI — user-triggered visits; robots.txt may not apply[3]No action needed
PerplexityBotPerplexity — search results, not model training[4]Allow
Claude-SearchBotAnthropic — search result quality[5]Allow
ClaudeBotAnthropic — content that could contribute to training[5]Your choice
Google-ExtendedGoogle — Gemini training and grounding; no effect on Google Search inclusion or ranking[6]Your choice (blocking may reduce Gemini app grounding)

How do you check your store’s current rules? (4 steps)

  1. Open https://yourstore.com/robots.txt on your primary domain[1] and search for Disallow: / on its own line under User-agent: * or any AI bot name.
  2. In Shopify admin go to Online Store → Themes → ⋯ → Edit code and look for templates/robots.txt.liquid[1]. If it doesn’t exist, you’re on Shopify’s default file.
  3. If it exists, check whether it still loops through robots.default_groups or was replaced with plain text. Shopify “strongly” discourages plain text because rules go out of date[1]; older templates can also keep rules the current default no longer has, such as Disallow: /policies/[1].
  4. Remove any proxy or third-party bot-blocking setup in front of the store: Shopify handles bot management at the network layer and doesn’t recommend a proxy in front of Shopify[1].

What’s a safe robots.txt.liquid template for AI crawlers?

Keep Shopify’s Liquid loop so default rules stay updated automatically[1][2], and add custom groups below it only for bots you want to block[2]:

{% for group in robots.default_groups %}
  {{- group.user_agent }}
  {%- for rule in group.rules -%}
    {{ rule }}
  {%- endfor -%}
  {%- if group.sitemap != blank -%}
    {{ group.sitemap }}
  {%- endif -%}
{% endfor %}

# Optional: opt out of AI model training only
User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

Delete the three optional groups if you’re happy for your content to be used in training. Don’t add User-agent: OAI-SearchBot + Allow: / “to be safe”: crawlers obey only the most specific group that matches them, and named groups aren’t combined with *[7], so that bot would ignore Shopify’s cart, checkout and filtered-collection disallows. Save the template in your published theme — uploading a theme via the admin doesn’t import robots.txt.liquid[1].

Does robots.txt control ChatGPT and Copilot shopping on Shopify?

No — and this is the part most store owners miss. Shopify says that if you sell through agentic storefronts such as ChatGPT or Microsoft Copilot, product data is syndicated through Shopify Catalog independently of /robots.txt; blocking crawlers affects only open-web discoverability[1]. Treat robots.txt as your lever for being cited in AI answers, and the agentic storefront settings as your lever for being sold inside them.

What’s changing next with AI training signals?

Anthropic says that since October 30, 2026 it has begun honoring a machine-readable “no AI training” preference based on IETF aipref work, while rules naming ClaudeBot directly still take priority[5]. Google says it intends to support the AIPREF training signal in early 2027[6]. For now, named user-agent rules remain the most predictable control.

Practical takeaway

  • Open /robots.txt today and confirm no AI search bot is disallowed.
  • Never replace the Liquid loop with plain text; add custom groups below it.
  • Block training bots only if you mean to — and never give search bots their own Allow: / group.
  • Manage ChatGPT/Copilot product syndication in agentic storefront settings, not robots.txt.

FAQ

Does Shopify’s default robots.txt block ChatGPT or Perplexity?

No. Shopify’s default file starts with a User-agent: * group that allows public pages, so OAI-SearchBot, PerplexityBot and Claude-SearchBot can crawl products, collections and blogs unless a custom template or an app adds a block.

Should we add “User-agent: OAI-SearchBot / Allow: /” to robots.txt?

Usually not. A named group replaces the * group for that bot, so it would lose Shopify’s cart, checkout and filter disallows. Only add a named group to block a bot, or copy the default disallows into it.

Can we block AI training but stay visible in AI search?

Yes. OpenAI, Anthropic and Google separate the tokens: disallow GPTBot, ClaudeBot and Google-Extended, and leave OAI-SearchBot, Claude-SearchBot and PerplexityBot under the default rules.

Does blocking AI crawlers remove our products from ChatGPT agentic checkout?

No. Shopify says product data for agentic storefronts is syndicated through Shopify Catalog independently of robots.txt; control that in your agentic storefront settings.

How long until ChatGPT or Perplexity reads our robots.txt change?

OpenAI says about 24 hours for search results; Perplexity says up to 24 hours. Shopify applies the file change instantly.

Want us to audit your Shopify robots.txt and AI visibility for US, UK or EU shoppers? Email ypeasystore@gmail.com or use our contact page. 中文讀者請看中文版。

Sources

  1. Shopify Help Center — Editing robots.txt.liquid (incl. “Controlling AI crawler access”)
  2. Shopify.dev — Customize robots.txt
  3. OpenAI — Overview of OpenAI Crawlers
  4. Perplexity — Perplexity Crawlers
  5. Claude Help Center — Does Anthropic crawl data from the web, and how can site owners block the crawler?
  6. Google Crawling Infrastructure — Google’s common crawlers (Google-Extended)
  7. Google Search Central — How Google interprets the robots.txt specification

Not sure AI search can see your store?

Send us your store URL. We’ll reply with a short AIO check: robots.txt and theme template review, AI crawler access, and which pages are most likely to be cited by ChatGPT, Perplexity and Claude.