Sign in Get Started
Home
Platform
AI VisibilityGEO InsightsAI TrafficOptimizeBrand ContextMCP Server Saba AIStart free trial
Solutions
BrandsSEO ProfessionalsAgenciesContent Teams Pricing
Resources
DocsBlogHelp CentreVideosIntegrationsChangelogRoadmap
Free tools
AI Visibility ChecklistAI Crawler CheckAI Visibility Report Sign in
Get Started
Free Tool

Is Your Website Locking Out ChatGPT, Perplexity and Claude?

Type your website and see in seconds which AI bots your robots.txt lets in and which it shuts out. The result shows on this page at once, with no email needed.

It reads your public robots.txt only. Nothing is installed, no login is needed and no AI is used.

Example

What a Result Looks Like

This is a made-up site with a shortened bot list, shown so you know what to expect. Run your own above to see the real thing.

1 of the bots that put sites in AI answers is blocked or restricted.

Result for vantage-example.com.

  • 6 allowed
  • 0 partly restricted
  • 4 blocked

Search bots

These put your pages in AI search answers. Blocking them keeps you out of those answers.

BotPlatformStatusRule that decides it
OAI-SearchBotChatGPT · OpenAIAllowedNo rule
Claude-SearchBotClaude · AnthropicAllowedNo rule
PerplexityBotPerplexityBlockedDisallow: /
ApplebotAppleAllowedNo rule

Bots that fetch a page when a person asks

These read a page when someone asks an assistant about it. Blocking them stops the assistant from reading your page for that person.

BotPlatformStatusRule that decides it
ChatGPT-UserChatGPT · OpenAIAllowedNo rule
Claude-UserClaude · AnthropicAllowedNo rule
Perplexity-UserPerplexityAllowedNo rule

Training bots

These collect pages to train models. Blocking them is a legitimate choice and does not block search.

BotPlatformStatusRule that decides it
GPTBotChatGPT · OpenAIBlockedDisallow: /
Google-ExtendedGemini · GoogleBlockedDisallow: /
CCBotCommon CrawlBlockedDisallow: /

What to do

  1. Open vantage-example.com/robots.txt and look at the rules for: PerplexityBot.
  2. To let a blocked bot in, remove its Disallow line, or give it its own group. A bot's own group beats the general one (User-agent: *). The groups to add are shown below.
  3. After you save the file, run the check again to see the change.
  4. Blocking training bots (GPTBot, ClaudeBot, Google-Extended) is a separate choice and does not stop search.
  5. This check reads robots.txt only. A firewall or CDN can still turn a bot away at the door, and a bot can ignore robots.txt; the page text must also be in the page source.

Groups to add to your robots.txt

User-agent: PerplexityBot
Allow: /

A robots.txt file is a request, not a lock. A firewall or CDN can still turn a bot away, and the page text must also be in the page source.

Bot list checked on October 11, 2026.

FAQ

About the Check

What it reads, what it cannot see and what the result means.

What does the check look at?
It reads the public robots.txt file of your website and compares it with a list of AI bots. Some put sites in AI search answers, some read a page when a person asks about it and some collect training data. For each bot it shows whether it is allowed, partly restricted or blocked, and the rule that decides it.
Does it use AI or cost anything?
No. It is free, it needs no account and it uses no AI. It downloads one public file and checks it against the bot list.
Why does it say a bot is blocked when I never blocked it?
A rule for every bot (User-agent: *) or a rule added by a plugin or a hosting default can shut a bot out. The rule line next to each bot shows which one decides.
If robots.txt allows a bot, can it still be turned away?
Yes. A robots.txt file is a request, not a lock. A firewall or CDN can still turn a bot away at the door, and a bot can ignore the file. The text of the page must also be in the page source for a bot to read it.
Should I allow the training bots?
That is your decision. Blocking GPTBot or Google-Extended does not block search, so a blocked training bot is shown as a choice and never as a problem.
What happens if I ask for the result by email?
The result arrives at once. Three short emails with practical tips follow on days 2, 6 and 11, each with an unsubscribe link, and unsubscribing stops them at once.
What if I cannot run the check?
The check has limits so it stays free for everyone. If you reach one, the page tells you and asks you to come back later. A site whose robots.txt cannot be read gets no ratings at all, and the page says so.

Go Beyond robots.txt

The free checklist has 20 checks, from the bots to the pages your buyers' questions land on.

Get the Checklist
Free • Arrives in your inbox • No account needed