There are three separate technical reasons an AI tool may not find your business, and any one of them is enough to wipe you from the results. Each one is checkable in your browser right now, before you touch a single word of your website content.
This is the most common question we hear from tourism operators who have a working website, decent reviews, and still do not appear when someone asks ChatGPT or Gemini what to do in their area. The answer is almost always technical, not creative. Before assuming your content is not good enough, check the floor first.
Is your website content readable without JavaScript?
Most websites today are built with tools that construct pages in the browser using JavaScript. When you visit your own site, your browser runs a small program that assembles the page you see. Many AI crawlers do not run that program. They request the raw HTML the server sends and move on.
If your tour descriptions, prices or contact details only appear after JavaScript builds them, the crawler sees an empty page. You can have excellent content and still appear blank to an AI tool, because the bot never saw the version your visitors see.
The same problem applies to content hidden behind tabs, accordions, or “load more” buttons that pull content in only when clicked. If the text is not in the page’s HTML at the moment the server sends it, it does not exist for the crawler.
How to check: Open any key page on your site, right-click anywhere on the page, and choose “View Page Source.” This shows the raw HTML before any code runs. Use Cmd+F (Mac) or Ctrl+F (Windows) to search for a sentence you can see on screen, like your tour description or a price. If you cannot find it in the source, AI probably cannot read it either.
The fix is a developer task. Ask them to render your key content server-side or ship it as static HTML so it is present on load; make tabs and accordions hide text with CSS rather than fetch it on click; and replace any “load more” feeds with real linked pages a crawler can follow. Give them the specific pages and the content that was missing from the source.
Has your site accidentally blocked the AI bots?
A file called robots.txt lives at the root of your domain and tells bots which pages they can visit. Many operators have copied a “block ChatGPT from using your content” snippet from a privacy-focused article and accidentally blocked the bots that decide whether AI recommends you, not just the ones that train on your content.
There are two types of AI bot, and they are not equal.
Retrieval bots (OAI-SearchBot, ChatGPT-User, PerplexityBot, Perplexity-User, Googlebot) read your site when an AI is answering a live question right now. Block these and you cannot be cited in a live answer, no matter how strong your content is.
Training crawlers (GPTBot, CCBot, ClaudeBot) mainly affect whether your content trains future AI models. Blocking them has little impact on whether AI recommends you today.
One bot often caught in the crossfire is Google-Extended. It sounds like a training tool, but it also controls whether Gemini can use your pages to ground its live answers. Block it and you disappear from Gemini responses too.
Allowing retrieval bots is a decision, not a requirement. Some operators block them for legitimate reasons. But it needs to be a knowing choice. If you blocked GPTBot for privacy reasons and Perplexity is also blocked because the snippet was over-broad, that is worth fixing.
How to check: Visit yourdomain.com/robots.txt in your browser. If you see a bot name followed by Disallow: /, that bot is blocked. If your site sits behind Cloudflare, also check the Security or Bots settings in your Cloudflare dashboard. Cloudflare’s firewall can block AI crawlers at the network level and overrides robots.txt entirely.
Here is what a clean robots.txt looks like for an operator who wants to be cited by AI but keep training crawlers out:
# Allow AI retrieval bots (these fetch your pages for live answers)
User-agent: OAI-SearchBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Perplexity-User
Allow: /
User-agent: Googlebot
Allow: /
# Optional: block training-only crawlers
User-agent: GPTBot
Disallow: /
User-agent: CCBot
Disallow: /
# Do NOT block Google-Extended: it also feeds Gemini's live answers
User-agent: Google-Extended
Allow: /
Pass this to whoever manages your website hosting and ask them to check the Cloudflare settings at the same time.
Has Google indexed your site at all?
Google’s index is the foundation a lot of AI sits on. Google AI Overviews and Gemini draw on it directly. ChatGPT runs its own web index blended with Bing and can also fetch pages live, but a site Google cannot index is usually failing all crawlers for the same underlying reasons: blocked pages, no sitemap, a login wall, a noindex setting left on by accident, or a JavaScript rendering problem.
If Google has not indexed your site, you are missing from the pool AI retrieves from. Good content cannot reach an AI answer if the crawlers were never let in.
A brand-new domain can take a few weeks to be crawled, and that is normal. If your site has been live for several months and still does not appear, something is wrong.
How to check: Go to Google and search: site:yourdomain.com (use your actual domain). If Google lists pages from your site, you are indexed. If nothing appears and the site is not new, you have a problem worth investigating.
The most common causes are: very few other sites link to yours, so Google has not found it; a noindex setting on pages or templates; or no sitemap submitted to Google. Set up a free Google Search Console account, verify ownership of your domain, and submit your XML sitemap (usually at yourdomain.com/sitemap.xml). Use the URL Inspection tool to request indexing for your homepage and key pages. A few links from reputable sources in your region, like your local tourism body or a regional visitor guide, help Google find and trust the site. Do not pay for links; it violates Google’s guidelines and can result in a penalty.
How to check your own site in ten minutes
Run these three checks in order. Each takes two to three minutes.
- View Page Source check. Open a key page, right-click, choose View Page Source, then search (Cmd+F or Ctrl+F) for your own tour description or a price. Present in the source? Crawlable. Missing? Talk to your web developer.
- robots.txt check. Visit
yourdomain.com/robots.txtin your browser. Scan for AI bot names followed byDisallow: /. If you use Cloudflare, log into the dashboard and check the bot management settings too. - Google index check. Search
site:yourdomain.comon Google. You should see a list of your pages. Nothing showing for an established site means you need Google Search Console.
Fixing any of these three is worth doing before anything else. There is no benefit in improving your content or schema if AI crawlers are being blocked or bouncing off an empty page before they read a word.
Frequently Asked Questions
Does blocking GPTBot mean ChatGPT cannot find me?
No. GPTBot is a training crawler: it collects data to train future versions of ChatGPT. Blocking it stops that training but does not block ChatGPT from reading your site when answering a live question. Live retrieval is handled by OAI-SearchBot and ChatGPT-User, which are separate bots. You can block GPTBot for training reasons and still be cited in ChatGPT answers.
Does ChatGPT use Google’s index?
Not directly. ChatGPT blends its own web index with Bing search results and can also fetch pages live. Google’s index feeds Google AI Overviews and Gemini specifically. That said, a site blocked from Google’s crawlers is usually failing all crawlers for the same technical reasons, so fixing the problem helps everywhere.
My site looks fine to me. Why would it be empty to AI?
Because your browser runs JavaScript and the AI crawler may not. Open your page in View Page Source mode and search for your own content. What you see there is the version AI reads.
I have great TripAdvisor reviews. Does that help if my site is not crawlable?
Yes, it does. AI tools cite TripAdvisor, Expedia, and other third-party platforms directly when answering questions about your area, even if your own site is invisible. But that content lives on TripAdvisor’s domain, not yours. If a traveller asks AI for your direct booking contact or your exact pricing, only your own site can supply that.
How do I know if Perplexity can find me?
Ask it. Open Perplexity and search for your business by name and location. If it finds you, check which sources it cites. If it is only citing TripAdvisor or Google Business Profile rather than your own website, your site may still have a crawlability issue even if the listing-level data gets through.
Is this different for Google Business Profile?
These three checks are specifically about your website. Your Google Business Profile is a separate signal and AI can read it independently of your website. A complete, active profile matters on its own. Read our article on <a href="https://www.tourismtribe.com/ai-search-transforming-tourism-marketing/">what AI search reads from your online presence</a> for the full picture on both.
Find out where you actually stand
These three checks surface the most critical blockers. Once they are clear, the next layer is your content structure: whether your pages are written to answer the questions travellers actually ask, and whether you have schema markup so AI can read your business details precisely. Our article on schema markup for tourism websites covers that.
If you want a complete picture across all these signals, a GEO Assessment audits your AI visibility end-to-end and gives you a prioritised action plan. For ongoing monitoring and quarterly strategy, the Digital Direction Plan puts a digital strategist in your corner, watching your search and AI performance and telling you what to focus on next. Members of our AI Enablement Plan work through these fixes in fortnightly sessions with hands-on support.
Start with the site: search and the robots.txt check. Five minutes, and you will know whether the technical floor is solid or not.
Your free AI marketing coach, right in your pocket
The free Pocket Rocket app gives you a personal AI marketing coach, website audit, weekly action plans and 5-minute tips. Built for tourism operators.

