Field notes · AI agents, Hermes & Claude Code By Julian Goldie

AI SEO Strategy: A 10-Step Operator Build Sheet for Google, ChatGPT, Perplexity and Claude

The exact order, crawler lines and tracking columns for a strategy that uses AI to do SEO and gets your pages into AI answers.

Get The AI Profit Stack Join AIPB →
  • 01 1,000+ done-for-you AI agent workflows
  • 02 5 live coaching calls / week with me
  • 03 7-day refund, cancel anytime
  • 04 3,400+ AI operators inside

An AI SEO strategy, run properly, is an operator's build sheet: ten steps that make AI tools do your SEO grunt work and make your site the page ChatGPT, Perplexity, Claude and Google's AI features pull answers from.

Book a free SEO strategy session →

This sheet gives you the order, the exact robots.txt lines, the Search Console settings and the tracking log.

If you'd rather hand the build to a team, book a free SEO strategy session with Goldie Agency and bring this sheet to the call.

One rule before you start: nobody controls these engines, and Google's page on hiring an SEO says plainly that no one can guarantee a #1 ranking.

You control three things: access, page quality and measurement.

Step 1: write the scope as two lines, one per meaning

Searchers use this phrase for two different jobs, so your scope document needs both.

Line one is AI for SEO: which tasks AI handles (research, clustering, briefs, schema drafts, page checks) and who signs off.

Line two is SEO for AI: which buyer questions you want to be named or cited for, on which engines.

Write ten to twenty of those buyer questions now. They become your prompt set in Step 10 and your page list in Step 7.

Keep the list in plain language, exactly as a customer would type or say it.

Step 2: pull the baseline before you change anything

Without a baseline you can't prove the strategy did anything.

Export these on day one and date the files:

  • Search Console Performance, Web search type, last 16 months.
  • The Search Console generative AI performance report: impressions from AI features by page, country, device and date. If it's missing, Google says the site probably hasn't had enough AI impressions yet.
  • Bing Webmaster Tools AI Performance: total citations, cited pages and grounding queries.
  • A first run of your prompt set in ChatGPT, Perplexity, Gemini, Claude and Google AI Mode, with screenshots.

Step 3: open the crawler gates in robots.txt

Each engine runs a search crawler and a separate training crawler. Allow the search ones, then decide on training as its own business call.

A minimal block that lets the search crawlers in looks like this:

User-agent: OAI-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: Googlebot
Allow: /

Why each line matters, straight from the vendors:

  • OAI-SearchBot: OpenAI's crawler page says sites opted out of it are not shown in ChatGPT search answers. GPTBot is the training crawler and is set independently.
  • PerplexityBot: Perplexity's bot docs say it surfaces and links sites in results and isn't used to crawl for foundation models.
  • Claude-SearchBot: Anthropic's crawler help page says disabling it may cut your visibility in Claude's search results. ClaudeBot is the training bot.
  • Googlebot: Google treats its normal Googlebot rules as the control for AI features in Search.

Book a free SEO strategy session →

After you ship the change, wait. OpenAI says it takes about 24 hours for ChatGPT search to reflect a robots.txt edit.

📞 Not sure what your CDN is blocking? Book a free SEO strategy session and the Goldie Agency team will read your robots.txt, bot rules and top pages with you live. → Get my free strategy session

Step 4: check the firewall and CDN, not just the file

A clean robots.txt means nothing if a bot-protection rule challenges the crawler first.

Perplexity publishes example Cloudflare and AWS WAF rules that match on User-Agent plus its published IP ranges. Copy that pattern for every search crawler you allow.

Google's AI features page makes the same point for Googlebot: crawling has to be allowed by robots.txt and by any CDN or hosting layer.

Test from outside your network after every rule change.

Step 5: confirm Search Console eligibility and snippet controls

Google's generative AI optimization guide says a page needs to be indexed and eligible to show with a snippet, and the site must be included in Search generative AI features in Search Console.

Run this check on your ten most important URLs:

  1. URL Inspection: indexed, and the rendered HTML shows your main content.
  2. No stray nosnippet or max-snippet:0 on pages you want quoted. Google says those limit what AI features can use.
  3. data-nosnippet only wraps sections you truly want hidden.
  4. Search Console settings: the site is included in Search generative AI features.

Step 6: fix the entity record

AI answers describe a business from what the web says about it, so conflicting facts produce muddled answers.

Make one source-of-truth sheet with your legal name, trading name, services, service areas, founders and authors.

Then match it in Google Business Profile, Merchant Center if you sell products, and Bing Places.

Bing's guidance adds a detail operators miss: make text, images and video name the same entities, products and concepts the same way.

Give every author a real bio page. Google's helpful content guide asks whether bylines lead to real background and warns against made-up profiles.

Step 7: pick the first pages to rebuild

Map each buyer question from Step 1 to one URL. Where no page exists, you have a gap; where three pages compete, merge them.

Book a free SEO strategy session →

Rebuild in this order: the money page closest to revenue, then the comparison page, then the step-by-step guide buyers use before they call.

Google's guide calls generic tip lists commodity content. Each rebuild needs something only you have: your process, your numbers, your screenshots, your failures.

Add tables and an FAQ where they help. Bing says clear headings, tables and FAQ sections help AI systems reference information accurately.

Don't spin off a page per query variant. Google says doing that mainly to sway rankings or AI responses breaks its scaled content abuse policy.

For the citation side in more depth, see how to get cited by AI.

🔥 Want the build sheet coached, step by step? Inside the AI Profit Boardroom you learn AI SEO yourself: step-by-step video trainings, the installable Agent OS and four coaching calls a week where you can share your page rebuilds and prompt log. → Join the AI Profit Boardroom

Step 8: set up the AI production line with a human gate

This is where AI earns its keep on the SEO side. Google's guidance on generative AI content says AI is useful for researching a topic and adding structure to original content.

Give the agent these jobs:

  • Cluster the buyer questions and suggest a page map.
  • Draft briefs from your call transcripts and notes.
  • Write first-pass titles, meta descriptions and JSON-LD.
  • List internal links each new page should get.
  • Run the monthly prompt set and fill the log.

Then put a person on the gate. Google warns that generative models predict likely words rather than retrieve facts, so every draft gets fact-checked before it ships, including titles, meta descriptions, structured data and alt text.

Grab the 200+ AI SEO Prompts to stock the agent's prompt library.

Step 9: video, mentions and links

Google's guide says its AI features can bring in images and video, and that following its image and video SEO docs already counts as optimizing for generative AI search.

So each rebuilt money page gets a short screen-recorded walkthrough, embedded on the page and published on your channel.

Off-site, the job is real coverage: digital PR, partner pages, podcasts, expert quotes and customer reviews.

Book a free SEO strategy session →

Google lists chasing inauthentic mentions as a myth, and its spam policies cover attempts to manipulate generative AI responses. Goldie Agency's own rule for links is manual outreach and no PBNs.

Step 10: the refresh calendar and the prompt log

Freshness is part of the system. Bing says accurate, current content matters for citation and points to IndexNow for telling engines about added, updated or removed URLs.

Put a review date on every money page, update facts and screenshots on that date, and submit the URL through IndexNow.

The prompt log is a sheet with these columns: date, engine, prompt, named (yes or no), cited URL, competitors named, notes.

Answers can change from one run to the next, so run each prompt more than once and judge the monthly trend, not a single screenshot.

Worked example: a regional roofing firm runs the sheet

  1. Scope: AI drafts briefs and schema; the owner signs off. Target questions include "who repairs flat roofs near me" and "roof repair or replacement".
  2. Baseline: the generative AI report shows almost no impressions, and the first prompt run names two competitors and not the firm.
  3. Access: robots.txt is clean, but the CDN challenges PerplexityBot. The rule gets fixed using Perplexity's published pattern.
  4. Entity: the Business Profile lists an old phone number. It gets corrected, and Bing Places is claimed.
  5. Pages: the repair-or-replace guide is rebuilt with the firm's own photos, inspection steps and a comparison table.
  6. Video: the owner records a two-minute walkthrough of a real inspection and embeds it.
  7. Loop: the page gets a review date, an IndexNow ping and a fresh prompt run each month.

Gotchas that cost operators a week

  • Allowing GPTBot and thinking it controls ChatGPT search. It doesn't; OAI-SearchBot does.
  • Fixing robots.txt while the WAF still challenges the bot.
  • Checking ChatGPT ten minutes after a change instead of a day later.
  • Building an llms.txt file for Google. Google says Search ignores it.
  • Reading third-party AI visibility scores as Google data. Google says no outside tool has access to its internal ranking or AI systems.

Where AI agents speed up the build

An agent can't earn you a mention, but it can cut the hours on Steps 2, 7, 8 and 10.

Book a free SEO strategy session →

Run it on draft-only: it reads, checks and writes reports and drafts, and a person approves anything that touches the live site.

For a full pre-launch pass, the AI SEO audit checklist gives the agent a ready list to work through.

📞 Hand over the build and keep the results Book a free SEO strategy session and get your crawler access, page rebuilds and prompt log planned with the Goldie Agency team. → Book my free strategy session

My verdict: the order to run it in

Run Steps 2 to 5 in week one, because access problems hide every other result.

Rebuild one money page in week two and start the prompt log the same day.

Then keep the monthly loop going: refresh, ping, rerun, compare.

If you want to learn the whole system yourself, join the AI Profit Boardroom; if you want it done, talk to Goldie Agency.

📘 Two free resources for the build Stock your agent with the 200+ AI SEO Prompts. Learn the off-page half with the free link building book.

Book a free SEO strategy session →

Also On Our Network

FAQ: AI SEO Strategy

What is the first step in an AI SEO strategy?

Take a dated baseline from Search Console, Bing AI Performance and a first prompt run. Without it you can't show what changed.

Which robots.txt lines matter most for AI search?

The ones for OAI-SearchBot, PerplexityBot, Claude-SearchBot and Googlebot. The training crawlers such as GPTBot and ClaudeBot are a separate decision.

How long after a robots.txt fix should I recheck ChatGPT?

OpenAI says about 24 hours for ChatGPT search to reflect the change.

Does Google need special schema or llms.txt for AI Overviews?

No. Google says there is no special schema.org markup to add and that Search ignores llms.txt.

Can an AI agent run the strategy for me?

It can draft, check and log on a draft-only basis. A person should fact-check every draft and approve live changes, as Google's AI content guidance advises.

How do I measure AI visibility?

Use the Search Console generative AI performance report for impressions, Bing's AI Performance report for citations, and a dated prompt log for ChatGPT, Perplexity, Gemini and Claude.

📺 Video notes + links to the tools 👉

🎥 Learn how I make these videos 👉

🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉

About Julian

I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.

I help business owners scale with AI agents, automation and SEO.

  • I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
  • I've grown a YouTube channel to 400,000+ subscribers.
  • I wrote "Link Building Mastery".
  • My Udemy courses have taught over 29,000 students.

→ Get my best AI training inside the AI Profit Boardroom

Work the ten steps in order, keep the agent on draft-only, and book a free SEO strategy session (or pick a slot on the calendar) when you want a team to run your AI SEO strategy.

§ Field reports

Real wins from inside the AI Profit Boardroom

See all 3,400+ members →
AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot

Scroll sideways →

⚑ Next step

Ready to run AI agents that actually do the work?

Join 3,400+ operators inside the AI Profit Boardroom. Get 1,000+ plug-and-play AI agent workflows, 5 coaching calls a week, and a community that holds you accountable.

Join The AI Agent Community →

7-day no-questions refund · Cancel anytime

Found this useful? Get more of this site in your Google.

One tap adds us as a preferred source — Google then shows you our posts more often in Search, Top Stories, and AI Overviews.

← Back to all posts