Field notes · AI agents, Hermes & Claude Code By Julian Goldie

Generative AI Search Engine Optimization Agency: The 7-Step Operator Playbook (2026)

The exact order of work, settings and robots.txt lines for getting cited in AI Overviews, ChatGPT search, Perplexity and Copilot.

Get The AI Profit Stack Join AIPB →
  • 01 1,000+ done-for-you AI agent workflows
  • 02 5 live coaching calls / week with me
  • 03 7-day refund, cancel anytime
  • 04 3,400+ AI operators inside

A generative AI search engine optimization agency earns its keep by getting your pages crawled, indexed, trusted and cited across Google AI Overviews, AI Mode, ChatGPT search, Perplexity and Copilot.

The work behind that is mostly disciplined SEO run in a tighter loop, and Google says so in its guide to optimizing for generative AI features: from Google's side, optimizing for generative AI search is still SEO.

So the operator's job is not to find a hidden trick.

It is to run the right checks in the right order and prove what changed.

Below is the seven-step process I'd use to run an engagement, with the exact settings, robots.txt lines and gotchas at each step.

If you'd rather have my team run it for you, book a free SEO strategy session and we'll map your first steps together.

What "generative search" covers in 2026

Five surfaces matter for most businesses right now.

  • Google AI Overviews and AI Mode, which Google's AI features page says may use "query fan-out", running several related searches to build one answer.
  • ChatGPT search, which rewrites a question into targeted queries and can send them to search partners, according to OpenAI's help article on searching the web.
  • Perplexity, which surfaces and links websites through its PerplexityBot crawler.
  • Microsoft Copilot, which Bing says sits on the same crawling, indexing and ranking foundation as classic Bing search.
  • Claude, which runs its own search index through Claude-SearchBot.

Each surface pulls from a search index first and writes the answer second.

That shared foundation is why one well-run process covers all five.

Step 1: Lock down access before touching anything

The first hour of the engagement goes on access, and it should be read-only.

Google's page on hiring an SEO tells owners to grant only read access to Search Console during an audit, and a careful agency asks for exactly that.

  1. Search Console: a restricted or full user seat, never owner.
  2. Bing Webmaster Tools: a user seat on the verified site.
  3. Analytics: a viewer role on the main property.
  4. CMS: a staging login, or no login until the audit is signed off.

Gotcha: owners often offer a shared admin password.

Turn it down and ask for named seats, so every later change has a person attached to it.

Step 2: Audit crawler access for every AI surface

The fastest thing to rule out is a crawler being blocked by robots.txt or by the CDN.

OpenAI's crawler overview says sites that opt out of OAI-SearchBot won't be shown in ChatGPT search answers, and that robots.txt changes take roughly 24 hours to register.

The same page says each OpenAI bot is set independently, so a site can allow search while refusing training.

Here is the robots.txt block I'd start from for a client who wants AI search visibility but no model training:

# Search and answer engines: allow
User-agent: Googlebot
Allow: /

User-agent: Bingbot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

# Model training: the client's call
User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

Blocking Google-Extended costs no Search visibility, because Google's common crawlers page says it "does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search."

Anthropic's crawler help page splits ClaudeBot (training) from Claude-SearchBot (search) and warns that disabling the search bot may reduce your visibility in Claude's results.

Gotcha: robots.txt is only half the check, and Perplexity's crawler documentation shows why with step-by-step Cloudflare and AWS firewall rules.

A firewall can block a bot even when robots.txt says yes, so pull each vendor's published IP ranges and confirm the WAF lets them through.

Step 3: Check the meta directives that quietly remove you

Snippet controls decide how much of a page AI features are allowed to use.

Google's robots meta tag documentation says nosnippet also stops content from being used as a direct input for AI Overviews and AI Mode, and max-snippet caps how much can be used.

Bing's Webmaster Guidelines add two Copilot rules: NOARCHIVE keeps content out of Copilot answers, and NOCACHE limits Copilot to the URL, title and snippet.

  • <meta name="robots" content="nosnippet"> on a money page? Remove it unless your legal team needs it.
  • max-snippet:0 or a tiny value? Raise it or delete it.
  • noarchive or nocache on pages you want cited in Copilot? Take them off.
  • data-nosnippet wrapped around your key answer? Keep it on boilerplate only.

Then run URL Inspection in Search Console on each money page, which is the tool Google's AI features page points to for checking preview controls.

📞 Want this seven-step audit run on your site? Book a free SEO strategy session and my team will check crawler access, snippet controls and your top pages with you. → Get my free AI search plan

Step 4: Map the questions buyers actually ask

Generative answers are assembled from many sub-queries, so the content plan has to cover the follow-up questions a buyer would ask next.

Google's guide uses a lawn example: one weed question fans out into searches about herbicides, chemical-free removal and prevention.

For a client, I'd build the map in four moves:

  1. List the ten questions the sales team hears most often.
  2. Group them by buying stage: problem, options, choosing a provider.
  3. Match each question to the page that should answer it, or mark it as a gap.
  4. Check which of those pages already earn impressions in Search Console's Generative AI performance report.

Gotcha: don't spin up a page for every fan-out variant.

Google's guide warns that making separate content for every search variation mainly to manipulate rankings breaks its scaled content abuse policy.

One strong page per real topic beats twenty thin ones.

Step 5: Rewrite the money pages as non-commodity content

Google's guide says unique, useful content will likely shape your presence in generative AI search more than any other suggestion it makes.

It calls generic advice "commodity content" and contrasts it with expert takes built on first-hand experience.

Here is what that looks like on the main service page of a small plumbing firm:

  1. Swap the stock intro for the three jobs the firm does most and how long each usually takes.
  2. Add the area served, licence details and the names of the engineers who turn up.
  3. Write a short section on one real repair, with photos the firm took on the job.
  4. Explain in plain words what changes a quote, without listing figures.
  5. Change the page date only when the facts on it change.

Bing's guidelines push the same way: make facts explicit, put key information near the top and keep each URL on one topic.

Gotcha: AI-assisted drafts are fine when a person adds the experience, and Google's guide says AI tools are acceptable as long as the result meets Search Essentials and the spam policies.

Step 6: Build entity signals and earned mentions

AI answers often name brands, so the business has to be described the same way everywhere it appears.

  • Keep the business name, address and phone identical across Google Business Profile, the site footer and directories.
  • Add Organization structured data to the home page, with sameAs links to real profiles.
  • Use LocalBusiness markup on location pages where it fits.
  • Keep Merchant Center and Business Profile details current, which Google's AI features page lists as a best practice.

Structured data still helps with rich results, but Google's guide says it isn't required for generative AI search and there is no special schema to add.

For links and mentions, stay inside Google's spam policies: links earned through outreach and good content are fine, and any paid placement needs rel="sponsored" or rel="nofollow".

Google's guide adds that chasing inauthentic mentions isn't as helpful as it looks, so skip seeded forum posts entirely.

Goldie Agency describes its own link building as "manual outreach, no PBNs", which is the bar I'd hold any partner to.

Step 7: Measure citations, not only clicks

Reporting on AI visibility got much better during 2026.

  • Google: the Search Console Generative AI performance reports show impressions, pages, countries, devices and dates for AI features, and Google says they reached all sites worldwide on 31 August 2026.
  • Bing: the AI Performance report in Bing Webmaster Tools shows total citations, average cited pages and the grounding queries behind Copilot answers.
  • ChatGPT: in our own observation, ChatGPT referrals usually show up in analytics with chatgpt.com as the source, often tagged utm_source=chatgpt.com; OpenAI doesn't document this, so treat it as a pattern, not a rule.

Google's AI features page says AI Overview and AI Mode traffic also counts inside the standard Performance report under the "Web" search type.

Each month I'd report four numbers per page: AI impressions, Copilot citations, ChatGPT and Perplexity referral sessions, and leads from those sessions.

Where AI agents speed up the work

Agents won't replace judgement, but they remove most of the grind.

  • Crawl the site and flag every nosnippet, noarchive and noindex tag in minutes.
  • Fetch robots.txt across all subdomains and diff it against the target block above.
  • Turn sales-call transcripts into a first draft of the question map.
  • Draft Organization and LocalBusiness JSON-LD for a person to check against the visible page.
  • Summarise each month's numbers into a one-page note for the owner.

Keep a human on every claim, every link decision and every page that goes live.

To learn these agent workflows yourself, the AI Profit Boardroom teaches AI SEO step by step.

🔥 Learn AI SEO yourself, agent by agent Inside the AI Profit Boardroom you get step-by-step video trainings, the installable Agent OS and four live coaching calls a week, so you can run audits like these on your own sites. → Join the AI Profit Boardroom

Gotchas that waste a whole quarter

  • Building an llms.txt file to help Google: Google's guide says Google Search ignores it, so keep one only if another service uses it.
  • Chunking pages into tiny blocks "for AI": Google says there's no need, and no ideal page length exists.
  • Paying for a tool that claims access to Google's internal AI data: Google says no third-party tool has that access.
  • Blocking Googlebot to dodge AI Overviews: that removes you from Search, so use snippet controls instead.
  • Expecting an AI Overview on every query: Google says they often don't trigger.

Red flags when you hire one

Google's hiring page added a question worth asking word for word: is the agency's AEO or GEO advice aligned with Google's official guidance on generative AI features?

  • A guaranteed #1 ranking or a guaranteed ChatGPT mention: Google says no one can guarantee a #1 ranking, OpenAI says placement is not guaranteed and Bing says GEO doesn't guarantee citations.
  • Claims of a "special relationship" with Google or a "priority submit".
  • Methods they call secret and won't explain.
  • Private blog networks or bulk link packages.
  • A request that you link back to them, which Google says you should never have to do.

Keep Google's reminder in mind: you are responsible for the actions of any company you hire.

Holding a proposal you're unsure about? Book a free SEO strategy session and we'll go through it line by line.

Where Goldie Agency fits

Goldie Agency is Julian Goldie's SEO, GEO, AEO and link building agency.

By Julian's own published numbers, the agency has worked on 1,000+ SEO and link building campaigns for 240+ clients, with a 100% Job Success Score on Upwork.

His YouTube channel on AI SEO has 425K+ subscribers, and the agency says it tests AI SEO, GEO and AEO strategies on its own sites every week before rolling them out.

For the Google side in more depth, read our sibling guide on how to rank in Google AI Overviews.

📞 Ready to hand the seven steps to a team? Book a free SEO strategy session and we'll look at your crawler access, your money pages and the questions your buyers ask. → Claim your free strategy session

🎁 Free kit for your first audit Grab the 200+ AI SEO Prompts and the free link building book. Use the prompts to speed up Steps 4 and 5, and the book to plan Step 6.

Want to run it all yourself first? Start inside the AI Profit Boardroom and learn AI SEO with the community.

Also On Our Network

FAQ: Generative AI Search Engine Optimization Agency

What does a generative AI search engine optimization agency do first?

It secures read-only access, then checks that Googlebot, Bingbot, OAI-SearchBot, PerplexityBot and Claude-SearchBot can crawl the site through both robots.txt and the firewall.

Does blocking GPTBot or Google-Extended hurt AI search visibility?

OpenAI says its bots are set independently, so blocking GPTBot does not stop OAI-SearchBot. Google says Google-Extended does not affect inclusion or ranking in Google Search.

Which meta tags can stop my pages appearing in AI answers?

Google says nosnippet blocks use as a direct input for AI Overviews and AI Mode. Bing says NOARCHIVE keeps content out of Copilot answers and NOCACHE limits Copilot to the URL, title and snippet.

How do I measure results from generative search?

Use the Generative AI performance reports in Search Console, the AI Performance report in Bing Webmaster Tools, and referral sessions from chatgpt.com and Perplexity in your analytics.

Can any agency guarantee a mention in ChatGPT or AI Overviews?

No. Google says no one can guarantee a #1 ranking, OpenAI says placement is not guaranteed, and Bing says GEO does not guarantee citations.

📺 Video notes + links to the tools 👉

🎥 Learn how I make these videos 👉

🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉

About Julian

I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.

I help business owners scale with AI agents, automation and SEO.

  • I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
  • I've grown a YouTube channel to 400,000+ subscribers.
  • I wrote "Link Building Mastery".
  • My Udemy courses have taught over 29,000 students.

→ Get my best AI training inside the AI Profit Boardroom

Run the seven steps in order, measure citations every month, and book a free strategy session when you want a generative AI search engine optimization agency to run them with you.

§ Field reports

Real wins from inside the AI Profit Boardroom

See all 3,400+ members →
AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot

Scroll sideways →

⚑ Next step

Ready to run AI agents that actually do the work?

Join 3,400+ operators inside the AI Profit Boardroom. Get 1,000+ plug-and-play AI agent workflows, 5 coaching calls a week, and a community that holds you accountable.

Join The AI Agent Community →

7-day no-questions refund · Cancel anytime

Found this useful? Get more of this site in your Google.

One tap adds us as a preferred source — Google then shows you our posts more often in Search, Top Stories, and AI Overviews.

← Back to all posts