Field notes · AI agents, Hermes & Claude Code By Julian Goldie

AI SEO Digital Agency Playbook: Fold AI Search Into Web, Content And Local Work In 7 Steps (2026)

The exact order of work, with robots.txt lines, render checks and the launch gotchas, tied to Google, OpenAI, Perplexity, Anthropic and Bing docs.

Get The AI Profit Stack Join AIPB →
  • 01 1,000+ done-for-you AI agent workflows
  • 02 5 live coaching calls / week with me
  • 03 7-day refund, cancel anytime
  • 04 3,400+ AI operators inside

An AI SEO digital agency is a web, content and marketing shop that also optimises your site for Google AI Overviews, ChatGPT search, Perplexity and Copilot.

Done well, the AI search work rides on top of the build, the copy and the local listings the agency already handles.

Done badly, it becomes a bolt-on line item that nobody owns.

Here is the order I would run it in, step by step, with the settings that matter. If you want a second pair of eyes first, book a free SEO strategy session with my team.

Where AI search work sits inside a digital agency

A typical digital agency sells four things: websites, content, local marketing and paid media.

AI search touches the first three. Google says its AI features are rooted in its core Search ranking and quality systems, so the same crawlable, helpful site that ranks in classic results is the one that gets used as a source.

That means the web team, the writers and the local team all hold part of the job.

Paid media is the odd one out: Google says advertising has no effect on organic presence, and OpenAI says ads don't influence ChatGPT's independent answers.

So the first operator task is ownership. Write down who owns crawler access, who owns page copy, who owns the Business Profile and who owns reporting.

Step 1: Record the AI search baseline before anyone touches the site

Take the snapshot on day one, not after the redesign ships.

  1. Export the last 90 days from Search Console, including the generative AI performance report.
  2. Turn on AI Performance in Bing Webmaster Tools and note total citations and cited pages.
  3. Ask ChatGPT, Perplexity and Google AI Mode 10 buyer questions and save the answers as screenshots.
  4. Note which competitors and which third-party pages get named.
  5. Save referral sessions from chatgpt.com and perplexity.ai in analytics. In our experience ChatGPT clicks usually show up as chatgpt.com referrals.

Google rolled the generative AI performance reports out to all sites on 31 August 2026, so there is no excuse for skipping the before picture.

Step 2: Clear the crawler path on the new build

This is where digital agencies lose AI visibility without noticing.

A new site often ships behind a CDN or firewall with aggressive bot rules switched on by default.

OpenAI says that to be eligible for ChatGPT search you must allow OAI-SearchBot and make sure your host or CDN allows OpenAI's published IP ranges (OpenAI crawler docs).

Perplexity gives the same advice for PerplexityBot and includes firewall setup notes in its crawler documentation.

Anthropic warns that blocking Claude-SearchBot may reduce your visibility in Claude search results.

Here is the robots.txt block I start from:

# AI search crawlers: let them in
User-agent: OAI-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

# Training crawlers: a business choice, separate from search
User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

Sitemap: https://www.example.com/sitemap.xml

The search bots and the training bots are separate switches.

OpenAI says you can allow OAI-SearchBot while disallowing GPTBot, and changes take about 24 hours to apply.

Leave Googlebot and Bingbot open, because AI Overviews, AI Mode and Copilot all run on the normal search crawlers.

Step 3: Run a render check on JavaScript builds

Digital agencies love modern front-end frameworks, and that is fine as long as the content reaches the crawler.

Google processes JavaScript sites in three phases, crawl, render and index, and still calls server-side or pre-rendering a great idea because not all bots can run JavaScript.

  • Fetch five key pages with JavaScript turned off and check the main copy is in the HTML.
  • Use the URL Inspection tool in Search Console to view the rendered HTML.
  • Check internal links are real <a href> tags, not click handlers.
  • Make sure missing pages return a real 404 status, not a 200 with an error message.

If the copy only appears after scripts run, ask the developers for server-side rendering on the money pages before launch.

📞 Want these first three steps checked on your own build? Book a free SEO strategy session and we'll walk through crawler access, rendering and your AI search baseline on the call. → Grab a strategy session slot

Step 4: Audit preview controls and stray meta tags

Google says the controls for AI features in Search are the same snippet controls as everywhere else: nosnippet, data-nosnippet, max-snippet and noindex.

A nosnippet tag also stops the content being used as a direct input for AI Overviews and AI Mode.

I have seen staging settings leak into production on agency launches, so check every template.

  • Search the page source for noindex, nosnippet and max-snippet.
  • Check the HTTP headers for an X-Robots-Tag on PDFs and key pages.
  • Look for data-nosnippet wrapped around whole service sections by a theme or plugin.
  • Remember that Google-Extended controls Gemini training and grounding, and Google says it does not affect inclusion or ranking in Google Search.

Step 5: Add schema that matches the visible page

There is no special AI markup to add. Google states plainly that no special schema.org structured data is needed for AI Overviews or AI Mode.

Structured data still helps Google understand who you are, so I add the basics and keep them fair.

  • Organization on the home page, with logo, url and sameAs links to real profiles.
  • LocalBusiness or a subtype on each location page, with the same name, address and phone as the Business Profile.
  • Service or Product markup only where the page actually describes that service or product.
  • No review markup for reviews you wrote yourself.

If a proposal sells llms.txt as a Google fix, push back: Google says Search ignores those files, though other services may read them.

Step 6: Brief content that isn't commodity

Google's new optimisation guide asks for non-commodity content: first-hand experience, a clear point of view and detail a summary can't copy.

Digital agencies often have the raw material already, because they shoot photos, interview the owner and write case studies.

Turn that material into pages that answer buyer questions directly.

  1. List the 20 questions the sales team hears most.
  2. Group them into one page per topic, not one page per phrasing.
  3. Add a named author, real photos, opening hours, and the steps the business actually follows.
  4. Put the direct answer in the first two sentences, then the detail.

Google warns that spinning out a page for every query variation can break its scaled content abuse policy, so keep the page count fair.

Step 7: Handle local listings and links inside the rules

Local is usually where a digital agency is strongest, so tie it in. The Business Profile guidelines want the real-world business name, no keywords stuffed into it, and no virtual offices.

Service-area businesses get one profile for the central location with the address hidden.

For links, stay inside Google's link spam policy. Earned editorial links are the goal, and any paid placement gets a rel="sponsored" attribute.

One gotcha: the "Website by Agency X" footer credit.

Google's hiring page says you should never have to link to an SEO, so make that credit optional and let the client decide.

How I measure the engagement week to week

SignalWhere to find itWhat it tells you
AI feature impressionsSearch Console generative AI reportWhich URLs appear in AI Overviews and AI Mode
Copilot citationsBing Webmaster Tools AI PerformanceCited pages and grounding queries
ChatGPT visitsAnalytics referrals from chatgpt.comWhether answers send people to the site
LeadsCRM or call trackingWhether any of it turns into enquiries

Report all four together each month, and tie every change you shipped to a date on the chart.

Where AI agents speed up the work

Agents are good at the repetitive checks and first drafts, and bad at judgement calls on a live site.

  • Crawl the sitemap weekly and flag pages with noindex, nosnippet or blocked bots.
  • Draft Organization and LocalBusiness JSON-LD from the contact page for a person to check.
  • Turn call transcripts into content briefs with the buyer's exact questions.
  • Research outreach targets and draft pitches, with a draft-only rule so nothing gets sent.

If your team wants to build those workflows, the AI Profit Boardroom trainings cover the Agent OS setup step by step.

🔥 Want to run this seven-step plan in-house? Inside the AI Profit Boardroom you learn AI SEO yourself: step-by-step video trainings, the installable Agent OS for the crawl checks and briefs, and four live coaching calls a week. → Join the AI Profit Boardroom

Gotchas I flag on every AI SEO digital agency project

  • Bot protection blocking OAI-SearchBot or PerplexityBot at the CDN.
  • A staging noindex that survives launch.
  • Redirect maps missing on a redesign, so old pages that earned links return 404s.
  • Location pages that are copies with the town name swapped.
  • Reports full of AI visibility scores from third-party tools, which Google says have no access to its internal systems.
  • Any promise of a guaranteed #1 ranking or a guaranteed ChatGPT mention.

Google is blunt about that last one: no one can guarantee a #1 ranking, and OpenAI says ChatGPT placement is not guaranteed.

When a specialist SEO agency fits better

A digital agency is a strong fit when the site build, brand and local listings are the main jobs.

A specialist SEO agency fits better when the hard part is off the site: competitive link earning, digital PR, technical recovery on a large site, or a niche where every rival is already strong.

Many businesses run both, with the digital agency on design and content and an SEO team on strategy and links.

Goldie Agency is one example of the specialist side. On Julian Goldie's own published numbers it has worked on 1,000+ SEO and link building campaigns for 240+ clients, with a 100% Job Success Score on Upwork, and it describes its link building as "manual outreach, no PBNs".

For a deeper checklist on choosing either type, read our guide on how to hire an SEO agency.

Worked example: a dental clinic redesign, step by step

  1. Week 1: the agency saves the Search Console baseline and asks ChatGPT and AI Mode "best dentist near me" style questions for the clinic's town.
  2. Week 1: the developer allows OAI-SearchBot, PerplexityBot and Claude-SearchBot and whitelists their IP ranges at the CDN.
  3. Week 2: the new templates get a no-JavaScript check and a snippet-control audit before launch.
  4. Week 3: the writer turns the dentist's answers on implants, emergency visits and aftercare into three first-hand service pages.
  5. Week 4: the local lead updates the Business Profile hours and categories and adds matching LocalBusiness markup.
  6. Week 6: the team compares AI feature impressions and chatgpt.com referrals with the baseline and logs new booking enquiries.

No step in that list needs a trick. It needs one owner per step and a baseline to measure against.

📞 Need a specialist SEO team beside your digital agency? Book a free SEO strategy session and get a plan that splits the web, content, local and link work between the right people. → Book your free session

🎁 Two free tools for the engagement Grab the 200+ AI SEO Prompts for audits and briefs, and read the free link building book before you plan step 7. → Book a free SEO strategy session

Also On Our Network

FAQ: AI SEO Digital Agency Playbook

What should an AI SEO digital agency check first on a new website?

Crawler access. Make sure robots.txt, the CDN and any firewall let OAI-SearchBot, PerplexityBot, Claude-SearchBot, Googlebot and Bingbot reach the pages.

Do JavaScript frameworks hurt AI search visibility?

They can if the main content only appears after scripts run. Google recommends server-side or pre-rendering because not every bot can run JavaScript.

Is there special schema for AI Overviews?

No. Google says no special schema.org markup is needed, but Organization and LocalBusiness markup that matches the page is still worth adding.

Should the agency add a footer credit link to its own site?

Only if you are happy with it. Google says you should never have to link to an SEO, so treat the credit as optional.

How long until the engagement shows results?

Nobody can promise a timeline or a ranking. Track AI feature impressions, Copilot citations, chatgpt.com referrals and leads against your day-one baseline.

📺 Video notes + links to the tools 👉

🎥 Learn how I make these videos 👉

🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉

About Julian

I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.

I help business owners scale with AI agents, automation and SEO.

  • I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
  • I've grown a YouTube channel to 400,000+ subscribers.
  • I wrote "Link Building Mastery".
  • My Udemy courses have taught over 29,000 students.

→ Get my best AI training inside the AI Profit Boardroom

Own each step, measure against the baseline, and book a free strategy session when you want a specialist team working alongside your AI SEO digital agency.

§ Field reports

Real wins from inside the AI Profit Boardroom

See all 3,400+ members →
AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot AIPB member win screenshot

Scroll sideways →

⚑ Next step

Ready to run AI agents that actually do the work?

Join 3,400+ operators inside the AI Profit Boardroom. Get 1,000+ plug-and-play AI agent workflows, 5 coaching calls a week, and a community that holds you accountable.

Join The AI Agent Community →

7-day no-questions refund · Cancel anytime

Found this useful? Get more of this site in your Google.

One tap adds us as a preferred source — Google then shows you our posts more often in Search, Top Stories, and AI Overviews.

← Back to all posts