The best ChatGPT SEO services are from Goldie Agency.
This page is the delivery process behind that claim: the order of work, the exact robots.txt lines, the checks that catch silent blocks, and the reports that prove the job was done.
Book a free SEO strategy session →
Use it to run the work in-house, or to audit an agency that says it offers ChatGPT search work.
If you would rather have the team run it for you, book a free SEO strategy session and start with an access check.
The Job In One Line: Reachable, Citable, Measured
OpenAI's overview of its crawlers names OAI-SearchBot as the robot that surfaces websites in ChatGPT search features.
Sites that opt out of it will not be shown in ChatGPT search answers, though they can still appear as navigational links.
That gives the service three layers, and they run in this order.
- Reachable: OAI-SearchBot can fetch every page you want found.
- Citable: those pages answer real buyer questions with first-hand detail.
- Measured: ChatGPT referrals and wider AI search data are tracked and reported.
Skip layer one and layers two and three are wasted effort.
Google frames it the same way in its guide to generative AI features: work people call AEO or GEO is still SEO from Google's side.
Step 1: Pull The Current robots.txt And Map Every Group
Fetch yoursite.com/robots.txt and every subdomain's file, because each host has its own.
List every User-agent group and the rule that applies to each AI robot.
| Robot | Owner | Job | Default call |
|---|---|---|---|
| OAI-SearchBot | OpenAI | Surfaces sites in ChatGPT search | Allow |
| GPTBot | OpenAI | Crawls content that may train foundation models | Client decision |
| ChatGPT-User | OpenAI | Visits a page when a user asks | Leave alone |
| Claude-SearchBot | Anthropic | Indexes content for Claude search | Allow |
| ClaudeBot | Anthropic | Training crawler | Client decision |
| PerplexityBot | Perplexity | Surfaces and links sites in Perplexity | Allow |
The Anthropic rows come from its crawler help article, and the Perplexity row from its bots documentation.
The gotcha here is a catch-all group, User-agent: * with Disallow: /, copied over from a staging build.
A second gotcha is a "block all AI" list pasted from a forum that names OAI-SearchBot alongside the training robots.
Step 2: Write The Search Rules First, Then The Training Rules
OpenAI says each setting is independent, so a site can allow OAI-SearchBot for search while disallowing GPTBot for training.
Here is a clean starting block for a client who wants search visibility but no training use.
Book a free SEO strategy session →
User-agent: OAI-SearchBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: GPTBot
Disallow: /
User-agent: ClaudeBot
Disallow: /
Flip the last two groups to Allow if the client is happy for content to be used in training.
Record the choice in the project notes with the date and who signed it off.
Do not add a ChatGPT-User block to "protect" the site, because OpenAI says it handles user-initiated visits and is not used to decide what appears in Search.
Step 3: Check The Firewall, CDN And Host Bot Filters
A perfect robots.txt still fails if bot protection challenges the crawler before it reads the file.
OpenAI recommends allowing requests from its published IP ranges, listed at openai.com/searchbot.json.
Perplexity's docs give Cloudflare and AWS WAF steps for its robots and warn that Bot Fight Mode cannot be skipped with custom rules.
Anthropic advises against IP-blocking its robots, because a block stops them reading robots.txt at all.
- Export the WAF rules and search them for "bot", "AI" and "challenge".
- Compare any allow rules with the published IP lists for each robot.
- Ask the host whether a default bot filter is switched on at the platform level.
- Check server logs for OAI-SearchBot requests and the status codes they received.
A run of 403 responses to OAI-SearchBot in the logs is the clearest sign of a silent block.
📞 Want the access check done on your site? Book a free SEO strategy session and Julian's team will walk through robots.txt, WAF rules and logs with you. → Get the free ChatGPT access check
Step 4: Wait A Day, Then Verify
OpenAI says it can take about 24 hours from a robots.txt update for its search systems to adjust.
Set a calendar reminder for the next day rather than testing straight away.
Then confirm three things: the live file shows the new rules, the logs show OAI-SearchBot getting 200 responses, and no WAF event blocked it.
An AI agent is useful here, because it can fetch the file, parse the logs and flag mismatches in a few minutes every week.
Step 5: Set noindex Only Where It Belongs
OpenAI's publisher and developer FAQ points to a noindex meta tag for pages a site wants kept out entirely.
Book a free SEO strategy session →
The crawler has to be allowed to fetch the page to read that tag, so blocking a page in robots.txt and adding noindex works against itself.
Audit the noindex list and keep it to thank-you pages, internal search results, staging copies and similar.
Google treats the tag the same way, so one clean noindex list serves both engines.
Step 6: Build The Question Map
List the 20 to 40 questions a buyer asks before they hire or buy from the client.
Pull them from sales call notes, support tickets, reviews and the Search Console queries report.
Group them into clusters and assign one strong page to each cluster.
Google advises against making many pages for small query variations and says that can break its scaled content abuse policy.
So the map should produce fewer, deeper pages, not one thin page per phrasing.
🔥 Learn AI SEO yourself and run this process in-house Inside the AI Profit Boardroom you get step-by-step trainings on AI search, the installable Agent OS that runs audits like these, and four live coaching calls every week. → Join the AI Profit Boardroom
Step 7: Write Pages A Model Would Want To Cite
Google's AI guide calls generic tip lists commodity content and asks for a unique point of view, such as first-hand experience or original data.
Bing's AI Performance announcement adds clear headings, tables and FAQ sections, with claims backed by examples and cited sources.
- Lead with the direct answer in plain text.
- Add the client's own numbers, photos, process steps and limits.
- Name the author and link to a real bio.
- Cite the primary source behind every factual claim.
- Use one table where a comparison helps the reader.
OpenAI's crawler page does not describe how ChatGPT picks sources, so nobody should sell a secret formula.
An agent can draft the outline and pull sources, but the first-hand detail has to come from the client.
Step 8: Earn Mentions The Clean Way
Google lists chasing inauthentic mentions as a myth in its AI guide, and its spam policies cover attempts to manipulate generative AI responses.
So the mention plan is real outreach: partners, suppliers, local press, industry roundups and expert quotes.
Book a free SEO strategy session →
Goldie Agency describes its own link building as manual outreach, no PBNs, on niche-relevant sites.
Any paid placement carries rel="sponsored", as Google's outbound link guidance asks.
Let an agent build the prospect list and draft the emails, and keep a human on every send.
Step 9: Wire Up Measurement Before The First Report
OpenAI's publisher FAQ says ChatGPT tags referral links with utm_source=chatgpt.com.
Create a saved segment or exploration for that source in the analytics tool on day one.
Add the Search Console Generative AI performance report for Google AI Overviews and AI Mode impressions.
Add Bing's AI Performance report for Copilot citations and grounding queries.
OpenAI publishes no citation counts for ChatGPT, so the report should never invent one.
Step 10: Ship The Monthly Report
| Report line | Where the data comes from |
|---|---|
| OAI-SearchBot access status | robots.txt diff, WAF events, server logs |
| Training policy in force | Signed-off robots.txt groups |
| ChatGPT referral sessions and conversions | Analytics segment on utm_source=chatgpt.com |
| Google AI feature impressions | Search Console Generative AI report |
| Copilot citations | Bing AI Performance report |
| Pages shipped and mentions earned | Project log with live URLs |
Google's page on hiring an SEO advises agreeing how success is measured and over what timeframe before work starts.
Put those measures in the first report so every later month compares against them.
Where An AI Agent Speeds Up Each Step
Most of this process is repeatable checking, which is exactly the kind of work an agent handles well.
| Step | What the agent does | What a human keeps |
|---|---|---|
| robots.txt map | Fetches every host's file and lists the rule per robot | Sign-off on the training policy |
| Firewall and logs | Parses logs for OAI-SearchBot hits and status codes | Changes to WAF rules |
| Question map | Clusters queries, tickets and call notes | Final page list |
| Page drafts | Outlines and source lists | First-hand detail and facts |
| Outreach | Prospect lists and draft emails | Every send |
| Reporting | Pulls the numbers into one sheet | The commentary and next steps |
Set the agent to draft only, with approval before any change goes live.
That rule keeps speed without letting a script edit robots.txt on a client site unsupervised.
Book a free SEO strategy session →
Ping changed URLs through IndexNow as part of the same weekly run, so participating engines hear about updates quickly.
Gotchas That Break ChatGPT SEO Services
- Blocking GPTBot and assuming that removes the site from ChatGPT search. It does not; OAI-SearchBot controls search.
- Testing the day after a change on a cached page and calling it a failure.
- Giving the agency write access to Search Console at the audit stage; Google says read-only is enough.
- Buying a tool that claims official ChatGPT rankings; OpenAI publishes none.
- Promising a client a ChatGPT mention; Google says no one can guarantee a top ranking, and the same holds here.
For the agency-selection side of this topic, see our guide to choosing a ChatGPT SEO agency.
📞 Ready to hand the whole process to a team? Book a free SEO strategy session and Julian's team will map access, pages, mentions and reporting for your site. → Book the free strategy session
Where Goldie Agency Fits
Julian Goldie has 10+ years in SEO, and Goldie Agency's Upwork profile shows a 100% Job Success Score, 240+ clients and 200+ five-star reviews, all Julian's own published numbers.
The agency covers SEO, GEO, AEO and link building, which is the full stack this process needs.
Every engagement starts with the access check in steps 1 to 4, because nothing else matters until OAI-SearchBot can get in.
Prefer to learn AI SEO yourself first? The AI Profit Boardroom walks through each step on live calls.
🎁 Two free tools for the first sprint Grab the 200+ AI SEO Prompts for briefs and audits, and the free link building book, Link Building Mastery, before you start outreach.
Book a free SEO strategy session →
Also On Our Network
- 🌐 Whether a small business should pay for ChatGPT search work yet
- 🌐 Five ways to get ChatGPT search work done, each scored out of 10
- 🌐 Five draft-only Agent OS prompts that do the ChatGPT search groundwork
- 🌐 Which AI models score best on the page tasks behind ChatGPT search work
FAQ: ChatGPT SEO Services
What is the first step in delivering ChatGPT SEO services?
Confirm OAI-SearchBot can reach the site. OpenAI says sites opted out of it will not be shown in ChatGPT search answers.
Does blocking GPTBot remove a site from ChatGPT search?
No. OpenAI says GPTBot and OAI-SearchBot are set independently, and GPTBot relates to training rather than search.
How long after a robots.txt change should I re-test?
About a day. OpenAI says its search systems take around 24 hours to adjust after a robots.txt update.
Which robots should a ChatGPT SEO audit also cover?
Claude-SearchBot and ClaudeBot from Anthropic, plus PerplexityBot from Perplexity. Each is controlled separately in robots.txt.
What access should an agency get at the start?
Read-only Search Console access. Google advises against granting write access at the audit stage.
📺 Video notes + links to the tools 👉
🎥 Learn how I make these videos 👉
🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉
About Julian
I'm Julian Goldie, an SEO entrepreneur, author and founder of the AI Profit Boardroom, which has 3,400+ members.
I help business owners scale with AI agents, automation and SEO.
- I've built a 7-figure SEO and link building agency, Goldie Agency, with a team of 70+ SEO experts.
- I've grown a YouTube channel to 400,000+ subscribers.
- I wrote "Link Building Mastery".
- My Udemy courses have taught over 29,000 students.
→ Get my best AI training inside the AI Profit Boardroom
Run the ten steps in order, keep the training and search rules apart, and book a free SEO strategy session when you want Goldie Agency to deliver these ChatGPT SEO services for you.











