Stage 01
Crawler access audit
We check your robots.txt, sitemap, meta robots tags, and server logs for every major AI crawler, and list exactly which bots can and cannot reach your site today.
AIO, AI Indexing Optimization
Make your site legible to every AI crawler that matters.
AIO is the plumbing layer under AEO and GEO. It is the work that makes sure AI crawlers can actually reach your pages, parse them into clean passages, and pass the result back to the answer engines that call them. RankSmith treats AIO as non negotiable on every build.
From R1 500 per month
The problem
Why can AI crawlers not read your site?
Most sites block AI crawlers by accident. Some block them on purpose and forget why. Some ship content behind client side JavaScript that AI crawlers do not render. Some have no sitemap, no robots.txt, and no llms.txt. Fixing all of this is a two week engagement that unlocks every other AI programme we run.
How RankSmith runs AIO
A four stage method, repeated every engagement.
Stage 02
Allow list and llms.txt
We rewrite robots.txt with explicit allow directives for GPTBot, ClaudeBot, PerplexityBot, Google Extended, and the rest, and we ship a hand written llms.txt at the site root.
Stage 03
Semantic and structured markup
We audit every template for semantic HTML (proper headings, lists, figures, main, article, section) and ship Organization, WebSite, LocalBusiness, Service, FAQPage, Article, and BreadcrumbList schema as appropriate.
Stage 04
Server side rendering
Any content that depends on client side rendering is lifted into server rendered output so AI crawlers can see it without executing JavaScript.
What you get
Deliverables, written into the contract.
- Crawler access audit with pass or fail per bot
- Rewritten robots.txt with explicit AI allow list
- Hand written llms.txt and llms-full.txt
- Full Schema.org markup across templates
- Server side rendering fixes where needed
Outcomes we target
The numbers this engagement is built to move.
- 01Every major AI crawler can fetch and render your site
- 02A valid llms.txt and llms-full.txt served at the site root
- 03Schema.org markup validated by Google Rich Results and schema.org validator
AIO questions
What people ask about AIO before they book a call.
These are the questions South African founders and marketing leads ask on a first AIO call. The answers are written the way a RankSmith lead would answer them in person.
AIO stands for AI Indexing Optimization. It is the layer of work that makes sure AI crawlers like GPTBot, ClaudeBot, PerplexityBot, and Google Extended can actually reach your site, render it, and pass the content back to their answer engines. Without AIO, everything else we do for AEO and GEO is blocked at the front door.
Ready when you are
Ready to run AIO with RankSmith?
Book a thirty minute strategy call. We will walk through your current site, your current visibility in Google and in AI engines, and where an honest AIO programme can move the number first.