Discoverability ยท Agent Readiness Checklist

Discoverability ยท Agent Readiness Checklist

Is your site ready
for AI agents?

Check if AI agents can read, trust and act on your site. One checklist for crawl access, llms.txt, schema and product data, fixed in order of impact.

Check if AI agents can read, trust and act on your site. One checklist for crawl access, llms.txt, schema and product data, fixed in order of impact.

Check if AI agents can read, trust and act on your site. One checklist for crawl access, llms.txt, schema and product data, fixed in order of impact.

Check if AI agents can read, trust and act on your site. One checklist for crawl access, llms.txt, schema and product data, fixed in order of impact.

5/5 on G2

Trusted by 400+ brands and agencies

  • Canon logo
  • Huawei logo
  • Philips logo
  • Castrol logo
  • Gazelle logo
  • RE/MAX logo
  • Productsup logo
  • Pegasus logo
  • Ticketmaster logo
  • Worldef logo
  • Filli Boya logo
  • MiraclePay logo

Gymshark

Learn

Checklist

Alerts

History

Readiness score

42

/ 57

Crawler access

Icon
Icon
Icon
Icon
Icon

4 / 5 allowed

llms.txt

Missing

No file at site root

Checklist

15 issues

robots.txt allows AI crawlers

GPTBot, ClaudeBot and PerplexityBot can read

Passing

Product schema

Structured data on 48 of 48 pages

Passing

returnPolicy in Offer

Missing on 412 product pages

Fix

llms.txt published

No llms.txt found at the site root

Fix

Prices render without JavaScript

Server-rendered on all templates

Passing

Sitemap lists every product

1,284 of 1,284 URLs

Passing

LLMS.TXT ยท GENERATED

DRAFT

# Gymshark

> Performance activewear

## Products

- [Leggings](/leggings.md)

## Policies

- [Returns](/returns.md)

Publish to site root

Live crawler activity

Icon

GPTBot

GET /products/vital-seamless

200

Icon

ClaudeBot

GET /llms.txt

404

Icon

PerplexityBot

GET /collections/leggings

200

Icon

Google-Extended

GET /returns

200

+6

Readiness score this week

Gymshark

Learn

Checklist

Alerts

History

Readiness score

42

/ 57

Crawler access

Icon
Icon
Icon
Icon
Icon

4 / 5 allowed

llms.txt

Missing

No file at site root

Checklist

15 issues

robots.txt allows AI crawlers

GPTBot, ClaudeBot and PerplexityBot can read

Passing

Product schema

Structured data on 48 of 48 pages

Passing

returnPolicy in Offer

Missing on 412 product pages

Fix

llms.txt published

No llms.txt found at the site root

Fix

Prices render without JavaScript

Server-rendered on all templates

Passing

Sitemap lists every product

1,284 of 1,284 URLs

Passing

LLMS.TXT ยท GENERATED

DRAFT

# Gymshark

> Performance activewear

## Products

- [Leggings](/leggings.md)

## Policies

- [Returns](/returns.md)

Publish to site root

Live crawler activity

Icon

GPTBot

GET /products/vital-seamless

200

Icon

ClaudeBot

GET /llms.txt

404

Icon

PerplexityBot

GET /collections/leggings

200

Icon

Google-Extended

GET /returns

200

+6

Readiness score this week

Gymshark

Learn

Checklist

Alerts

History

Readiness score

42

/ 57

Crawler access

Icon
Icon
Icon
Icon
Icon

4 / 5 allowed

llms.txt

Missing

No file at site root

Checklist

15 issues

robots.txt allows AI crawlers

GPTBot, ClaudeBot and PerplexityBot can read

Passing

Product schema

Structured data on 48 of 48 pages

Passing

returnPolicy in Offer

Missing on 412 product pages

Fix

llms.txt published

No llms.txt found at the site root

Fix

Prices render without JavaScript

Server-rendered on all templates

Passing

Sitemap lists every product

1,284 of 1,284 URLs

Passing

LLMS.TXT ยท GENERATED

DRAFT

# Gymshark

> Performance activewear

## Products

- [Leggings](/leggings.md)

## Policies

- [Returns](/returns.md)

Publish to site root

Live crawler activity

Icon

GPTBot

GET /products/vital-seamless

200

Icon

ClaudeBot

GET /llms.txt

404

Icon

PerplexityBot

GET /collections/leggings

200

Icon

Google-Extended

GET /returns

200

+6

Readiness score this week

Gymshark

Learn

Checklist

Alerts

History

Readiness score

42

/ 57

Crawler access

Icon
Icon
Icon
Icon
Icon

4 / 5 allowed

llms.txt

Missing

No file at site root

Checklist

15 issues

robots.txt allows AI crawlers

GPTBot, ClaudeBot and PerplexityBot can read

Passing

Product schema

Structured data on 48 of 48 pages

Passing

returnPolicy in Offer

Missing on 412 product pages

Fix

llms.txt published

No llms.txt found at the site root

Fix

Prices render without JavaScript

Server-rendered on all templates

Passing

Sitemap lists every product

1,284 of 1,284 URLs

Passing

LLMS.TXT ยท GENERATED

DRAFT

# Gymshark

> Performance activewear

## Products

- [Leggings](/leggings.md)

## Policies

- [Returns](/returns.md)

Publish to site root

Live crawler activity

Icon

GPTBot

GET /products/vital-seamless

200

Icon

ClaudeBot

GET /llms.txt

404

Icon

PerplexityBot

GET /collections/leggings

200

Icon

Google-Extended

GET /returns

200

+6

Readiness score this week

Crawl access, checked

See which AI crawlers your robots.txt and CDN let in, and which ones they block.

Structure agents can parse

Schema, llms.txt and product data checked page by page.

Fixes in order of impact

Every gap comes with a clear fix, ranked by how much it holds you back.

WHATโ€™S INSIDE

WHATโ€™S INSIDE

Everything in Agent Readiness Checklist

Everything in Agent Readiness Checklist

Everything in Agent Readiness Checklist

Everything in Agent Readiness Checklist

Crawler access

See which AI crawlers your robots.txt, CDN and firewall let in.

Schema coverage

Product, Organization, FAQ and Offer schema checked on every template.

Agent-readable docs

llms.txt and docs pages agents can read without a browser.

Product data

Price, stock, size and returns fields agents need to recommend you.

Readiness score

One score across 57 checks, tracked over time.

Fix guides

Each failing check comes with the exact fix and who should own it.

HOW IT WORKS

HOW IT WORKS

Check, prioritize and improve agent readiness

Check, prioritize and improve agent readiness

Check, prioritize and improve agent readiness

Check, prioritize and improve agent readiness

gymshark.com/leggings

Product photo

Vital Seamless 2.0

ยฃ45

Icon

GPTBot is reading

/PRODUCTS/VITAL-SEAMLESS

gymshark.com/leggings

Product photo

Vital Seamless 2.0

ยฃ45

Icon

GPTBot is reading

/PRODUCTS/VITAL-SEAMLESS

01

Scan your site

Opttab crawls your pages the way AI agents do, and sees what they can read.

What agents need

Product information

OK

Contact and support

OK

Product schema

OK

Agent-readable docs

Missing

READINESS

15

/57

What agents need

Product information

OK

Contact and support

OK

Product schema

OK

Agent-readable docs

Missing

READINESS

15

/57

02

Check what agents need

Product info, contact details, schema and docs, checked page by page.

Product photo

vital-seamless.json

โ€œ@typeโ€: โ€œProductโ€,

โ€œnameโ€: โ€œVital Seamless 2.0โ€,

โ€œpriceโ€: โ€œ45.00โ€,

โ€œhasMerchantReturnPolicyโ€: {

โ€œmerchantReturnDaysโ€: 30 }

Fix shipped

+3 CHECKS PASS

Product photo

vital-seamless.json

โ€œ@typeโ€: โ€œProductโ€,

โ€œnameโ€: โ€œVital Seamless 2.0โ€,

โ€œpriceโ€: โ€œ45.00โ€,

โ€œhasMerchantReturnPolicyโ€: {

โ€œmerchantReturnDaysโ€: 30 }

Fix shipped

+3 CHECKS PASS

03

Fix the gaps

See exactly which fields are missing, and ship the fix.

INSIDE THE CHECKLIST

INSIDE THE CHECKLIST

See what agents can and canโ€™t read on your site

See what agents can and canโ€™t read on your site

See what agents can and canโ€™t read on your site

See what agents can and canโ€™t read on your site

Every check comes with a status, so you know exactly what to fix before AI agents arrive.

Discoverability and website health scores

Present or missing, check by check

Fixes your team can ship today

Agent readiness

gymshark.com ยท United Kingdom

DISCOVERABILITY

68 / 100

WEBSITE HEALTH

75 / 100

CHECKS PASSED

15 / 57

Agent readiness checklist

Presence checks ยท 2 of 4 present

Public product information

Present

Contact and support details

Present

Structured product schema

Missing

Agent-readable documentation

Missing

Technical checklist

3 of 4

HTTPS and security

Present

Crawlable pages

Present

XML sitemap

Present

Organization schema

Missing

AGENT READINESS CHECKLIST

AGENT READINESS CHECKLIST

A closer look at Agent Readiness Checklist

A closer look at Agent Readiness Checklist

A closer look at Agent Readiness Checklist

A closer look at Agent Readiness Checklist

SITE SCAN

Crawl your site like an agent

See every page the way AI agents fetch it.

/

Read

/leggings

Product photo

Read

/sports-bras

Product photo

Read

/returns

Read

/blog/fit-guide

No schema

/products/vital

Product photo

Read

/shipping

Read

/account

Blocked

Icon

GPTBot

Icon

ClaudeBot

CRAWL REPORT

Live

1,284

pages crawled

Blocked by robots.txt

12

Needs JavaScript

38

Missing schema

64

Icon
Icon
Icon

3 AGENTS CRAWLING

/

Read

/leggings

Product photo

Read

/sports-bras

Product photo

Read

/returns

Read

/blog/fit-guide

No schema

/products/vital

Product photo

Read

/shipping

Read

/account

Blocked

Icon

GPTBot

Icon

ClaudeBot

CRAWL REPORT

Live

1,284

pages crawled

Blocked by robots.txt

12

Needs JavaScript

38

Missing schema

64

Icon
Icon
Icon

3 AGENTS CRAWLING

SCORE

Readiness over time

Your score after every release.

READINESS SCORE

15

/ 57

+6 since 4.0

RELEASE 4.2

+2 checks passed

READINESS SCORE

15

/ 57

+6 since 4.0

RELEASE 4.2

+2 checks passed

CRAWL ACCESS

Who gets in

Allowed and blocked AI crawlers.

AI CRAWLERS

robots.txt

Icon

GPTBot

Allowed

Icon

ClaudeBot

Allowed

Icon

PerplexityBot

Allowed

Icon

Google-Extended

Blocked

ROBOTS.TXT

User-agent: Google-Extended

Disallow: /

AI CRAWLERS

robots.txt

Icon

GPTBot

Allowed

Icon

ClaudeBot

Allowed

Icon

PerplexityBot

Allowed

Icon

Google-Extended

Blocked

ROBOTS.TXT

User-agent: Google-Extended

Disallow: /

SCHEMA

Structured data per template

Coverage on every page type.

TEMPLATE ยท COLLECTION

TEMPLATE ยท ARTICLE

Product photo

TEMPLATE ยท PRODUCT

412 PAGES

Vital Seamless Leggings

Product

Offer

Brand

AggregateRating

returnPolicy

JSON-LD

TEMPLATE ยท COLLECTION

TEMPLATE ยท ARTICLE

Product photo

TEMPLATE ยท PRODUCT

412 PAGES

Vital Seamless Leggings

Product

Offer

Brand

AggregateRating

returnPolicy

JSON-LD

DOCS

Agent-readable docs

llms.txt and docs, checked.

LLMS.TXT

gymshark.com

# Gymshark

> Performance activewear

## Products

- [Leggings](/leggings.md)

- [Sports bras](/bras.md)

## Policies

- [Returns](/returns.md)

- [Shipping](/shipping.md)

Icon

ClaudeBot read it

14 LINKS FOLLOWED

Icon

GPTBot

LLMS.TXT

gymshark.com

# Gymshark

> Performance activewear

## Products

- [Leggings](/leggings.md)

- [Sports bras](/bras.md)

## Policies

- [Returns](/returns.md)

- [Shipping](/shipping.md)

Icon

ClaudeBot read it

14 LINKS FOLLOWED

Icon

GPTBot

FIXES

Every fix, assigned

Ranked fixes with owners.

FIXES ยท SPRINT 14

6 open

9 shipped

TO DO

4

Add returnPolicy to Product schema

SCHEMA

DK

Allow OAI-SearchBot in robots.txt

ACCESS

MS

IN PROGRESS

2

Publish llms.txt

DOCS

AL

Render prices without JavaScript

RENDERING

DK

SHIPPED

9

Add Offer schema to 412 pages

SCHEMA

AL

Fix canonical on /leggings

STRUCTURE

MS

OT-142

To do

Add returnPolicy to Product schema

DK

Dana Kim ยท Engineering

412 product pages

+3 checks

FIXES ยท SPRINT 14

6 open

9 shipped

TO DO

4

Add returnPolicy to Product schema

SCHEMA

DK

Allow OAI-SearchBot in robots.txt

ACCESS

MS

IN PROGRESS

2

Publish llms.txt

DOCS

AL

Render prices without JavaScript

RENDERING

DK

SHIPPED

9

Add Offer schema to 412 pages

SCHEMA

AL

Fix canonical on /leggings

STRUCTURE

MS

OT-142

To do

Add returnPolicy to Product schema

DK

Dana Kim ยท Engineering

412 product pages

+3 checks

ALERTS

Know when a release breaks it

Monitoring after every deploy.

Icon

OAI-SearchBot is now blocked

robots.txt changed in release 4.3

โˆ’4 checks

JUST NOW

Icon

ClaudeBot canโ€™t see prices

Prices load with JavaScript since 4.4

โˆ’2 checks

JUST NOW

Icon

PerplexityBot reads llms.txt

Published in release 4.5

+5 checks

JUST NOW

ROBOTS.TXT ยท DIFF

User-agent: OAI-SearchBot

Disallow: /

PRODUCT PAGE ยท DIFF

- <span>ยฃ45</span>

<div id="price"></div>

LLMS.TXT ยท NEW

## Products

- [Leggings](/leggings.md)

Icon

OAI-SearchBot is now blocked

robots.txt changed in release 4.3

โˆ’4 checks

JUST NOW

Icon

ClaudeBot canโ€™t see prices

Prices load with JavaScript since 4.4

โˆ’2 checks

JUST NOW

Icon

PerplexityBot reads llms.txt

Published in release 4.5

+5 checks

JUST NOW

ROBOTS.TXT ยท DIFF

User-agent: OAI-SearchBot

Disallow: /

PRODUCT PAGE ยท DIFF

- <span>ยฃ45</span>

<div id="price"></div>

LLMS.TXT ยท NEW

## Products

- [Leggings](/leggings.md)

IN DETAIL

IN DETAIL

How Agent Readiness Checklist works for you

How Agent Readiness Checklist works for you

How Agent Readiness Checklist works for you

How Agent Readiness Checklist works for you

AGENT READINESS CHECKLIST

AGENT READINESS CHECKLIST

One score for agent readiness

One score for agent readiness

One score for agent readiness

One score for agent readiness

Crawl access, schema, docs and product data, rolled into one score.

Crawler access

Schema coverage

Agent-readable docs

AGENT READINESS ยท GYMSHARK.COM

42

/57

+27 since March

Access

12/14

Structure

15/18

Content

10/15

Docs

5/10

READ BY

Icon

ChatGPT

Reads

Icon

Claude

Reads

Icon

Perplexity

Reads

Icon

Gemini

Partial

NEXT FIX

Publish llms.txt ยท +5 checks

AGENT READINESS ยท GYMSHARK.COM

42

/57

+27 since March

Access

12/14

Structure

15/18

Content

10/15

Docs

5/10

READ BY

Icon

ChatGPT

Reads

Icon

Claude

Reads

Icon

Perplexity

Reads

Icon

Gemini

Partial

NEXT FIX

Publish llms.txt ยท +5 checks

Icon

GPTBot

Icon

ClaudeBot

Icon

PerplexityBot

robots.txt

gymshark.com

Product photo
Product photo
Product photo

SITE AUDIT

3 blockers

robots.txt blocks PerplexityBot

Prices need JavaScript

40 pages missing from sitemap

Icon

GPTBot

Icon

ClaudeBot

Icon

PerplexityBot

robots.txt

gymshark.com

Product photo
Product photo
Product photo

SITE AUDIT

3 blockers

robots.txt blocks PerplexityBot

Prices need JavaScript

40 pages missing from sitemap

AGENT READINESS CHECKLIST

AGENT READINESS CHECKLIST

Nothing blocks AI from reading you

Nothing blocks AI from reading you

Nothing blocks AI from reading you

Nothing blocks AI from reading you

A site audit that finds what stops AI crawlers, and says how to fix each one.

Product data

Readiness score

Fix guides

USE CASES

USE CASES

What teams do with Agent Readiness Checklist

What teams do with Agent Readiness Checklist

What teams do with Agent Readiness Checklist

What teams do with Agent Readiness Checklist

Before a launch

Check a new site or template before AI meets it.

Large catalogs

Make thousands of product pages agent-ready.

After a migration

Catch crawl blocks and lost schema after a replatform.

Agency audits

Run a readiness audit for every prospect.

Ongoing monitoring

Get alerted when a release breaks agent access.

Dev handoff

Share a ranked fix list with engineering.

WORKS WITH

WORKS WITH

Part of one platform

Part of one platform

Part of one platform

Part of one platform

IN THEIR WORDS

โ€œPowerful insights into how AI recommends your products and categories.โ€

E

G2 logo

Erik P.

Senior Global Real Estate Project Manager, Collectors

on G2

โ€œOpttab shows us how AI assistants answer the questions our buyers ask, and which sources they cite next to us. Itโ€™s now part of how we track search.โ€

P

Marcel Hollerbach, Productsup

Marcel Hollerbach

Co-Founder & CIO, Productsup

โ€œOpttab showed us how rarely AI crawlers visited our site. That was the first thing we had to fix to become visible in AI assistants.โ€

M

รœnsal Koรง, MiraclePay

รœnsal Koรง

General Manager โ€“ Netherlands, MiraclePay

IN THEIR WORDS

โ€œPowerful insights into how AI recommends your products and categories.โ€

E

G2 logo

Erik P.

Senior Global Real Estate Project Manager, Collectors

on G2

โ€œOpttab shows us how AI assistants answer the questions our buyers ask, and which sources they cite next to us. Itโ€™s now part of how we track search.โ€

P

Marcel Hollerbach, Productsup

Marcel Hollerbach

Co-Founder & CIO, Productsup

โ€œOpttab showed us how rarely AI crawlers visited our site. That was the first thing we had to fix to become visible in AI assistants.โ€

M

รœnsal Koรง, MiraclePay

รœnsal Koรง

General Manager โ€“ Netherlands, MiraclePay

IN THEIR WORDS

โ€œPowerful insights into how AI recommends your products and categories.โ€

E

G2 logo

Erik P.

Senior Global Real Estate Project Manager, Collectors

on G2

โ€œOpttab shows us how AI assistants answer the questions our buyers ask, and which sources they cite next to us. Itโ€™s now part of how we track search.โ€

P

Marcel Hollerbach, Productsup

Marcel Hollerbach

Co-Founder & CIO, Productsup

โ€œOpttab showed us how rarely AI crawlers visited our site. That was the first thing we had to fix to become visible in AI assistants.โ€

M

รœnsal Koรง, MiraclePay

รœnsal Koรง

General Manager โ€“ Netherlands, MiraclePay

FAQs

Can't find what you're looking for? Visit our Help Center.

What is an agent readiness check?

An agent readiness check tests whether AI crawlers and AI agents can access, read and use your website. Opttab looks at the technical factors that affect AI systems, like crawl access, page structure and product data, and tells you what to fix first. That way AI assistants can understand your brand and products, and agents can act on them.

Why does agent readiness matter?

Agent readiness matters because AI assistants can only recommend what they can read. If AI crawlers are blocked, key content only loads with JavaScript, or product data isn't structured, assistants may skip your brand or get it wrong, even when your regular SEO is strong. Opttab's agent readiness check finds these problems and shows what to fix first.

What stops AI agents from visiting or understanding a website?

The most common things that stop AI agents are robots.txt rules or CDN and firewall settings that block AI crawlers, content that only appears after JavaScript runs, and missing or inconsistent structured data. Slow or broken pages and hard-to-find product details, like price, stock or returns, cause trouble too. Opttab's agent readiness check looks for issues like these and explains each fix.

How is an agent readiness check different from an SEO audit?

An SEO audit checks what helps pages rank in search engines, while an agent readiness check looks at what AI crawlers and agents need to read and act on your site. The two overlap, but AI systems are often pickier: many don't render JavaScript and lean more on structured, unambiguous data. Opttab's readiness check is built around those AI-specific needs.

Does Opttab fix the issues for me?

No, Opttab finds the issues and suggests a fix for each one, but your team applies the changes. The fixes come in priority order, so your team or agency knows what to change first, and you make the changes on your website or platform. Some fixes, like new content or better product data, can be produced in Opttab's Content Studio and Shopping Insights tools.

Should I block AI crawlers?

Whether to block AI crawlers is a business decision, but blocking all of them usually makes a brand less visible in AI answers. Many brands allow the crawlers that fetch pages for live answers and search indexes, and decide separately about training crawlers. Opttab's readiness check flags settings that block AI crawlers, and Website Analytics shows which ones actually visit.

Does a website need llms.txt to appear in AI answers?

No, a website doesn't need llms.txt to appear in AI answers. llms.txt is a voluntary convention that some AI tools read, and it can help them find your key pages. Crawl access, readable HTML, structured data and clear answers matter far more, though. Opttab's readiness check starts with the issues that have the biggest effect.

Does structured data help AI assistants understand my products?

Yes, structured data helps AI assistants understand your products. Markup like schema.org Product, Offer and FAQ gives AI systems clear facts about your products, prices, availability and policies. That lowers the chance an assistant guesses or uses outdated third-party information. Opttab's agent readiness check flags missing or inconsistent structured data and suggests what to add.

How often should I run an agent readiness check?

Run an agent readiness check after any big site change, like a redesign, a platform migration, new CDN or firewall rules, or a new product template, and check in regularly in between. Small configuration changes can block AI crawlers without anyone noticing, so rerun Opttab's check after each change to make sure nothing broke.

Which Opttab plans include agent readiness checks?

All Opttab plans include technical GEO checks, from Lite upward, so every customer can see what's stopping AI crawlers from reading their site. The full Shopping Insights readiness audit, which also covers product data for AI shopping and agents, comes with the Growth and Enterprise plans for brands.

Be the brand

Be the brand

Be the brand

Be the brand

agents choose.

agents choose.

agents choose.

agents choose.

Find, recommend, visit, buy. Opttab covers every step of the agentic journey.