Site access

Can AI crawlers read my store?

Check your public robots.txt and site security settings to make sure AI crawlers can access the pages you want shoppers to find.

Last reviewed July 2026

What should I check?

Review your robots.txt file and firewall or CDN rules.

Test public pages after changing settings and make sure they contain useful, accurate information.

Frequently asked questions

Does access guarantee inclusion?

No. Crawl access is only a prerequisite; AI answers change and no provider controls them.

Get your first 5 Unclaimed Questions

Get five buyer questions where your brand still has a real chance to become part of the answer, each with a clear brief for what to publish next. No credit card. Delivered within 24 hours.

Get your first 5 — free