scn-01
What does the free scan fetch from my store?
In this order: /robots.txt first, which it obeys; then /products.json; up to three product pages as raw HTML; /sitemap.xml; and /llms.txt. That is the whole list. It never logs in, submits a form, opens checkout or account pages, writes anything or runs JavaScript, so markup a script injects later is not seen. It identifies itself as RankSniperBot; its identity page shows the exact User-Agent.
scn-02
What happens if my robots.txt blocks RankSniperBot?
The scan does not run. RankSniperBot reads robots.txt before anything else; if the catalogue endpoint is disallowed, nothing is fetched and the person who asked is told the store declined. Narrower rules are honoured path by path: disallowing /products/ skips the product-page sample and leaves those checks unscored. Two lines refuse it outright: User-agent: RankSniperBot and Disallow: /. How it matches rules.
scn-03
Which AI crawlers does the scan check?
10, by name: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, anthropic-ai, PerplexityBot, Google-Extended, Applebot-Extended, Bytespider, CCBot. Each is checked against the robots.txt group that applies to it. Googlebot and Bingbot are read too, for the SEO pillar only. Agents outside the list are not checked, including Claude-SearchBot, Claude-User, Perplexity-User; adding one changes scores, so the list moves only with a rubric version. The crawler index covers 33 agents, with who runs each and what a block changes.
scn-04
Why does a blocked crawler cost points, and is the penalty capped?
Each listed AI agent your robots.txt fully disallows subtracts 6 points from the composite and from the GEO pillar, capped at 30. It is a capped penalty, not an exclusion from the score: catalogue quality still counts. Only a root Disallow: / without an overriding Allow: / counts, and a wildcard block applies to every listed agent the file does not name, so User-agent: * with Disallow: / reaches the cap by itself. Control tokens such as Google-Extended count the same as crawlers today.
scn-05
Why is part of my result marked unscored?
Because an input could not be read. If a product page times out, is refused, or is disallowed to RankSniperBot, the checks that depend on it are excluded from that pillar rather than scored as failures, and the pillar normalises over the checks that remain. A missing file is different: a 404 on sitemap.xml or llms.txt is a finding, because absence is what those checks measure. An unreadable robots.txt is treated as no restriction, the standard’s default. Unscored checks, defined.