Check Your Website
We fetch only the public /robots.txt and /llms.txt files. Your site must allow browser requests (CORS) for the check to work.
—/100
AI crawlability score
AI bot access
| AI crawler | Access | Matched rule |
|---|
See which AI crawlers can access your website, inspect your robots.txt rules, and check whether you publish an llms.txt file.
We fetch only the public /robots.txt and /llms.txt files. Your site must allow browser requests (CORS) for the check to work.
| AI crawler | Access | Matched rule |
|---|
Each of the 10 named AI crawlers contributes 10 points when it can access your homepage under the broadest applicable robots.txt rule. Explicitly blocking a crawler costs those points; an absent robots.txt rule is treated as accessible. The result is a transparent 0–100 score—not a guarantee that a crawler will visit or index your content.
llms.txt is an optional plain-text file that gives language models a concise, curated map of your site. It complements, rather than replaces, robots.txt.
Check that the URL is correct and that the site is publicly accessible. Some websites also block automated requests or may be temporarily unavailable.