llms.txt is the new sitemap
Generate llms.txt for any website
Crawl any site, analyze with AI, and produce a standards-compliant llms.txt ready to deploy at your site root.
No account needed · 10 pages free · Results in under 60 seconds
—
Sites crawled
—
Pages analyzed
—
llms.txt generated
How it works
01
Enter your URL
Paste any website URL. We support static sites, SPAs, and everything in between.
02
AI crawls & analyzes
Our 3-tier crawler fetches every page. Claude analyzes content and categorizes it.
03
Download llms.txt
Get a standards-compliant llms.txt file. Deploy it to your site root in seconds.
Simple pricing
Start free. Upgrade when you need more.
Starter
$9/per month
- ✓100 pages per crawl
- ✓20 crawls per day
- ✓10 saved domains
- ✓Weekly auto-refresh
- ✓1-year storage
Pro
$29/per month
- ✓500 pages per crawl
- ✓100 crawls per day
- ✓Unlimited domains
- ✓Daily auto-refresh
- ✓API access
- ✓Webhooks