Module 4Claude
AI readiness
Can answer engines read, trust and quote these pages? Rule checks are free; the fact-extraction test uses Claude Haiku on sample pages.
PerplexityBot blocked in robots.txt
Retrieval bots fetch pages to answer live questions. Blocking them removes the site from those answers. Training bots are a separate choice.
| Template | JSON-LD | Fresh dateModified | Verdict sentence | Facts up front | Title matches intent | Facts extracted |
|---|---|---|---|---|---|---|
| /buildings/{slug} | missing | ✕ | ✕ | ✕ | ✕ | 20% |
| /neighborhoods/{slug} | valid | ✓ | ✓ | ✓ | ✓ | 75% |
| /landlords/{slug} | issues | ✕ | ✕ | ✓ | ✕ | 50% |
| /near/{station}-station | valid | ✓ | ✕ | ✓ | ✓ | 75% |
| /blog/{slug} | valid | ✓ | ✓ | ✓ | ✓ | 100% |
AI crawler policy (robots.txt)
- OAI-SearchBotallowed · retrieval
- ChatGPT-Userallowed · retrieval
- PerplexityBotblocked · retrieval
- Claude-Userallowed · retrieval
- GPTBotblocked · training
- ClaudeBotallowed · training
- CCBotblocked · training
- Google-Extendedallowed · training
llms.txt
No /llms.txt at nestlist.example
A short markdown file that tells AI assistants what the site is and which pages matter. A generated one is ready in Fixes.