Checked 10/28/2026 · https://www.citepulse.io/
The technical prerequisites for AI discoverability are met.
AI crawler matrix
For each bot: what your robots.txt allows — and what your server actually returns to the bot's user agent. Rows highlighted in red: robots allows it, but the server blocks it (usually a WAF or bot-protection rule).
| Bot | Operator | robots.txt | Server response |
|---|---|---|---|
| GPTBot | OpenAI | allowed | 200 + content |
| OAI-SearchBot | OpenAI | allowed | 200 + content |
| ChatGPT-User | OpenAI | allowed | 200 + content |
| ClaudeBot | Anthropic | allowed | 200 + content |
| Claude-SearchBot | Anthropic | allowed | 200 + content |
| Claude-User | Anthropic | allowed | 200 + content |
| PerplexityBot | Perplexity | allowed | 200 + content |
| Perplexity-User | Perplexity | allowed | 200 + content |
| Google-Extended | Google (Gemini-Training) | allowed | — |
| Googlebot | Google (KI-Übersichten) | allowed | 200 + content |
| CCBot | Common Crawl (Trainingsdaten vieler LLMs) | allowed | 200 + content |
| Bytespider | ByteDance (Doubao) | allowed (via User-agent: *) | 200 + content |
| Amazonbot | Amazon (Alexa/Rufus) | allowed (via User-agent: *) | 200 + content |
| Applebot-Extended | Apple (Intelligence-Training) | allowed (via User-agent: *) | — |
| Meta-ExternalAgent | Meta (Llama/Meta AI) | allowed (via User-agent: *) | 200 + content |
How is the score calculated?
| No FAQ or HowTo markup | -2 |
| Result | 98 / 100 |
Structure & machine understanding
No FAQ or HowTo markup
Question-and-answer and step-by-step content is harder for AI systems to recognise as directly citable answers without FAQPage or HowTo markup.
This is what you should do: Where the page answers real questions or gives instructions, mark it up as FAQPage or HowTo (no markup without visibly matching content).
OK (11)
- llms.txt present and plausibly structured.
- The main content is in the HTML without JavaScript.
- Structured data (JSON-LD) is present. — Organization, WebSite, SoftwareApplication, WebPage
- The organisation is marked up as JSON-LD.
- Exactly one H1 heading.
- A canonical URL is set.
- The sitemap is reachable.
- The page title has a sensible length.
- An author / authorship signal is present.
- Fast server response time.
- No noindex — the page may be indexed.
Next steps
- No FAQ or HowTo markup. Where the page answers real questions or gives instructions, mark it up as FAQPage or HowTo (no markup without visibly matching content).
Weekly re-scan with an email alert on every change. In preparation — add your address.
Method & limits
Checked 10/28/2026. citeglass fetches citepulse.io and its related files (robots.txt, llms.txt, sitemap.xml) over HTTP — once as a normal browser, once per AI crawler user agent. No JavaScript is executed. Time to first byte: 725 ms.
What this is not: No rank or citation tracking, no statement about whether a model actually names you, and no check of content loaded via JavaScript. A snapshot from the perspective of one server IP.