Home › Knowledge base › AI crawlers in detail

Applebot-Extended

Like Google-Extended, Applebot-Extended is a robots.txt token, not a separate crawler: it only controls training use by Apple.

Applebot and Applebot-Extended

The regular Applebot powers Siri, Spotlight and Safari suggestions — you need it for visibility in Apple's search. Applebot-Extended concerns solely the training of generative Apple models.

Excluding training only

"User-agent: Applebot-Extended" followed by "Disallow: /" removes you from Apple Intelligence training while Applebot may keep indexing.

Default behaviour

Without a rule, Apple assumes permission for training use. If you don't want that, you have to set the Disallow rule actively.

Checking the rule

citeglass shows the applicable robots.txt rule for each bot — Applebot and Applebot-Extended — and whether it applies bot-specifically or via the wildcard.

Check your own site

citeglass shows in about 30 seconds where your website is unreadable for AI systems — free and without login.

Read on

• Google-Extended and Googlebot
• Amazonbot
• Block training, allow search

General information, not legal advice. GEO is a young field — recommendations may change.