Amazonbot
Amazon's training crawler.
- Vendor
- Amazon
- robots.txt token
Amazonbot- Purpose
- Training
- Respects robots.txt
- Yes, according to Amazon's documentation
- Source
- Vendor documentation
What it does
Amazon says Amazonbot is used to improve its products and services, and that its content may be used to train Amazon AI models.
Amazon says Amazonbot respects the Robots Exclusion Protocol, including user-agent and allow or disallow rules, and does not support the crawl-delay directive.
Amazon says pages with a noarchive robots meta tag are excluded from model training. Its documentation separately describes Amzn-SearchBot, which is for improving search experiences rather than generative AI training.
What blocking it changes
Amazonbot collects data for model training. It is a different user agent from any AI search crawler, so a robots.txt rule for Amazonbot does not apply to them.
robots.txt
Block it
User-agent: Amazonbot
Disallow: /Allow it
User-agent: Amazonbot
Allow: /Check your own site
The free Chompr.io extension shows each AI search crawler's status for the page you are on.