Skip to content

AI crawler

What is MistralAI-Training?

MistralAI-Training is Mistral's crawler that collects public pages to train its models.

AI trainingFollows robots.txtNo way to verify
Operator
Mistral
Purpose
AI training. Collects pages to train AI models. Blocking it does not remove you from AI answers.
robots.txt token
MistralAI-Training
Sample user agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)User agents change with versions. Match on the token, not the full string.
Follows robots.txt
Yes, according to Mistral.
How to verify
Mistral doesn't publish a way to verify it.
Sources
Mistral documentation
Last reviewed

Allow or block MistralAI-Training

Block MistralAI-Training
User-agent: MistralAI-Training
Disallow: /

Asks MistralAI-Training not to crawl any page. Well-behaved crawlers stop; it does not stop anyone who ignores robots.txt.

Allow MistralAI-Training
User-agent: MistralAI-Training
Allow: /

Lets MistralAI-Training crawl everything. You only need this if a broader rule would otherwise block it.

Should you block it?

Blocking MistralAI-Training asks Mistral not to use new crawls of your pages for training. It doesn't remove you from AI answers, and it doesn't affect MistralAI-Index.

Write a full policy with the AI Crawler Policy Generator

MistralAI-Training can't be verified

Mistral doesn't publish IP ranges, DNS names or signatures for MistralAI-Training. The user agent is the only signal, and anyone can copy it, so treat a request that claims to be MistralAI-Training as unproven.

Questions about MistralAI-Training

Is MistralAI-Training safe to allow?

MistralAI-Training reads public pages; it does not log in or submit forms. Whether to allow it is about how your content is used, not security.

How do I know a request is really MistralAI-Training?

You can't, from the request alone. Mistral doesn't publish IP ranges, DNS names or signatures for it, so the user agent is the only signal, and anyone can copy that.

How often does MistralAI-Training visit?

It depends on your site; Mistral doesn't publish a schedule. Referscope shows the real visits.

Related crawlers

All AI crawlers

Free tools for MistralAI-Training

AI Crawler Policy Generator

Build a robots.txt that blocks AI training and keeps AI search and Google.

Build your robots.txt

AI Bot Verification Tester

Paste an IP and user agent from your logs and see if the bot is real.

Verify a bot

robots.txt Checker

See which AI crawlers your robots.txt allows or blocks.

Check robots.txt

Less guessing. Clearer growth.

Connect your site today and see your first verified AI crawler by tomorrow.

Explore ReferscopeBecome a design partner