Skip to content

AI crawler

What is MistralAI-User?

MistralAI-User is the agent Mistral uses when a user asks its assistant to read a page; Mistral says it is not used for training.

User-triggered fetchFollows robots.txtIP list
Operator
Mistral
Purpose
User-triggered fetch. Fetches a page when a person asks an assistant about it.
robots.txt token
MistralAI-User
Sample user agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0; +https://docs.mistral.ai/robots)User agents change with versions. Match on the token, not the full string.
Follows robots.txt
Yes, according to Mistral. Mistral says the token governs which sites these user requests can be made to.
How to verify
Check the IP against Mistral's published list.
Last reviewed

Allow or block MistralAI-User

Block MistralAI-User
User-agent: MistralAI-User
Disallow: /

Asks MistralAI-User not to crawl any page. Well-behaved crawlers stop; it does not stop anyone who ignores robots.txt.

Allow MistralAI-User
User-agent: MistralAI-User
Allow: /

Lets MistralAI-User crawl everything. You only need this if a broader rule would otherwise block it.

Should you block it?

MistralAI-User only visits when a person asks Mistral's assistant about your page. Blocking it means the assistant can't read the page that person asked about.

Write a full policy with the AI Crawler Policy Generator

How to verify a MistralAI-User request

  1. Find the IP address of the request in your server or CDN logs.
  2. Get Mistral's published list (Mistral IP list).
  3. Check whether the IP falls inside one of the ranges. If it doesn't, the request is not from MistralAI-User, whatever its user agent says.

Questions about MistralAI-User

Is MistralAI-User safe to allow?

MistralAI-User reads public pages; it does not log in or submit forms. Whether to allow it depends on whether you want Mistral's product to use your pages.

How do I know a request is really MistralAI-User?

Check the request against what Mistral publishes: Check the IP against Mistral's published list. The user agent alone proves nothing.

How often does MistralAI-User visit?

It depends on your site; Mistral doesn't publish a schedule. Referscope shows the real visits.

Less guessing. Clearer growth.

Connect your site today and see your first verified AI crawler by tomorrow.