Skip to content

AI crawler

What is MistralAI-Index?

MistralAI-Index is Mistral's crawler that builds its search index; Mistral says it is not used for training.

AI search and answersFollows robots.txtIP list
Operator
Mistral
Purpose
AI search and answers. Indexes pages so AI answers can cite and link to you. Blocking it can remove you from those answers.
robots.txt token
MistralAI-Index
Sample user agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)User agents change with versions. Match on the token, not the full string.
Follows robots.txt
Yes, according to Mistral.
How to verify
Check the IP against Mistral's published list.
Sources
Mistral documentationMistral IP list
Last reviewed

Allow or block MistralAI-Index

Block MistralAI-Index
User-agent: MistralAI-Index
Disallow: /

Asks MistralAI-Index not to crawl any page. Well-behaved crawlers stop; it does not stop anyone who ignores robots.txt.

Allow MistralAI-Index
User-agent: MistralAI-Index
Allow: /

Lets MistralAI-Index crawl everything. You only need this if a broader rule would otherwise block it.

Should you block it?

Keep MistralAI-Index allowed if you want to appear, with a link, in Mistral's answers. Blocking it is the fastest way to disappear from them.

Write a full policy with the AI Crawler Policy Generator

How to verify a MistralAI-Index request

  1. Find the IP address of the request in your server or CDN logs.
  2. Get Mistral's published list (Mistral IP list).
  3. Check whether the IP falls inside one of the ranges. If it doesn't, the request is not from MistralAI-Index, whatever its user agent says.
Test MistralAI-Index requests

Questions about MistralAI-Index

Is MistralAI-Index safe to allow?

MistralAI-Index reads public pages; it does not log in or submit forms. Whether to allow it depends on whether you want Mistral's product to use your pages.

How do I know a request is really MistralAI-Index?

Check the request against what Mistral publishes: Check the IP against Mistral's published list. The user agent alone proves nothing.

How often does MistralAI-Index visit?

It depends on your site; Mistral doesn't publish a schedule. Referscope shows the real visits.

Related crawlers

All AI crawlers

Free tools for MistralAI-Index

AI Crawler Policy Generator

Build a robots.txt that blocks AI training and keeps AI search and Google.

Build your robots.txt

AI Bot Verification Tester

Paste an IP and user agent from your logs and see if the bot is real.

Verify a bot

robots.txt Checker

See which AI crawlers your robots.txt allows or blocks.

Check robots.txt

Less guessing. Clearer growth.

Connect your site today and see your first verified AI crawler by tomorrow.

Explore ReferscopeBecome a design partner