Skip to content

AI crawler

What is Perplexity-User?

Perplexity-User is the agent Perplexity uses when a user asks it to read a page.

User-triggered fetchIgnores robots.txtIP list
Operator
Perplexity
Purpose
User-triggered fetch. Fetches a page when a person asks an assistant about it.
robots.txt token
Perplexity-User
Sample user agent
Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)User agents change with versions. Match on the token, not the full string.
Follows robots.txt
No. Perplexity says it generally ignores robots.txt rules, because a person asked for the page.
How to verify
Check the IP against Perplexity's published list.
Sources
Perplexity documentationPerplexity IP list
Last reviewed

Allow or block Perplexity-User

Block Perplexity-User
User-agent: Perplexity-User
Disallow: /

Asks Perplexity-User not to crawl any page. Well-behaved crawlers stop; it does not stop anyone who ignores robots.txt.

Allow Perplexity-User
User-agent: Perplexity-User
Allow: /

Lets Perplexity-User crawl everything. You only need this if a broader rule would otherwise block it.

Should you block it?

Perplexity-User only visits when a person asks Perplexity's assistant about your page. Blocking it means the assistant can't read the page that person asked about.

Write a full policy with the AI Crawler Policy Generator

How to verify a Perplexity-User request

  1. Find the IP address of the request in your server or CDN logs.
  2. Get Perplexity's published list (Perplexity IP list).
  3. Check whether the IP falls inside one of the ranges. If it doesn't, the request is not from Perplexity-User, whatever its user agent says.
Test Perplexity-User requests

Questions about Perplexity-User

Is Perplexity-User safe to allow?

Perplexity-User reads public pages; it does not log in or submit forms. Whether to allow it depends on whether you want Perplexity's product to use your pages.

How do I know a request is really Perplexity-User?

Check the request against what Perplexity publishes: Check the IP against Perplexity's published list. The user agent alone proves nothing.

How often does Perplexity-User visit?

It depends on your site; Perplexity doesn't publish a schedule. Referscope shows the real visits.

Related crawlers

All AI crawlers

Free tools for Perplexity-User

AI Crawler Policy Generator

Build a robots.txt that blocks AI training and keeps AI search and Google.

Build your robots.txt

AI Bot Verification Tester

Paste an IP and user agent from your logs and see if the bot is real.

Verify a bot

robots.txt Checker

See which AI crawlers your robots.txt allows or blocks.

Check robots.txt

Less guessing. Clearer growth.

Connect your site today and see your first verified AI crawler by tomorrow.

Explore ReferscopeBecome a design partner