Skip to content

Crawler

What is OAI-AdsBot?

OAI-AdsBot is the bot OpenAI uses to check pages submitted as ads in ChatGPT; OpenAI says it is not used for training.

Other botsNot documentedIP list
Operator
OpenAI
Purpose
Other bots. Ads checks, SEO tools and research crawls. Not AI training or AI search.
robots.txt token
OAI-AdsBot
Sample user agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-AdsBot/1.0; +https://openai.com/adsbotUser agents change with versions. Match on the token, not the full string.
Follows robots.txt
Not documented by the operator. OpenAI does not say. It only visits pages submitted as ads.
How to verify
Check the IP against OpenAI's published list.
Sources
OpenAI documentationOpenAI IP list
Last reviewed

Allow or block OAI-AdsBot

Block OAI-AdsBot
User-agent: OAI-AdsBot
Disallow: /

Asks OAI-AdsBot not to crawl any page. Well-behaved crawlers stop; it does not stop anyone who ignores robots.txt.

Allow OAI-AdsBot
User-agent: OAI-AdsBot
Allow: /

Lets OAI-AdsBot crawl everything. You only need this if a broader rule would otherwise block it.

Should you block it?

OAI-AdsBot is not an AI training or AI search crawler. Block it only if you don't want OpenAI's product to read your pages.

Write a full policy with the AI Crawler Policy Generator

How to verify a OAI-AdsBot request

  1. Find the IP address of the request in your server or CDN logs.
  2. Get OpenAI's published list (OpenAI IP list).
  3. Check whether the IP falls inside one of the ranges. If it doesn't, the request is not from OAI-AdsBot, whatever its user agent says.
Test OAI-AdsBot requests

Questions about OAI-AdsBot

Is OAI-AdsBot safe to allow?

OAI-AdsBot reads public pages; it does not log in or submit forms. Whether to allow it depends on whether you want OpenAI's product to use your pages.

How do I know a request is really OAI-AdsBot?

Check the request against what OpenAI publishes: Check the IP against OpenAI's published list. The user agent alone proves nothing.

How often does OAI-AdsBot visit?

It depends on your site; OpenAI doesn't publish a schedule. Referscope shows the real visits.

Related crawlers

All AI crawlers

Free tools for OAI-AdsBot

AI Crawler Policy Generator

Build a robots.txt that blocks AI training and keeps AI search and Google.

Build your robots.txt

AI Bot Verification Tester

Paste an IP and user agent from your logs and see if the bot is real.

Verify a bot

robots.txt Checker

See which AI crawlers your robots.txt allows or blocks.

Check robots.txt

Less guessing. Clearer growth.

Connect your site today and see your first verified AI crawler by tomorrow.

Explore ReferscopeBecome a design partner