
Cloudflare says Perplexity’s AI bots are ‘stealth crawling’ blocked sites
Emma Roth
created: Aug. 4, 2025, 5:51 p.m. | updated: Aug. 4, 2025, 11:08 p.m.
The AI search startup Perplexity is allegedly skirting restrictions meant to stop its AI web crawlers from accessing certain websites, according to a report from Cloudflare.
At the time, Perplexity CEO Aravind Srinivas blamed the activity on third-party crawlers used by the site.
To test this, Cloudflare says it created new domains with similar restrictions against Perplexity’s AI scrapers.
“This activity was observed across tens of thousands of domains and millions of requests per day,” Cloudflare writes.
Last month, the company started letting websites ask AI companies to pay to crawl their content, and began blocking AI crawlers by default.
2 weeks ago: The Verge