Neil Vogel, CEO of PeopleInco, has voiced concerns that publishers can effectively block most AI crawlers but are unable to restrict Google’s crawler due to its dual role in search and AI, which he describes as “an incredible abuse of market power.” This issue stems from the integration of search indexing and AI training on major platforms, making it difficult for content owners to selectively block crawlers while attempting to protect their content. To combat unauthorized data scraping, publishers are increasingly collaborating with services like Cloudflare to enhance their defenses.
Neil Vogel: Neil Vogel is the CEO of People Inc., the parent entity for a wide array of major consumer media brands. In the reported comments, he articulates the practical barriers publishers encounter when attempting to restrict AI crawlers while preserving essential search functionality.
PeopleIncco: People Inc. is America’s largest digital and print publisher, operating more than 40 iconic brands such as PEOPLE, Travel + Leisure, Better Homes & Gardens, Verywell, and Southern Living. The company has recently rebranded from its prior Dotdash Meredith identity under IAC leadership and continues to focus on premium content across print and digital platforms. Its CEO’s public remarks directly address the challenges its publishing operations face with AI data access.
AI Crawler Controls: Publishers are actively partnering with services such as Cloudflare to restrict unauthorized AI data scraping from their sites.
Traffic Diversification: Leading publishers have been shifting focus toward direct audience relationships and alternative revenue streams to lessen reliance on external referral traffic.
Search Integration Issues: Major platforms continue to use the same infrastructure for both core search indexing and AI training, creating unavoidable conflicts for content owners seeking selective blocking.
