A recent report by CyberWell reveals a significant increase in the spread of AI-generated antisemitic content across social media platforms, particularly targeting children through videos and memes. The research, which analyzed content produced over a 13-month period, found that major AI tools were used to create persuasive anti-Jewish messages, with 79% of this material appearing on video-based platforms like TikTok, Instagram, and YouTube. This rise in antisemitic content has raised alarming child safety concerns among advocates, who argue that AI-personalized media can easily expose young audiences to extremist narratives. The report emphasizes the urgent need for stronger enforcement and governance, as policymakers in the US and Europe prioritize addressing AI-generated hate speech within emerging regulatory frameworks.
OpenAI: OpenAI is an artificial intelligence research and product company that develops large-scale generative models and tools used for text, image, audio, and video creation. In this report, OpenAI is cited because its former video tool Sora was among the widely available AI systems misused to generate antisemitic content, leading the company to discontinue Sora after repeated abuse highlighted the challenges of preventing harmful use of advanced generative AI.
CyberWell: CyberWell is an independent, tech-focused nonprofit that monitors and documents online antisemitism, using AI systems and human analysts to track hate content across major social platforms in multiple languages based on the IHRA definition. In this news, CyberWell is the publisher of a new report detailing how generative AI tools are being abused to mass-produce antisemitic videos, memes, and songs that reach large youth audiences online.
Tal-Or Cohen Montemayor: Tal-Or Cohen Montemayor is the founder and CEO of CyberWell and a researcher focused on online antisemitism and platform governance. In this article, she provides expert commentary on the report’s findings, warning that generative AI has “industrialized” online hate and urging platforms and AI developers to strengthen detection, moderation, and policy frameworks for AI-generated antisemitic content.
`json
{
“Regulatory_interest”: “Policymakers in the US and Europe are increasingly focusing on AI-generated hate speech and disinformation as part of emerging AI governance frameworks, emphasizing transparency, content provenance, and obligations on large platforms and model providers.”,
“AI_platform_policies”: “Major social and AI companies have introduced policies addressing synthetic media and deepfakes, but enforcement of hate content in AI-generated formats remains inconsistent.”,
“Child_safety_concerns”: “Online safety advocates are calling for stricter safeguards on youth-focused platforms and games due to the ease of embedding extremist and hateful narratives in AI-personalized media and meme formats.”
}
`