Platform Incentives Fuel Surge of AI War Fakes on Social Media

A recent investigation reveals that X, the platform formerly known as Twitter, is being inundated with fabricated images and videos of a non-existent U.S.-Iran war. These synthetic posts, generating tens of millions of views, highlight a systemic failure to manage AI-driven misinformation.

The timing capitalizes on real-world tensions, but the mechanism is financial. X’s revenue-sharing program, which pays creators based on engagement, provides a direct monetary incentive for spreading sensational, AI-generated content. Accounts specializing in this synthetic media are reportedly earning from the platform while posting dramatic, entirely fictional war scenes.

Corrective measures are failing to match the speed of disinformation. While X’s Community Notes feature has flagged some false posts, these corrections often appear days after the content has gone viral. The platform's reduced trust and safety teams, cut after Elon Musk’s acquisition, struggle with the volume and velocity.

Enforcement remains inconsistent. Despite rules against harmful synthetic media, accounts identified by researchers often stay active, their content still earning revenue. The problem is compounded by advancing AI tools from Midjourney and others, which now produce imagery casual viewers struggle to distinguish from photographs.

Industry professionals note serious brand safety risks, exacerbating an existing advertiser retreat from the platform. The situation presents a stark test: social media business models that reward virality are colliding with AI technology that makes fakery cheap and convincing. Without significant changes to platform incentives and moderation capacity, this cycle shows no sign of stopping.

Source: Webpronews