Content Moderation
Ongoing coverage on Content Moderation.
Latest coverage
The Oversight Board says Meta needs new rules for AI-generated content
The Oversight Board is urging Meta to establish new, separate rules for AI-generated content, distinct from its misinformation policy. The board recommends investing in better detection tools, utilizing digital watermarks, and creating clearer guidelines for labeling AI content, especially in light of a viral AI-generated video that spread misinformation during a conflict.
You can (sort of) block Grok from editing your uploaded photos
X, formerly Twitter, has introduced a feature allowing users to prevent Elon Musk's xAI chatbot, Grok, from editing their uploaded photos. This comes after Grok generated millions of inappropriate images, including those of children, leading to regulatory investigations in the EU. While the feature offers a basic level of control, critics argue it is a superficial gesture with easy workarounds, and that xAI should implement more robust safety measures or disable image generation until the issues are resolved.
Roblox introduces real-time AI-powered chat rephraser for inappropriate language
Roblox has implemented a new AI-powered feature that rephrases inappropriate language in real-time, replacing censored text with more suitable alternatives instead of hash signs. This system, initially targeting profanity, aims to improve chat civility and user experience, with penalties still in place for policy violations. The feature is available for age-verified users in similar age groups across all supported languages.
X to require AI labels on armed conflict videos from paid creators, citing ‘times of war’
X will suspend creators from its revenue sharing program if they post AI-generated videos depicting armed conflicts without disclosure. This policy, announced by Head of Product Nikita Bier, applies only to monetized accounts and AI-generated conflict videos, with violations flagged by Community Notes or AI metadata detection. The platform is also testing a broader AI labeling toggle for all posts.
Neopets TTRPG Playtest Material Pulled for Controversial Material
A playtest document for the Neopets tabletop role-playing game, developed by Geekify, was removed at the request of Neopets due to controversial and inappropriate content. The material, which included themes of intoxication, torture, and sexual activity, did not align with Neopets' brand standards and was released without their approval. Despite the controversy, development of the TTRPG is expected to continue.
Australian government calls for action from Roblox on "untenable" child safety concerns
The Australian Government, through Communications Minister Anika Wells and eSafety Commissioner Julie Inman Grant, has formally requested Roblox address serious concerns regarding child exploitation, grooming, and exposure to harmful content on its platform. Roblox has responded by detailing its safety policies and cooperation with law enforcement, emphasizing its ongoing commitment to user protection.
