Content Moderation
Ongoing coverage on Content Moderation.
Latest coverage
Canada federal government concerned about children's safety in Roblox
The Canadian federal government has expressed concerns regarding the use of Roblox and similar platforms by violent extremists and pedophiles to target and recruit children. A Public Safety Canada brief highlighted vulnerabilities due to the platform's user-generated content and social features, noting risks of radicalization and exploitation. Roblox Corp. stated its commitment to safety with multi-layered systems, while also facing ongoing criticism and litigation over child protection measures.
Australian Government Demands to Know What Roblox, Minecraft, Fortnite, and Steam are Doing to Prevent Grooming, Radicalisation
The Australian government has formally requested information from major gaming platforms including Roblox, Minecraft, Fortnite, and Steam regarding their strategies to combat grooming and radicalization. These companies are now required to provide mandatory responses detailing their safety measures.
Epic Games Reveals Staggering 778K Fortnite Moderation Actions in Six Months
Epic Games reported over 778,000 moderation actions on Fortnite in a six-month period, with cyber harassment and hate speech being the most common violations. The company detailed its use of AI and human review for various issues, including suicide-related interventions and predator actions against minors. This transparency highlights the significant challenges and resources required for maintaining online safety in large gaming communities.
Australia wants to know how Valve is combating 'extreme-right communities' on Steam
Australia's eSafety Commissioner has issued a transparency notice to Valve, demanding an explanation of how Steam combats 'extreme-right communities' and related harms. Valve risks significant daily fines if it fails to respond. Similar notices have been served to Roblox, Microsoft for Minecraft, and Epic Games for Fortnite, citing reports of grooming, terrorism, and violent extremism on these platforms.
Roblox is finally cracking down on illicit games as security continues to tighten
Roblox is reportedly increasing its security measures and content moderation to combat illicit games, including those with sexual themes referred to as 'condos.' This comes after the platform reached a $10 million settlement with Nevada over child safety issues and appointed Matt Kaufman as its new Chief Safety Officer. While some players welcome the stricter enforcement, others worry about accidental bans.
Forza Horizon 6 has reportedly pre-sold 500,000 copies on Steam a month before launch | News-in-brief
Forza Horizon 6 has reportedly achieved 500,000 pre-sales on Steam a month before its launch, according to Alinea Analytics, suggesting a potentially stronger debut than its predecessor. Separately, BAFTA has been criticized for pulling a trailer for the indie game The Quiet Things from its awards ceremony due to content warnings, with developer Alyx Jones expressing frustration over the decision and past similar experiences.
Morning Safety Dance
Anthropic's Mythos AI model has raised concerns about its potential to enhance hacking capabilities. Separately, Square Enix has taken action against a Japanese content creator for allegedly harassing staff working on Final Fantasy 14, marking the second such incident in two months.
DOJ refuses to help French authorities in criminal probe of X
The US Department of Justice has refused to assist French authorities in a criminal probe against X, citing concerns that the investigation is an attempt to regulate the social media platform through prosecution. France's investigation into X, which began in July, includes accusations of algorithm manipulation, fraudulent data extraction, and potentially CSAM dissemination and Holocaust denial. X and xAI expressed gratitude for the DOJ's decision, calling the investigation baseless.
The BAFTA Games Awards pulls indie game's trailer at the last minute, citing "the wellbeing of all guests"
The developer of the indie game The Quiet Things, Alyx Jones of Silver Script Games, expressed devastation after her game's trailer was removed from the BAFTA Games Awards showcase at the last minute. BAFTA cited concerns for guest wellbeing due to the game's mature themes, including discussions of trauma and abuse, stating they could not sufficiently warn the audience. Jones highlighted the lost opportunity for visibility and the personal pain of having her story about survival and being silenced be subjected to similar silencing.
Panic says the Playdate Catalog won't accept games made with generative AI
Panic, the company behind the Playdate console, announced that its game catalog will no longer accept titles that use generative AI for art, audio, music, text, or dialogue starting this month. While AI assistance for coding is permitted and will be disclosed, the use of large language models and AI image/audio generators for creative assets is prohibited. Previously approved games using generative AI will remain with a disclosure.
Meta isn't setting its Oversight Board free just yet
Meta's Oversight Board is seeking to expand its role beyond the company, exploring partnerships with AI firms. However, Meta has not yet approved changes to its governing documents that would allow for this. The board, funded by Meta, is also facing internal questions about its future and investment as Meta shifts its content moderation priorities.
Steam’s AI Ouroboros: Bots Now Review AI-Generated Games
The Steam platform is facing a growing issue where AI-generated games are being reviewed by AI bots, creating a meta-feedback loop that undermines the authenticity of user reviews. This trend raises concerns about the erosion of human voices and community connection within gaming culture. Valve may need to implement new tools and policies to detect and combat AI-generated content to maintain user trust in its review system.
Resident Evil Adult Mod Video Takedown
Capcom has issued a takedown for over 1,000 "adult-orientated" mod videos featuring Resident Evil characters. The videos, uploaded by a YouTuber, depicted characters in revealing attire.
Roblox introduces age-based accounts
Roblox is introducing new age-based accounts, including Roblox Kids (5-8), Roblox Select (9-15), and Roblox (16+), to enhance child safety and tailor content access. These accounts will automatically adjust based on user age and will be implemented alongside expanded parental controls and an International Age Rating Coalition (IARC) system. The changes aim to address concerns regarding child grooming, inappropriate content, and platform bans.
Roblox is changing the eligibility to upload games on the platform
Roblox is implementing new eligibility requirements for users who wish to publish games on its platform, aiming to enhance safety and prevent malicious content. These changes include mandatory ID verification, two-factor authentication, and accounts in good standing, with specific criteria varying for games targeted at all ages versus those for players aged 16 and over. The updates are designed to make it harder for bad actors to bypass moderation systems and will be rolled out in early June.
Pragmata Controversy Explained: The Reddit Scandal That Has Fans Talking | Invision Game Community
Capcom's upcoming sci-fi game Pragmata is facing controversy stemming from inappropriate content involving an in-game character on Reddit, leading to subreddit shutdowns and community debate. While the issue is attributed to user behavior and not Capcom's development, it has sparked discussions about character design and online community management.
Roblox introduces mandatory age-gated account tiers
Roblox is implementing mandatory age-gated account tiers globally starting in mid-May, dividing users into Kids (5-8), Select (9-15), and standard (16+) categories. These tiers will restrict access to games based on content maturity labels, with further restrictions for users under 18. Developers will need to pay a monthly fee and verify their identity to label their games appropriately, with AI moderation assisting in enforcement.
Roblox Is Rethinking Accounts After Lawsuits Over Failing To Protect Children
Roblox Corp. is introducing new account categories for children aged 5-15 and adults 16+ to enhance child safety and content appropriateness. These changes, rolling out in June, include age-checks via facial recognition or parental verification and adjusted communication and content access settings based on age groups. The company aims to provide parents with more control over their children's interactions and game access, following lawsuits and criticism regarding child protection on the platform.
Cult horror game Doki Doki Literature Club pulled from Google Play Store for its "depiction of sensitive themes" and content that "violates" its TOS
Doki Doki Literature Club has been removed from the Google Play Store due to its depiction of sensitive themes and violation of terms of service. Developer Team Salvato and publisher Serenity Forge are working to reinstate the game on the platform and explore alternative Android distribution methods. The cult psychological horror visual novel remains available on iOS, Steam, Nintendo Switch, PC, and PlayStation.
Metal Gear Solid movie adaptation finds new directors
Sony's Metal Gear Solid film adaptation has new directors, Zach Lipovsky and Adam B. Stein, replacing Jordan Vogt-Roberts. The project, first announced by Hideo Kojima in 2006, aims to bring the iconic game characters to life. Separately, Google removed the visual novel Doki Doki Literature Club from its Play Store for alleged violations of terms of service regarding sensitive themes.
