Roblox deployed its controversial AI-powered face-scanning system globally last week, sparking a massive user revolt as the tool frequently misidentifies ages and fails to curb platform predators. While the gaming giant intended the update to facilitate safer, age-appropriate interactions, technical glitches and privacy concerns have instead paralyzed the platform’s social features and created a thriving black market for verified accounts.
Systemic Failures and the Rise of the Black Market
The rollout has already encountered severe security breaches. Investigations revealed multiple listings on eBay offering age-verified Roblox accounts for as little as $4, some belonging to children as young as nine. Although eBay began removing these listings following reports, the ease with which these accounts are traded undermines the system’s primary goal of protecting minors. Roblox Chief Safety Officer Matt Kaufman defended the initiative, stating that “tens of millions” have already used the system, though he acknowledged that perfecting such a massive infrastructure takes time.
AI Inaccuracy: Adults Censored, Children Exposed
The core of the controversy lies in the AI’s inability to accurately estimate age. Users report a spectrum of errors, from a 23-year-old being restricted to teen-only chats to a 10-year-old being categorized as 21+. Social media platforms like TikTok and X are currently flooded with videos demonstrating how easily the AI—provided by third-party firm Persona—can be deceived. Critics have successfully bypassed the check using photos of deceased celebrities or even drawing fake wrinkles and facial hair with markers to gain adult status.
A Social Platform Without Socialization
For many developers, the update has been catastrophic for player engagement. Internal data shared by creators shows that chat activity—the lifeblood of the Roblox experience—has plummeted in some games from an average of 85% to just 36%. Players describe the current environment as “lifeless” and “a ghost town,” as many refuse to submit biometric data or government IDs due to privacy concerns. Despite Roblox’s assurance that personal data is deleted immediately, a significant portion of the community remains distrustful.
Escalating Legal Pressure Over Child Safety
This rollout occurs as Roblox faces intense legal scrutiny. Attorneys general in Louisiana, Texas, and Kentucky have filed lawsuits alleging the platform failed to protect children from predators. Florida’s attorney general has also issued subpoenas to investigate whether the company’s systems inadvertently aid criminal exploitation. While Roblox claims the new verification prevents unauthorized adult-child interactions, experts like extremism researcher Ry Terran warn that misidentified accounts may actually create new, hidden dangers for vulnerable users.
Roblox has pledged to implement periodic rechecks and fraud detection to address these vulnerabilities. However, the company has yet to provide a clear timeline or technical explanation for how it will correct the thousands of accounts currently locked in incorrect age brackets.
