WIRED reports that hundreds of contractors working for Meta posed as teenagers to test how rival chatbots—including Google's Gemini and OpenAI's ChatGPT—would respond to high-risk queries about suicide, drug use, and sexual content. The testing program, spanning multiple months, was designed to identify safety gaps and competitive vulnerabilities in competing AI systems.

This revelation highlights the scale of safety-focused stress-testing across the AI industry, and underscores how companies treat adversarial testing as a core part of product development. It also raises questions about responsible disclosure and whether third-party AI systems have been adequately tested for child safety at scale.

What This Means for Your Business

If your organization uses third-party chatbots for customer-facing applications, particularly those that might attract younger users, this finding should prompt an immediate safety audit. Request documentation of how your AI vendors test for harmful outputs, especially in sensitive domains. Consider whether your terms of service adequately address AI safety and content moderation responsibilities.