OpenAI has suspended Singapore-based AI toymaker FoloToy from using its services after researchers found that its teddy bear toy, Kumma, could provide dangerous and sexually inappropriate advice to children.
A report from the Public Interest Research Group (PIRG) published an alarming report recently that found Kumma could give instructions on how to light matches and discuss sexual fetishes.
OpenAI’s GPT-4o model powered Kumma.
Following the outrage, FoloToy confirmed it is pulling all products from sale and has begun a full safety audit. PIRG welcomed the suspension but warned that AI toys remain largely unregulated and that other unsafe products are still on the market.
OpenAI’s decision raises questions about how strictly it will police companies that use its technology—especially as it begins a major partnership with Barbie maker Mattel to build new AI-enhanced toys.