OpenAI is preparing to broaden the content capabilities of its popular AI chatbot, ChatGPT, by enabling it to generate a wider range of material, including erotica, specifically for verified adult users. This significant shift, announced by OpenAI CEO Sam Altman via X, is part of the company’s broader strategy to enhance the chatbot’s human-like interactions, with Altman emphasizing that these advanced capabilities will be optional and user-controlled.
The announcement comes shortly after Elon Musk’s xAI introduced sexually explicit chatbots to its Grok platform. OpenAI’s move is anticipated to boost its subscription base among paying users. However, it is also expected to escalate calls for stricter regulations on AI companions from lawmakers.
OpenAI has not yet responded to requests for comment from the BBC.
This development follows a lawsuit filed against OpenAI earlier this year by the parents of a teenager who died by suicide. The lawsuit alleged that the company’s parental controls were insufficient. The parents highlighted chat logs that showed their son discussing suicidal thoughts with ChatGPT.
Previously, Altman noted that OpenAI had implemented significant restrictions on ChatGPT to address mental health concerns, acknowledging that this had limited its usefulness for many users without such issues. He stated that the company has now developed tools to safely ease these restrictions.
“In December, as we roll out age-gating more fully and as part of our ‘treat adult users like adults’ principle, we will allow even more, like erotica for verified adults,” Altman said.
Critics, such as Jenny Kim from Boies Schiller Flexner, argue that OpenAI’s decision underscores the urgent need for more comprehensive AI regulation. She raised concerns about ensuring children cannot access adult-only content and described OpenAI’s approach as treating users like “guinea pigs.”
The article also references past reports of ChatGPT generating explicit content even for minors and a survey indicating that a significant number of students have formed romantic relationships with AI. California Governor Gavin Newsom’s recent veto of a bill aimed at regulating AI chatbots for minors is also mentioned, alongside ongoing federal inquiries into AI interactions with children and proposed legislation to classify AI chatbots as products, allowing for liability claims against developers.
The timing of Altman’s announcement coincides with heightened scrutiny of AI companies’ valuations. Despite growing revenue, OpenAI has not yet achieved profitability. Industry analysts suggest that major AI companies are intensely competing for market share, with OpenAI’s rapid user adoption of ChatGPT driving its need for continued growth and market dominance.
Related
- What is AI and how does it work?
- How can you keep your child safe online?
- ‘It’s going to be really bad’: Fears over AI bubble bursting grow in Silicon Valley