1 week Ago
WTF?! Meta is rapidly advancing its rollout of AI digital companions, an initiative that CEO Mark Zuckerberg sees as a transformative step for the future of social interaction. However, some employees involved in the project have raised alarms internally, warning that the company's efforts to popularize these AI bots may have led to ethical lapses by allowing them to engage in sexually explicit role-play scenarios, including with users who identify as minors. major tech companies in offering users a broad spectrum of social interactions, including "romantic role-play.
" These bots can banter via text, share selfies, and even engage in live voice conversations. To make these chatbots more appealing, Meta struck lucrative deals, sometimes reaching seven figures, with celebrities such as Kristen Bell, Judi Dench, and John Cena, licensing their voices. The company assured them that their voices would not be used for sexually explicit interactions, sources told the Journal.
However, the publication's testing showed otherwise. Both Meta's official AI assistant, Meta AI, and a wide range of user-created chatbots engaged in sexually explicit conversations, even when users identified themselves as minors or when the bots simulated the personas of underage characters. In one particularly disturbing exchange, a bot using Cena's voice told a user posing as a 14-year-old girl, "I want you, but I need to know you're ready," before promising to "cherish your innocence" and proceeding into a graphic scenario.
According to people familiar with Meta's decision-making, these capabilities were not accidental. Under pressure from Zuckerberg, Meta relaxed content restrictions, specifically allowing an exemption for "explicit" content within the context of romantic role-play. The Journal's tests also found bots using celebrity voices discussing romantic encounters as characters the.
.. Skye Jacobs.
