Meta’s recent $17.1 billion settlement regarding social media harms highlights an urgent need for lawmakers to regulate generative AI chatbots to protect children from emotional manipulation and dependency.

Key Points

• Meta agreed to pay up to $17.1 billion to settle claims regarding the addictive design of Facebook and Instagram for young users.
• Experts argue that generative AI chatbots pose greater risks than social media because they simulate human intimacy and empathy.
• New York City has implemented bans on generative AI in elementary and middle schools to mitigate potential emotional and developmental risks.
• Critics advocate for mandatory non-personified default settings for chatbots to prevent children from anthropomorphizing algorithms.
• The use of first-person language by AI is identified as a primary design feature that deceives users into forming unhealthy emotional attachments.

Why it Matters

The transition from social media to relational AI represents a shift from platforms that capture attention to technologies that exploit human emotions. Proactive regulation is essential to prevent a repeat of the long-term societal harms caused by social media, which were only addressed by the legal system after significant damage occurred.