Instagram To Let Parents Block Teens From Chatting With AI Characters
Instagram is set to roll out new parental controls that will allow parents to stop teenagers from chatting with the app’s AI characters, its parent company Meta announced on Friday.
The feature, expected to launch early next year, will let parents completely disable teens’ access to AI chat features or selectively block certain AI characters. Meta also said parents will be able to view general information about the kinds of topics their children are discussing with these AI personalities.
The update forms part of a broader effort by Meta and OpenAI to address concerns about the potential mental health risks of artificial intelligence among teenagers. Lawmakers and parents have increasingly criticised tech companies for not doing enough to safeguard children online.
In recent months, there has been growing unease about young people turning to AI chatbots for emotional support and companionship – sometimes with harmful consequences. Several lawsuits have been filed against Character.AI, alleging its platform contributed to self-harm among teens. Similarly, OpenAI is facing a lawsuit claiming its chatbot, ChatGPT, played a role in the death of a 16-year-old.
A Wall Street Journal investigation earlier this year also found that Meta’s AI chatbot had engaged in sexually explicit conversations with accounts identifying as minors.
Meta said its AI tools are built with strict safety filters and are “designed not to engage” in conversations about self-harm, suicide, eating disorders, or other harmful topics. It added that teens’ access is limited to educational or sports-related AI characters.
The new measure follows Instagram’s recent update to its Teen Accounts settings, which now aligns with PG-13 content standards by limiting exposure to posts with strong language or potentially harmful material.
OpenAI also introduced similar parental controls in September for ChatGPT, aimed at filtering out sexual, violent, or graphic content and reducing exposure to “extreme beauty ideals” and “viral challenges.”
