Children & wellbeing
Should AI companions remind you they are not human?
Companion interfaces can offer comfort and accessibility. Their design can also encourage unrealistic expectations.
Loading page…
Young people need privacy and support. Caregivers also need ways to respond to serious risk. Age and context matter.
Privacy and support can both matter to a young person’s safety. UNICEF’s guidance treats children’s rights, development and participation together. An automatic transcript-sharing rule may have different consequences depending on family circumstances and what information is disclosed.
A teenager uses an assistant for ordinary schoolwork and a private personal question. Compare sharing all chats with offering clearly explained, limited escalation for a defined concern. Consider the young person’s understanding of the rule before they use the service.
Privacy can make it easier to ask sensitive questions and seek support.
Caregivers may need a clear way to respond when a young person faces immediate danger.
Background reading for the tradeoff. Scenarios and discussion questions are editorial examples.
Connects safety, privacy, inclusion, development and children’s participation in AI design.
Details activity, connected apps, retention and human review for Gemini Apps; other deployments can differ.
Sources reviewed 13 September 2026. Product documentation can change. How we use evidence
Companion interfaces can offer comfort and accessibility. Their design can also encourage unrealistic expectations.
This question concerns product expectations, not medical advice. Think about the boundary between information and decisions.
People want different things from AI. Some value firm safeguards; others want more room to choose. Where should that choice sit?