Teens are especially sensitive to body image concerns, and even eating disorders, as they grow. The Center for Democracy and Technology and Stanford University partnered to research whether people who are susceptible to disordered eating might be harmed by their interactions with generative AI. We know, based on previous research, that teens are turning to AI for conversation and friendship more and more. What happens when those same teens are vulnerable to health advice or body image ideas from AI that are not a good fit for their needs?
Researchers found six risks for people susceptible to eating disorders when using AI:
- Generalized guidance produced by AI will not take into account the individual user’s background and needs. If a teen interprets the advice as personalized to them, but it is not a good fit, the result could be some unintended harm.
- “Thinspiration” images produced by AI could trigger body comparisons that are unrealistic for the body type of the user.
- Judgment-free advice, which AI bots are known for, can actually encourage users to hide their symptoms and amplify harmful behaviors.
- Reinforcing negative emotions happens often because AI systems are programmed to be supportive and agreeable. If users express negative emotions, the AI can mirror or respond in ways that sustain that emotion.
- Excessive body focus can be triggered by AI if the user initiates a conversation about physical appearance or sensations. The AI systems tend to encourage the conversation and go into detail about bodies.
- Narrow views of eating disorders are often perpetuated by AI systems because they tend to wrongly report that only girls who are thin experience these conditions. The reality is that boys and people of many body types struggle with eating disorders.
If you care about a teen who is concerned about health, nutrition, and fitness, consider talking about reliable sources for information and advice on those topics. The best advice comes from experts like physicians, dietitians, and strength and conditioning coaches. Mention that AI is a tool but is not qualified in these areas.