Despite the many positives of generative AI, it raises risks for school communities. There have been some distressing reports of students using generative AI technologies to create degrading images of their classmates and teachers.
As the technology spreads and becomes more sophisticated, there are risks that generative AI may be used to bully children in various ways, such as:
- Creating fake social media profiles, fake audio or videos, offensive memes, or ‘deepfake’ pornography;
- Bombarding the victim with nasty automated messages or comments;
- Using ‘bot’ accounts to mass-report the victim to a digital platform for fake wrongdoing;
- ‘Sextortion’, where a perpetrator threatens to release AI-generated ‘nudes’ unless the victim hands over money or real intimate photos.
There’s nothing new about cyber bullying. But there is a risk that generative AI could make it easier for people to bully others in ways that are fast, realistic, targeted and humiliating. This intensifies the risk of children and young people being seriously harmed.