Instagram actively helping spread of self-harm among teenagers, study finds
Source: The Guardian
Sat 30 Nov 2024 11.00 EST
Last modified on Sat 30 Nov 2024 13.28 EST
Meta is actively helping self-harm content to flourish on Instagram by failing to remove explicit images and encouraging those engaging with such content to befriend one another, according to a damning new study that found its moderation extremely inadequate.
Danish researchers created a private self-harm network on the social media platform, including fake profiles of people as young as 13 years old, in which they shared 85 pieces of self-harm-related content gradually increasing in severity, including blood, razor blades and encouragement of self-harm.
The aim of the study was to test Metas claim that it had significantly improved its processes for removing harmful content, which it says now uses artificial intelligence (AI). The tech company claims to remove about 99% of harmful content before it is reported. But Digitalt Ansvar (Digital Accountability), an organisation that promotes responsible digital development, found that in the month-long experiment not a single image was removed.
When it created its own simple AI tool to analyse the content, it was able to automatically identify 38% of the self-harm images and 88% of the most severe. This, the company said, showed that Instagram had access to technology able to address the issue but has chosen not to implement it effectively. The platforms inadequate moderation, said Digitalt Ansvar, suggested that it was not complying with EU law. The Digital Services Act requires large digital services to identify systemic risks, including foreseeable negative consequences on physical and mental wellbeing.
Read more: https://www.theguardian.com/technology/2024/nov/30/instagram-actively-helping-to-spread-of-self-harm-among-teenagers-study-suggests