# Thoughts on child safety on commodity platforms

**Authors:** Ian Levy, Crispin Robinson  
**arXiv:** [2207.09506](https://arxiv.org/abs/2207.09506)  
**Date:** 2022-07-19  
**Summary page:** https://www.summarizepaper.com/en/paper/2207.09506v1/

## Key points

- The explosion of global social media and online communication platforms has revolutionized interactions with society.
- Challenges in security and privacy have emerged due to the misuse of these platforms for harm on a large scale.
- Alarming rise in child sexual abuse facilitated by online platforms is a major concern, leading to new forms of exploitation.
- Platforms are investing in combating child sexual abuse by identifying and reporting illegal content to authorities.
- Introduction of end-to-end encryption complicates efforts to combat child sexual abuse, sparking debate over balancing protection with user privacy.
- A new framework of 'harm archetypes' has been proposed to categorize different types of harms based on technical characteristics for better understanding and addressing the issue.
- Various techniques are being explored as potential solutions to effectively combat online child sexual abuse while safeguarding user privacy and enabling law enforcement action when necessary.

## Summary

The explosion of global social media and online communication platforms has revolutionized the way we interact with each other and society as a whole. However, it has also presented new challenges in terms of security and privacy. While these platforms offer immense benefits, they can also be misused to perpetrate harm on a large scale. One of the most concerning issues is the alarming rise in child sexual abuse facilitated by these platforms. This not only amplifies existing abuse but also gives rise to new forms of online-only exploitation with equally devastating consequences for victims. In response to this growing threat, many platforms have made significant investments in combating child sexual abuse by actively identifying and reporting illegal content to law enforcement authorities. However, the introduction of end-to-end encryption and similar technologies has complicated these efforts by undermining existing mitigation strategies. This has sparked a contentious debate over balancing the imperative of protecting children from harm with safeguarding user privacy and security more broadly. While much of the discourse has focused on detecting offenders sharing known abuse imagery through client-side scanning techniques, it is evident that the issue of online child sexual abuse is far more nuanced and multifaceted than previously acknowledged. To provide greater clarity on this complex problem, a new framework of 'harm archetypes' has been proposed to categorize different types of harms based on their technical characteristics. By delineating these categories more clearly, stakeholders can better understand the processes currently employed by platforms and law enforcement agencies in addressing child sexual abuse content and its real-world impacts. Looking ahead, various techniques are being explored at a high level as potential solutions to combat online child sexual abuse effectively. These approaches aim to strike a delicate balance between ensuring user privacy and security while simultaneously safeguarding child safety and enabling swift law enforcement action when necessary. Through a hypothetical service example, it becomes apparent how integrating multiple techniques can create a comprehensive strategy that addresses the complexities of online child sexual abuse while upholding fundamental values of privacy, security, and protection for vulnerable individuals.