Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Go
AI-generated Key Points
- The proliferation of harmful content on online platforms is a significant societal problem.
- Harmful content takes various forms, including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content, sexual abuse, self-harm, and more.
- Online platforms strive to moderate such content to limit societal harm and comply with legislation.
- There is currently a dichotomy between the types of harmful content that online platforms aim to curb and the research efforts dedicated to automatically detecting such content.
- Researchers have developed different methods for automatically detecting harmful content.
- These methods often focus on specific sub-problems or narrow communities since what is considered harmful can vary depending on the platform and context.
- There has been no comprehensive work covering all aspects of harmful content detection.
- Around half of the datasets used for training and evaluation in this field are limited to English only.
- Some datasets cover European languages like Hindi and Indonesian while six datasets specifically target Arabic language content.
- Twitter is the primary source of data for most datasets in this field, but other social networks are also utilized.
- Hate Speech Detection has received significant attention in research and several shared tasks have been organized in this area. Multimodal approaches using memes as a medium for hate speech detection have also been explored.
- Offensive Language Detection has a widely used dataset containing over 24,000 English tweets. Multiple shared tasks and associated datasets have focused on offensive language identification in various languages.
- Aggression Detection had a shared task on Aggression Identification that provided a dataset for discriminating between non-aggressive covertly aggressive and overtly aggressive content.
Authors: Arnav Arora, Preslav Nakov, Momchil Hardalov, Sheikh Muhammad Sarwar, Vibha Nayak, Yoan Dinkov, Dimitrina Zlatkova, Kyle Dent, Ameya Bhatawdekar, Guillaume Bouchard, Isabelle Augenstein
Abstract: The proliferation of harmful content on online platforms is a major societal problem, which comes in many different forms including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content, sexual abuse, self harm, and many other. Online platforms seek to moderate such content to limit societal harm, to comply with legislation, and to create a more inclusive environment for their users. Researchers have developed different methods for automatically detecting harmful content, often focusing on specific sub-problems or on narrow communities, as what is considered harmful often depends on the platform and on the context. We argue that there is currently a dichotomy between what types of harmful content online platforms seek to curb, and what research efforts there are to automatically detect such content. We thus survey existing methods as well as content moderation policies by online platforms in this light and we suggest directions for future work.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.