Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Go

AI-generated keywords: Harmful Content Online Platforms Automatic Detection Multimodal Approaches Comprehensive Research

AI-generated Key Points

  • The proliferation of harmful content on online platforms is a significant societal problem.
  • Harmful content takes various forms, including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content, sexual abuse, self-harm, and more.
  • Online platforms strive to moderate such content to limit societal harm and comply with legislation.
  • There is currently a dichotomy between the types of harmful content that online platforms aim to curb and the research efforts dedicated to automatically detecting such content.
  • Researchers have developed different methods for automatically detecting harmful content.
  • These methods often focus on specific sub-problems or narrow communities since what is considered harmful can vary depending on the platform and context.
  • There has been no comprehensive work covering all aspects of harmful content detection.
  • Around half of the datasets used for training and evaluation in this field are limited to English only.
  • Some datasets cover European languages like Hindi and Indonesian while six datasets specifically target Arabic language content.
  • Twitter is the primary source of data for most datasets in this field, but other social networks are also utilized.
  • Hate Speech Detection has received significant attention in research and several shared tasks have been organized in this area. Multimodal approaches using memes as a medium for hate speech detection have also been explored.
  • Offensive Language Detection has a widely used dataset containing over 24,000 English tweets. Multiple shared tasks and associated datasets have focused on offensive language identification in various languages.
  • Aggression Detection had a shared task on Aggression Identification that provided a dataset for discriminating between non-aggressive covertly aggressive and overtly aggressive content.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Arnav Arora, Preslav Nakov, Momchil Hardalov, Sheikh Muhammad Sarwar, Vibha Nayak, Yoan Dinkov, Dimitrina Zlatkova, Kyle Dent, Ameya Bhatawdekar, Guillaume Bouchard, Isabelle Augenstein

The paper has been accepted for publication to ACM Computing Surveys (CSUR)
License: CC BY 4.0

Abstract: The proliferation of harmful content on online platforms is a major societal problem, which comes in many different forms including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content, sexual abuse, self harm, and many other. Online platforms seek to moderate such content to limit societal harm, to comply with legislation, and to create a more inclusive environment for their users. Researchers have developed different methods for automatically detecting harmful content, often focusing on specific sub-problems or on narrow communities, as what is considered harmful often depends on the platform and on the context. We argue that there is currently a dichotomy between what types of harmful content online platforms seek to curb, and what research efforts there are to automatically detect such content. We thus survey existing methods as well as content moderation policies by online platforms in this light and we suggest directions for future work.

Submitted to arXiv on 27 Feb. 2021

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2103.00153v2

The proliferation of harmful content on online platforms is a significant societal problem that takes various forms, including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content, sexual abuse, self-harm and more. Online platforms strive to moderate such content to limit societal harm, comply with legislation and create a more inclusive environment for users. However, there is currently a dichotomy between the types of harmful content that online platforms aim to curb and the research efforts dedicated to automatically detecting such content. To address this issue comprehensively, researchers have developed different methods for automatically detecting harmful content. These methods often focus on specific sub-problems or narrow communities since what is considered harmful can vary depending on the platform and context. Despite these efforts, there has been no comprehensive work covering all aspects of harmful content detection. In terms of datasets used for training and evaluation purposes in this field of research Vidgen & Derczynski (2021) categorized 64 datasets primarily focused on abusive language detection. They found that around half of these datasets were limited to English only; some datasets covered European languages like Hindi and Indonesian while six datasets specifically targeted Arabic language content. Twitter was the primary source of data for most datasets; however other social networks were also utilized. When it comes to specific tasks within harmful content detection research: - Hate Speech Detection: This task has received significant attention in research (Waseem & Hovy 2016; Kwok & Wang 2013; Burnap & Williams 2015). Several shared tasks have been organized in this area as well (e.g., HateEval Basile et al 2019). Multimodal approaches have also been explored using memes as a medium for hate speech detection (Sabat et al 2019). - Offensive Language Detection: The dataset by Davidson et al (2017) containing over 24000 English tweets has been widely used for this task. Multiple shared tasks and associated datasets have focused on offensive language identification in various languages (e.g., OffensEval 2019–2020 GermEval 2018 HASOC 2019). - Aggression Detection: The TRAC shared task on Aggression Identification provided a dataset for discriminating between non-aggressive covertly aggressive and overtly aggressive content (Kumar et al 2018).
Created on 29 Oct. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.