AI summary · arXiv: 2302.12952v1 · cs.CL

Robust language-based mental health assessments in time and space through social media

Siddharth Mangalik, Johannes C. Eichstaedt, Salvatore Giorgi, Jihu Mun, Farhan Ahmed, Gilvir Gill, Adithya V. Ganesan, Shashanka Subrahmanya,
and 3 more authorsNikita Soni, Sean A. P. Clouston, H. Andrew Schwartz
Original paper Submitted to arXiv on 25 Feb. 2023 9 pages, 7 figures, pre-print License: CC BY-SA 4.0

How to read this summary? Illustrated guide

The essentials

  • Study focuses on measuring population mental health in the United States
  • Aims to provide a more fine-grained assessment compared to existing methods
  • Current methods only capture mental health broadly through surveys with limited estimates
  • Researchers propose using large-scale analysis of social media data for higher resolution estimates
  • Validated approach using 1.2 billion Tweets from 2 million geo-located users
  • Specifically focused on estimating mental health changes related to depression and anxiety
  • Moderate to large associations found between language-based mental health assessments from social media data and survey scores from Gallup
  • Language-based assessment method proved cost-effective and scalable for monitoring population mental health at weekly time scales
  • Fine-grained time series data allows for monitoring effects of societal events and policies, as well as enabling quasi-experimental study designs in population health and other disciplines
  • Method can be generalized beyond mental health in the U.S. and applied to a broad range of psychological outcomes
  • Can facilitate community measurement in under-resourced settings where traditional survey measures may not be available but social media data is accessible

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: Social Media Data Mental Health Population Measurement Spatio-Temporal Resolution Validity

Read further

  • Comprehensive Summary
  • Layman's Summary
  • Blog article
  • Original abstract
This study focuses on the measurement of population mental health in the United States and aims to provide a more fine-grained assessment compared to existing methods. Currently, mental health is only broadly captured through surveys that assess "mentally unhealthy days" or "sadness", and these surveys are limited to infrequent state or metropolitan estimates. To address this limitation, the researchers propose using large-scale analysis of social media data to estimate mental health changes at higher resolutions, such as weekly estimates for counties. To validate their approach, the researchers used a sample of 1.2 billion Tweets from 2 million geo-located users. They specifically focused on estimating mental health changes related to depression and anxiety, which are two leading mental health conditions. The findings showed moderate to large associations between language-based mental health assessments derived from social media data and survey scores from Gallup, a well-known research organization. The language-based assessment method proved to be cost-effective and scalable for monitoring population mental health at weekly time scales. This level of spatially fine-grained time series data allows for monitoring the effects of societal events and policies, as well as enabling quasi-experimental study designs in population health and other disciplines. Importantly, this method can be generalized beyond mental health in the U.S. It can be applied to a broad range of psychological outcomes and can facilitate community measurement in under-resourced settings where traditional survey measures may not be available but social media data is accessible. The study also provides additional context regarding the data used in their analysis.

Was this synthesis useful?

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Tools for this paper

Explain it differently 3 free rewrites left today
Save to a collection Group papers in collections to compare them, chat with them and export them. Create a free account Log in

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero
Citation alerts Citation alerts guide

Papers around this one

See them on a map

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Close
    A Psychologically Informed Part-of-Speech Analysis of Depression in Social Media
    Ana-Maria Bucur, Ioana R. Podină, Liviu P. Dinu · 2021 · Computation and Language · AI summary available
    Abstract

    In this work, we provide an extensive part-of-speech analysis of the discourse of social media users with depression. Research in psychology revealed that depressed users tend to be self-focused, more preoccupied with themselves and ruminate more about their lives and emotions. Our work aims to make use of large-scale datasets and computational methods for a quantitative exploration of discourse. We use the publicly available depression dataset from the Early Risk Prediction on the Internet Workshop (eRisk) 2018 and extract part-of-speech features and several indices based on them. Our results reveal statistically significant differences between the depressed and non-depressed individuals co…

  2. Close
    Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health
    Tim Althoff, Kevin Clark, Jure Leskovec · 2016 · Computation and Language · AI summary available
    Abstract

    Mental illness is one of the most pressing public health issues of our time. While counseling and psychotherapy can be effective treatments, our knowledge about how to conduct successful counseling conversations has been limited due to lack of large-scale data with labeled outcomes of the conversations. In this paper, we present a large-scale, quantitative study on the discourse of text-message-based counseling conversations. We develop a set of novel computational discourse analysis methods to measure how various linguistic aspects of conversations are correlated with conversation outcomes. Applying techniques such as sequence-based conversation models, language model comparisons, message c…

  3. Close
    Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnaires
    Thong Nguyen, Andrew Yates, Ayah Zirikly et al. · 2022 · Computation and Language · AI summary available
    Abstract

    Automated methods have been widely used to identify and analyze mental health conditions (e.g., depression) from various sources of information, including social media. Yet, deployment of such models in real-world healthcare applications faces challenges including poor out-of-domain generalization and lack of trust in black box models. In this work, we propose approaches for depression detection that are constrained to different degrees by the presence of symptoms described in PHQ9, a questionnaire used by clinicians in the depression screening process. In dataset-transfer experiments on three social media datasets, we find that grounding the model in PHQ9's symptoms substantially improves i…

  4. Close
    Psy-LLM: Scaling up Global Mental Health Psychological Services with AI-based Large Language Models
    Tin Lai, Yukun Shi, Zicong Du et al. · 2023 · Computation and Language · AI summary available
    Abstract

    The demand for psychological counselling has grown significantly in recent years, particularly with the global outbreak of COVID-19, which has heightened the need for timely and professional mental health support. Online psychological counselling has emerged as the predominant mode of providing services in response to this demand. In this study, we propose the Psy-LLM framework, an AI-based assistive tool leveraging Large Language Models (LLMs) for question-answering in psychological consultation settings to ease the demand for mental health professions. Our framework combines pre-trained LLMs with real-world professional Q\&A from psychologists and extensively crawled psychological articles…

  5. Close
    Language Models Trained on Media Diets Can Predict Public Opinion
    Eric Chu, Jacob Andreas, Stephen Ansolabehere et al. · 2023 · Computation and Language · AI summary available
    Abstract

    Public opinion reflects and shapes societal behavior, but the traditional survey-based tools to measure it are limited. We introduce a novel approach to probe media diet models -- language models adapted to online news, TV broadcast, or radio show content -- that can emulate the opinions of subpopulations that have consumed a set of media. To validate this method, we use as ground truth the opinions expressed in U.S. nationally representative surveys on COVID-19 and consumer confidence. Our studies indicate that this approach is (1) predictive of human judgements found in survey response distributions and robust to phrasing and channels of media exposure, (2) more accurate at modeling people…

  6. Close
    Benefits and Harms of Large Language Models in Digital Mental Health
    Munmun De Choudhury, Sachin R. Pendse, Neha Kumar · 2023 · Computation and Language · AI summary available
    Abstract

    The past decade has been transformative for mental health research and practice. The ability to harness large repositories of data, whether from electronic health records (EHR), mobile devices, or social media, has revealed a potential for valuable insights into patient experiences, promising early, proactive interventions, as well as personalized treatment plans. Recent developments in generative artificial intelligence, particularly large language models (LLMs), show promise in leading digital mental health to uncharted territory. Patients are arriving at doctors' appointments with information sourced from chatbots, state-of-the-art LLMs are being incorporated in medical software and EHR s…

  7. Close
    Exploring COVID-19 Related Stressors Using Topic Modeling
    Yue Tong Leung, Farzad Khalvati · 2022 · Computation and Language · AI summary available
    Abstract

    The COVID-19 pandemic has affected lives of people from different countries for almost two years. The changes on lifestyles due to the pandemic may cause psychosocial stressors for individuals, and have a potential to lead to mental health problems. To provide high quality mental health supports, healthcare organization need to identify the COVID-19 specific stressors, and notice the trends of prevalence of those stressors. This study aims to apply natural language processing (NLP) on social media data to identify the psychosocial stressors during COVID-19 pandemic, and to analyze the trend on prevalence of stressors at different stages of the pandemic. We obtained dataset of 9266 Reddit pos…

  8. Close
    Leveraging Large Language Models for Mental Health Prediction via Online Text Data
    Xuhai Xu, Bingshen Yao, Yuanzhe Dong et al. · 2023 · Computation and Language · AI summary available
    Abstract

    The recent technology boost of large language models (LLMs) has empowered a variety of applications. However, there is very little research on understanding and improving LLMs' capability for the mental health domain. In this work, we present the first comprehensive evaluation of multiple LLMs, including Alpaca, Alpaca-LoRA, and GPT-3.5, on various mental health prediction tasks via online text data. We conduct a wide range of experiments, covering zero-shot prompting, few-shot prompting, and instruction finetuning. The results indicate the promising yet limited performance of LLMs with zero-shot and few-shot prompt designs for mental health tasks. More importantly, our experiments show that…

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

For now only among the papers summarized on this site: search again to add the prior work, the follow-ups and Semantic Scholar’s recommendations.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.