Eliminating Sentiment Bias for Aspect-Level Sentiment Classification with Unsupervised Opinion Extraction
Auteurs : Bo Wang, Tao Shen, Guodong Long, Tianyi Zhou, Yi Chang
Résumé scientifique
Aspect-level sentiment classification (ALSC) aims at identifying the sentiment polarity of a specified aspect in a sentence. ALSC is a practical setting in aspect-based sentiment analysis due to no opinion term labeling needed, but it fails to interpret why a sentiment polarity is derived for the aspect. To address this problem, recent works fine-tune pre-trained Transformer encoders for ALSC to extract an aspect-centric dependency tree that can locate the opinion words. However, the induced opinion words only provide an intuitive cue far below human-level interpretability. Besides, the pre-trained encoder tends to internalize an aspect's intrinsic sentiment, causing sentiment bias and thus affecting model performance. In this paper, we propose a span-based anti-bias aspect representation learning framework. It first eliminates the sentiment bias in the aspect embedding by adversarial learning against aspects' prior sentiment. Then, it aligns the distilled opinion candidates with the aspect by span-based dependency modeling to highlight the interpretable opinion terms. Our method achieves new state-of-the-art performance on five benchmarks, with the capability of unsupervised opinion extraction.
Les articles autour de lui, par date et par proximité
Plus haut, c’est plus proche de cet article ; à gauche, c’est plus ancien. Les traits relient les articles proches entre eux : les groupes de traits sont des sous-thèmes. Sélectionnez un point pour voir pourquoi il est là. Retour au résumé de cet article
Les articles autour de celui-ci
Classés selon la proximité de leur titre et de leur résumé avec ceux de cet article. Sélectionnez-en pour les lire ensemble.
Les articles les plus proches
-
From Overall Sentiment to Aspect-Level Insights: A Pretraining Strategy for Unsupervised Aspect-based Sentiment AnalysisSimone Prete, Giovanni Maria Biancofiore, Fedelucio Narducci et al. · 2025 · User Modeling, Adaptation, and Personalization · cité 1 fois · Pas encore résumé
From Overall Sentiment to Aspect-Level Insights induce des sentiments d’aspects sans annotations fines, tandis que cet article extrait des opinions sans supervision pour la classification par aspect.
Résumé scientifique
Aspect-Based Sentiment Analysis (ABSA) aims to identify sentiments associated with specific aspects within a text. It plays a crucial role in applications such as product reviews and customer feedback analysis, where understanding nuanced opinions is essential. However, progress in ABSA remains constrained by the need for fine-grained labeled data, limiting the applicability of supervised models in real-world scenarios. In this study, we propose an unsupervised transformer-based approach that leverages sentence-level sentiment annotations to induce aspect-level sentiment representations. By supervising attention distributions during pretraining, our model learns to aggregate token-level sent…
-
Aspect-level sentiment classification with fused local and global contextAo Feng, Jia-Zhi Cai, Zhengjie Gao et al. · 2023 · Journal of Big Data · cité 4 fois · Pas encore résumé
Aspect-level sentiment classification with fused local and global context combine les informations locales et globales pour classer les sentiments d’aspects, sans traiter le biais ni extraire les opinions.
Résumé scientifique
Sentiment analysis aims to determine the sentiment orientation of a text piece (sentence or document), but many practical applications require more in-depth analysis, which makes finer-grained sentiment classification the ideal solution. Aspect-level Sentiment Classification (ALSC) is a task that identifies the emotional polarity for aspect terms in a sentence. As the mainstream Transformer framework in sentiment classification, BERT-based models apply self-attention mechanism that extracts global semantic information for a given aspect, while a certain proportion of local information is missing in the process. Although recent ALSC models have achieved good performance, they suffer from robu…
-
Aspect sentiment learning for Aspect-Level Sentiment ClassificationZhong-Quan Jian, Jiajian Li, Meihong Wang et al. · 2025 · Neural Networks · cité 1 fois · Pas encore résumé
AspLearn améliore la classification par aspect avec un apprentissage contrastif entre phrases liées, plutôt que par suppression du biais et extraction d’opinions.
Résumé scientifique
Aspect-Level Sentiment Classification (ALSC) is a fine-grained Sentiment Analysis (SA) task that aims to determine the sentiments of a sentence toward different aspects. Despite their significant success, most existing methods derive aspect sentiment semantics from individual sentences, overlooking the interrelationships among relevant sentences that could provide a more comprehensive understanding of aspect sentiment semantics. To this end, we propose AspLearn, an aspect-learning method to optimize aspect sentiment semantics and generate more robust aspect-specific sentence features for the ALSC task. In a nutshell, AspLearn employs the Aspect-aware Contrastive Learning (AspCL) to mine valu…
-
Aspect Is Not You Need: No-aspect Differential Sentiment Framework for Aspect-based Sentiment AnalysisJia-Hao Cao, Rui Liu, Huai-Liang Peng et al. · 2022 · North American Chapter of the Association for Computational Linguistics · cité 14 fois · Pas encore résumé
Aspect Is Not You Need cite cet article et traite aussi le biais de sentiment lié aux aspects, avec un cadre différentiel sans aspect.
Résumé scientifique
Aspect-based sentiment analysis (ABSA) is a fine-grained sentiment classification task. Most recent efforts adopt pre-trained model to classify the sentences with aspects. However, the aspect sentiment bias from pre-trained model brings some noise to the ABSA task. Besides, traditional methods using cross-entropy loss are hard to find the potential associations between sentiment polarities. In this work, we analyze the ABSA task from a novel cognition perspective: humans can often judge the sentiment of an aspect even if they do not know what the aspect is. Moreover, it is easier to distinguish positive and negative sentiments than others for human beings because positive and negative are tw…
-
Improving span-based Aspect Sentiment Triplet Extraction with part-of-speech filtering and contrastive learningQingling Li, Wu-Shao Wen, Jing-Hui Qin · 2024 · Neural Networks · cité 20 fois · Pas encore résumé
Improving span-based Aspect Sentiment Triplet Extraction filtre des segments candidats par catégories grammaticales pour extraire des triplets, plutôt que des opinions non supervisées pour la classification.
Résumé scientifique
Aspect Sentiment Triple Extraction (ASTE), a subtask of fine-grained sentiment analysis, aims to extract aspect terms, opinion terms, and their corresponding sentiment polarities from sentences. Previous methods often enumerated all possible spans of aspects and opinions as candidate spans that contain many invalid and irrelevant spans. This made the model training and prediction more difficult due to noised spans, leading to poor performance. To address this issue, we first propose a novel span-level approach that explicitly considers prior grammatical knowledge to generate possible candidate spans by part-of-speech filtering. In this way, our approach can make the model easier to be traine…
-
Complementary Learning of Aspect Terms for Aspect-based Sentiment AnalysisHan Qin, Yuanhe Tian, Fei Xia et al. · 2022 · International Conference on Language Resources and Evaluation · cité 3 fois · Pas encore résumé
Complementary Learning of Aspect Terms renforce la classification par aspect en modélisant les termes d’aspect, au lieu de supprimer leur biais de sentiment.
Résumé scientifique
Aspect-based sentiment analysis (ABSA) aims to predict the sentiment polarity towards a given aspect term in a sentence on the fine-grained level, which usually requires a good understanding of contextual information, especially appropriately distinguishing of a given aspect and its contexts, to achieve good performance. However, most existing ABSA models pay limited attention to the modeling of the given aspect terms and thus result in inferior results when a sentence contains multiple aspect terms with contradictory sentiment polarities. In this paper, we propose to improve ABSA by complementary learning of aspect terms, which serves as a supportive auxiliary task to enhance ABSA by explic…
-
Exploiting Position Bias for Robust Aspect Sentiment ClassificationFangjie Ma, Chen Zhang, Da-Wei Song · 2021 · Findings · cité 26 fois · Pas encore résumé
Exploiting Position Bias utilise la proximité des mots pour rendre la classification par aspect plus robuste, tandis que cet article lutte contre le biais intrinsèque des aspects.
Résumé scientifique
Aspect sentiment classification (ASC) aims at determining sentiments expressed towards different aspects in a sentence. While state-of-the-art ASC models have achieved remarkable performance, they are recently shown to suffer from the issue of robustness. Particularly in two common scenarios: when domains of test and training data are different (out-of-domain scenario) or test data is adversarially perturbed (adversarial scenario), ASC models may attend to irrelevant words and neglect opinion expressions that truly describe diverse aspects. To tackle the challenge, in this paper, we hypothesize that position bias (i.e., the words closer to a concerning aspect would carry a higher degree of i…
-
Enhancing Aspect-Based Sentiment Analysis with Supervised Contrastive LearningBin Liang, Wangda Luo, Xiang Li et al. · 2021 · International Conference on Information and Knowledge Management · cité 53 fois · Pas encore résumé
Enhancing Aspect-Based Sentiment Analysis utilise l’apprentissage contrastif supervisé pour distinguer les sentiments associés aux aspects, contrairement à l’apprentissage adversarial anti-biais.
Résumé scientifique
Most existing aspect-based sentiment analysis (ABSA) research efforts are devoted to extracting the aspect-dependent sentiment features from the sentence towards the given aspect. However, it is observed that about 60% of the testing aspects in commonly used public datasets are unknown to the training set. That is, some sentiment features carry the same polarity regardless of the aspects they are associated with (aspect-invariant sentiment), which props up the high accuracy of existing ABSA models when inevitably inferring sentiment polarities for those unknown testing aspects. Therefore, in this paper, we revisit ABSA from a novel perspective by deploying a novel supervised contrastive lear…
Les travaux antérieurs sur lesquels il s’appuie
-
A Joint Training Dual-MRC Framework for Aspect Based Sentiment AnalysisYue Mao, Yi Shen, Chao Yu et al. · 2021 · AAAI Conference on Artificial Intelligence · cité 259 fois · Pas encore résumé
A Joint Training Dual-MRC Framework extrait conjointement aspects, opinions et polarités, tandis que cet article cible la classification par aspect avec extraction non supervisée d’opinions.
Résumé scientifique
Aspect based sentiment analysis (ABSA) involves three fundamental subtasks: aspect term extraction, opinion term extraction, and aspect-level sentiment classification. Early works only focused on solving one of these subtasks individually. Some recent work focused on solving a combination of two subtasks, e.g., extracting aspect terms along with sentiment polarities or extracting the aspect and opinion terms pair-wisely. More recently, the triple extraction task has been proposed, i.e., extracting the (aspect term, opinion term, sentiment polarity) triples from a sentence. However, previous approaches fail to solve all subtasks in a unified end-to-end framework. In this paper, we propose a c…
-
Aspect-Level Sentiment Analysis Via Convolution over Dependency TreeKai Sun, Richong Zhang, Samuel Mensah et al. · 2019 · Conference on Empirical Methods in Natural Language Processing · cité 391 fois · Pas encore résumé
Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree exploite les arbres de dépendance pour relier les mots d’opinion à un aspect, comme le module de dépendance de cet article.
Résumé scientifique
We propose a method based on neural networks to identify the sentiment polarity of opinion words expressed on a specific aspect of a sentence. Although a large majority of works typically focus on leveraging the expressive power of neural networks in handling this task, we explore the possibility of integrating dependency trees with neural networks for representation learning. To this end, we present a convolution over a dependency tree (CDT) model which exploits a Bi-directional Long Short Term Memory (Bi-LSTM) to learn representations for features of a sentence, and further enhance the embeddings with a graph convolutional network (GCN) which operates directly on the dependency tree of the…
-
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTaJunqi Dai, Hang Yan, Tianxiang Sun et al. · 2021 · North American Chapter of the Association for Computational Linguistics · cité 201 fois · Pas encore résumé
Does syntax matter? compare les arbres induits par RoBERTa aux arbres de dépendance pour l’analyse par aspect, question syntaxique pertinente pour l’extraction d’opinions de cet article.
Résumé scientifique
Aspect-based Sentiment Analysis (ABSA), aiming at predicting the polarities for aspects, is a fine-grained task in the field of sentiment analysis. Previous work showed syntactic information, e.g. dependency trees, can effectively improve the ABSA performance. Recently, pre-trained models (PTMs) also have shown their effectiveness on ABSA. Therefore, the question naturally arises whether PTMs contain sufficient syntactic information for ABSA so that we can obtain a good ABSA model only based on PTMs. In this paper, we firstly compare the induced trees from PTMs and the dependency parsing trees on several popular models for the ABSA task, showing that the induced tree from fine-tuned RoBERTa …
-
Open-Domain Targeted Sentiment Analysis via Span-Based Extraction and ClassificationMing-Hao Hu, Yuxing Peng, Zhen Huang et al. · 2019 · Annual Meeting of the Association for Computational Linguistics · cité 234 fois · Pas encore résumé
Open-Domain Targeted Sentiment Analysis extrait des cibles sous forme de segments puis classe leur polarité, comme l’approche par segments de cet article.
Résumé scientifique
Open-domain targeted sentiment analysis aims to detect opinion targets along with their sentiment polarities from a sentence. Prior work typically formulates this task as a sequence tagging problem. However, such formulation suffers from problems such as huge search space and sentiment inconsistency. To address these problems, we propose a span-based extract-then-classify framework, where multiple opinion targets are directly extracted from the sentence under the supervision of target span boundaries, and corresponding polarities are then classified using their span representations. We further investigate three approaches under this framework, namely the pipeline, joint, and collapsed models…
-
Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary SentenceChi Sun, Luyao Huang, Xipeng Qiu · 2019 · North American Chapter of the Association for Computational Linguistics · cité 762 fois · Pas encore résumé
Utilizing BERT for Aspect-Based Sentiment Analysis transforme la tâche en classification de paires de phrases, au lieu d’extraire des opinions par segments.
Résumé scientifique
Aspect-based sentiment analysis (ABSA), which aims to identify fine-grained opinion polarity towards a specific aspect, is a challenging subtask of sentiment analysis (SA). In this paper, we construct an auxiliary sentence from the aspect and convert ABSA to a sentence-pair classification task, such as question answering (QA) and natural language inference (NLI). We fine-tune the pre-trained model from BERT and achieve new state-of-the-art results on SentiHood and SemEval-2014 Task 4 datasets. The source codes are available at https://github.com/HSLCY/ABSA-BERT-pair.
Les articles qui le citent
-
Modeling Aspect Sentiment Coherency via Local Sentiment AggregationHeng Yang, Ke Li · 2021 · Findings · cité 26 fois · Pas encore résumé
Modeling Aspect Sentiment Coherency via Local Sentiment Aggregation cite cet article et modélise la cohérence des polarités entre aspects avec une agrégation locale.
Résumé scientifique
Aspect sentiment coherency is an intriguing yet underexplored topic in the field of aspect-based sentiment classification. This concept reflects the common pattern where adjacent aspects often share similar sentiments. Despite its prevalence, current studies have not fully recognized the potential of modeling aspect sentiment coherency, including its implications in adversarial defense. To model aspect sentiment coherency, we propose a novel local sentiment aggregation (LSA) paradigm based on constructing a differential-weighted sentiment aggregation window. We have rigorously evaluated our model through experiments, and the results affirm the proficiency of LSA in terms of aspect coherency …
-
A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and ChallengesWenxuan Zhang, Xin Li, Yang Deng et al. · 2022 · IEEE Transactions on Knowledge and Data Engineering · cité 485 fois · Pas encore résumé
A Survey on Aspect-Based Sentiment Analysis passe en revue les tâches, méthodes et défis de l’analyse de sentiment au niveau des aspects.
Résumé scientifique
As an important fine-grained sentiment analysis problem, aspect-based sentiment analysis (ABSA), aiming to analyze and understand people's opinions at the aspect level, has been attracting considerable interest in the last decade. To handle ABSA in different scenarios, various tasks are introduced for analyzing different sentiment elements and their relations, including the aspect term, aspect category, opinion term, and sentiment polarity. Unlike early ABSA works focusing on a single sentiment element, many compound ABSA tasks involving multiple elements have been studied in recent years for capturing more complete aspect-level sentiment information. However, a systematic review of various …
-
Exploiting Careful Design of SVM Solution for Aspect-term Sentiment AnalysisHan-Feng Liu, Minping Chen, Zhen-Yao Zheng et al. · 2024 · Conference on Empirical Methods in Natural Language Processing · cité 3 fois · Pas encore résumé
Exploiting Careful Design of SVM Solution for Aspect-term Sentiment Analysis traite la classification de sentiment des termes d’aspect, mais son résumé ne précise pas de méthode comparable.
Résumé scientifique
,
-
Instruct-DeBERTa: A Hybrid Approach for Aspect-based Sentiment Analysis on Textual ReviewsD. Jayakody, A. Malkith, Koshila Isuranda et al. · 2024 · arXiv.org · preprint, non relu par les pairs · cité 14 fois · Pas encore résumé
Instruct-DeBERTa présente une revue de l’évolution des méthodes d’analyse de sentiment par aspect, des lexiques aux modèles Transformer.
Résumé scientifique
Aspect-based Sentiment Analysis (ABSA) is a critical task in Natural Language Processing (NLP) that focuses on extracting sentiments related to specific aspects within a text, offering deep insights into customer opinions. Traditional sentiment analysis methods, while useful for determining overall sentiment, often miss the implicit opinions about particular product or service features. This paper presents a comprehensive review of the evolution of ABSA methodologies, from lexicon-based approaches to machine learning and deep learning techniques. We emphasize the recent advancements in Transformer-based models, particularly Bidirectional Encoder Representations from Transformers (BERT) and i…
-
A Weak Supervision Approach for Few-Shot Aspect Based Sentiment AnalysisRobert Vacareanu, Siddharth Varia, Kishaloy Halder et al. · 2023 · Conference of the European Chapter of the Association for Computational Linguistics · cité 6 fois · Pas encore résumé
A Weak Supervision Approach exploite des données non annotées pour améliorer l’analyse par aspect en faible quantité d’exemples, plutôt que l’extraction d’opinions non supervisée.
Résumé scientifique
We explore how weak supervision on abundant unlabeled data can be leveraged to improve few-shot performance in aspect-based sentiment analysis (ABSA) tasks. We propose a pipeline approach to construct a noisy ABSA dataset, and we use it to adapt a pre-trained sequence-to-sequence model to the ABSA tasks. We test the resulting model on three widely used ABSA datasets, before and after fine-tuning. Our proposed method preserves the full fine-tuning performance while showing significant improvements (15.84 absolute F1) in the few-shot learning scenario for the harder tasks. In zero-shot (i.e., without fine-tuning), our method outperforms the previous state of the art on the aspect extraction se…
Aller plus loin
Comment ces articles sont-ils trouvés ?
Nous comparons le titre et le résumé de cet article avec ceux de tous les articles résumés sur ce site, et avec les articles que Semantic Scholar recommande, ceux qu’il cite et ceux qui le citent (pour un article très cité, ses citations les plus récentes et, depuis OpenAlex, les plus citées). Parmi les travaux antérieurs et les suites, les articles qui s’utilisent en profondeur, une méthode qu’il utilise et les suites très citées remontent un peu. Les niveaux (très proche, proche, apparenté) viennent de la similarité des textes, pas d’un jugement de qualité ; * signale un article sans résumé, comparé par son titre. La phrase sous un article est écrite par une IA à partir des deux résumés : vérifiez-la dans les articles. Un article jugé hors sujet par trois lecteurs quitte la liste.
Mis à jour le 6 novembre 2026.