Deep Learning for Text Style Transfer: A Survey

AI-generated keywords: Text style transfer deep neural models systematic survey parallel and non-parallel data future research agenda

AI-generated Key Points

  • Text style transfer is a crucial task in natural language generation focusing on controlling specific attributes like formality, politeness, gender, humor, and more.
  • The survey covers various aspects of neural text style transfer including task formulation, datasets, subtasks, evaluation methods, and methodologies for both parallel and non-parallel data.
  • Different tasks within text style transfer are discussed such as formality, politeness, gender, humor, romance, biasedness, toxicity, authorship, sentiment analysis,
  • topic manipulation,
  • and political slant adjustment.
  • Key properties explored include parallel vs. non-parallel data usage,
  • uni-directional vs. bi-directional approaches,
  • dataset sizes and word overlap considerations.
  • Techniques for handling parallel data like multi-tasking and data augmentation are discussed along with disentanglement and pseudo data construction for non-parallel data scenarios.
  • Extended applications of text style transfer include aiding other NLP tasks like paraphrasing and summarization.
  • The paper aims to provide standardizations on terminology definitions,
  • benchmark datasets selection criteria
  • and evaluation metrics to streamline future research efforts in text style transfer.
  • Existing approaches are categorized based on parallel and non-parallel data sources while proposing unified methodological frameworks for each category.
  • A research agenda is outlined for the future development of text style transfer encompassing expanding styles scope improving methodologies dataset assumptions loosening constraints and enhancing evaluation metrics.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Di Jin, Zhijing Jin, Zhiting Hu, Olga Vechtomova, Rada Mihalcea

Computational Linguistics Journal 2022
License: CC BY-NC-SA 4.0

Abstract: Text style transfer is an important task in natural language generation, which aims to control certain attributes in the generated text, such as politeness, emotion, humor, and many others. It has a long history in the field of natural language processing, and recently has re-gained significant attention thanks to the promising performance brought by deep neural models. In this paper, we present a systematic survey of the research on neural text style transfer, spanning over 100 representative articles since the first neural text style transfer work in 2017. We discuss the task formulation, existing datasets and subtasks, evaluation, as well as the rich methodologies in the presence of parallel and non-parallel data. We also provide discussions on a variety of important topics regarding the future development of this task. Our curated paper list is at https://github.com/zhijing-jin/Text_Style_Transfer_Survey

Submitted to arXiv on 01 Nov. 2020

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2011.00416v5

Text style transfer is a crucial task in natural language generation that focuses on controlling specific attributes in generated text such as formality, politeness, gender, humor, and more. With the resurgence of interest in deep neural models, text style transfer has gained significant attention in the field of natural language processing. This paper presents a systematic survey of over 100 representative articles on neural text style transfer since its inception in 2017. The survey covers various aspects such as task formulation, datasets, subtasks, evaluation methods, and methodologies for both parallel and non-parallel data. The survey delves into different tasks within text style transfer including formality, politeness, gender, humor, romance, biasedness, toxicity, authorship, sentiment analysis, topic manipulation, and political slant adjustment. It also discusses key properties like parallel vs. non-parallel data usage, uni-directional vs. bi-directional approaches, dataset sizes and word overlap considerations. The methodology section explores techniques for handling parallel data such as multi-tasking and data augmentation while also discussing disentanglement and pseudo data construction for non-parallel data scenarios. Additionally, extended applications of text style transfer are highlighted including aiding other NLP tasks like paraphrasing and summarization. The motivation behind conducting this survey lies in the increasing interest among NLP researchers towards user-centeredness and personalization through text styling. The paper aims to provide standardizations on terminology definitions, benchmark datasets selection criteria and evaluation metrics to streamline future research efforts in text style transfer. Furthermore, the survey categorizes existing approaches based on parallel and non-parallel data sources while proposing unified methodological frameworks for each category. It also outlines a research agenda for the future development of text style transfer encompassing expanding styles scope improving methodologies dataset assumptions loosening constraints and enhancing evaluation metrics. In conclusion, the paper envisions broadening the impact of text style transfer by connecting it to more NLP tasks specialized downstream applications ethical considerations thereby paving the way for further advancements in this field. The selection criteria for papers reviewed include top conferences in NLP AI along with insightful non-peer-reviewed preprint papers focusing on novelty completeness among other factors.
Created on 15 Apr. 2025

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.