Results of the summarizing process for the arXiv paper: 2302.07388v1

In this study, the researchers propose two innovative strategies to reduce the toxicity of pretrained large language models (LMs) without compromising their utility. The first strategy, called MEDA, involves adding raw toxicity scores as meta-data to the pretraining samples. The second strategy, called INST, adds instructions in natural language form to indicate the toxicity of the samples. To obtain toxicity scores for each sample, the researchers use the widely accepted Commercial PerspectiveAPI. Since LMs have a maximum sequence length that is smaller than the size limit of PerspectiveAPI, they process documents in their dataset into samples of 2000 tokens before obtaining PerspectiveAPI scores. The researchers use a total of 15 datasets for their experiments including Common Crawl, The Pile, Books3, OpenWebText2, Stack Exchange, PubMed Abstracts, Wikipedia Gutenberg (PG-19), BookCorpus2 NIH ExPorter ArXiv GitHub and Pile-CC datasets which contribute to a corpus consisting of 339 billion tokens. The results show that INST strategy performs best in reducing toxicity probability by up to 61% while maintaining accuracy on five benchmark NLP tasks and improving AUC scores on four bias detection tasks by 1.3%. Additionally they demonstrate generalizability of their techniques by scaling number of training samples and model parameters. Overall this study presents an effective approach for controlling toxicity in LMs during pretraining by providing them with explicit instructions and incorporating toxicity scores as meta-data.

• - Two innovative strategies proposed to reduce toxicity of pretrained large language models (LMs):
• - MEDA: Adding raw toxicity scores as meta-data to pretraining samples
• - INST: Adding instructions in natural language form to indicate toxicity of samples
• - PerspectiveAPI used to obtain toxicity scores for each sample
• - LMs process documents into samples of 2000 tokens before obtaining PerspectiveAPI scores
• - 15 datasets used for experiments, contributing to a corpus consisting of 339 billion tokens
• - Results show that INST strategy reduces toxicity probability by up to 61% while maintaining accuracy on five benchmark NLP tasks and improving AUC scores on four bias detection tasks by 1.3%
• - Techniques demonstrated generalizability by scaling number of training samples and model parameters

Two new ways to make language models less mean: adding scores that show how mean the words are and giving instructions about being mean. A tool called PerspectiveAPI tells us how mean each sample is. The models look at 2000-word pieces of writing to get the scores. They tested the strategies on 15 sets of writing, which had a total of 339 billion words. The results showed that one strategy reduced meanness by up to 61% without losing accuracy on five tests and improved four other tests by 1.3%. The techniques worked well with different amounts of training and settings for the models. Definitions- Toxicity: How mean or harmful something is. - Pretraining: Teaching a model before it learns specific tasks. - Meta-data: Extra information added to something. - Natural language: The way people talk and write naturally, without special rules. - Samples: Small parts taken from a larger piece. - Tokens: Individual units like words or characters in text. - Corpus: A collection of written texts used for study or analysis. - AUC scores: A measure of how well a model can tell things apart, like good vs bad writing. - Generalizability: How well something works in different situations or with different data.

Error: needs to be re-run