# Quantifying Memorization Across Neural Language Models

**Authors:** Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramer, Chiyuan Zhang  
**arXiv:** [2202.07646](https://arxiv.org/abs/2202.07646)  
**Date:** 2022-02-15  
**Summary page:** https://www.summarizepaper.com/en/paper/2202.07646v1/

## Key points

- Memorization in large language models (LMs) is a significant issue with implications for privacy and content quality.
- The extent of memorization in LMs increases with model capacity, frequency of example duplication during training, and amount of contextual tokens used for prompting.
- Memorization is not uniform across all texts and can impact fairness in text generation processes.
- Generalizing results across different model families presents complexities.
- Urgent need for strategies to address memorization in LMs to protect user privacy, maintain content quality, and uphold fairness.

## Summary

The study "Quantifying Memorization Across Neural Language Models" by Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramer, and Chiyuan Zhang addresses the issue of memorization in large language models (LMs). LMs have the ability to memorize segments of their training data and reproduce it verbatim when prompted. This raises privacy concerns as sensitive user data can be exposed. The authors also note that repeated instances of easily memorizable text can lead to a decline in overall content quality. Additionally, they highlight how this process is not uniform across all texts and can impact fairness. To quantify the extent of memorization in LMs, the authors introduce three log-linear relationships. They show that memorization increases with model capacity, frequency of example duplication during training, and amount of contextual tokens used for prompting. Surprisingly, generalizing these results across different model families presents complexities. The study reveals that memorization within LMs is more prevalent than previously thought and will likely worsen as models continue to scale up unless active mitigations are implemented. These findings emphasize the urgent need for strategies to address this issue in order to protect user privacy, maintain content quality, and uphold fairness in text generation processes.