## DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data

### AI-generated Key Points

- Proof assistants like Lean have revolutionized mathematical proof verification by ensuring accuracy and reliability.
- Progress of large language models (LLMs) in formal theorem proving is hindered by a lack of training data.
- A novel approach has been introduced to generate extensive Lean 4 proof data from high-school and undergraduate-level mathematical competition problems.
- The DeepSeekMath 7B model was fine-tuned on a dataset comprising 8 million formal statements with proofs, leading to remarkable advancements.
- The model demonstrated whole-proof generation accuracies surpassing both the baseline GPT-4 and a tree search reinforcement learning method.
- Leveraging synthetic data generated through this method enhances theorem-proving capabilities in LLMs.

**Authors:**
Huajian Xin,
Daya Guo,
Zhihong Shao,
Zhizhou Ren,
Qihao Zhu,
Bo Liu,
Chong Ruan,
Wenda Li,
Xiaodan Liang

**Abstract:** Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem proving is hindered by a lack of training data. To address this issue, we introduce an approach to generate extensive Lean 4 proof data derived from high-school and undergraduate-level mathematical competition problems. This approach involves translating natural language problems into formal statements, filtering out low-quality statements, and generating proofs to create synthetic data. After fine-tuning the DeepSeekMath 7B model on this synthetic dataset, which comprises 8 million formal statements with proofs, our model achieved whole-proof generation accuracies of 46.3% with 64 samples and 52% cumulatively on the Lean 4 miniF2F test, surpassing the baseline GPT-4 at 23.0% with 64 samples and a tree search reinforcement learning method at 41.0%. Additionally, our model successfully proved 5 out of 148 problems in the Lean 4 Formalized International Mathematical Olympiad (FIMO) benchmark, while GPT-4 failed to prove any. These results demonstrate the potential of leveraging large-scale synthetic data to enhance theorem-proving capabilities in LLMs. Both the synthetic dataset and the model will be made available to facilitate further research in this promising field.

### Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

Assess the quality of the AI-generated content by voting

Score: 0

**Why do we need votes?**

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

## Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation**Look for similar papers (in beta version)**

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

**Disclaimer:** The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.