Results of the summarizing process for the arXiv paper: 2402.10200v1

, , , , The study "Chain-of-Thought Reasoning Without Prompting" delves into the effectiveness of large language models (LLMs) in reasoning without the need for specific prompting techniques. Previous research has focused on methods such as few-shot or zero-shot chain-of-thought (CoT) prompting, which require manual prompt engineering. However, this study takes a new approach by investigating whether LLMs can effectively reason without prompts. The findings reveal that CoT reasoning paths can be elicited from pre-trained LLMs by simply altering the decoding process. By exploring alternative tokens in the top-k sequences instead of using conventional greedy decoding, the study uncovers that CoT paths are frequently present in these sequences. This not only eliminates the need for prompting but also allows for an assessment of the LLMs' intrinsic reasoning abilities. Furthermore, it is observed that the presence of a CoT in the decoding path correlates with higher confidence in the model's decoded answer. This confidence metric effectively distinguishes between CoT and non-CoT paths. Extensive empirical studies on various reasoning benchmarks demonstrate that the proposed CoT-decoding method significantly outperforms standard greedy decoding. In contrast to recent works that still rely on CoT prompting to improve generation processes, this study completely removes that need and focuses on searching at the token-level during decoding while utilizing confidence scores. Additionally, other recent works explore how chain-of-thought emerges in language models and highlight how pretraining distribution influences model performance in few-shot reasoning scenarios. Techniques such as instruction-tuning or distillation offer alternative ways to elicit reasoning paths from language models without explicit prompting. Overall, this study provides valuable insights into enhancing LLMs' reasoning capabilities without relying on traditional prompting methods and showcases significant improvements through innovative decoding strategies.

• - Study explores effectiveness of large language models (LLMs) in reasoning without specific prompting techniques
• - Investigates whether LLMs can effectively reason without prompts by altering decoding process
• - CoT reasoning paths can be elicited from pre-trained LLMs by exploring alternative tokens in top-k sequences
• - Presence of CoT in decoding path correlates with higher confidence in model's decoded answer
• - Proposed CoT-decoding method significantly outperforms standard greedy decoding on various reasoning benchmarks
• - Study removes need for CoT prompting and focuses on token-level search during decoding while utilizing confidence scores

Summary- A study looked at how well big language models can think without being told what to do. - They checked if these models can think by changing how they read words. - By trying different word choices, the models could show their thinking process. - When the models showed clear thinking paths, they were more confident in their answers. - The new way of reading words helped the models do better on tests. Definitions- Language Models (LLMs): Programs that help computers understand and generate human language. - Reasoning: Thinking about things and coming up with answers or solutions. - Decoding: Figuring out the meaning of something written or spoken. - Confidence Scores: How sure someone or something is about an answer or decision.

Introduction: The use of large language models (LLMs) has revolutionized natural language processing (NLP) tasks such as text generation, question-answering, and summarization. These models have shown impressive performance in various benchmarks and are continuously being improved through pre-training on large datasets. However, one area where LLMs still struggle is reasoning - the ability to connect multiple pieces of information and generate logical conclusions. Previous research has focused on prompting techniques to improve LLMs' reasoning abilities, but these methods require manual prompt engineering. In this study, "Chain-of-Thought Reasoning Without Prompting," the authors explore a new approach that eliminates the need for prompts and instead focuses on altering the decoding process to elicit chain-of-thought paths from LLMs. Background: The study begins by discussing previous works on prompting techniques for LLMs' reasoning abilities. These include few-shot or zero-shot chain-of-thought (CoT) prompting, which rely on manually constructed prompts to guide the model towards relevant information for reasoning. While effective in improving performance, these methods require significant effort in prompt engineering and do not fully assess the model's intrinsic reasoning capabilities. The authors also mention recent works that explore how CoT emerges in language models and highlight how pretraining distribution influences model performance in few-shot scenarios. Methodology: To investigate whether LLMs can reason without prompts, the authors propose a new decoding method called CoT-decoding. This method involves exploring alternative tokens in top-k sequences during decoding instead of using conventional greedy decoding. The study uses confidence scores to distinguish between CoT paths and non-CoT paths effectively. Results: Extensive empirical studies are conducted on various reasoning benchmarks such as Winograd Schema Challenge (WSC), Logical Reasoning Dataset (LRD), CommonsenseQA (CSQA), etc., to evaluate the effectiveness of CoT-decoding compared to standard greedy decoding with prompts. The results show that CoT-decoding significantly outperforms traditional decoding methods, demonstrating the LLMs' intrinsic reasoning abilities. Discussion: The study's findings have significant implications for NLP tasks that require reasoning abilities, as it eliminates the need for manual prompt engineering and allows for a more comprehensive evaluation of LLMs' capabilities. The authors also discuss how their method can be combined with other techniques such as instruction-tuning or distillation to further enhance LLMs' reasoning abilities without prompts. Conclusion: In conclusion, "Chain-of-Thought Reasoning Without Prompting" presents a novel approach to elicit chain-of-thought paths from pre-trained language models without relying on traditional prompting methods. By altering the decoding process and utilizing confidence scores, this study demonstrates significant improvements in LLMs' reasoning abilities across various benchmarks. This research opens up new possibilities for enhancing NLP tasks that require complex reasoning by eliminating the need for manual prompt engineering and focusing on alternative decoding strategies.