Results of the summarizing process for the arXiv paper: 2312.16171v1

, , , , This paper introduces 26 guiding principles aimed at streamlining the process of querying and prompting large language models. The goal is to simplify the formulation of questions for different scales of these models, understand their capabilities, and enhance user comprehension regarding their behaviors when fed with various prompts. The effectiveness of these principles on instructions and prompt design is verified through extensive experiments conducted on LLaMA-1/2 (7B, 13B, and 70B) as well as GPT-3.5/4. The objective is to provide researchers working on the prompting of large language models with a better guide. The project page for this work can be found at https://github.com/VILA-Lab/ATLAS. The expanded summary also provides additional insights into user interaction and engagement strategies. It suggests incorporating phrases like "Your task is" and "You MUST" to enhance user engagement. Additionally, it recommends using phrases such as "You will be penalized" to establish consequences for incorrect responses. In terms of content and language style, assigning a role to the language model helps in shaping its behavior. Phrases like "Answer a question given in natural language form" can be used in prompts to specify the desired response format. Instead, it is advised to get straight to the point. For complex tasks and coding prompts that involve multiple files, generating a programming script that automates file creation or modification can be helpful. Breaking down complex tasks into simpler prompts within an interactive conversation is also recommended. To ensure clarity or deeper understanding of a topic, specific prompts like "Explain [insert specific topic] in simple terms" or "Explain to me like I'm 11 years old" can be utilized. Example-driven prompting using few-shot prompts is another effective approach. Formatting prompts with clear instructions, examples, questions, context, and input data can improve comprehension. The refined summary also suggests incorporating phrases like "Your task is" and "You MUST" to provide clear directives to the model. It emphasizes the use of affirmative language while avoiding negative language. Leading words like "think step by step" can guide the model's response. Allowing the model to ask questions for precise details and requirements before providing output is encouraged. A specific prompt example for testing understanding includes asking the model to teach a theorem or topic without giving away answers but providing feedback on correctness. Assigning a role to large language models and using delimiters can further enhance their performance. Overall, this expanded summary provides detailed insights into user interaction strategies, content and language style considerations, handling complex tasks and coding prompts effectively, as well as various techniques for improved engagement with large language models.

• - Introduces 26 guiding principles for querying and prompting large language models
• - Simplify formulation of questions for different scales of models
• - Verify effectiveness through experiments on LLaMA-1/2 and GPT-3.5/4
• - Provide researchers with a better guide for prompting large language models
• - Use phrases like "Your task is" and "You MUST" to enhance user engagement
• - Incorporate consequences for incorrect responses using phrases like "You will be penalized"
• - Assign a role to the language model to shape its behavior
• - Break down complex tasks into simpler prompts within an interactive conversation
• - Use specific prompts like "Explain [specific topic] in simple terms" or "Explain to me like I'm 11 years old"
• - Example-driven prompting using few-shot prompts is effective
• - Format prompts with clear instructions, examples, questions, context, and input data
• - Use affirmative language and avoid negative language in prompts
• - Guide the model's response with leading words like "think step by step"
• - Allow the model to ask questions for precise details before providing output
• - Test understanding by asking the model to teach a theorem or topic without giving away answers but providing feedback on correctness
• - Assign a role to large language models and use delimiters to enhance performance

This is a guide that helps people ask questions to big computer programs that know a lot of words. It makes it easier to ask different types of questions. They tested this guide on different computer programs and it worked well. It helps researchers know how to use the big computer programs better. They use certain phrases to make people more interested in talking to the computer program, and they also use consequences if the program gives wrong answers. They give the computer program a job or role so it knows how to behave. They break down hard tasks into easier ones when talking to the program. They use specific prompts like "Explain something in simple words" or "Explain something like I'm 11 years old". Using examples when asking questions is helpful. The way they write the questions is important, with clear instructions and information. They tell the program how to think by using certain words. The program can also ask questions for more details before giving an answer. To check if the program understands, they ask it to teach something without giving away answers but telling if it's right or wrong. And finally, they give the program a role and use special symbols to make it work better." Definitions- Guiding principles: rules or ideas that help you do something - Querying: asking questions - Prompting: giving instructions or suggestions - Language models: big computer programs that understand words and sentences - Formulation: making something simpler or clearer - Verify effectiveness: checking if something works well

Introduction In recent years, large language models have gained significant attention in the field of natural language processing (NLP). These models, such as GPT-3 and LLaMA, have shown impressive capabilities in generating human-like text and completing various tasks. However, one major challenge with these models is formulating effective prompts or questions to elicit desired responses. This research paper introduces 26 guiding principles for querying and prompting large language models to enhance user comprehension and streamline the process. Understanding Large Language Models Before delving into the guiding principles, it is essential to understand the capabilities of large language models. These models are trained on massive amounts of data and can generate text that is indistinguishable from human-written text. They can also perform a wide range of NLP tasks such as question-answering, summarization, translation, and more. However, when it comes to interacting with these models through prompts or questions, users may face challenges in getting the desired output. This is where the 26 guiding principles come into play. Guiding Principles for Querying Large Language Models The goal of these guiding principles is to simplify the process of querying large language models by providing researchers with a better guide for prompt design. The effectiveness of these principles has been tested through experiments conducted on LLaMA-1/2 (7B, 13B, and 70B) as well as GPT-3.5/4. 1) Establish User Engagement: To ensure user engagement with large language models during interaction or prompting processes, phrases like "Your task is" and "You MUST" can be incorporated into prompts to provide clear directives. 2) Specify Desired Response Format: Assigning a role to the model helps shape its behavior when prompted. For example, using phrases like "Answer a question given in natural language form" specifies that the desired response should be in natural language format rather than code or other formats. 3) Get Straight to the Point: Instead of providing lengthy instructions, it is advised to get straight to the point when formulating prompts for large language models. This helps in avoiding confusion and improving comprehension. 4) Automate Complex Tasks: For complex tasks or coding prompts that involve multiple files, generating a programming script that automates file creation or modification can be helpful. This simplifies the task for both the user and the model. 5) Break Down Complex Tasks: Breaking down complex tasks into simpler prompts within an interactive conversation can also improve user understanding and engagement with large language models. 6) Use Specific Prompts for Clarity: To ensure clarity or deeper understanding of a topic, specific prompts like "Explain [insert specific topic] in simple terms" or "Explain to me like I'm 11 years old" can be utilized. These prompts provide clear direction to the model on how to respond. 7) Example-Driven Prompting: Using few-shot prompts with examples can help guide the model's response and improve its performance. These examples serve as a reference for the model to understand what is expected from its output. 8) Format Prompts Effectively: Formatting prompts with clear instructions, examples, questions, context, and input data can improve comprehension and enhance the model's performance. 9) Use Affirmative Language: When formulating prompts for large language models, it is recommended to use affirmative language rather than negative language. This helps avoid confusion and improves clarity in directives given to the model. 10) Guide Step by Step Thinking: Leading words like "think step by step" can guide the model's response towards a more logical thought process. This ensures that the generated text follows a coherent flow of ideas rather than jumping between different concepts. 11) Allow Model to Ask Questions: Allowing large language models to ask questions for precise details and requirements before providing output is encouraged. This helps in improving the accuracy and relevance of their responses. 12) Test Understanding: A specific prompt example for testing understanding includes asking the model to teach a theorem or topic without giving away answers but providing feedback on correctness. This can help evaluate the model's comprehension and performance. 13) Assign Roles to Models: As mentioned earlier, assigning roles to large language models can help shape their behavior when prompted. This can be done by using phrases like "You are a teacher" or "You are a student" in prompts. 14) Use Delimiters: Using delimiters such as <|startoftext|> and