Results of the summarizing process for the arXiv paper: 2306.04528v2

PromptBench is a robustness benchmark designed to measure the resilience of Large Language Models (LLMs) to adversarial prompts. The study focuses on various types of textual attacks targeting prompts at different levels, including character, word, sentence, and semantic levels. These adversarial prompts are used in diverse tasks such as sentiment analysis, natural language inference, reading comprehension, machine translation, and math problem-solving. The study evaluates 4,032 adversarial prompts across 8 tasks and 13 datasets with a total of 567,084 test samples. The findings reveal that contemporary LLMs are vulnerable to adversarial prompts. To provide practical guidance for downstream users and prompt engineers in crafting more robust prompts, the analysis of word frequency is utilized. Additionally, the code and compiled prompts are made publicly accessible to stimulate future research on prompt robustness. A visualization website is also built for easy exploration of adversarial prompts. PromptBench consists of different types of prompts categorized based on their purpose and labeled sample requirements. Task-oriented prompts explicitly describe the task for the model to perform while role-oriented prompts frame the model as an entity with a specific role. Both zero-shot (ZS) and few-shot (FS) learning scenarios are considered for these prompt categories. The evaluation includes a set of LLMs with different architectures and sizes to assess their performance across various tasks and domains. The models considered include Flan-T5-large (0.8B), Dolly-6B, LLaMA-13B, Vicuna-13B , Cerebras-GPT-13B , GPT-NEOX -20B Flan -UL2 (20B )and ChatGPT . PromptBench comprises 8 diverse tasks with 13 public datasets covering areas such as sentiment analysis , grammar correctness detection , duplicate sentence detection , natural language inference , multi -task knowledge evaluation through multiple -choice questions , and reading comprehension . The datasets used include SST -2 , CoLA , QQP , MRPC , MNLI , QNLI , RTE , WNLI , and MMLU . Overall, PromptBench provides comprehensive insights into the robustness of LLMs to adversarial prompts and offers practical recommendations for prompt composition . The availability of code and evaluation benchmark encourages collaborative exploration in this field .

• - PromptBench is a robustness benchmark for Large Language Models (LLMs) to measure their resilience to adversarial prompts.
• - The study focuses on different types of textual attacks targeting prompts at various levels: character, word, sentence, and semantic.
• - Adversarial prompts are used in tasks such as sentiment analysis, natural language inference, reading comprehension, machine translation, and math problem-solving.
• - The study evaluates 4,032 adversarial prompts across 8 tasks and 13 datasets with a total of 567,084 test samples.
• - Contemporary LLMs are found to be vulnerable to adversarial prompts.
• - Word frequency analysis is utilized to provide practical guidance for crafting more robust prompts.
• - Code and compiled prompts are publicly accessible for future research on prompt robustness.
• - A visualization website is available for easy exploration of adversarial prompts.
• - PromptBench categorizes different types of prompts based on their purpose and labeled sample requirements: task-oriented and role-oriented prompts in both zero-shot (ZS) and few-shot (FS) learning scenarios.
• - The evaluation includes multiple LLMs with different architectures and sizes across various tasks and domains.
• - PromptBench comprises 8 diverse tasks with 13 public datasets covering areas such as sentiment analysis, grammar correctness detection, duplicate sentence detection, natural language inference, multi-task knowledge evaluation through multiple-choice questions, and reading comprehension.
• - Datasets used include SST-2, CoLA, QQP, MRPC, MNLI, QNLI, RTE, WNLI, and MMLU.
• - Overall findings from PromptBench provide insights into the robustness of LLMs to adversarial prompts and offer practical recommendations for prompt composition.

PromptBench is a test for big computer programs that understand language to see how well they can handle tricky questions. The test looks at different ways that these programs can be tricked, like changing the words in a question or making the question sound different but mean the same thing. These tricks are used in tasks like figuring out if a sentence sounds positive or negative, understanding what a sentence means, answering questions about a story, translating languages, and solving math problems. The test looked at over 4,000 tricky questions across 8 tasks and 13 sets of data and found that the programs were not very good at handling them. To help make better questions, the researchers looked at how often different words are used and made some tools available for other people to use. They also made a website where people can look at these tricky questions easily. PromptBench puts the tricky questions into categories based on what they're trying to do and what kind of information they need from the program. The test looked at many different kinds of programs doing many different tasks with lots of different sets of data."

Exploring the Robustness of Large Language Models with PromptBench

The development of large language models (LLMs) has enabled many advances in natural language processing, from sentiment analysis to reading comprehension. However, these models are vulnerable to adversarial prompts that can cause them to make incorrect predictions or fail entirely. To measure the resilience of LLMs against such attacks, researchers have developed a benchmark called PromptBench. This study evaluates 4,032 adversarial prompts across 8 tasks and 13 datasets with a total of 567,084 test samples. The findings reveal that contemporary LLMs are indeed vulnerable to adversarial prompts and provide practical guidance for downstream users and prompt engineers in crafting more robust ones.

What is PromptBench?

PromptBench is a robustness benchmark designed to measure the resilience of LLMs against various types of textual attacks targeting prompts at different levels: character, word, sentence, and semantic levels. These adversarial prompts are used in diverse tasks such as sentiment analysis, natural language inference (NLI), reading comprehension (RC), machine translation (MT), and math problem-solving (MPS). PromptBench consists of different types of prompts categorized based on their purpose and labeled sample requirements. Task-oriented prompts explicitly describe the task for the model to perform while role-oriented prompts frame the model as an entity with a specific role. Both zero-shot (ZS) and few-shot (FS) learning scenarios are considered for these prompt categories. The evaluation includes a set of LLMs with different architectures and sizes including Flan-T5-large(0.8B), Dolly-6B , LLaMA -13B , Vicuna -13B , Cerebras -GPT -13B , GPT -NEOX -20B Flan -UL2(20B )and ChatGPT .

Datasets Used in Evaluation

PromptBench comprises 8 diverse tasks with 13 public datasets covering areas such as sentiment analysis , grammar correctness detection , duplicate sentence detection , NLI , multi -task knowledge evaluation through multiple choice questions , RC . The datasets used include SST – 2 CoLA QQP MRPC MNLI QNLI RTE WNLI MMLU .

Analysis & Findings

The findings reveal that contemporary LLMs are indeed vulnerable to adversarial prompts which can lead them to make incorrect predictions or fail entirely depending on how they were crafted by attackers or malicious actors . To provide practical guidance for downstream users and prompt engineers in crafting more robust ones analysis of word frequency is utilized . Additionally code compiledprompts made publicly accessible stimulate future research on prompt robustness A visualization website also built easy explorationofadversarialprompts

Conclusion

Overall PromptBench provides comprehensive insights into the robustnessofLLMstoadversarialpromptsandofferspracticalrecommendationsforpromptcomposition Availability code evaluationbenchmark encourages collaborative exploration this field