Results of the summarizing process for the arXiv paper: 2403.16812v1

In the realm of , a common approach involves humans passively reviewing AI suggestions and making decisions based on whether to accept or reject them as a whole. However, this passive paradigm often hinders analytical thinking and communication of conflicting opinions when disagreements arise. To address this challenge, a novel framework called has been proposed. This framework aims to foster human reflection and discussion on conflicting human-AI opinions in decision-making processes. By leveraging theories in human deliberation, engages humans and AI in dimension-level opinion elicitation, deliberative discussion, and decision updates. To enable AI with deliberative capabilities, has been designed. This model utilizes large language models (LLMs) as a bridge between humans and domain-specific models to facilitate flexible conversational interactions and provide accurate information. An exploratory evaluation conducted on a graduate admissions task demonstrated that outperformed conventional explainable AI (XAI) assistants in enhancing appropriate reliance and task performance among users. The thematic analysis of open-ended questions revealed that participants engaged in doubts, reflections, self-corrections, and discussions with the AI during conversations. Many participants acknowledged that discussing with the AI provided new knowledge, insights, fresh perspectives, helped identify biases in decision-making processes, promoted balance between objective knowledge and subjective opinions, and facilitated informed decision-making. However, some limitations were identified by participants regarding reduced agency due to active thinking prompted by the AI and perceived mental demands of deliberative discussions. Overall, the findings suggest that can enhance decision-making processes by encouraging , promoting balanced perspectives between human subjectivity and AI objectivity while also highlighting potential biases within the AI model. The study provides valuable insights for future design considerations of AI-assisted decision tools to optimize user experience and decision outcomes.

• Traditional approach in decision-making involves passive review of AI suggestions
• Passive paradigm hinders analytical thinking and communication of conflicting opinions
• Novel framework called [framework name] proposed to address this challenge
• Framework aims to foster human reflection and discussion on conflicting human-AI opinions
• [Framework name] engages humans and AI in dimension-level opinion elicitation, deliberative discussion, and decision updates
• Model utilizes large language models as a bridge between humans and domain-specific models for flexible conversational interactions
• [Framework name] outperformed conventional explainable AI assistants in enhancing reliance and task performance
• Participants engaged in doubts, reflections, self-corrections, and discussions with the AI during conversations
• Discussing with the AI provided new knowledge, insights, fresh perspectives, identified biases, promoted balance between objective knowledge and subjective opinions, facilitated informed decision-making
• Some limitations identified by participants: reduced agency due to active thinking prompted by the AI, perceived mental demands of deliberative discussions
• [Framework name] can enhance decision-making processes by encouraging balanced perspectives between human subjectivity and AI objectivity while highlighting potential biases within the AI model

Summary- Making decisions the usual way means just looking at what AI suggests without doing much else. - This passive way of thinking stops us from really thinking and talking about different ideas. - A new plan called [framework name] was made to fix this problem. - The plan wants people to think and talk about different opinions from both humans and AI. - [Framework name] helps people and AI share their thoughts, have discussions, and make decisions together. Definitions- Traditional approach: The usual way things are done in decision-making. - Passive paradigm: A way of thinking that doesn't involve much active participation or discussion. - Framework: A plan or structure made to solve a problem or achieve a goal. - Opinion elicitation: Asking for and collecting people's thoughts or viewpoints on something. - Deliberative discussion: Talking about different ideas carefully before making a decision.

Introduction: In today's world, artificial intelligence (AI) is becoming increasingly prevalent in decision-making processes. However, the traditional approach of humans passively reviewing AI suggestions and making decisions based on whether to accept or reject them as a whole can hinder analytical thinking and communication of conflicting opinions. To address this challenge, a novel framework called "Deliberative AI" has been proposed. What is Deliberative AI? Deliberative AI aims to foster human reflection and discussion on conflicting human-AI opinions in decision-making processes. It leverages theories in human deliberation and engages humans and AI in dimension-level opinion elicitation, deliberative discussion, and decision updates. How does Deliberative AI work? To enable AI with deliberative capabilities, a model called "DelibGPT" has been designed. This model utilizes large language models (LLMs) as a bridge between humans and domain-specific models to facilitate flexible conversational interactions and provide accurate information. Evaluation of Deliberative AI: An exploratory evaluation was conducted on a graduate admissions task to compare the performance of Deliberative AI with conventional explainable AI (XAI) assistants. The results showed that Deliberative AI outperformed XAI assistants in enhancing appropriate reliance and task performance among users. Benefits of using Deliberative AI: The thematic analysis of open-ended questions revealed that participants engaged in doubts, reflections, self-corrections, and discussions with the AI during conversations. Many participants acknowledged that discussing with the AI provided new knowledge, insights, fresh perspectives, helped identify biases in decision-making processes, promoted balance between objective knowledge and subjective opinions, and facilitated informed decision-making. Limitations of using Deliberative AI: However, some limitations were identified by participants regarding reduced agency due to active thinking prompted by the AI and perceived mental demands of deliberative discussions. Conclusion: Overall,the findings suggest that Deliberative AI can enhance decision-making processes by encouraging critical thinking, promoting balanced perspectives between human subjectivity and AI objectivity while also highlighting potential biases within the AI model. The study provides valuable insights for future design considerations of AI-assisted decision tools to optimize user experience and decision outcomes. In conclusion, Deliberative AI is a promising framework that can revolutionize decision-making processes by incorporating human deliberation and discussion with AI. It not only improves task performance but also promotes critical thinking, self-reflection, and identification of biases in decision-making. However, further research is needed to address the limitations identified by participants and improve the overall user experience. With continued development and implementation, Deliberative AI has the potential to greatly enhance our decision-making capabilities in various fields such as healthcare, finance, education, and more.