In the realm of , a common approach involves humans passively reviewing AI suggestions and making decisions based on whether to accept or reject them as a whole. However, this passive paradigm often hinders analytical thinking and communication of conflicting opinions when disagreements arise. To address this challenge, a novel framework called has been proposed. This framework aims to foster human reflection and discussion on conflicting human-AI opinions in decision-making processes. By leveraging theories in human deliberation, engages humans and AI in dimension-level opinion elicitation, deliberative discussion, and decision updates. To enable AI with deliberative capabilities, has been designed. This model utilizes large language models (LLMs) as a bridge between humans and domain-specific models to facilitate flexible conversational interactions and provide accurate information. An exploratory evaluation conducted on a graduate admissions task demonstrated that outperformed conventional explainable AI (XAI) assistants in enhancing appropriate reliance and task performance among users. The thematic analysis of open-ended questions revealed that participants engaged in doubts, reflections, self-corrections, and discussions with the AI during conversations. Many participants acknowledged that discussing with the AI provided new knowledge, insights, fresh perspectives, helped identify biases in decision-making processes, promoted balance between objective knowledge and subjective opinions, and facilitated informed decision-making. However, some limitations were identified by participants regarding reduced agency due to active thinking prompted by the AI and perceived mental demands of deliberative discussions. Overall, the findings suggest that can enhance decision-making processes by encouraging , promoting balanced perspectives between human subjectivity and AI objectivity while also highlighting potential biases within the AI model. The study provides valuable insights for future design considerations of AI-assisted decision tools to optimize user experience and decision outcomes.
Summary- Making decisions the usual way means just looking at what AI suggests without doing much else.
- This passive way of thinking stops us from really thinking and talking about different ideas.
- A new plan called [framework name] was made to fix this problem.
- The plan wants people to think and talk about different opinions from both humans and AI.
- [Framework name] helps people and AI share their thoughts, have discussions, and make decisions together.
Definitions
- Traditional approach: The usual way things are done in decision-making.
- Passive paradigm: A way of thinking that doesn't involve much active participation or discussion.
- Framework: A plan or structure made to solve a problem or achieve a goal.
- Opinion elicitation: Asking for and collecting people's thoughts or viewpoints on something.
- Deliberative discussion: Talking about different ideas carefully before making a decision.
Introduction:
In today's world, artificial intelligence (AI) is becoming increasingly prevalent in decision-making processes. However, the traditional approach of humans passively reviewing AI suggestions and making decisions based on whether to accept or reject them as a whole can hinder analytical thinking and communication of conflicting opinions. To address this challenge, a novel framework called "Deliberative AI" has been proposed.
What is Deliberative AI?
Deliberative AI aims to foster human reflection and discussion on conflicting human-AI opinions in decision-making processes. It leverages theories in human deliberation and engages humans and AI in dimension-level opinion elicitation, deliberative discussion, and decision updates.
How does Deliberative AI work?
To enable AI with deliberative capabilities, a model called "DelibGPT" has been designed. This model utilizes large language models (LLMs) as a bridge between humans and domain-specific models to facilitate flexible conversational interactions and provide accurate information.
Evaluation of Deliberative AI:
An exploratory evaluation was conducted on a graduate admissions task to compare the performance of Deliberative AI with conventional explainable AI (XAI) assistants. The results showed that Deliberative AI outperformed XAI assistants in enhancing appropriate reliance and task performance among users.
Benefits of using Deliberative AI:
The thematic analysis of open-ended questions revealed that participants engaged in doubts, reflections, self-corrections, and discussions with the AI during conversations. Many participants acknowledged that discussing with the AI provided new knowledge, insights, fresh perspectives, helped identify biases in decision-making processes, promoted balance between objective knowledge and subjective opinions, and facilitated informed decision-making.
Limitations of using Deliberative AI:
However, some limitations were identified by participants regarding reduced agency due to active thinking prompted by the AI and perceived mental demands of deliberative discussions.
Conclusion:
Overall,the findings suggest that Deliberative AI can enhance decision-making processes by encouraging critical thinking, promoting balanced perspectives between human subjectivity and AI objectivity while also highlighting potential biases within the AI model. The study provides valuable insights for future design considerations of AI-assisted decision tools to optimize user experience and decision outcomes.
In conclusion, Deliberative AI is a promising framework that can revolutionize decision-making processes by incorporating human deliberation and discussion with AI. It not only improves task performance but also promotes critical thinking, self-reflection, and identification of biases in decision-making. However, further research is needed to address the limitations identified by participants and improve the overall user experience. With continued development and implementation, Deliberative AI has the potential to greatly enhance our decision-making capabilities in various fields such as healthcare, finance, education, and more.
In AI-assisted decision-making, humans often passively review AI's suggestion and decide whether to accept or reject it as a whole. In such a paradigm, humans are found to rarely trigger analytical thinking and face difficulties in communicating the nuances of conflicting opinions to the AI when disagreements occur. To tackle this challenge, we propose Human-AI Deliberation, a novel framework to promote human reflection and discussion on conflicting human-AI opinions in decision-making. Based on theories in human deliberation, this framework engages humans and AI in dimension-level opinion elicitation, deliberative discussion, and decision updates. To empower AI with deliberative capabilities, we designed Deliberative AI, which leverages large language models (LLMs) as a bridge between humans and domain-specific models to enable flexible conversational interactions and faithful information provision. An exploratory evaluation on a graduate admissions task shows that Deliberative AI outperforms conventional explainable AI (XAI) assistants in improving humans' appropriate reliance and task performance. Based on a mixed-methods analysis of participant behavior, perception, user experience, and open-ended feedback, we draw implications for future AI-assisted decision tool design.
