Results of the summarizing process for the arXiv paper: 2309.08573v1

In the study titled "Casteist but Not Racist? Quantifying Disparities in Large Language Model Bias between India and the West," authors Khyati Khandelwal, Manuel Tonneau, Andrew M. Bean, Hannah Rose Kirk, and Scott A. Hale address the issue of societal biases encoded in Large Language Models (LLMs). To bridge the gap between research on bias levels and potential harms in the Global South versus a Western-centric perspective, they developed a novel dataset called Indian-BhED (Indian Bias Evaluation Dataset) to quantify stereotypical bias in popular LLMs. The dataset includes examples related to caste and religion contexts that are both stereotypical and anti-stereotypical. The findings reveal that most LLMs tested exhibit strong biases towards stereotypes in an Indian context compared to a Western context. This highlights the need for more diverse voices when evaluating LLMs. Additionally, Instruction Prompting was investigated as a simple intervention to mitigate such biases. The results show that Instruction Prompting significantly reduces both stereotypical and anti-stereotypical biases for GPT-3.5 in most cases. Overall, this research emphasizes the importance of considering biases in LLMs across different cultural contexts and their potential representational harms. By focusing on an Indian-centric frame, it sheds light on disparities between India and the West regarding LLM bias levels.

• Study titled "Casteist but Not Racist? Quantifying Disparities in Large Language Model Bias between India and the West"
• Addresses societal biases encoded in Large Language Models (LLMs)
• Developed Indian-BhED dataset to quantify stereotypical bias in LLMs
• Dataset includes examples related to caste and religion contexts
• Most LLMs tested exhibit strong biases towards stereotypes in an Indian context compared to a Western context
• Need for more diverse voices when evaluating LLMs
• Instruction Prompting investigated as intervention to mitigate biases
• Instruction Prompting significantly reduces both stereotypical and anti-stereotypical biases for GPT-3.5 in most cases
• Importance of considering biases in LLMs across different cultural contexts and their potential representational harms
• Sheds light on disparities between India and the West regarding LLM bias levels

A study looked at how computers can have unfair ideas about different groups of people. They made a special set of examples to test this in India. The examples were about things like people's social class and religion. They found that the computers had more unfair ideas in India compared to Western countries. They also tried a way to make the computers less unfair, and it worked most of the time. It is important to think about these unfair ideas in different cultures because they can cause harm." Definitions- Caste: A system in some societies where people are divided into different social classes based on their family background. - Bias: Unfair or unbalanced opinions or beliefs. - Stereotype: An oversimplified idea or belief about a group of people. - Context: The situation or circumstances that surround something and help explain its meaning. - Intervention: Taking action to change or improve a situation. - Mitigate: To make something less severe, harmful, or painful. - Representational harms: Negative effects caused by how something is shown or represented.

Casteist but Not Racist? Quantifying Disparities in Large Language Model Bias between India and the West

In a recent study titled "Casteist but Not Racist? Quantifying Disparities in Large Language Model Bias between India and the West," authors Khyati Khandelwal, Manuel Tonneau, Andrew M. Bean, Hannah Rose Kirk, and Scott A. Hale address an important issue of societal biases encoded in Large Language Models (LLMs). The research aims to bridge the gap between research on bias levels and potential harms in the Global South versus a Western-centric perspective. To do this, they developed a novel dataset called Indian-BhED (Indian Bias Evaluation Dataset) to quantify stereotypical bias in popular LLMs.

The Indian-BhED Dataset

The Indian-BhED dataset includes examples related to caste and religion contexts that are both stereotypical and anti-stereotypical. The findings reveal that most LLMs tested exhibit strong biases towards stereotypes in an Indian context compared to a Western context. This highlights the need for more diverse voices when evaluating LLMs.

Instruction Prompting as an Intervention

Additionally, Instruction Prompting was investigated as a simple intervention to mitigate such biases. The results show that Instruction Prompting significantly reduces both stereotypical and anti-stereotypical biases for GPT-3.5 in most cases.

Conclusion

Overall, this research emphasizes the importance of considering biases in LLMs across different cultural contexts and their potential representational harms. By focusing on an Indian-centric frame, it sheds light on disparities between India and the West regarding LLM bias levels. It is essential for researchers to consider these differences when developing models so that they can be used responsibly without perpetuating harmful stereotypes or misrepresentations of certain groups of people based on their culture or background