Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits

In recent years, there has been a surge in the development of open-source machine learning (ML) fairness toolkits aimed at helping practitioners assess and address unfairness in their systems. However, little research has been conducted to investigate how these toolkits are used in practice. To bridge this gap, a study was conducted to explore how industry practitioners work with existing fairness toolkits. The study involved 11 participants who completed all phases of the research, including a pre-interview task and a 60-minute think-aloud semi-structured interview. The participants were tasked with building a model to determine which students were in need of additional tutoring resources using the Student Performance dataset, which includes student grades as well as demographic, social, and school-related features. The aim was to observe participants' thought processes during the exploratory data analysis (EDA) and problem formulation stages. The study identified several opportunities for fairness toolkits to better address practitioner needs and scaffold them in using toolkits effectively and responsibly. The findings highlight implications for future open-source fairness toolkits that can support practitioners in better contextualizing, communicating, and collaborating around ML fairness efforts. For instance, external pressure from stakeholders was identified as an important factor that drives practitioners' engagement with fairness issues. Therefore, future toolkits should consider incorporating features that enable practitioners to communicate effectively with stakeholders about fairness concerns. Overall, this study provides valuable insights into how industry practitioners use existing ML fairness toolkits in practice and highlights areas where improvements can be made to better support them in addressing unfairness issues. The Colab notebook used in the study is also available for others conducting relevant evaluations.

Exploring How Industry Practitioners Use Open-Source Machine Learning Fairness Toolkits

In recent years, the development of open-source machine learning (ML) fairness toolkits has surged. These toolkits are designed to help practitioners assess and address unfairness in their systems. However, little research has been conducted to investigate how these toolkits are used in practice. To bridge this gap, a study was recently conducted to explore how industry practitioners work with existing fairness toolkits.

Overview of the Study

The study involved 11 participants who completed all phases of the research, including a pre-interview task and a 60-minute think-aloud semi-structured interview. The participants were tasked with building a model to determine which students were in need of additional tutoring resources using the Student Performance dataset, which includes student grades as well as demographic, social, and school-related features. The aim was to observe participants' thought processes during the exploratory data analysis (EDA) and problem formulation stages.

Findings from the Study

The study identified several opportunities for fairness toolkits to better address practitioner needs and scaffold them in using toolkits effectively and responsibly. The findings highlight implications for future open-source fairness toolkits that can support practitioners in better contextualizing, communicating, and collaborating around ML fairness efforts. For instance, external pressure from stakeholders was identified as an important factor that drives practitioners' engagement with fairness issues. Therefore, future toolkits should consider incorporating features that enable practitioners to communicate effectively with stakeholders about fairness concerns. Overall, this study provides valuable insights into how industry practitioners use existing ML fairness toolkits in practice and highlights areas where improvements can be made to better support them in addressing unfairness issues. The Colab notebook used in the study is also available for others conducting relevant evaluations.

Conclusion

This research paper presents an exploration into how industry practitioners use open source machine learning (ML) fairness toolsets when assessing potential bias or unfairness within their systems or models they have built using datasets such as Student Performance dataset which includes student grades as well as demographic information along with social factors related to schools etc.. It identifies opportunities for improvement on current toolsets by suggesting features that would enable communication between stakeholders regarding any potential bias found while also providing insights on ways these toolsets could be more effective at helping professionals address any unfairness they may find within their system or model designs before deployment into production environments where it could potentially cause harm or damage due its biased nature towards certain demographics etc.. Overall this paper provides valuable insight into how current ML fairnesstool sets are being used by professionals today while also highlighting areas where improvements can be made so they can better serve those needing assistance when dealing with potential bias or discrimination within their models/systems designs before releasing them out into production environments where it could cause real world harm if not addressed properly beforehand via proper testing/analysis using these types of toolsets first before deployment takes place