Results of the summarizing process for the arXiv paper: 1811.10154v1

The use of black box models for high-stakes decision-making in society has become increasingly prevalent. However, the practice of trying to explain these models after the fact rather than creating inherently interpretable models can perpetuate bad practices and potentially cause catastrophic harm to society. While there is a vast amount of literature on interpretability, much recent work on explainable ML contains critical misconceptions that can have a lasting negative impact on the widespread use of machine learning models in society. One such misconception is that there is necessarily a tradeoff between accuracy and interpretability, which is often not true, particularly when data naturally have a good representation. Deep learning models tend to be black boxes because they are highly recursive, but this does not mean that complicated black boxes are necessary for top predictive performance. In fact, there tends to be little difference in performance between more complex classifiers and much simpler ones after preprocessing in data science problems where structured data with meaningful features are constructed as part of the process. The way forward is to design models that are inherently interpretable rather than relying on explanations after the fact. This will allow policy-makers to demand more effort in ensuring safety and trust in machine learning models for high-stakes decisions while avoiding any unnecessary tradeoffs between accuracy and interpretability.

• - Black box models are increasingly used for high-stakes decision-making in society.
• - Trying to explain these models after the fact can perpetuate bad practices and potentially cause harm to society.
• - Recent work on explainable ML contains critical misconceptions that can negatively impact the widespread use of machine learning models in society.
• - There is not necessarily a tradeoff between accuracy and interpretability, particularly when data naturally have a good representation.
• - Deep learning models tend to be black boxes because they are highly recursive, but complicated black boxes are not necessary for top predictive performance.
• - There tends to be little difference in performance between more complex classifiers and much simpler ones after preprocessing in data science problems where structured data with meaningful features are constructed as part of the process.
• - The way forward is to design inherently interpretable models rather than relying on explanations after the fact.
• - This will allow policy-makers to demand more effort in ensuring safety and trust in machine learning models for high-stakes decisions while avoiding unnecessary tradeoffs between accuracy and interpretability.

Summary: 1. Black box models are used for important decisions in society. 2. Explaining these models later can be harmful. 3. Some recent work on explainable ML has misconceptions that could hurt the use of machine learning. 4. Accuracy and interpretability don't always have to be traded off. 5. We need to design models that are easy to understand from the beginning. Definitions - Black box models: a model or system where you can see what goes in and what comes out, but not how it works inside - Perpetuate: make something continue - Misconceptions: ideas that are not true - Tradeoff: when you have to give up one thing to get another thing - Interpretability: how easy it is to understand how a model or system works

Explainable Machine Learning: Avoiding the Tradeoff Between Accuracy and Interpretability

The use of black box models for high-stakes decision-making in society has become increasingly prevalent. However, the practice of trying to explain these models after the fact rather than creating inherently interpretable models can perpetuate bad practices and potentially cause catastrophic harm to society. While there is a vast amount of literature on interpretability, much recent work on explainable ML contains critical misconceptions that can have a lasting negative impact on the widespread use of machine learning models in society.

Misconceptions About Interpretability

One such misconception is that there is necessarily a tradeoff between accuracy and interpretability, which is often not true, particularly when data naturally have a good representation. Deep learning models tend to be black boxes because they are highly recursive, but this does not mean that complicated black boxes are necessary for top predictive performance. In fact, there tends to be little difference in performance between more complex classifiers and much simpler ones after preprocessing in data science problems where structured data with meaningful features are constructed as part of the process.

Designing Models That Are Inherently Interpretable

The way forward is to design models that are inherently interpretable rather than relying on explanations after the fact. This will allow policy-makers to demand more effort in ensuring safety and trust in machine learning models for high-stakes decisions while avoiding any unnecessary tradeoffs between accuracy and interpretability.

Conclusion

In conclusion, it’s important to recognize that deep learning algorithms don’t always need complicated black boxes for top predictive performance; instead we should focus our efforts on designing inherently interpretable machine learning models so we can avoid any unnecessary tradeoffs between accuracy and interpretability when making high stakes decisions with AI technology.