What makes us trust analytics, and how to argue.
Weaponizing KPIs and debiasing decision algorithms.
1. Prior experience → More trust In Trustworthy Data Analysis, Roger Peng gives an elegant description of how he evaluates analytics presentations, and what factors influence his trust level. First, he imagines analytical work in three buckets: A (the material presented), B (work done but not presented), and C (analytical work not done). “We can […]
Debiasing is painful, why analytics fail, and health app evidence.
1. Vigilance → Better algorithms “Eliminating bias… requires constant vigilance on the part of not only data scientists but up and down the corporate ranks.” In an insightful Information Week commentary, James Kobielus (@jameskobielus) considers the importance of Debiasing Our Statistical Algorithms Down to Their Roots. “Rest assured that AI, machine learning, and other statistical […]
Machines Gone Wild! + Can Microlearning improve Data Science training?
1. Debiasing → Better decisions Debiasing is hard work, requiring honest communication and occasional stomach upset. But it gets easier and can become a habit, especially if people have a systematic way of checking their decisions for bias. In this podcast and interview transcript, Nobel-winning Richard Thaler explains several practical ways to debias decisions. First, […]
Cognitive bias in algorithms, baseball analytics denied, and soft skills ROI.
1. Machines Gone Wild → Digital trust gap Last year I spoke with the CEO of a smallish healthcare firm. He had not embraced sophisticated analytics or machine-made decision making, with no comfort level for ‘what information he could believe’. He did, however, trust the CFO’s recommendations. Evidently, these sentiments are widely shared. — […]
1. Recognize bias → Create better algorithms Can we humans better recognize our biases before we turn the machines loose, fully automating them? Here’s a sample of recent caveats about decision-making fails: While improving some lives, we’re making others worse. Yikes. From HBR, Hiring algorithms are not neutral. If you set up your resume-screening algorithm […]