Consider Your Own Black Box: Evaluating Human Intelligence Alongside Artificial Intelligence
Artificial intelligence (AI) systems are playing significant roles in decision-making processes that affect our lives. However, decisions made in a “black-box” fashion (such as algorithms hidden from view or evaluation), rarely inspire confidence or build trust. Moreover, opaque decision-making may run afoul of legal frameworks (for example the Fair Credit Reporting Act) that require support for certain decisions. Because of the significance of the decisions that AI makes, the decision-making AI should be explainable and trustworthy. Scientists from the National Institute of Standards and Technology (NIST) have proposed four fundamental principles for explainable AI: • Explanation. Systems deliver evidence or reasons for all their outputs. • Meaningful. Systems provide explanations that are meaningful or understandable to individual users. • Explanation Accuracy. The explanation correctly reflects the system’s process for generating the output. • Knowledge Limits. The system only operates under conditions for which it was designed or when the system reaches a sufficient confidence in its output. (If a system has insufficient confidence in its decision, it should not supply a decision to the user.) This NIST draft also asks whether human decision-making can satisfy these principles. NIST concludes that human decision-making can only do so (if at all) in a limited way, due to how our brains consciously and unconsciously process information. Comparing AI system decision making with the human decision process can help us evaluate the relative risks and benefits of using AI systems, and learn more about the upside and pitfalls of our own human decision-making systems. This presentation will address some of the cognitive biases (reasoning flaws) that may affect not only legal decision-making processes, but health and well-being choices. By learning to be aware of cognitive bias and the way it may influence our thoughts and actions, we can improve our decision process- and hopefully our choices.
Recommended
Recommended
More Related Content
Similar to Consider Your Own Black Box: Evaluating Human Intelligence Alongside Artificial Intelligence
Similar to Consider Your Own Black Box: Evaluating Human Intelligence Alongside Artificial Intelligence (20)
More from Jack Pringle
More from Jack Pringle (20)
Recently uploaded
Recently uploaded (20)
Consider Your Own Black Box: Evaluating Human Intelligence Alongside Artificial Intelligence
- 7. Overview • Why we need Explainable AI and What That Might Mean • The Human Decisionmaking Process • How That Process May Leave Us Short • Some Ways to See and Address Our Shortcuts
- 8. Background • Interested in what parts of our minds we outsource to tools like computers (Thompson, Smarter Than You Think) • What biases these new tools have • Make sure that new tech is not a solution in search of a problem (or worse)
- 9. What We Mean When We Say AI Using computer systems to make decisions that normally or traditionally require human intelligence.
- 10. Why Do We Care?
- 12. The Four Principles • Explanation • Meaningful • Explanation Accuracy • Knowledge Limits
- 13. Apply Those Four to Various Humans • Explanation • Meaningful • Explanation Accuracy • Knowledge Limits
- 14. What Makes Human Decisions?
- 15. Your Brain is Not For Thinking
- 16. The Brain is a Prediction Machine https://www.polar.com/blog/recovery-from-exercise/
- 17. What Predicts Decisions • The Inputs Are Not Just What We Encounter in the “Real” World • Memory and Environment- Outside and In • Decisions Made Prior to Conscious Awareness
- 20. Rational?
- 25. The Trains Don’t Care
- 27. A Human Distress Decision Loop
- 28. Chronic Stress and the Mind/Body
- 29. Heuristics Cheat Sheet • There’s Too Much Information • There’s Not Enough Meaning • There’s Not Enough Time and Resources • There’s Not Enough Memory
- 31. Blind Spots That Keep You Stuck
- 35. Ways To Notice Your Short Cuts • Give Your Brain What it Needs • Make Observations Rather than Judgements • Seek Out Counterfactuals • Change Predictions as You Gather Evidence • Develop Empathy • Be Curious
- 37. Do the Work • Notice • Question • Turn it Around
- 38. Notice The Stories You Tell • Livin’ the Dream • Another Day in Paradise • My Dad didn’t do any housework • These Goldern Millennials and Everybody Gets a Trophy • These Goldern Baby Boomers Just Trying to Retire • I Don’t Think ______ Woulda’ Done it This Way • I Don’t Do Technology • I Just Want to Retire Before Things Get Any More Crazy. • Pringle, Why Don’t You Shut the Hell Up?
- 41. Practice Gratitude -5 Minutes a Day
- 42. Work Hard, Till the End of Your Shift
- 43. Where the Real Work Is …
- 44. Resources Four Principles of Explainable Artificial Intelligence, Draft NISTIR 8312, August, 2020 https://www.nist.gov/system/files/documents/2020/08/17/NIST%20Explainable%20AI%20Draft%20NISTIR8312%20%281%29. pdf Seven and a Half Lessons About the Brain, Lisa Feldman Barrett ( @LFeldmanBarrett ) https://www.amazon.com/Seven-Half-Lessons-About-Brain/dp/0358157145 Extended Notes for Seven and a Half Lessons About the Brain https://sevenandahalflessons.com/notes/Extended_notes_for_Seven_and_a_Half_Lessons_About_the_Brain Cognitive Bias Cheat Sheet, Simplified, Buster Benson, January 8, 2017 https://medium.com/thinking-is-hard/4-conundrums-of-intelligence-2ab78d90740f Fun and Games With Cognitive Biases, Cosmos, February 18, 2011 https://www.lesswrong.com/posts/Ytr4dJT79sCBuuEjG/fun-and-games-with-cognitive-biases The Work of Byron Katie ( @ByronKatie ) https://thework.com/instruction-the-work-byron-katie/ Resources to Help Create Space and Build Resilience https://www.linkedin.com/posts/jack-pringle-cipp-us-5834554_resources-to-help-create-space-and-build-activity- 6722498253276909568-h5-N Remove Self-Judgement from Your Judgment – And Get Curious https://jjpringlesc.medium.com/remove-self-judgement-from-your-judgment-and-get-curious-73babc913895 Practice Breathing to Help your Body Work for You https://jjpringlesc.medium.com/practice-breathing-to-help-your-body-work-for-you-1284ba04e98b Noticing Your Private Voice: A Few Observations on the Benefits of Journaling https://jjpringlesc.medium.com/noticing-your-private-voice-a-few-observations-on-the-benefits-of-journaling-4c50866a989d
Editor's Notes
- I didn’t come down here to change your mind about anything, but to ease my own mind about everything.
- -Evidence or Reasons -Meaningful or Understandable to Individual Users -The Explanation matches the process used to generate the output -Operates under the conditions for which it was designed or when it has sufficient confidence
- Juries, Judges, Experts, Legislators, Customer Service Representatives
- Feldman sites
- Trust, belief, impatience, urgency, greed, lust
- Agency, autonomy, mastery
- Interferes with learning and memory lower immune function and bone density increased weight gain, blood pressure, cholesterol, heart disease increase risk for depression, mental illness, and lower life expectancy. potential trigger for mental illness and decreased resilience—especially in adolescence.
- Less evaluative of other people; feel unique but recognize that everyone is also unique; ability to take risks. Situational rather than personality-based. (When You notice Things about yourself, you notice things about others) (opposite of projection). Gets you off your back foot and in a posture of being ready to actively solve problems and create possibilities David Allen and the open loop. Hard not to be humble when you see the way your brain works.
- 1. Is it True? 2. How do you know it’s true? 3) How Do React, what happens, if you believe that thought? 4) Who would you be without that thought?