SlideShare a Scribd company logo
Eliminating Machine Bias
ML4ALL - May 29, 2018
Addressing
What is machine bias?
• Machine Bias, or Algorithmic Bias, occurs
when machine intelligence exhibits bias against
groups of people, usually systematic and unfair
• Algorithmic Fairness describes efforts to
ensure people are treated equally by algorithms
Not related to bias/
variance or model bias
Human bias
Racial Bias
Motherhood Penalty
Gender Bias Ableism
Religious Bias
Unconscious Bias
Xenophobia
Ageism
Positive Bias
Fatherhood Bonus
“People who wear kilts are the worst”
Bernie Bros
“Android users are fools”
Machines are seen as impartial
Machine learning is like
money laundering for bias.
It's a clean, mathematical
apparatus that gives the status
quo the aura of logical inevitability.
—Maciej Cegłowski
http://idlewords.com/talks/sase_panel.htm
PredPol - Predictive policing
Higher observed
crime rates in an area
Additional policing
of the area
Additional observation
of crimes
To predict and serve?, Volume: 13, Issue: 5, Pages: 14-19, First published: 07 October
2016, DOI: (10.1111/j.1740-9713.2016.00960.x)
Drug arrests vs. estimated use
To predict and serve?, Volume: 13, Issue: 5, Pages: 14-19, First published: 07 October 2016,
DOI: (10.1111/j.1740-9713.2016.00960.x)
Simulated effects of additional observed crime
To predict and serve? Lum, Isacc 2016
COMPAS - Risk assessment
White Black
Higher risk,
didn’t reoffend 23.5% 44.9%
Low risk, did
reoffend 47.7% 28.0%
Machine Bias - ProPublica
White Black
Higher risk, re-
offended 505 1369
Total higher
risk 854 2174
Positive
predictive
value (PPV)
59% 63%
Demo at http://bit.ly/BIAS4ALL
COMPAS - Risk assessment
A Popular Algorithm Is No Better at Predicting
Crimes Than Random People
The Atlantic - January 17, 2018
The accuracy, fairness, and limits of predicting recidivism (Dressel and Farid 2018)
COMPAS:
65.2%
Average human:
62.8%
Pooled humans:
67%
Protected attributes
Gender Age College Major
Favorite
Movie Genre
Female 23 English
Romantic
Comedy
Male 78 Physics
Science
Fiction
Neutral 48 Economics
Action/
Adventure
Over-sampling Data
Augmentation
More diverse teams
• A more diverse team will likely test with a wider
variety of data
• Members of diverse groups are more likely to
find biases in code
• This is a good idea anyway
Other ways to uncover bias
• Community Policing: allow users to report biased
results
• Algorithmic auditing: analyze performance on
different inputs
• Ask for help! Algorithmic Justice League offers
to help detect bias, ORCAA consulting firm
Interpretability
Deep Residual Learning for Image Recognition (He et al 2015)
Word embeddings
apple
orange
grapefruit
…apple juice…
…orange juice…
…grapefruit juice…
Word embeddings
father
motherking
queen
mother : father :: king : ?
Word embeddings
father
motherking
queen
mother - father + king ≈ ?
Word embeddings
father
motherdoctor
nurse
mother - father + doctor ≈ ?
Google Translate is sexist
Turkish:
• o bir doktor
• o bir hemşire
• o evli
• o bekar
English:
• he is a doctor
• she is a nurse
• she is married
• he is single
Word embeddings
father
motherdoctor
nurse
Demo at http://bit.ly/BIAS4ALL
What can we do?
What happens when an algorithm cuts your health care
The Verge - Mar 21, 2018
PEOPLE cut
• Support tools, standards, and regulation! GDPR,
algorithmic impact assessment, new NYC law
• Talk about these issues with your communities!
Resources
Organizations and conferences
• Orgs: Algorithmic Justice League, AI
Now, Algorithm Watch, AFOG - Berkeley,
fairness.haverford.edu
• Confs: FAT/ML, FAT Conference
• Consulting: ORCAA
• Data-focused: Data & Society, Human
Rights Data Analysis Group
Technical resources
• Debiaswe - word embeddings and
source from Bolukbasi
• COMPAS Analysis on GitHub
• Deep Learning on Coursera
Human bias/justice
• Project Implicit - Implicit bias tests
• @pdxlawgrrrl, @shaunking,
@Data4BlackLives, so many more
• hiremorewomenintech.com (and
all underrepresented people)
Books
• Weapons of Math Destruction by
Cathy O’Neil
• Automating Inequality by Virginia
Eubanks

More Related Content

What's hot

National Healthcare Informatics Strategy Role Of Standards
National Healthcare Informatics Strategy Role Of StandardsNational Healthcare Informatics Strategy Role Of Standards
National Healthcare Informatics Strategy Role Of Standards
Saji Salam MD,MBA
 
2.4 Deployment of eHealth @ CMC Vellore , India by Prof. Joy John Mammen
2.4 Deployment of eHealth @ CMC Vellore , India by Prof. Joy John Mammen2.4 Deployment of eHealth @ CMC Vellore , India by Prof. Joy John Mammen
2.4 Deployment of eHealth @ CMC Vellore , India by Prof. Joy John Mammen
Apollo Hospitals Group and ATNF
 
Mobile Health Technologies: Future Tools of Healthcare
Mobile Health Technologies: Future Tools of HealthcareMobile Health Technologies: Future Tools of Healthcare
Mobile Health Technologies: Future Tools of Healthcare
David Lee Scher, MD
 
Dark Side and Bright Side of AI in Medicine
Dark Side and Bright Side of AI in MedicineDark Side and Bright Side of AI in Medicine
Dark Side and Bright Side of AI in Medicine
University of Florida
 
mHealth - The Mobile App Strategy Healthcare
mHealth - The Mobile App Strategy HealthcaremHealth - The Mobile App Strategy Healthcare
mHealth - The Mobile App Strategy Healthcare
Think Media Labs
 
2016 iHT2 San Diego Health IT Summit
2016 iHT2 San Diego Health IT Summit2016 iHT2 San Diego Health IT Summit
2016 iHT2 San Diego Health IT Summit
Health IT Conference – iHT2
 
m-Health
m-Healthm-Health
m-Health
Sudhakar Mishra
 
The mHealth + Telehealth World 2014
The mHealth + Telehealth World 2014The mHealth + Telehealth World 2014
The mHealth + Telehealth World 2014
WorldCongress
 
mHealth Security: Stats and Solutions
mHealth Security: Stats and SolutionsmHealth Security: Stats and Solutions
mHealth Security: Stats and Solutions
Kristie Allison
 
ARTIFICIAL INTELLIGENCE ROLE IN HEALTH CARE Dr.T.V.Rao MD
ARTIFICIAL INTELLIGENCE ROLE IN HEALTH CARE  Dr.T.V.Rao MDARTIFICIAL INTELLIGENCE ROLE IN HEALTH CARE  Dr.T.V.Rao MD
ARTIFICIAL INTELLIGENCE ROLE IN HEALTH CARE Dr.T.V.Rao MD
Society for Microbiology and Infection care
 
2015 iHT2 Health IT Beverly Hills Summit
2015 iHT2 Health IT Beverly Hills Summit2015 iHT2 Health IT Beverly Hills Summit
2015 iHT2 Health IT Beverly Hills Summit
Health IT Conference – iHT2
 
Role of artificial intelligence in health care
Role of artificial intelligence in health careRole of artificial intelligence in health care
Role of artificial intelligence in health care
Prachi Gupta
 
Artificial Intelligence Service in Healthcare
Artificial Intelligence Service in HealthcareArtificial Intelligence Service in Healthcare
Artificial Intelligence Service in Healthcare
Ankit Jain
 
M health
M healthM health
M health
4priyakishore
 
Adequate directions for use "In the Age of AI and Watson"
Adequate directions for use "In the Age of AI and Watson"Adequate directions for use "In the Age of AI and Watson"
Adequate directions for use "In the Age of AI and Watson"
Stephen Allan Weitzman
 
New Access Models for Healthcare
New Access Models for HealthcareNew Access Models for Healthcare
New Access Models for Healthcare
Tyrone Grandison
 
2016 iHT2 Miami Health IT Summit
2016 iHT2 Miami Health IT Summit2016 iHT2 Miami Health IT Summit
2016 iHT2 Miami Health IT Summit
Health IT Conference – iHT2
 
Artificial intelligence in Healthcare by Dr. Laila Azmi
Artificial intelligence in Healthcare by Dr. Laila AzmiArtificial intelligence in Healthcare by Dr. Laila Azmi
Artificial intelligence in Healthcare by Dr. Laila Azmi
Laila Azmi Maqbool
 
“Your Web Site is Their First Impression”
“Your Web Site is Their First Impression”“Your Web Site is Their First Impression”
“Your Web Site is Their First Impression”
Michele Affronte
 
Nursing informatics
Nursing informaticsNursing informatics
Nursing informatics
pasok02
 

What's hot (20)

National Healthcare Informatics Strategy Role Of Standards
National Healthcare Informatics Strategy Role Of StandardsNational Healthcare Informatics Strategy Role Of Standards
National Healthcare Informatics Strategy Role Of Standards
 
2.4 Deployment of eHealth @ CMC Vellore , India by Prof. Joy John Mammen
2.4 Deployment of eHealth @ CMC Vellore , India by Prof. Joy John Mammen2.4 Deployment of eHealth @ CMC Vellore , India by Prof. Joy John Mammen
2.4 Deployment of eHealth @ CMC Vellore , India by Prof. Joy John Mammen
 
Mobile Health Technologies: Future Tools of Healthcare
Mobile Health Technologies: Future Tools of HealthcareMobile Health Technologies: Future Tools of Healthcare
Mobile Health Technologies: Future Tools of Healthcare
 
Dark Side and Bright Side of AI in Medicine
Dark Side and Bright Side of AI in MedicineDark Side and Bright Side of AI in Medicine
Dark Side and Bright Side of AI in Medicine
 
mHealth - The Mobile App Strategy Healthcare
mHealth - The Mobile App Strategy HealthcaremHealth - The Mobile App Strategy Healthcare
mHealth - The Mobile App Strategy Healthcare
 
2016 iHT2 San Diego Health IT Summit
2016 iHT2 San Diego Health IT Summit2016 iHT2 San Diego Health IT Summit
2016 iHT2 San Diego Health IT Summit
 
m-Health
m-Healthm-Health
m-Health
 
The mHealth + Telehealth World 2014
The mHealth + Telehealth World 2014The mHealth + Telehealth World 2014
The mHealth + Telehealth World 2014
 
mHealth Security: Stats and Solutions
mHealth Security: Stats and SolutionsmHealth Security: Stats and Solutions
mHealth Security: Stats and Solutions
 
ARTIFICIAL INTELLIGENCE ROLE IN HEALTH CARE Dr.T.V.Rao MD
ARTIFICIAL INTELLIGENCE ROLE IN HEALTH CARE  Dr.T.V.Rao MDARTIFICIAL INTELLIGENCE ROLE IN HEALTH CARE  Dr.T.V.Rao MD
ARTIFICIAL INTELLIGENCE ROLE IN HEALTH CARE Dr.T.V.Rao MD
 
2015 iHT2 Health IT Beverly Hills Summit
2015 iHT2 Health IT Beverly Hills Summit2015 iHT2 Health IT Beverly Hills Summit
2015 iHT2 Health IT Beverly Hills Summit
 
Role of artificial intelligence in health care
Role of artificial intelligence in health careRole of artificial intelligence in health care
Role of artificial intelligence in health care
 
Artificial Intelligence Service in Healthcare
Artificial Intelligence Service in HealthcareArtificial Intelligence Service in Healthcare
Artificial Intelligence Service in Healthcare
 
M health
M healthM health
M health
 
Adequate directions for use "In the Age of AI and Watson"
Adequate directions for use "In the Age of AI and Watson"Adequate directions for use "In the Age of AI and Watson"
Adequate directions for use "In the Age of AI and Watson"
 
New Access Models for Healthcare
New Access Models for HealthcareNew Access Models for Healthcare
New Access Models for Healthcare
 
2016 iHT2 Miami Health IT Summit
2016 iHT2 Miami Health IT Summit2016 iHT2 Miami Health IT Summit
2016 iHT2 Miami Health IT Summit
 
Artificial intelligence in Healthcare by Dr. Laila Azmi
Artificial intelligence in Healthcare by Dr. Laila AzmiArtificial intelligence in Healthcare by Dr. Laila Azmi
Artificial intelligence in Healthcare by Dr. Laila Azmi
 
“Your Web Site is Their First Impression”
“Your Web Site is Their First Impression”“Your Web Site is Their First Impression”
“Your Web Site is Their First Impression”
 
Nursing informatics
Nursing informaticsNursing informatics
Nursing informatics
 

Similar to Eliminating Machine Bias - Mary Ann Brennan - ML4ALL 2018

Algorithmic Bias: Challenges and Opportunities for AI in Healthcare
Algorithmic Bias:  Challenges and Opportunities for AI in HealthcareAlgorithmic Bias:  Challenges and Opportunities for AI in Healthcare
Algorithmic Bias: Challenges and Opportunities for AI in Healthcare
Gregory Nelson
 
Data Con LA 2022 - AI Ethics
Data Con LA 2022 - AI EthicsData Con LA 2022 - AI Ethics
Data Con LA 2022 - AI Ethics
Data Con LA
 
Maura Tuohy
Maura TuohyMaura Tuohy
Maura Tuohy
James Prentis
 
Fair AI
Fair AIFair AI
How do we train AI to be Ethical and Unbiased?
How do we train AI to be Ethical and Unbiased?How do we train AI to be Ethical and Unbiased?
How do we train AI to be Ethical and Unbiased?
Mark Borg
 
Bias in AI-systems: A multi-step approach
Bias in AI-systems: A multi-step approachBias in AI-systems: A multi-step approach
Bias in AI-systems: A multi-step approach
Eirini Ntoutsi
 
algorithmic-bias.pptx
algorithmic-bias.pptxalgorithmic-bias.pptx
algorithmic-bias.pptx
TewodrosEshete1
 
New Developments in Machine Learning - Prof. Dr. Max Welling
New Developments in Machine Learning - Prof. Dr. Max WellingNew Developments in Machine Learning - Prof. Dr. Max Welling
New Developments in Machine Learning - Prof. Dr. Max Welling
Textkernel
 
A Glimpse Into the Future of Data Science - What's Next for AI, Big Data & Ma...
A Glimpse Into the Future of Data Science - What's Next for AI, Big Data & Ma...A Glimpse Into the Future of Data Science - What's Next for AI, Big Data & Ma...
A Glimpse Into the Future of Data Science - What's Next for AI, Big Data & Ma...
Pangea.ai
 
SHOULD ALGORITHMS DECIDE YOUR FUTUREThis publication was .docx
SHOULD ALGORITHMS DECIDE YOUR FUTUREThis publication was .docxSHOULD ALGORITHMS DECIDE YOUR FUTUREThis publication was .docx
SHOULD ALGORITHMS DECIDE YOUR FUTUREThis publication was .docx
maoanderton
 
Data is the New Oil: Presented By Naveen Narayanan, Global Client Partner of ...
Data is the New Oil: Presented By Naveen Narayanan, Global Client Partner of ...Data is the New Oil: Presented By Naveen Narayanan, Global Client Partner of ...
Data is the New Oil: Presented By Naveen Narayanan, Global Client Partner of ...
InterCon
 
Algorithmic Bias - What is it? Why should we care? What can we do about it?
Algorithmic Bias - What is it? Why should we care? What can we do about it? Algorithmic Bias - What is it? Why should we care? What can we do about it?
Algorithmic Bias - What is it? Why should we care? What can we do about it?
University of Minnesota, Duluth
 
Algorithmic Bias : What is it? Why should we care? What can we do about it?
Algorithmic Bias : What is it? Why should we care? What can we do about it?Algorithmic Bias : What is it? Why should we care? What can we do about it?
Algorithmic Bias : What is it? Why should we care? What can we do about it?
University of Minnesota, Duluth
 
Ethics for Conversational AI
Ethics for Conversational AIEthics for Conversational AI
Ethics for Conversational AI
Verena Rieser
 
Big Data Analytics for Measuring Gender Norms: Too Big to Ignore
Big Data Analytics for Measuring Gender Norms: Too Big to IgnoreBig Data Analytics for Measuring Gender Norms: Too Big to Ignore
Big Data Analytics for Measuring Gender Norms: Too Big to Ignore
MEASURE Evaluation
 
AI for Finance
AI for FinanceAI for Finance
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagementTRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
Ansgar Koene
 
2019 WIA - The Importance of Ethics in Data Science
2019 WIA - The Importance of Ethics in Data Science2019 WIA - The Importance of Ethics in Data Science
2019 WIA - The Importance of Ethics in Data Science
Women in Analytics Conference
 
Artificial Intelligence and Machine Learning for business
Artificial Intelligence and Machine Learning for businessArtificial Intelligence and Machine Learning for business
Artificial Intelligence and Machine Learning for business
Steven Finlay
 
BIG DATA AND MACHINE LEARNING
BIG DATA AND MACHINE LEARNINGBIG DATA AND MACHINE LEARNING
BIG DATA AND MACHINE LEARNING
Umair Shafique
 

Similar to Eliminating Machine Bias - Mary Ann Brennan - ML4ALL 2018 (20)

Algorithmic Bias: Challenges and Opportunities for AI in Healthcare
Algorithmic Bias:  Challenges and Opportunities for AI in HealthcareAlgorithmic Bias:  Challenges and Opportunities for AI in Healthcare
Algorithmic Bias: Challenges and Opportunities for AI in Healthcare
 
Data Con LA 2022 - AI Ethics
Data Con LA 2022 - AI EthicsData Con LA 2022 - AI Ethics
Data Con LA 2022 - AI Ethics
 
Maura Tuohy
Maura TuohyMaura Tuohy
Maura Tuohy
 
Fair AI
Fair AIFair AI
Fair AI
 
How do we train AI to be Ethical and Unbiased?
How do we train AI to be Ethical and Unbiased?How do we train AI to be Ethical and Unbiased?
How do we train AI to be Ethical and Unbiased?
 
Bias in AI-systems: A multi-step approach
Bias in AI-systems: A multi-step approachBias in AI-systems: A multi-step approach
Bias in AI-systems: A multi-step approach
 
algorithmic-bias.pptx
algorithmic-bias.pptxalgorithmic-bias.pptx
algorithmic-bias.pptx
 
New Developments in Machine Learning - Prof. Dr. Max Welling
New Developments in Machine Learning - Prof. Dr. Max WellingNew Developments in Machine Learning - Prof. Dr. Max Welling
New Developments in Machine Learning - Prof. Dr. Max Welling
 
A Glimpse Into the Future of Data Science - What's Next for AI, Big Data & Ma...
A Glimpse Into the Future of Data Science - What's Next for AI, Big Data & Ma...A Glimpse Into the Future of Data Science - What's Next for AI, Big Data & Ma...
A Glimpse Into the Future of Data Science - What's Next for AI, Big Data & Ma...
 
SHOULD ALGORITHMS DECIDE YOUR FUTUREThis publication was .docx
SHOULD ALGORITHMS DECIDE YOUR FUTUREThis publication was .docxSHOULD ALGORITHMS DECIDE YOUR FUTUREThis publication was .docx
SHOULD ALGORITHMS DECIDE YOUR FUTUREThis publication was .docx
 
Data is the New Oil: Presented By Naveen Narayanan, Global Client Partner of ...
Data is the New Oil: Presented By Naveen Narayanan, Global Client Partner of ...Data is the New Oil: Presented By Naveen Narayanan, Global Client Partner of ...
Data is the New Oil: Presented By Naveen Narayanan, Global Client Partner of ...
 
Algorithmic Bias - What is it? Why should we care? What can we do about it?
Algorithmic Bias - What is it? Why should we care? What can we do about it? Algorithmic Bias - What is it? Why should we care? What can we do about it?
Algorithmic Bias - What is it? Why should we care? What can we do about it?
 
Algorithmic Bias : What is it? Why should we care? What can we do about it?
Algorithmic Bias : What is it? Why should we care? What can we do about it?Algorithmic Bias : What is it? Why should we care? What can we do about it?
Algorithmic Bias : What is it? Why should we care? What can we do about it?
 
Ethics for Conversational AI
Ethics for Conversational AIEthics for Conversational AI
Ethics for Conversational AI
 
Big Data Analytics for Measuring Gender Norms: Too Big to Ignore
Big Data Analytics for Measuring Gender Norms: Too Big to IgnoreBig Data Analytics for Measuring Gender Norms: Too Big to Ignore
Big Data Analytics for Measuring Gender Norms: Too Big to Ignore
 
AI for Finance
AI for FinanceAI for Finance
AI for Finance
 
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagementTRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
TRILcon'17 confernece workshop presentation on UnBias stakeholder engagement
 
2019 WIA - The Importance of Ethics in Data Science
2019 WIA - The Importance of Ethics in Data Science2019 WIA - The Importance of Ethics in Data Science
2019 WIA - The Importance of Ethics in Data Science
 
Artificial Intelligence and Machine Learning for business
Artificial Intelligence and Machine Learning for businessArtificial Intelligence and Machine Learning for business
Artificial Intelligence and Machine Learning for business
 
BIG DATA AND MACHINE LEARNING
BIG DATA AND MACHINE LEARNINGBIG DATA AND MACHINE LEARNING
BIG DATA AND MACHINE LEARNING
 

Recently uploaded

Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Webinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data WarehouseWebinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data Warehouse
Federico Razzoli
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
Mariano Tinti
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 

Recently uploaded (20)

Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Webinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data WarehouseWebinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data Warehouse
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 

Eliminating Machine Bias - Mary Ann Brennan - ML4ALL 2018

  • 1. Eliminating Machine Bias ML4ALL - May 29, 2018 Addressing
  • 2. What is machine bias? • Machine Bias, or Algorithmic Bias, occurs when machine intelligence exhibits bias against groups of people, usually systematic and unfair • Algorithmic Fairness describes efforts to ensure people are treated equally by algorithms Not related to bias/ variance or model bias
  • 3. Human bias Racial Bias Motherhood Penalty Gender Bias Ableism Religious Bias Unconscious Bias Xenophobia Ageism Positive Bias Fatherhood Bonus “People who wear kilts are the worst” Bernie Bros “Android users are fools”
  • 4. Machines are seen as impartial Machine learning is like money laundering for bias. It's a clean, mathematical apparatus that gives the status quo the aura of logical inevitability. —Maciej Cegłowski http://idlewords.com/talks/sase_panel.htm
  • 5. PredPol - Predictive policing Higher observed crime rates in an area Additional policing of the area Additional observation of crimes To predict and serve?, Volume: 13, Issue: 5, Pages: 14-19, First published: 07 October 2016, DOI: (10.1111/j.1740-9713.2016.00960.x) Drug arrests vs. estimated use To predict and serve?, Volume: 13, Issue: 5, Pages: 14-19, First published: 07 October 2016, DOI: (10.1111/j.1740-9713.2016.00960.x) Simulated effects of additional observed crime To predict and serve? Lum, Isacc 2016
  • 6. COMPAS - Risk assessment White Black Higher risk, didn’t reoffend 23.5% 44.9% Low risk, did reoffend 47.7% 28.0% Machine Bias - ProPublica White Black Higher risk, re- offended 505 1369 Total higher risk 854 2174 Positive predictive value (PPV) 59% 63% Demo at http://bit.ly/BIAS4ALL
  • 7. COMPAS - Risk assessment A Popular Algorithm Is No Better at Predicting Crimes Than Random People The Atlantic - January 17, 2018 The accuracy, fairness, and limits of predicting recidivism (Dressel and Farid 2018) COMPAS: 65.2% Average human: 62.8% Pooled humans: 67%
  • 8. Protected attributes Gender Age College Major Favorite Movie Genre Female 23 English Romantic Comedy Male 78 Physics Science Fiction Neutral 48 Economics Action/ Adventure
  • 10. More diverse teams • A more diverse team will likely test with a wider variety of data • Members of diverse groups are more likely to find biases in code • This is a good idea anyway
  • 11. Other ways to uncover bias • Community Policing: allow users to report biased results • Algorithmic auditing: analyze performance on different inputs • Ask for help! Algorithmic Justice League offers to help detect bias, ORCAA consulting firm
  • 12. Interpretability Deep Residual Learning for Image Recognition (He et al 2015)
  • 17. Google Translate is sexist Turkish: • o bir doktor • o bir hemşire • o evli • o bekar English: • he is a doctor • she is a nurse • she is married • he is single
  • 19. What can we do? What happens when an algorithm cuts your health care The Verge - Mar 21, 2018 PEOPLE cut • Support tools, standards, and regulation! GDPR, algorithmic impact assessment, new NYC law • Talk about these issues with your communities!
  • 20. Resources Organizations and conferences • Orgs: Algorithmic Justice League, AI Now, Algorithm Watch, AFOG - Berkeley, fairness.haverford.edu • Confs: FAT/ML, FAT Conference • Consulting: ORCAA • Data-focused: Data & Society, Human Rights Data Analysis Group Technical resources • Debiaswe - word embeddings and source from Bolukbasi • COMPAS Analysis on GitHub • Deep Learning on Coursera Human bias/justice • Project Implicit - Implicit bias tests • @pdxlawgrrrl, @shaunking, @Data4BlackLives, so many more • hiremorewomenintech.com (and all underrepresented people) Books • Weapons of Math Destruction by Cathy O’Neil • Automating Inequality by Virginia Eubanks