Recommended
More Related Content
Similar to Discrimination, Fairness and the Design of Robots
Similar to Discrimination, Fairness and the Design of Robots (9)
Recently uploaded
Recently uploaded (20)
Discrimination, Fairness and the Design of Robots
- 2. OM1 OM2 OM3 OM4 OM5 Doctor Lawyer Roboticist Outcomes Outcome Makers Population A B C
- 3. OM1 OM2 OM3 OM4 OM5 Doctor Lawyer Roboticist Equality of Outcome Equality of Opportunity A B C Ensure that everyone has the same outcome or ensure each group is proportionately represented in the outcome buckets Ensure everyone has the outcome makers they need to access any possible outcome
- 4. OM1 OM2 OM3 OM4 OM5 Doctor Lawyer Roboticist A B C GATEKEEPERS
- 6. Protected Race Gender Age Religion Disability etc. Non-Protected IQ Education Income Measured ability etc Direct Discrimination Indirect Discrimination Structural Discrimination Individual Discrimination Positive Discrimination Impartiality
- 7. 90% P Does reoffend TP 90% N Does Not reoffend Does Not reoffend Does reoffend FP TN FN Individual Could be a member of group 1 or group 2 Risk Score A prediction of what the individual will do Actual Outcomes What the individual actually did
- 8. Black Defendants Higher Risk Lower Risk Total White Defendants Higher Risk Lower Risk Total Did Reoffend 1369 532 1901 Did Reoffend 505 461 966 Didn’t Reoffend 805 990 1714 Didn’t Reoffend 349 1139 1488 Total 2174 1522 3615 Total 854 1600 2454 Source: Angwin et al 2016, available at https://www.propublica.org/article/machine-bias-risk- assessments-in-criminal-sentencing (this version taken from Sumpter 2018)
- 9. 90% P Does reoffend TP 90% N Does Not reoffend Does Not reoffend Does reoffend FP TN FN CRITERION 1 Well-calibrated CRITERION 2 Balance in the positive class CRITERION 2 Balance in the Negative class + +
- 10. 90% P Does reoffend TP 90% N Does Not reoffend Does Not reoffend Does reoffend FP TN FN CRITERION 1 Well-calibrated CRITERION 2 Balance in the positive class CRITERION 2 Balance in the Negative class + + X
- 11. A1 If robots perform general social gate-keeping functions, then they will have similar normative aims and face similar practical constraints. A2 If robots are intended to be closer, personal companions (etc) then they may be bound by a duty of partiality (or positive discrimination) to their human users. GATEKEEPER FRIEND