Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Artificial Intelligence and Bias
1. AI and bias
Oleksandr Krakovetskyi
CEO DevRain, devrain.com
CTO DonorUA, donor.ua
Ph.D. in Computer Science
Microsoft Regional Director
Microsoft Artificial Intelligence Most Valuable Professional
2. Agenda
1. Types of bias
2. Research results
3. Bias in job postings
4. Gender neutral language
5. How to avoid bias?
6. Discussion and Q&A
4. Beauty Bias
This is the view that we
tend to think that the
most handsome individual
will be the most
successful.
5. Affinity Bias
Affinity bias occurs when we
see someone we feel we have
an affinity with e.g. we
attended the same college, we
grew up in the same town, or
they remind us of someone we
know and like.
6. Halo/Horns Effect
Halo is when we see one
great thing about a person
and we let the halo glow of
that significant thing affect
our opinions of everything
else about that person.
7. Similarity Bias
Naturally, we want to
surround ourselves with
people we feel are similar to
us. And as a result, we tend
to want to work more with
people who are like us.
8. Contrast Effect
We should be comparing are
the skills and attributes each
individual has, to the skills and
attributes required for the job,
not those of the person that
came directly before them.
9. Attribution Bias
When we do something badly we tend
to believe that our failing is down to
external factors like other people that
adversely affected us and prevented us
from doing our best.
When it comes to other people, we
tend to think the opposite.
10. Confirmation Bias
When we make a judgement
about another person, we
subconsciously look for evidence
to back up our own opinions of
that person. We do this because
we want to believe we’re right
and that we’ve made the right
assessment of a person.
11. Conformity Bias
Occurs when a positive or
negative evaluation is
made of someone based
on their body language,
personal appearance or
style of dress.
14. Example #1
Women are less like to apply for jobs that have a very long list
of ’desirable’ qualities, as they do not wish to waste the
employer's time if they are not perfectly suited to the role.
Women are also less likely to shout about their
achievements, and to negotiate salaries.
15. Example #2
Researchers from Harvard and Princeton found that blind
auditions increased the likelihood that female musicians would
be hired by an orchestra by 25 to 46 percent.
https://www.forbes.com/sites/pragyaagarwaleurope/2019/02/20/how-to-minimize-unconscious-bias-during-recruitment/
16. Example #3
The researchers found that 70% (possibly even higher) of
hidden biases are directed towards African-Americans, the
elderly, the disabled, and overweight individuals.
17. What evidence do you have for the claim
that the wording of job ads has any effect
on the people reading them?
The evidence underlying this tool comes from a research paper written by
written by Danielle Gaucher, Justin Friesen, and Aaron C. Kay, called
Evidence That Gendered Wording in Job Advertisements Exists and
Sustains Gender Inequality. It was published in the Journal of
Personality and Social Psychology, July 2011, Vol 101(1), p109-28.
https://www.hw.ac.uk/documents/gendered-wording-in-job-ads.pdf
18. Job interview
1. The language in job adverts affects the type of people
who apply.
2. The fact is Latisha and Jamal do not get the same
number of callbacks as Emily and Greg.
3. Structured interviews “standardize the interview
process” and “minimize bias” by allowing employers to
“focus on the factors that have a direct impact on
performance.”
19. Job interview
1. Employers often use the last person to hold a post as a
benchmark for the type of candidate they’re looking for.
2. The growing use of machine learning algorithms to help
identify potential employees is leading to new types of bias.
3. Some people say they have no bias against anything, and
that’s laughable.
http://www.bbc.com/capital/story/20180806-how-hidden-bias-can-stop-you-getting-a-
job
20. Gender-neutral language
Masculine Feminine Gender
neutral
man woman person
father mother parent
boy girl child
uncle aunt
husband wife spouse
actor actress
prince princess
waiter waitress server
rooster hen chicken
stallion mare horse