Conducting impartial research
Mitigating your biases (we all have them)
Yael Gutman
About me…
2
Privileged and Confidential
Research, Product Management,
Project Management,
20 years experience in digital
products
3
Inspiration
Customer service
Indented with calls
4
Inspiration
5
Inspiration
Customer service
Indented with calls
Calls as expected
6
Inspiration - recommendation
KPI:
Improve end user
conversion rates
8
Privileged and Confidential
Opps
9
Privileged and Confidential
Original reported issue continued:
● No change in ratio of calls
● No impact on types of questions
Retrospect
10
Privileged and Confidential
● Arrogance
● Reporting user group disregarded
● Territorial and siloed ways of working
Research Cornerstone Violation
Empathy:
The ability to fully understand and share
another person’s expressions, needs,
and motivations.
Privileged and Confidential
Empathy Blocker
It was our own drivers and motivations that led to extreme
consequences on deliverables
Privileged and Confidential
Biases & Strategies to avoid them
Definition: when you have an interpretation,
and you adopt it, and then, top down, you
force everything to fit that interpretation.
Research context:
You adopt an hypothesis and you use data
to validate it, discarding or ignoring data
that challenges the hypothesis.
14
Confirmation Bias
15
Privileged and Confidential
Inclusive research think tanks
• Access to additional POVs,
experiences
• Better understanding of
business and users
• Increased breadth of research
and testing idea
Inclusive Mindset
16
Privileged and Confidential
Inclusive Mindset
Leverage partners experience
● Share areas of interest
● Access to learnings
Goal: Capture without commentary
● Listen more, talk less
● Mirror you understanding
● Observe affect, behavioral cues
17
Active Listening
Privileged and Confidential
Supplement qualitative and quantitative data
● Provide holistic insights
● Clue to potential bias
18
Use Quantitative and Quantitative Data
Privileged and Confidential
19
Communicate impartially
Leading question Impartial question
Rate <org name> stance on
inclusiveness and social justice
What social issues do you
think <org name> cares
about?
● Non leading scripts
● Peer reviews
Definition: Attitudes and stereotypes we associate with people
without our conscious knowledge
Research context:
When we have preconceived notions and generalizations people
from certain groups - demographic, racial or ethnic groups.
20
Implicit Bias
Periodic sync ups with Customer service
Privileged and Confidential
Leverage Internal Teams
Neutrality through Self Awareness
● Identify existing defensiveness, ego
preconceptions
● Note down assumptions
● Regular reflection times
Privileged and Confidential
Practice Humility
Your opinion fact
Privileged and Confidential
Practice Humility
“Bet” which test variant will win
● Normalize being wrong
● It’s not about being right
● Fun
Privileged and Confidential
Practice Humility
Celebrate learnings aka “Failures”
● Celebrate averted costs
● Acknowledge that we don’t know,
importance of analysis
Privileged and Confidential
Privileged and Confidential
Continued Learning
● Learn a new skill: musical instrument,
hobby, foreign language.
● Develop a new professional competency
● Read
● Travel
27
Privileged and Confidential
Key Takeaways
Emotions and biases may influence our work
unknowingly
● Self awareness
● Practice humility
● Inclusive mindset
● Active listening
● Use quantitative data
● Communicate impartially
● Continued Learning
Thank you.
Iinkedin | yaelgutman
Twitter | @Ygutman

Conducting objective research - Mitigating your hidden biases