SlideShare a Scribd company logo
1 of 22
Download to read offline
Principles of
User Research
for VR and AR
Dr. Danya Glabau
Implosion Labs
Presented at Jump Into the Light, May 15, 2018
What is User Research for
VR and AR?
User research for AR and VR:
A growing toolkit
● Usability testing
● Remote usability testing
● Motion tracking
● Eye tracking
● Quantitative surveys
● Interviews
○ Open-ended
○ Directed
● Observation
● VR as a setting for user
research
Our focus at Implosion Labs
● Qualitative
● Research-focused
● People-centered
● Open-ended
● Exploratory
Why use qualitative data?
● Strength in small numbers
● Depth and nuance
● Generating new questions
● Find opportunities for future research and development
● Discover market opportunities
Why use qualitative data?
● Find mismatches between designer & user expectations
● Understand the range of abilities, attitudes,
expectations people will bring to an experience
● “Reality check” that helps drive design for users
● Some will call the above “empathy”
Beyond “average”
Qualitative
research is best
when you don’t just
study “average”
users, but include
users at the tails of
variation.
Surprise!
Carefully designed qualitative research delivers unexpected
insights and opportunities.
The user researcher’s mindset
● Curious about people as unique individuals
● Finding patterns in expectations, attitudes, and
behaviors
● Understanding the meaning of what people do
● Work collaboratively to translate findings into next steps
for development
The #1 Priority:
Step back from your
own investment in the
product to genuinely
listen to people.
User Research for VR and AR:
Two Techniques
Two techniques for qualitative user research
Open-ended interviews
● Guided by protocol
● No predetermined answers
● Information gathered guided
by rapport with participant
Participant observation
(Ethnography)
● “Naturalistic” observation
● Range from hands-off
observation to interactive and
cooperative exploration
Open-ended interviews: Strategies
● Questions address topics/themes of interest but do
NOT invite specific responses
● Questions address an overarching research question
● Questions answered through organic conversation,
rapport
● Go deep rather than broad
Open-ended interviews: Tactics
● LISTEN
● Start with questions about “what” and “how”
○ Follow up with questions about “why”
● Ask for examples, more information, demonstrations
● Propose connections between different comments
Participant
Observation
Approach your
participants as
though they are an
unknown culture.
What traditions,
rituals, identities,
ethics do they have?
Ethnographers excel at studying
“the imponderabilia of everyday life”
- Bronislaw Malinowski, Argonauts of the Western
Pacific, 1922
Participant observation: Strategy
● Approach research with a “research question”
○ Why do people come to a virtual reality cinema?
● Initial findings may produce more specific questions
○ Why do people come to a VR cinema in groups?
○ What experiences do people prefer based on their purpose for
coming?
Participant observation: Tactics
● DOCUMENT DOCUMENT DOCUMENT
○ Notes, audio recordings, video, photos, or a combination
● Often combined with interviews or demographic survey
● Helpful to plan “stages” of research to respond to
surprises along the way
User Research for VR and AR:
Interpreting the Data
Understanding qualitative data
● Data will be heterogeneous
○ Multiple formats: otes, photos, video, audio, etc
○ Each participant will answer slightly differently
● Analysis will start out frustrating, become rewarding as
patterns become clear
Understanding qualitative data
● Qualitative data analysis is time-consuming
● Multiple methods for analysis
○ Tech tools to find and document patterns: Atlas.ti, pivot tables,
automated transcription software, Airtable
○ Design research methods: sticky notes for thematic analysis
○ Thematic analysis by hand: searching for “ethnographic
moments” in the data
Thanks for
learning with us!
Danya Glabau, PhD
Implosion Labs, LLC
Brooklyn, NY
danya@implosionlabs.com
Implosionlabs.com

More Related Content

Similar to Principles of User Research for AR and VR

UX Burlington 2017: Exploratory Research in UX Design
UX Burlington 2017: Exploratory Research in UX DesignUX Burlington 2017: Exploratory Research in UX Design
UX Burlington 2017: Exploratory Research in UX DesignSarah Fathallah
 
Getting Started With UX Research
Getting Started With UX ResearchGetting Started With UX Research
Getting Started With UX ResearchGilang Andi Pradana
 
UXDX Stockholm - Is user experience research a science? Piotr Sliwa May 8th 2018
UXDX Stockholm - Is user experience research a science? Piotr Sliwa May 8th 2018UXDX Stockholm - Is user experience research a science? Piotr Sliwa May 8th 2018
UXDX Stockholm - Is user experience research a science? Piotr Sliwa May 8th 2018UXDXConf
 
People-Centered Design
People-Centered DesignPeople-Centered Design
People-Centered DesignKatrina Alcorn
 
HCD Process
HCD ProcessHCD Process
HCD ProcessNTUST
 
Impact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual InquiryImpact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual InquiryRachel Vacek
 
Session1 methods research_question
Session1 methods research_questionSession1 methods research_question
Session1 methods research_questionmilolostinspace
 
Customer Research & Personas
Customer Research & PersonasCustomer Research & Personas
Customer Research & PersonasBrian Winters
 
Composing the perfect research symphony – What are the key elements to conduc...
Composing the perfect research symphony – What are the key elements to conduc...Composing the perfect research symphony – What are the key elements to conduc...
Composing the perfect research symphony – What are the key elements to conduc...innogy Innovation GmbH
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopLynn Connaway
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopOCLC
 
Introduction to UX Research: Fundamentals of Contextual Inquiry
Introduction to UX Research: Fundamentals of Contextual InquiryIntroduction to UX Research: Fundamentals of Contextual Inquiry
Introduction to UX Research: Fundamentals of Contextual InquiryMarc Niola
 
Critical Incident Technique: collecting data from a user’s perspective (aka W...
Critical Incident Technique: collecting data from a user’s perspective (aka W...Critical Incident Technique: collecting data from a user’s perspective (aka W...
Critical Incident Technique: collecting data from a user’s perspective (aka W...Northern User Experience
 
The basics of customer experience research
The basics of customer experience researchThe basics of customer experience research
The basics of customer experience researchSmaply
 
Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015Jen van der Meer
 

Similar to Principles of User Research for AR and VR (20)

Rosenhan "User Research"
Rosenhan "User Research"Rosenhan "User Research"
Rosenhan "User Research"
 
UX Burlington 2017: Exploratory Research in UX Design
UX Burlington 2017: Exploratory Research in UX DesignUX Burlington 2017: Exploratory Research in UX Design
UX Burlington 2017: Exploratory Research in UX Design
 
Getting Started With UX Research
Getting Started With UX ResearchGetting Started With UX Research
Getting Started With UX Research
 
UXDX Stockholm - Is user experience research a science? Piotr Sliwa May 8th 2018
UXDX Stockholm - Is user experience research a science? Piotr Sliwa May 8th 2018UXDX Stockholm - Is user experience research a science? Piotr Sliwa May 8th 2018
UXDX Stockholm - Is user experience research a science? Piotr Sliwa May 8th 2018
 
People-Centered Design
People-Centered DesignPeople-Centered Design
People-Centered Design
 
Role of research in ux
Role of research in uxRole of research in ux
Role of research in ux
 
HCD Process
HCD ProcessHCD Process
HCD Process
 
Impact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual InquiryImpact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual Inquiry
 
Session1 methods research_question
Session1 methods research_questionSession1 methods research_question
Session1 methods research_question
 
Customer Research & Personas
Customer Research & PersonasCustomer Research & Personas
Customer Research & Personas
 
Composing the perfect research symphony – What are the key elements to conduc...
Composing the perfect research symphony – What are the key elements to conduc...Composing the perfect research symphony – What are the key elements to conduc...
Composing the perfect research symphony – What are the key elements to conduc...
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
 
Participant observation
Participant observationParticipant observation
Participant observation
 
Intro to UX
Intro to UXIntro to UX
Intro to UX
 
Introduction to UX Research: Fundamentals of Contextual Inquiry
Introduction to UX Research: Fundamentals of Contextual InquiryIntroduction to UX Research: Fundamentals of Contextual Inquiry
Introduction to UX Research: Fundamentals of Contextual Inquiry
 
Critical Incident Technique: collecting data from a user’s perspective (aka W...
Critical Incident Technique: collecting data from a user’s perspective (aka W...Critical Incident Technique: collecting data from a user’s perspective (aka W...
Critical Incident Technique: collecting data from a user’s perspective (aka W...
 
The basics of customer experience research
The basics of customer experience researchThe basics of customer experience research
The basics of customer experience research
 
Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015
 
Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015Lean NYU ITP Class 2 2.9.2015
Lean NYU ITP Class 2 2.9.2015
 

Recently uploaded

"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 

Recently uploaded (20)

"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 

Principles of User Research for AR and VR

  • 1. Principles of User Research for VR and AR Dr. Danya Glabau Implosion Labs Presented at Jump Into the Light, May 15, 2018
  • 2. What is User Research for VR and AR?
  • 3. User research for AR and VR: A growing toolkit ● Usability testing ● Remote usability testing ● Motion tracking ● Eye tracking ● Quantitative surveys ● Interviews ○ Open-ended ○ Directed ● Observation ● VR as a setting for user research
  • 4. Our focus at Implosion Labs ● Qualitative ● Research-focused ● People-centered ● Open-ended ● Exploratory
  • 5. Why use qualitative data? ● Strength in small numbers ● Depth and nuance ● Generating new questions ● Find opportunities for future research and development ● Discover market opportunities
  • 6. Why use qualitative data? ● Find mismatches between designer & user expectations ● Understand the range of abilities, attitudes, expectations people will bring to an experience ● “Reality check” that helps drive design for users ● Some will call the above “empathy”
  • 7. Beyond “average” Qualitative research is best when you don’t just study “average” users, but include users at the tails of variation.
  • 8. Surprise! Carefully designed qualitative research delivers unexpected insights and opportunities.
  • 9. The user researcher’s mindset ● Curious about people as unique individuals ● Finding patterns in expectations, attitudes, and behaviors ● Understanding the meaning of what people do ● Work collaboratively to translate findings into next steps for development
  • 10. The #1 Priority: Step back from your own investment in the product to genuinely listen to people.
  • 11. User Research for VR and AR: Two Techniques
  • 12. Two techniques for qualitative user research Open-ended interviews ● Guided by protocol ● No predetermined answers ● Information gathered guided by rapport with participant Participant observation (Ethnography) ● “Naturalistic” observation ● Range from hands-off observation to interactive and cooperative exploration
  • 13. Open-ended interviews: Strategies ● Questions address topics/themes of interest but do NOT invite specific responses ● Questions address an overarching research question ● Questions answered through organic conversation, rapport ● Go deep rather than broad
  • 14. Open-ended interviews: Tactics ● LISTEN ● Start with questions about “what” and “how” ○ Follow up with questions about “why” ● Ask for examples, more information, demonstrations ● Propose connections between different comments
  • 15. Participant Observation Approach your participants as though they are an unknown culture. What traditions, rituals, identities, ethics do they have?
  • 16. Ethnographers excel at studying “the imponderabilia of everyday life” - Bronislaw Malinowski, Argonauts of the Western Pacific, 1922
  • 17. Participant observation: Strategy ● Approach research with a “research question” ○ Why do people come to a virtual reality cinema? ● Initial findings may produce more specific questions ○ Why do people come to a VR cinema in groups? ○ What experiences do people prefer based on their purpose for coming?
  • 18. Participant observation: Tactics ● DOCUMENT DOCUMENT DOCUMENT ○ Notes, audio recordings, video, photos, or a combination ● Often combined with interviews or demographic survey ● Helpful to plan “stages” of research to respond to surprises along the way
  • 19. User Research for VR and AR: Interpreting the Data
  • 20. Understanding qualitative data ● Data will be heterogeneous ○ Multiple formats: otes, photos, video, audio, etc ○ Each participant will answer slightly differently ● Analysis will start out frustrating, become rewarding as patterns become clear
  • 21. Understanding qualitative data ● Qualitative data analysis is time-consuming ● Multiple methods for analysis ○ Tech tools to find and document patterns: Atlas.ti, pivot tables, automated transcription software, Airtable ○ Design research methods: sticky notes for thematic analysis ○ Thematic analysis by hand: searching for “ethnographic moments” in the data
  • 22. Thanks for learning with us! Danya Glabau, PhD Implosion Labs, LLC Brooklyn, NY danya@implosionlabs.com Implosionlabs.com