SlideShare a Scribd company logo
1 of 14
Bringing User Experience empirical data
to gesture-control and somatic interaction
in virtual reality videogames: an Exploratory
Study with a multimodal interaction prototype
Luís Fernandes et al.
INESC TEC & UTAD - PORTUGAL
Emotions
BeliefsPreferences
Physical Responses
Behaviours
Achievements
Psychological Responses
Videogame Concept and Prototype
The Exploratory Study
Co-Discovery
Qualitative Method
2 Users (typically friends)
Exploration and Discussion
Mediator (optional)
Case Study 1 – Sicó School
Participants and Organization
72 students (aged 14-17)
Physical space limitations
Structure and Data Collection
36 tests (10min each)
Direct observation
Audio-visual recordings
Case Study 2 – S. Pedro School
Participants and Organization
36 students (aged 14-17)
Physical space limitations
Structure and Data Collection
25 tests (7min each)
Direct observation (based on a grid)
Audio-visual recordings
Researcher as mediator
Results and Discussion: Helmsman Player
Cybersickness
Sense of presence
Emotional State
Results and Discussion: Adamastor Player
Feedback
Mediator Role
Final thoughts – Results are preliminary, but positive
Technical concerns
Calibrate devices according to each user
Environment enhancements
Videogame mechanics
Research concerns
Evaluation of UX with new interaction devices
Future work – Helmsman Player
Future work – Adamastor Player
Thank you! Any questions?
Luís Fernandes – INESC TEC & UTAD
lfernandes@utad.pt

More Related Content

Viewers also liked

Cortana Analytics Workshop: Operationalizing Your End-to-End Analytics Solution
Cortana Analytics Workshop: Operationalizing Your End-to-End Analytics SolutionCortana Analytics Workshop: Operationalizing Your End-to-End Analytics Solution
Cortana Analytics Workshop: Operationalizing Your End-to-End Analytics SolutionMSAdvAnalytics
 
Anbefaling Copenhagen Cutlery
Anbefaling Copenhagen CutleryAnbefaling Copenhagen Cutlery
Anbefaling Copenhagen CutleryDennis Hauge
 
2016 kia sportage official images released press release
2016 kia sportage official images released press release2016 kia sportage official images released press release
2016 kia sportage official images released press releasesteeringnews
 
webappVM Cloud Onboarding and Application Management
webappVM Cloud Onboarding and Application ManagementwebappVM Cloud Onboarding and Application Management
webappVM Cloud Onboarding and Application ManagementwebappVM
 
Intel® Xeon® Processor E5-2600 v4 Big Data Analytics Applications Showcase
Intel® Xeon® Processor E5-2600 v4 Big Data Analytics Applications ShowcaseIntel® Xeon® Processor E5-2600 v4 Big Data Analytics Applications Showcase
Intel® Xeon® Processor E5-2600 v4 Big Data Analytics Applications ShowcaseIntel IT Center
 
Project Management: Knowledge Areas
Project Management: Knowledge Areas Project Management: Knowledge Areas
Project Management: Knowledge Areas Gregory Mangos
 
Iconografia cristiana
Iconografia cristianaIconografia cristiana
Iconografia cristianajjridru
 

Viewers also liked (14)

TLCS-900/H1 Microcontroller
TLCS-900/H1 MicrocontrollerTLCS-900/H1 Microcontroller
TLCS-900/H1 Microcontroller
 
Cortana Analytics Workshop: Operationalizing Your End-to-End Analytics Solution
Cortana Analytics Workshop: Operationalizing Your End-to-End Analytics SolutionCortana Analytics Workshop: Operationalizing Your End-to-End Analytics Solution
Cortana Analytics Workshop: Operationalizing Your End-to-End Analytics Solution
 
Anbefaling Copenhagen Cutlery
Anbefaling Copenhagen CutleryAnbefaling Copenhagen Cutlery
Anbefaling Copenhagen Cutlery
 
2016 kia sportage official images released press release
2016 kia sportage official images released press release2016 kia sportage official images released press release
2016 kia sportage official images released press release
 
Circuit training
Circuit trainingCircuit training
Circuit training
 
Luisa Roldán( La Roldana)
Luisa Roldán( La Roldana) Luisa Roldán( La Roldana)
Luisa Roldán( La Roldana)
 
Demand forecasting1
Demand forecasting1Demand forecasting1
Demand forecasting1
 
webappVM Cloud Onboarding and Application Management
webappVM Cloud Onboarding and Application ManagementwebappVM Cloud Onboarding and Application Management
webappVM Cloud Onboarding and Application Management
 
Intel® Xeon® Processor E5-2600 v4 Big Data Analytics Applications Showcase
Intel® Xeon® Processor E5-2600 v4 Big Data Analytics Applications ShowcaseIntel® Xeon® Processor E5-2600 v4 Big Data Analytics Applications Showcase
Intel® Xeon® Processor E5-2600 v4 Big Data Analytics Applications Showcase
 
How to Play Floor Hockey
How to Play Floor HockeyHow to Play Floor Hockey
How to Play Floor Hockey
 
Project Management: Knowledge Areas
Project Management: Knowledge Areas Project Management: Knowledge Areas
Project Management: Knowledge Areas
 
Iconografia cristiana
Iconografia cristianaIconografia cristiana
Iconografia cristiana
 
The flipped classroom in action
The flipped classroom in actionThe flipped classroom in action
The flipped classroom in action
 
Paleocristiano
PaleocristianoPaleocristiano
Paleocristiano
 

Similar to Bringing User Experience empirical data to gesture-control and somatic interaction in virtual reality videogames: an Exploratory Study with a multimodal interaction prototype

Kentucky presentation at CGAMES USA 2011
Kentucky presentation at CGAMES USA 2011Kentucky presentation at CGAMES USA 2011
Kentucky presentation at CGAMES USA 2011Magnus Johansson
 
Serious-games-based exercises for arthroplasty rehabilitation
Serious-games-based exercises for arthroplasty rehabilitationSerious-games-based exercises for arthroplasty rehabilitation
Serious-games-based exercises for arthroplasty rehabilitationJorge Luis Pérez Medina
 
Playing with Climate Change S.Law - CNIE Conference 2008
Playing with Climate Change S.Law - CNIE Conference 2008Playing with Climate Change S.Law - CNIE Conference 2008
Playing with Climate Change S.Law - CNIE Conference 2008sklaw
 
18 cse366t human computer interaction - hci - unit i
18 cse366t  human computer interaction - hci - unit i18 cse366t  human computer interaction - hci - unit i
18 cse366t human computer interaction - hci - unit ibabeethas14
 
VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual ...
VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual ...VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual ...
VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual ...sugiuralab
 
Motion sensing game
Motion sensing gameMotion sensing game
Motion sensing gamepatsy fung
 
Explainable AI for non-expert users
Explainable AI for non-expert usersExplainable AI for non-expert users
Explainable AI for non-expert usersKatrien Verbert
 
CarterCritique1
CarterCritique1CarterCritique1
CarterCritique1amyecarter
 
CarterCritique1
CarterCritique1CarterCritique1
CarterCritique1amyecarter
 
Download Presentation
Download PresentationDownload Presentation
Download PresentationVideoguy
 
Virtual reality Immersion and Presence in Physiological Measures
Virtual reality Immersion and Presence in Physiological MeasuresVirtual reality Immersion and Presence in Physiological Measures
Virtual reality Immersion and Presence in Physiological MeasuresOsama Askoura
 

Similar to Bringing User Experience empirical data to gesture-control and somatic interaction in virtual reality videogames: an Exploratory Study with a multimodal interaction prototype (12)

Kentucky presentation at CGAMES USA 2011
Kentucky presentation at CGAMES USA 2011Kentucky presentation at CGAMES USA 2011
Kentucky presentation at CGAMES USA 2011
 
Serious-games-based exercises for arthroplasty rehabilitation
Serious-games-based exercises for arthroplasty rehabilitationSerious-games-based exercises for arthroplasty rehabilitation
Serious-games-based exercises for arthroplasty rehabilitation
 
Playing with Climate Change S.Law - CNIE Conference 2008
Playing with Climate Change S.Law - CNIE Conference 2008Playing with Climate Change S.Law - CNIE Conference 2008
Playing with Climate Change S.Law - CNIE Conference 2008
 
Hedonomics
HedonomicsHedonomics
Hedonomics
 
18 cse366t human computer interaction - hci - unit i
18 cse366t  human computer interaction - hci - unit i18 cse366t  human computer interaction - hci - unit i
18 cse366t human computer interaction - hci - unit i
 
VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual ...
VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual ...VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual ...
VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual ...
 
Motion sensing game
Motion sensing gameMotion sensing game
Motion sensing game
 
Explainable AI for non-expert users
Explainable AI for non-expert usersExplainable AI for non-expert users
Explainable AI for non-expert users
 
CarterCritique1
CarterCritique1CarterCritique1
CarterCritique1
 
CarterCritique1
CarterCritique1CarterCritique1
CarterCritique1
 
Download Presentation
Download PresentationDownload Presentation
Download Presentation
 
Virtual reality Immersion and Presence in Physiological Measures
Virtual reality Immersion and Presence in Physiological MeasuresVirtual reality Immersion and Presence in Physiological Measures
Virtual reality Immersion and Presence in Physiological Measures
 

Recently uploaded

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxComplianceQuest1
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️anilsa9823
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsAndolasoft Inc
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfjoe51371421
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVshikhaohhpro
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsJhone kinadey
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerThousandEyes
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsArshad QA
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 

Recently uploaded (20)

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.js
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdf
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 

Bringing User Experience empirical data to gesture-control and somatic interaction in virtual reality videogames: an Exploratory Study with a multimodal interaction prototype

Editor's Notes

  1. The proposal herein was developed in the context of a corporate-funded innovation project, called InMERSE.
  2. Problema e contributo Muitos dispositivos Falta de dados empíricos em relação à UX com os novos dispositivos de interação multimodal Algo que ajude no planeamento e desenvolvimento de um videojogo que utilize estas novas formas de interação
  3. According to several authors, UX is dynamic and related to emotions, beliefs, preferences, physical and psychological responses, behaviours, and achievements of users that occur before, during, and after the use of the product.
  4. Multimodal Human-Computer Interaction Human interaction with the world is inherently multimodal Falar da evolução , de modo a melhorar a experiência do utilizador; o caminho para uma interação mais natural – algo criticado pelo Donald Norman Isto devido aos vários dispositivos low-cost que têm vindo a surgir.
  5. Breve descrição com base no paper anterior (2 jogadores, dispositivos utilizados, possibilidades de interação) Focar no que é utilizado no protótipo destes casos de estudo: oculus rift e Kinect 2
  6. Método e Desenho. Protótipo muito inicial. Avaliar o uso deste protótipo de uma forma exploratória; sem grande estrutura no que toca à sua utilização Two case studies were designed to assess the user experience with the early versions of the prototype, through testing sessions with groups of students from different educational backgrounds (potential end-users). The objectives of the case study were to characterize the user experience of the players: helmsman and Adamastor. In both studies we adopted the user experience collection procedure known as co-discovery or constructive interaction This is a qualitative method, based on exploration and simultaneous discussion of the prototype by two users, which may or may not be mediated by the researcher No nosso caso existe um mediador para dar pequenas ajudas na utilização dos dispositivos. Summary Two friends explore a product/concept together and discuss about it (with or without a moderator). Videorecording is used especially when no moderator is present. Description Two participants (typically friends who know each other) explore the product together, freely discussing about it. Video is recorded and/or a moderator is present to guide the discussion. Sharing experience with a friend triggers typically more experiential comments than when discussing with a moderator. Strengths May trigger more authentic experiential data than a normal face-to-face interview. The discussion might reveal interesting experiential aspects. Most suitable for investigating the initial responses to products. Weaknesses Hard to control the direction of the discussion.
  7. Participantes e organização do espaço físico. Estrutura do teste: The study was conducted for 6 hours, distributed over a day, during which a total of 36 users tests were conducted, of approximately 10 minutes each The data collection was made through the registration of direct observation and audio-visual recordings.
  8. Observation Grid Participantes e organização do espaço físico. Estrutura do teste: The case study lasted 3 hours, during which a total of 25 tests were conducted, of approximately 7 minutes each Thus, the session was interrupted for space reorganization For data collection, an observation grid was used (developed after reflection about the first case study) to support the recording of direct observation. Audio-visual recordings were also made.
  9. Lack of feedback, leading to confusion, disinterest, and a high dropout rate in the first study. A more active mediator role contributed in the 2nd study.. Encouraging/motivating interaction
  10. Overall the re