SlideShare a Scribd company logo
1 of 51
Download to read offline
Eisuke Fujinawa1
Yuki Koyama2
Tomohiro Tanikawa1
Shigeo Yoshida1
Takuji Narumi1
Michitaka Hirose1
1The University of Tokyo
2National Institute of Advance Industrial
Science and Technology (AIST)
Computational Design of Hand-Held VR Controllers
Using Haptic Shape Illusion
Motivation
Hand-Held VR Controllers
Oculus Touch
Playstation Move Tennis Racket
Weapon
https://www.oculus.com/rift/
https://www.playstation.com/en-us/
https://www.ea.com/en-gb/games/starwars/battlefront/battlefront-2
http://www.vrunicorns.com/selfietennis/
‣ cannot provide proper haptic perception
‣ leads to lack of immersion inappropriate object handling
Typical Controllers
‣may not fit into limited room space
‣can be dangerous against surrounding people
Naively Designed Controllers
Previous Work: Nonlinearity of Human Haptic Perception
Force direction
[Amemiya et al. 2005]
Haptic Perception
Stimulus
Perception is nonlinear to Stimulus
Previous Work: Shape Perception Through Haptic Cue
Shape Perception
[Tuvey et al. 1996]
Haptic shape perception consists of moments
the moment of inertia
I = ∫ mr2
New Concept: Haptic Shape Illusion
Target VR Controller
A hand-held VR controller that
‣gives haptic shape perception of VR object
‣is smaller than visualized
‣is customized for each VR application
‣is limited to thin symmetric planar for simplicity
Design ExampleDesign Example
Our Approach
Shape Perception Model
f : (moments) → (perceived length,width)
moments perceived shape
f -1: (perceived length,width) → (moments)
Data Driven Approach
[Lau et al. 2016][Umetani et al. 2014]
Physical Property Shape Semantics
We take data-driven approach to predict shape perception model
Construction of Shape Perception Model
f : (moments) → (perceived length,width)
Designing Controller Using Shape Perception Model
E = || (perceived length,width) - (target length,width) ||2
E = || f (moments) - (target length,width) ||2
f : (moments) → (perceived length,width)
Shap
?
Prop3Prop2Prop 1
Shape
Mass Prop
target shape
we want.. perceived shape (controller) ≒ target shape (VR)
Shape3Shape2Shape1
Mass Prop
controller perceived shape
Overview of Our Approach
Contribution
(1) a novel design concept that uses a haptic shape illusion
(2) a data-driven representation of a perceived shape based on
the mass properties of a wielded object
(3) an interactive optimization-guided hand-held VR controller
design tool
Data Collection & Regression for
Shape Perception Model
Overview of Data Collection Experiment
sample controllers
(w/ various moments)
perceived shape
(length/width)
wield and estimate in VR
Condition of Experiment
controllers (moments)
16 (x 4 times each)
participants
10
perceived shape
640=
we obtained 640 evaluation data pairs (moments, perceived shape)
x
Regression of Shape Perception Model
Linear
Regression
Quadratic
Regression
Gaussian

Process
Regression
Error in L
[mm]
117.5 116 115.9
Error in W
[mm]
99.2 98.5 97.9
we use linear regression model for simplicity
User Study
test controllers
C1 C2 C3
C4 C5
perceived shapes
S1 S2 S3
S4 S5
Overview of User Study
look all same in VR find most suitable one
Participant's view in VRComparing controllers
controller looks the same
Design System
Target virtual model
size
constraint
handle
1.Deformation
2.Weight Placement
Optimization
3.Inner Carving
Optimization CAD data of designed
VR controller
Overview of Design System
1. Deformation
Target virtual model
size
constraint
handle
Deformation Weight Carving
CAD data of designed
VR controller
Optimization of Perceived Shape
Target Shape
(target length,width)
Current Perceived Shape
f (moments)
Target virtual model
size
constraint
handle
Deformation Weight Carving
E = argmin || f (moments) - (target length,width) ||2
minimization for moments of the controller model
Optimization of moments
moments of inertia
[Beacher et al. 2012]
center of gravity
[Prevost et al. 2012]
optimize moments of 3d model by weight placement and inner carving
Target virtual model
size
constraint
handle
Deformation Weight Carving
CAD
V
2. Weight Placement Optimization
cf. [Baecher et al. 2012] [Prevost et al. 2012]
3. Inner Carving Optimization
Target virtual model
size
constraint
handle
1.Deformation
2.Weight Placement
Optimization
3.Inner Carving
Optimization CAD data of designed
VR controller
Overview of Design System
Fabrication
Designed Controllers
Sword
Target shape Designed controller
Target shape Designed controller
Example #1 Sword
Example #1 Sword
weights are gathered on the tip to represent long shape
Example #2 Tennis Racket
Target shape Designed controller
Example #2 Tennis Racket
weights are distributed to represent wide shape
Example #3 Electric Guitar
Target shape Designed controller
Example #3 Electric Guitar
handle is specified on the neck while the head is preserved
55% size of original in average
57.7%
55.0%51.6%
Limitation & Future work
Limitation & Future Work
Limited to symmetric 2D planner
→ Extension to 3d objects
Ignored air resistance and deflectance
→ Incorporating into perception model
Cannot represent multiple shapes
→Dynamic Shape Change
Weight movable device
[Zenner et al. 2017]
Summary
Computational Design of Hand-Held VR Controllers
Using Haptic Shape Illusion
‣a novel design concept using Haptic Shape Illusion
users perceive as if they handle the object though the actual
appearance of the controller differs from that of the object in VR
‣a data-driven representation of a perceived shape
based on the moments of a wielded object
we aggregate perceived shape data against hand-held VR
controllers with different mass properties through experiments
and derive the mapping using regression techniques.
‣an interactive optimization-guided hand-held VR
controller design tool
we implement a design system which enables automatic
design of hand-held VR controllers which are smaller than
target shapes while maintaining their haptic shape perception.

More Related Content

What's hot

Training report on catia
Training report on catiaTraining report on catia
Training report on catiaTajender12singh
 
Sketchup basic course by Eng. Khalid A. Mter
Sketchup basic course by Eng. Khalid A. MterSketchup basic course by Eng. Khalid A. Mter
Sketchup basic course by Eng. Khalid A. Mterkhalid mter
 
3D theory: geometry, extrusion, co-ordinate theory
3D theory: geometry, extrusion, co-ordinate theory3D theory: geometry, extrusion, co-ordinate theory
3D theory: geometry, extrusion, co-ordinate theoryiain bruce
 
Laser Cutting Primer
Laser Cutting PrimerLaser Cutting Primer
Laser Cutting PrimerNYCCTfab
 
Presentation on 3D Printers for B.Com
Presentation on 3D Printers for B.ComPresentation on 3D Printers for B.Com
Presentation on 3D Printers for B.ComBrijpal744
 

What's hot (9)

Training report on catia
Training report on catiaTraining report on catia
Training report on catia
 
Sketchup basic course by Eng. Khalid A. Mter
Sketchup basic course by Eng. Khalid A. MterSketchup basic course by Eng. Khalid A. Mter
Sketchup basic course by Eng. Khalid A. Mter
 
3D theory: geometry, extrusion, co-ordinate theory
3D theory: geometry, extrusion, co-ordinate theory3D theory: geometry, extrusion, co-ordinate theory
3D theory: geometry, extrusion, co-ordinate theory
 
3D Modelling and Animation
3D Modelling and Animation3D Modelling and Animation
3D Modelling and Animation
 
Catiav5interviewppt 160802120654
Catiav5interviewppt 160802120654Catiav5interviewppt 160802120654
Catiav5interviewppt 160802120654
 
3 d modeling part 1
3 d modeling part 13 d modeling part 1
3 d modeling part 1
 
Laser Cutting Primer
Laser Cutting PrimerLaser Cutting Primer
Laser Cutting Primer
 
Presentation on 3D Printers for B.Com
Presentation on 3D Printers for B.ComPresentation on 3D Printers for B.Com
Presentation on 3D Printers for B.Com
 
Ppt on catia
Ppt on  catiaPpt on  catia
Ppt on catia
 

Similar to [VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion

Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorSoma Boubou
 
IRJET- Virtual Changing Room using Image Processing
IRJET- Virtual Changing Room using Image ProcessingIRJET- Virtual Changing Room using Image Processing
IRJET- Virtual Changing Room using Image ProcessingIRJET Journal
 
TURKISH SIGN LANGUAGE RECOGNITION USING HIDDEN MARKOV MODEL
TURKISH SIGN LANGUAGE RECOGNITION USING HIDDEN MARKOV MODELTURKISH SIGN LANGUAGE RECOGNITION USING HIDDEN MARKOV MODEL
TURKISH SIGN LANGUAGE RECOGNITION USING HIDDEN MARKOV MODELcscpconf
 
Turkish Sign Language Recognition Using Hidden Markov Model
Turkish Sign Language Recognition Using Hidden Markov Model Turkish Sign Language Recognition Using Hidden Markov Model
Turkish Sign Language Recognition Using Hidden Markov Model csandit
 
3D Human Hand Posture Reconstruction Using a Single 2D Image
3D Human Hand Posture Reconstruction Using a Single 2D Image3D Human Hand Posture Reconstruction Using a Single 2D Image
3D Human Hand Posture Reconstruction Using a Single 2D ImageWaqas Tariq
 
PhD presentation bboulay
PhD presentation bboulayPhD presentation bboulay
PhD presentation bboulayBernard Boulay
 
A musculoskeletal model driven by microsoft kinect sensor v2 data
A musculoskeletal model driven by microsoft kinect sensor v2 dataA musculoskeletal model driven by microsoft kinect sensor v2 data
A musculoskeletal model driven by microsoft kinect sensor v2 dataAdam Frank
 
User Friendly Virtual Clothes System Based on Simulation and Visualization us...
User Friendly Virtual Clothes System Based on Simulation and Visualization us...User Friendly Virtual Clothes System Based on Simulation and Visualization us...
User Friendly Virtual Clothes System Based on Simulation and Visualization us...IJMTST Journal
 
Paper on Virtual inputs for Computer
Paper on Virtual inputs for ComputerPaper on Virtual inputs for Computer
Paper on Virtual inputs for ComputerIRJET Journal
 
Correcting garment set deformalities on virtual human model using transparanc...
Correcting garment set deformalities on virtual human model using transparanc...Correcting garment set deformalities on virtual human model using transparanc...
Correcting garment set deformalities on virtual human model using transparanc...eSAT Publishing House
 

Similar to [VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion (20)

Designing Usable Interface
Designing Usable InterfaceDesigning Usable Interface
Designing Usable Interface
 
BAXTER PLAYING POOL
BAXTER PLAYING POOLBAXTER PLAYING POOL
BAXTER PLAYING POOL
 
Virtual Reality(full)
Virtual Reality(full)Virtual Reality(full)
Virtual Reality(full)
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptor
 
Virtual Reality
Virtual RealityVirtual Reality
Virtual Reality
 
IRJET- Virtual Changing Room using Image Processing
IRJET- Virtual Changing Room using Image ProcessingIRJET- Virtual Changing Room using Image Processing
IRJET- Virtual Changing Room using Image Processing
 
TURKISH SIGN LANGUAGE RECOGNITION USING HIDDEN MARKOV MODEL
TURKISH SIGN LANGUAGE RECOGNITION USING HIDDEN MARKOV MODELTURKISH SIGN LANGUAGE RECOGNITION USING HIDDEN MARKOV MODEL
TURKISH SIGN LANGUAGE RECOGNITION USING HIDDEN MARKOV MODEL
 
Turkish Sign Language Recognition Using Hidden Markov Model
Turkish Sign Language Recognition Using Hidden Markov Model Turkish Sign Language Recognition Using Hidden Markov Model
Turkish Sign Language Recognition Using Hidden Markov Model
 
3D Human Hand Posture Reconstruction Using a Single 2D Image
3D Human Hand Posture Reconstruction Using a Single 2D Image3D Human Hand Posture Reconstruction Using a Single 2D Image
3D Human Hand Posture Reconstruction Using a Single 2D Image
 
PhD presentation bboulay
PhD presentation bboulayPhD presentation bboulay
PhD presentation bboulay
 
Gesture recognition technology
Gesture recognition technologyGesture recognition technology
Gesture recognition technology
 
Digital technology 1
Digital technology 1Digital technology 1
Digital technology 1
 
Notes04.pdf
Notes04.pdfNotes04.pdf
Notes04.pdf
 
A musculoskeletal model driven by microsoft kinect sensor v2 data
A musculoskeletal model driven by microsoft kinect sensor v2 dataA musculoskeletal model driven by microsoft kinect sensor v2 data
A musculoskeletal model driven by microsoft kinect sensor v2 data
 
V2 v posenet
V2 v posenetV2 v posenet
V2 v posenet
 
User Friendly Virtual Clothes System Based on Simulation and Visualization us...
User Friendly Virtual Clothes System Based on Simulation and Visualization us...User Friendly Virtual Clothes System Based on Simulation and Visualization us...
User Friendly Virtual Clothes System Based on Simulation and Visualization us...
 
Smart Room Gesture Control
Smart Room Gesture ControlSmart Room Gesture Control
Smart Room Gesture Control
 
Paper on Virtual inputs for Computer
Paper on Virtual inputs for ComputerPaper on Virtual inputs for Computer
Paper on Virtual inputs for Computer
 
Correcting garment set deformalities on virtual human model using transparanc...
Correcting garment set deformalities on virtual human model using transparanc...Correcting garment set deformalities on virtual human model using transparanc...
Correcting garment set deformalities on virtual human model using transparanc...
 
1604.08848v1
1604.08848v11604.08848v1
1604.08848v1
 

Recently uploaded

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Bhuvaneswari Subramani
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 

Recently uploaded (20)

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 

[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion

  • 1. Eisuke Fujinawa1 Yuki Koyama2 Tomohiro Tanikawa1 Shigeo Yoshida1 Takuji Narumi1 Michitaka Hirose1 1The University of Tokyo 2National Institute of Advance Industrial Science and Technology (AIST) Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion
  • 3. Hand-Held VR Controllers Oculus Touch Playstation Move Tennis Racket Weapon https://www.oculus.com/rift/ https://www.playstation.com/en-us/ https://www.ea.com/en-gb/games/starwars/battlefront/battlefront-2 http://www.vrunicorns.com/selfietennis/
  • 4. ‣ cannot provide proper haptic perception ‣ leads to lack of immersion inappropriate object handling Typical Controllers
  • 5. ‣may not fit into limited room space ‣can be dangerous against surrounding people Naively Designed Controllers
  • 6. Previous Work: Nonlinearity of Human Haptic Perception Force direction [Amemiya et al. 2005] Haptic Perception Stimulus Perception is nonlinear to Stimulus
  • 7. Previous Work: Shape Perception Through Haptic Cue Shape Perception [Tuvey et al. 1996] Haptic shape perception consists of moments the moment of inertia I = ∫ mr2
  • 8. New Concept: Haptic Shape Illusion
  • 9. Target VR Controller A hand-held VR controller that ‣gives haptic shape perception of VR object ‣is smaller than visualized ‣is customized for each VR application ‣is limited to thin symmetric planar for simplicity
  • 12. Shape Perception Model f : (moments) → (perceived length,width) moments perceived shape f -1: (perceived length,width) → (moments)
  • 13. Data Driven Approach [Lau et al. 2016][Umetani et al. 2014] Physical Property Shape Semantics We take data-driven approach to predict shape perception model
  • 14. Construction of Shape Perception Model f : (moments) → (perceived length,width)
  • 15. Designing Controller Using Shape Perception Model E = || (perceived length,width) - (target length,width) ||2 E = || f (moments) - (target length,width) ||2 f : (moments) → (perceived length,width) Shap ? Prop3Prop2Prop 1 Shape Mass Prop target shape we want.. perceived shape (controller) ≒ target shape (VR) Shape3Shape2Shape1 Mass Prop controller perceived shape
  • 16. Overview of Our Approach
  • 17. Contribution (1) a novel design concept that uses a haptic shape illusion (2) a data-driven representation of a perceived shape based on the mass properties of a wielded object (3) an interactive optimization-guided hand-held VR controller design tool
  • 18. Data Collection & Regression for Shape Perception Model
  • 19. Overview of Data Collection Experiment sample controllers (w/ various moments) perceived shape (length/width) wield and estimate in VR
  • 20.
  • 21. Condition of Experiment controllers (moments) 16 (x 4 times each) participants 10 perceived shape 640= we obtained 640 evaluation data pairs (moments, perceived shape) x
  • 22. Regression of Shape Perception Model Linear Regression Quadratic Regression Gaussian
 Process Regression Error in L [mm] 117.5 116 115.9 Error in W [mm] 99.2 98.5 97.9 we use linear regression model for simplicity
  • 24. test controllers C1 C2 C3 C4 C5 perceived shapes S1 S2 S3 S4 S5 Overview of User Study look all same in VR find most suitable one
  • 25. Participant's view in VRComparing controllers controller looks the same
  • 26.
  • 28. Target virtual model size constraint handle 1.Deformation 2.Weight Placement Optimization 3.Inner Carving Optimization CAD data of designed VR controller Overview of Design System
  • 30. Target virtual model size constraint handle Deformation Weight Carving CAD data of designed VR controller Optimization of Perceived Shape Target Shape (target length,width) Current Perceived Shape f (moments) Target virtual model size constraint handle Deformation Weight Carving E = argmin || f (moments) - (target length,width) ||2 minimization for moments of the controller model
  • 31. Optimization of moments moments of inertia [Beacher et al. 2012] center of gravity [Prevost et al. 2012] optimize moments of 3d model by weight placement and inner carving Target virtual model size constraint handle Deformation Weight Carving CAD V
  • 32. 2. Weight Placement Optimization cf. [Baecher et al. 2012] [Prevost et al. 2012]
  • 33. 3. Inner Carving Optimization
  • 34. Target virtual model size constraint handle 1.Deformation 2.Weight Placement Optimization 3.Inner Carving Optimization CAD data of designed VR controller Overview of Design System
  • 36.
  • 38. Sword Target shape Designed controller Target shape Designed controller Example #1 Sword
  • 39. Example #1 Sword weights are gathered on the tip to represent long shape
  • 40.
  • 41. Example #2 Tennis Racket Target shape Designed controller
  • 42. Example #2 Tennis Racket weights are distributed to represent wide shape
  • 43.
  • 44. Example #3 Electric Guitar Target shape Designed controller
  • 45. Example #3 Electric Guitar handle is specified on the neck while the head is preserved
  • 46.
  • 47. 55% size of original in average 57.7% 55.0%51.6%
  • 49. Limitation & Future Work Limited to symmetric 2D planner → Extension to 3d objects Ignored air resistance and deflectance → Incorporating into perception model Cannot represent multiple shapes →Dynamic Shape Change Weight movable device [Zenner et al. 2017]
  • 51. Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion ‣a novel design concept using Haptic Shape Illusion users perceive as if they handle the object though the actual appearance of the controller differs from that of the object in VR ‣a data-driven representation of a perceived shape based on the moments of a wielded object we aggregate perceived shape data against hand-held VR controllers with different mass properties through experiments and derive the mapping using regression techniques. ‣an interactive optimization-guided hand-held VR controller design tool we implement a design system which enables automatic design of hand-held VR controllers which are smaller than target shapes while maintaining their haptic shape perception.