Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Eisuke Fujinawa1
Yuki Koyama2
Tomohiro Tanikawa1
Shigeo Yoshida1
Takuji Narumi1
Michitaka Hirose1
1The University of Tokyo...
Motivation
Hand-Held VR Controllers
Oculus Touch
Playstation Move Tennis Racket
Weapon
https://www.oculus.com/rift/
https://www.plays...
‣ cannot provide proper haptic perception
‣ leads to lack of immersion inappropriate object handling
Typical Controllers
‣may not fit into limited room space
‣can be dangerous against surrounding people
Naively Designed Controllers
Previous Work: Nonlinearity of Human Haptic Perception
Force direction
[Amemiya et al. 2005]
Haptic Perception
Stimulus
Pe...
Previous Work: Shape Perception Through Haptic Cue
Shape Perception
[Tuvey et al. 1996]
Haptic shape perception consists o...
New Concept: Haptic Shape Illusion
Target VR Controller
A hand-held VR controller that
‣gives haptic shape perception of VR object
‣is smaller than visualize...
Design ExampleDesign Example
Our Approach
Shape Perception Model
f : (moments) → (perceived length,width)
moments perceived shape
f -1: (perceived length,width) → (...
Data Driven Approach
[Lau et al. 2016][Umetani et al. 2014]
Physical Property Shape Semantics
We take data-driven approach...
Construction of Shape Perception Model
f : (moments) → (perceived length,width)
Designing Controller Using Shape Perception Model
E = || (perceived length,width) - (target length,width) ||2
E = || f (mo...
Overview of Our Approach
Contribution
(1) a novel design concept that uses a haptic shape illusion
(2) a data-driven representation of a perceived ...
Data Collection & Regression for
Shape Perception Model
Overview of Data Collection Experiment
sample controllers
(w/ various moments)
perceived shape
(length/width)
wield and es...
Condition of Experiment
controllers (moments)
16 (x 4 times each)
participants
10
perceived shape
640=
we obtained 640 eva...
Regression of Shape Perception Model
Linear
Regression
Quadratic
Regression
Gaussian

Process
Regression
Error in L
[mm]
1...
User Study
test controllers
C1 C2 C3
C4 C5
perceived shapes
S1 S2 S3
S4 S5
Overview of User Study
look all same in VR find most suita...
Participant's view in VRComparing controllers
controller looks the same
Design System
Target virtual model
size
constraint
handle
1.Deformation
2.Weight Placement
Optimization
3.Inner Carving
Optimization CAD...
1. Deformation
Target virtual model
size
constraint
handle
Deformation Weight Carving
CAD data of designed
VR controller
Optimization of ...
Optimization of moments
moments of inertia
[Beacher et al. 2012]
center of gravity
[Prevost et al. 2012]
optimize moments ...
2. Weight Placement Optimization
cf. [Baecher et al. 2012] [Prevost et al. 2012]
3. Inner Carving Optimization
Target virtual model
size
constraint
handle
1.Deformation
2.Weight Placement
Optimization
3.Inner Carving
Optimization CAD...
Fabrication
Designed Controllers
Sword
Target shape Designed controller
Target shape Designed controller
Example #1 Sword
Example #1 Sword
weights are gathered on the tip to represent long shape
Example #2 Tennis Racket
Target shape Designed controller
Example #2 Tennis Racket
weights are distributed to represent wide shape
Example #3 Electric Guitar
Target shape Designed controller
Example #3 Electric Guitar
handle is specified on the neck while the head is preserved
55% size of original in average
57.7%
55.0%51.6%
Limitation & Future work
Limitation & Future Work
Limited to symmetric 2D planner
→ Extension to 3d objects
Ignored air resistance and deflectance
...
Summary
Computational Design of Hand-Held VR Controllers
Using Haptic Shape Illusion
‣a novel design concept using Haptic Shape Il...
[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion
[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion
[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion
[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion
[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion
[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion
Upcoming SlideShare
Loading in …5
×

[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion

1,891 views

Published on

Talk slide at VRST 2017.
Project page: http://nawafuji.org/illusioncontroller/

Published in: Technology
  • Be the first to comment

  • Be the first to like this

[VRST 2017] Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion

  1. 1. Eisuke Fujinawa1 Yuki Koyama2 Tomohiro Tanikawa1 Shigeo Yoshida1 Takuji Narumi1 Michitaka Hirose1 1The University of Tokyo 2National Institute of Advance Industrial Science and Technology (AIST) Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion
  2. 2. Motivation
  3. 3. Hand-Held VR Controllers Oculus Touch Playstation Move Tennis Racket Weapon https://www.oculus.com/rift/ https://www.playstation.com/en-us/ https://www.ea.com/en-gb/games/starwars/battlefront/battlefront-2 http://www.vrunicorns.com/selfietennis/
  4. 4. ‣ cannot provide proper haptic perception ‣ leads to lack of immersion inappropriate object handling Typical Controllers
  5. 5. ‣may not fit into limited room space ‣can be dangerous against surrounding people Naively Designed Controllers
  6. 6. Previous Work: Nonlinearity of Human Haptic Perception Force direction [Amemiya et al. 2005] Haptic Perception Stimulus Perception is nonlinear to Stimulus
  7. 7. Previous Work: Shape Perception Through Haptic Cue Shape Perception [Tuvey et al. 1996] Haptic shape perception consists of moments the moment of inertia I = ∫ mr2
  8. 8. New Concept: Haptic Shape Illusion
  9. 9. Target VR Controller A hand-held VR controller that ‣gives haptic shape perception of VR object ‣is smaller than visualized ‣is customized for each VR application ‣is limited to thin symmetric planar for simplicity
  10. 10. Design ExampleDesign Example
  11. 11. Our Approach
  12. 12. Shape Perception Model f : (moments) → (perceived length,width) moments perceived shape f -1: (perceived length,width) → (moments)
  13. 13. Data Driven Approach [Lau et al. 2016][Umetani et al. 2014] Physical Property Shape Semantics We take data-driven approach to predict shape perception model
  14. 14. Construction of Shape Perception Model f : (moments) → (perceived length,width)
  15. 15. Designing Controller Using Shape Perception Model E = || (perceived length,width) - (target length,width) ||2 E = || f (moments) - (target length,width) ||2 f : (moments) → (perceived length,width) Shap ? Prop3Prop2Prop 1 Shape Mass Prop target shape we want.. perceived shape (controller) ≒ target shape (VR) Shape3Shape2Shape1 Mass Prop controller perceived shape
  16. 16. Overview of Our Approach
  17. 17. Contribution (1) a novel design concept that uses a haptic shape illusion (2) a data-driven representation of a perceived shape based on the mass properties of a wielded object (3) an interactive optimization-guided hand-held VR controller design tool
  18. 18. Data Collection & Regression for Shape Perception Model
  19. 19. Overview of Data Collection Experiment sample controllers (w/ various moments) perceived shape (length/width) wield and estimate in VR
  20. 20. Condition of Experiment controllers (moments) 16 (x 4 times each) participants 10 perceived shape 640= we obtained 640 evaluation data pairs (moments, perceived shape) x
  21. 21. Regression of Shape Perception Model Linear Regression Quadratic Regression Gaussian
 Process Regression Error in L [mm] 117.5 116 115.9 Error in W [mm] 99.2 98.5 97.9 we use linear regression model for simplicity
  22. 22. User Study
  23. 23. test controllers C1 C2 C3 C4 C5 perceived shapes S1 S2 S3 S4 S5 Overview of User Study look all same in VR find most suitable one
  24. 24. Participant's view in VRComparing controllers controller looks the same
  25. 25. Design System
  26. 26. Target virtual model size constraint handle 1.Deformation 2.Weight Placement Optimization 3.Inner Carving Optimization CAD data of designed VR controller Overview of Design System
  27. 27. 1. Deformation
  28. 28. Target virtual model size constraint handle Deformation Weight Carving CAD data of designed VR controller Optimization of Perceived Shape Target Shape (target length,width) Current Perceived Shape f (moments) Target virtual model size constraint handle Deformation Weight Carving E = argmin || f (moments) - (target length,width) ||2 minimization for moments of the controller model
  29. 29. Optimization of moments moments of inertia [Beacher et al. 2012] center of gravity [Prevost et al. 2012] optimize moments of 3d model by weight placement and inner carving Target virtual model size constraint handle Deformation Weight Carving CAD V
  30. 30. 2. Weight Placement Optimization cf. [Baecher et al. 2012] [Prevost et al. 2012]
  31. 31. 3. Inner Carving Optimization
  32. 32. Target virtual model size constraint handle 1.Deformation 2.Weight Placement Optimization 3.Inner Carving Optimization CAD data of designed VR controller Overview of Design System
  33. 33. Fabrication
  34. 34. Designed Controllers
  35. 35. Sword Target shape Designed controller Target shape Designed controller Example #1 Sword
  36. 36. Example #1 Sword weights are gathered on the tip to represent long shape
  37. 37. Example #2 Tennis Racket Target shape Designed controller
  38. 38. Example #2 Tennis Racket weights are distributed to represent wide shape
  39. 39. Example #3 Electric Guitar Target shape Designed controller
  40. 40. Example #3 Electric Guitar handle is specified on the neck while the head is preserved
  41. 41. 55% size of original in average 57.7% 55.0%51.6%
  42. 42. Limitation & Future work
  43. 43. Limitation & Future Work Limited to symmetric 2D planner → Extension to 3d objects Ignored air resistance and deflectance → Incorporating into perception model Cannot represent multiple shapes →Dynamic Shape Change Weight movable device [Zenner et al. 2017]
  44. 44. Summary
  45. 45. Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion ‣a novel design concept using Haptic Shape Illusion users perceive as if they handle the object though the actual appearance of the controller differs from that of the object in VR ‣a data-driven representation of a perceived shape based on the moments of a wielded object we aggregate perceived shape data against hand-held VR controllers with different mass properties through experiments and derive the mapping using regression techniques. ‣an interactive optimization-guided hand-held VR controller design tool we implement a design system which enables automatic design of hand-held VR controllers which are smaller than target shapes while maintaining their haptic shape perception.

×