Third Hand for ahci class

1. THIRD HAND
ENHANCING SINGLE-HANDED AND HAPTIC
INTERACTIONS ON MOBILE DEVICES
THROUGH A ROBOTIC ARM
CHICHI LIAO, SHUN-YAO YANG
3/13 2015,
@ADVANCED HCI

2. OUTLINE
• Motivation
• Device
• Implementation
• Application
• Study
• Issues

3. OUTLINE
• Motivation
• Device
• Implementation
• Application
• Study
• Issues

4. PHYSICAL SUPPORT FOR
HANDHELD DEVICE

5. LIMITATION

6. IF THERE’S ANOTHER
PHYSICAL FORCE GRASP
PHONE FOR YOU?

7. BUT HOW?

8. WE WANT TO
INTRODECE
A concept,
that is a solution to allow the device an
additional physical support
through grasping its user with an
Robot Arm.

9. EXPLORE THE
CONCEPT
• Opens up new opportunities for novel
single-handed interaction and haptic
feedback on mobile devices.

10. USE CASE I
• Single-handed interactions:
• 在一個下雨的日子，Andy撐著傘走在路上，經過了大學
時期充滿回憶的一間咖啡廳，想要對他拍一張照。
• 此時他一支手撐著傘，只有一支手方便使用，於是拿起了
手機，讓鏡頭對準那間咖啡廳。放開了手機，手機固定在
半空中、就像是有人幫他拿著手機一樣，他很輕鬆使用了
in-air gestures調整焦距、用手指按按鈕改變亮度，最後
按下了快門。
• 拍完照之後再把手機抓住，放入口袋。

11. USE CASE II
• Haptic feedback:
• Andy在玩賽車遊戲，Third Hand能夠把手腕當做支點、
產生對於手指的各方向轉動和位移， 將遊戲中的高低起伏
和衝撞等等force feedback表現出來。

12. OUTLINE
• Motivation
• Device
• Implementation
• Application
• Study
• Issues

13. DEVICE

14. DEVICE

15. DEVICE

16. DEVICE

17. OUTLINE
• Motivation
• Device
• Implementation
• Application
• Study
• Issues

18. IMPLEMENTATION
Fix position and rotation
relative to head.
Implementation:
• Camera on phone
• AR tag on face
• Using Forward Kinematics decide position and rotation
relative to wrist
• Decide every motor by Inverse Kinematics

19. OUTLINE
• Motivation
• Device
• Implementation
• Application
• Study

20. APPLICATION
• Single-handed gestures
• Haptic feedback

21. OFF-SCREEN SINGLE
HAND GESTURES
• In-air gestures
• Back-device-touch
• Others

22. HAPTIC FEEDBACK
• Racing car game
• Photo taking tutorial

23. OUTLINE
• Motivation
• Device
• Implementation
• Application
• Study
• Issues

24. STUDY
• Force
• Different by voltage
• Different by Angle (?)
• Comfortable
• The conflict between two force, on fingers
and on the wrist.
• Experience

25. ISSUES
• How to study?
• The relation between wrist, robot arm, phone itself.
• 手機用手臂抓手？
• 手用手臂抓手機？
• 手機和手被手臂抓住？
• 手抓手臂、手臂再抓手機？
• 手機抓手臂、手臂再抓手機？
• 手臂抓手、手臂再抓手機？
• 手臂抓手機、手臂再抓手？

26. SUMMARY
• Third hand is a novel concept, explore
new possibilities of mobile device in
single-handed gestures and haptic
feedback.

27. Thank You