This document discusses potential hand gesture interfaces for interacting with digital interfaces and screens. It outlines several approaches including using the hand as a mouse cursor, highlighting objects as the hand moves over them, using an animated 3D hand model, and overlaying an augmented hand onto the UI. For each approach, pros and cons are listed. Key themes discussed are providing feedback to the user, designing interfaces that are intuitive to operate and avoid fatigue, and handling selection vs activation.
3. Pros:
• Extension of current
paradigm
• Uses only 2D
• Constant feedback to user
Cons:
• Leads to fatigue
• Accuracy
• Standard UI
difficult to operate
Hand/finger becomes the mouse cursor
3Oliver Schreck2015-10-20
4. Pros:
• No issues of
accuracy
• Fewer false selection
due to big buttons
Cons:
• Chang in the
interface design
• No constant
feedback to user
As hand moves over objects they are highlighted
4Oliver Schreck2015-10-20
5. Pros:
• Very detail
feedback
• Virtual reality
feeling
• Immersive world
Cons:
• “Uncanny valley”, create a hand
that user wants to use
• Very sensitive to tracking
• Requires certain amount of
control
• High sensitivity to the
perspective of the interface
Animated 3D model that reaches into the screen
5Oliver Schreck2015-10-20
6. Pros:
• Intuitive
• Constant feedback
• Use of all 3 dimensions
• No pointer required, the
hand is the pointer
Cons:
• Re-design of UI and
interaction
• Unclear definition of
selector
• Obscuring of elements
A augmented Hand is overlaid onto the UI
6Oliver Schreck2015-10-20
8. Old interfaces are designed for mouse
The finger is not a mouse
Gesture adds value, without replacing the keyboard and mouse
8Oliver Schreck2015-10-20
14. • Avoid frustration of user,
if selection does not work
• Signalize the user when
he is leaving the
“Effective Interaction Zone”
14Oliver Schreck2015-10-20
25. Simulate a touchscreen in the air
- Provide visual feedback to the user
- No haptic feedback
- Separates action from selection
- Selection before wall
- Action after wall
25Oliver Schreck2015-10-20
26. Corel Painter interaction with Leapmotion
- Hover zone for selection
- Painting zone for action
Color selector
- Select color
- Stay on one color for a certain time
circle will fill
26Oliver Schreck2015-10-20
28. Pros:
• Easy to select
• Good feedback due
to AR hand
• Clear how to interact
Cons:
• High fatigue
• Hand would obscure the
menus on the screen
• Right handed difficult to
select left menu
28Oliver Schreck2015-10-20