This document discusses several next generation user interfaces including gesture interfaces, augmented reality, voice user interfaces, and tangible user interfaces. Gesture interfaces allow interaction through bodily motions detected by cameras or sensors. Augmented reality enhances the real world with computer-generated perceptual information. Voice user interfaces enable interaction through speech. Tangible user interfaces couple physical objects with digital information for manipulation. These emerging interfaces provide more natural, intuitive ways for humans to interact with technology beyond the traditional graphical user interface.

1. 1
NEXT GENERATION
USER INTERFACES
HARSHAD K T
S5 MCA
Roll NO: DOALMCA013
NIELIT CALICUT

2. Contents
 Introduction
Technologies
 Gesture Interfaces
 Augmented Reality (AR)
 Voice User Interface (VUI)
 Tangible User Interface (TUI)
 Conclusion
 References

3. INTRODUCTION
• User Interface
• Graphical User Interface (GUI)
 User interfaces provide a means of
 Input, allowing the users to manipulate a system
 Output, allowing the system to indicate the effects of the users'
manipulation

4. Here are some key features of
1. Gesture Interfaces
2. Augmented Reality (AR)
3. Voice User Interface (VUI)
4. Tangible User Interface (TUI)

5. Gesture Interfaces
 Gesture recognition is a topic in computer science interpreting
human gestures via mathematical algorithms.
 Gestures can originate from any bodily motion (commonly
originate from the face or hand )
 It enables humans to communicate with the machine
 Gestures enabled applications provide interface to interact with the
system

6. Gesture types
•Offline gestures : Those gestures that are processed after the
user interaction with the object. An example is the gesture to
activate a menu.
•Online gestures : Direct manipulation gestures. They are used
to scale or rotate a tangible object.

7. Uses of gestures interfaces
1.
Sign language recognition
2. Control through facial gestures
3.
Alternative computer interfaces
4.
Immersive game technology
5. Affective computing
6.
Remote control

8. Input devices
1. Wired gloves
Data glove
2. Depth-aware cameras
3. Controller-based gestures
4. Single camera
Depth aware camera

9. Sixth Sense Technology (Example system )
'Sixth Sense' is a wearable gestural interface that augments the
physical world around us with digital information and lets us
use natural hand gestures to interact with that information
Pranav mistry , inventor of the SixthSense

10. • prototype is comprised of a Pocket Projector, a Mirror and a Camera
• connected with the mobile computing device in the user’s pocket.
• The software program processes the video stream data captured by the
camera and tracks the locations of the colored markers
• Sixth Sense also supports multi-touch and multi-user interaction

11. Applications
 Navigate a map
 Multi-touch based systems
 Zoom in, zoom out
 Drawing application
 Takes photos using “framing” gestures
 It augments the physical objects

12. Devices used
Navigation, Zoom in / zoom out
Taking photos with gestures
Augmented reality using 6th sense
technology

13. Augmented Reality (AR)
Augmented reality (AR) is a live, copy view of real-world environment
whose elements are augmented by computer-generated sensory input
such as sound, video, graphics or GPS data

14. AR enabled camera
Gaming Application
Navigation
Live AU

15. Devices Used
 Hardware
 Display
 Head-mounted Display
HMD
 Eyeglasses
 Contact lenses
 EyeTap
 Handheld
 Spatial Augmented reality
Contact lenses
 Input devices
EyeTap

16. Applications
 Architecture
Google Glass view
 Commerce
 Education
 Gaming
 Medical
 Military
Education
 Navigation
Navigation
Commerc
e

17. Voice User Interface (VUI)
A voice–user interface (VUI) makes human interaction
with computers possible through a voice/speech platform in order to
initiate an automated service or process.

18. Future Uses
1.
Smart phone and PDA`s working
2.
Helps the people who are slow in typing, (avoids straining and
Injuries )
3.
Helps the handicapped people
4.
Facilitate to create portable devices (with no keyboard, no separation
between content and keyboard on the touch screen )
5.
Reduce the devices half in size ( laptop computers , desktop, sliding
mobile devices)

19. 1. The VUI must be sophisticated enough to distinguish between the
input commands, and background conversation
2. It need highly sophisticated software in order to accurately process
and find or retrieve as per the particular user's preferences

20. Example gadget : Google glass
Samsung S-voice

21. Understanding Speech Technology
 Barge-In
 Grammar
 Tuning
 Voice User Interface
 VXML
 The Voice XML Specification
 The Voice XML Advantage

22. Tangible User Interface
A tangible user interface (TUI) is a user interface in which a person
interacts with digital information through the physical environment.

23. Characteristics TUI

Physical representations are computationally coupled to
underlying digital information.

Physical representations with visible/ tangible interfaces for
interactive control.

Aware of physical objects through sensors and coupled to digital
representation

24. Properties of tangible user interfaces
•
space-multiplex both input and output
•
concurrent access
•
spatially aware (position, area, size… etc)

25. Object recognition in TUI

26. Surface computing
Surface computing enables user to interact directly with the system
Without using keyboard and mouse
Features
Direct interaction
Multi user experience
Multi touch
Object recognition

27. Application
• Used in hotel, restaurants and retails stores
• In casinos (watch video , games, navigation, ..etc)
• Digital image painting
Advantages
Disadvantages

Wireless communication
Not portable

Time saving
Very Expansive

New and improved learning
experience

28. Surface commuting systems
Microsoft pixelsense

29. CONCLUSION
 Next Generation user interfaces are focused on real world objects
 The future electronic gadgets will be working on the above discussed
concepts
 Many of these technologies are implemented now and some of them
are in developing stage
 The trend changes in Electronics and IT will make effect on future
user interfaces also

30. REFERENCES
1.
www.hongkiat.com/blog/next-gen-user-interface
2.
www.hongkiat.com/blog/cool-futuristicconcept-gadgets-that-really-inspires
3.
en.wikipedia.org/wiki/Gesture_recognition
4.
www.ted.com/talks/john_underkoffler_drive_3d_data_with_a_gesture
5.
www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_tech
nology
6.
en.wikipedia.org/wiki/Voice_user_interface
7.
mashable.com/category/augmented-reality
8.
www.google.com/glass/start

31. TED talks References
John Underkoffler
(Gestures interfaces)
( www.ted.com )
Pranav Mistry
(Sixth sense technology)
Tomi Ahonen
(Augmented reality)
TED is a global set of conferences owned by the private non-profit Sapling Foundation

32. Thank you