By
Samuel Kibbs
Computer Vision Based Interfaces
Introduction
Computer vision based interfaces (CVBI)is one of the
emerging HCI technologies.
This technology enables the computer to acquire and process
images and gestures.
It enables computers to interpret gestures such as waving and
raising hands.
It also enable computers to gather information from the
environment through computer sight/ observation.
Concept
Vision is one the main avenues that human use to collect
information.
CVBI technology seek to equip computers with the same
capability.
It seek to enable computers to collect and analyze
information from the environment through visualization.
It entails fitting computers with capabilities for collecting
and processing information from images.
Technologies
1. Image acquisition device: Act as the computer eyes as it relays
image to the computer. May include:
 Light sensitive cameras
 Sensors
 Radar imaging
 Structured-light 3D scanners
 Magnetic resonance imaging
2. Image understanding system/ Graphic Processing units
 Processes the image conveyed to the computer
 May process primitive features such as shape, size and texture
 May also process advanced features such as events, objects, and
scenes.
Application
Consumer electronics such as televisions.
Mechanical systems such as elevators
Computer games
Visualization systems
Modeling environments or objects
Estimating position of objects
Facial recognition in security systems
Application
Scene reconstruction in law enforcement
Event detection in surveillance activities
Object recognition
Navigation
Automatic inspection of industrial machines
Motion analysis
Image restoration
Benefits
Enables users to communicate with computing devices at a
distance without physical contact.
Beneficial to users with physical disability
Also suitable in situation where speech commands would
cause nuisance.
Development Challenges
The computer could interpret any kind of activity within the
environment as a manipulating action.
There is no single method of image recognition that is
suitable for all applications.
There are also challenges of reliability, cost and speed.
References
Tofighi, G., Raahemifar, K., Frank, M., & Gu, H. (2016).
Vision-based engagement detection in virtual reality. Paper
presented at the Digital Media Industry and Academic Forum.
Santorini, Greece.
Badi, H., (2016). A survey on recent vision-based gesture
recognition. Intelligent Industrial Systems, 2(2), 179- 191.
References
Tofighi, G., Raahemifar, K., Frank, M., & Gu, H. (2016).
Vision-based engagement detection in virtual reality. Paper
presented at the Digital Media Industry and Academic Forum.
Santorini, Greece.
Badi, H., (2016). A survey on recent vision-based gesture
recognition. Intelligent Industrial Systems, 2(2), 179- 191.

Computer Vision Based Interfaces

  • 1.
  • 2.
    Introduction Computer vision basedinterfaces (CVBI)is one of the emerging HCI technologies. This technology enables the computer to acquire and process images and gestures. It enables computers to interpret gestures such as waving and raising hands. It also enable computers to gather information from the environment through computer sight/ observation.
  • 3.
    Concept Vision is onethe main avenues that human use to collect information. CVBI technology seek to equip computers with the same capability. It seek to enable computers to collect and analyze information from the environment through visualization. It entails fitting computers with capabilities for collecting and processing information from images.
  • 4.
    Technologies 1. Image acquisitiondevice: Act as the computer eyes as it relays image to the computer. May include:  Light sensitive cameras  Sensors  Radar imaging  Structured-light 3D scanners  Magnetic resonance imaging 2. Image understanding system/ Graphic Processing units  Processes the image conveyed to the computer  May process primitive features such as shape, size and texture  May also process advanced features such as events, objects, and scenes.
  • 5.
    Application Consumer electronics suchas televisions. Mechanical systems such as elevators Computer games Visualization systems Modeling environments or objects Estimating position of objects Facial recognition in security systems
  • 6.
    Application Scene reconstruction inlaw enforcement Event detection in surveillance activities Object recognition Navigation Automatic inspection of industrial machines Motion analysis Image restoration
  • 7.
    Benefits Enables users tocommunicate with computing devices at a distance without physical contact. Beneficial to users with physical disability Also suitable in situation where speech commands would cause nuisance.
  • 8.
    Development Challenges The computercould interpret any kind of activity within the environment as a manipulating action. There is no single method of image recognition that is suitable for all applications. There are also challenges of reliability, cost and speed.
  • 9.
    References Tofighi, G., Raahemifar,K., Frank, M., & Gu, H. (2016). Vision-based engagement detection in virtual reality. Paper presented at the Digital Media Industry and Academic Forum. Santorini, Greece. Badi, H., (2016). A survey on recent vision-based gesture recognition. Intelligent Industrial Systems, 2(2), 179- 191.
  • 10.
    References Tofighi, G., Raahemifar,K., Frank, M., & Gu, H. (2016). Vision-based engagement detection in virtual reality. Paper presented at the Digital Media Industry and Academic Forum. Santorini, Greece. Badi, H., (2016). A survey on recent vision-based gesture recognition. Intelligent Industrial Systems, 2(2), 179- 191.