This document discusses alternative methods of human-computer interaction (HCI) for people with disabilities. It describes various impairments such as low vision, blindness, deafness, and motor impairments. Brain-computer interfaces are discussed as a way for paralyzed people to communicate without muscle control. Commercial BCIs and SSVEP-based BCIs are mentioned. Eye-tracking and eye-blink systems are presented for controlling HCI through eye gaze and blinking. A mouth-shape detection system is also proposed. Students have developed EMG-based and vision-based HCI systems to enhance accessibility.

1. Alternative methods
of Human-Computer Interaction
Aleksandra Królak

2. Human-Computer Interaction
Human Computer
Interaction
2Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

3. HCI and other disciplines
HCI
Engineering
Artificial
Intelligence Psychology
Computer
Science
Physiology
Antropology
Ergonomics
Linguistics
Sociology
Art
Philosophy
3Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

4. Human-machine communication
4Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

5. Disability in numbers
John Gill, 20095Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

6. Vision & Hearing Impairments
Problems:
• Low vision
• Color vision
impairments
• Blind
• Deaf
Solutions:
• Magnifier, large font
• Color schemes
• Screen readers
• Voice recognition
• Lip reading systems
• Touchplates
• Extended subtitles
6Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

7. Motor impairments
7Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

8. Brain-Computer Interface
The goal of BCI technology is to give severely paralyzed
people another way to communicate, a way that does not
depend on muscle control [Wadsworth Center]
http://www.ece.ubc.ca
Traditional Definition
8Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

9. Commercial BCI
2014-06-17 Alternative methods of Human-Computer Interaction - Aleksandra Królak 9
EPOC Emotiv
Neural Impulse
Actuator
MindWave
Necomimi Brainwave
Cat Ears

10. SSVEP-based BCIs
FFT
EEG Signal
Frequency [Hz]
Amplitude[uV]
SSVEPs for stimulation frequency and its
harmoincs
Stimulation
A
(f1)
C
(f3)
B
(f2)
D
(f4)
F
(f6)
E
(f5)
G
(f7)
I
(f9)
H
(f8)
• System developed in Medical Electronics Division, TUL
• Steady State Visually Evoked Potential (SSVEP) - natural responses
of brain to visual stimulation at specific frequencies (3.5Hz to
65Hz):
OZ channel or
O1, O2 channel pair
10Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

11. EEG spatial filtering
optimal spatial
filter
Laplace
filter
single
channel
differential
pair
graphic illustration of the filter coefficients
11Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

12. Proposed SSVEP detection method
12Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

13. Eye-controlled HCI
VisionKey
EagleEyes
VISERG
Eye Gaze
Interaction
Project
13Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

14. Eye-blink controlled HCI
 System developed in Medical
Electronics Division, TUL
 PC computer or laptop
 USB webcam
 Open source solution:
http://b-link.sourceforge.net/
14Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

15. Eye-blink detection system
Image from
webcam
Face and eyes
detection
Eye openess
analysis and
eye-blink
detection
15Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

16. Communication via eye-blinks
• short (spontaneous) <200ms
• long (voluntary) >200ms
16Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

17. On-screen keyboard
BLINK
C
17Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

18. System performance
Before training After training
Letter sequence Average time [s] Average time [s]
MAIL 40.1 35.03
NAME 46.2 39.77
MY NAME IS 111.8 93.45
INFORMATION 132.5 100.57
GOOD MORNING 141.3 108.27
18/24 Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

19. Mouth shape detection system
Image from
webcam
Face and mouth
detection
Control gesture (showing teeth) detection
19Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17

20. HCI systems developed by students
in Medical Electronics Division
0.00 1.00 2.00 3.00
seconds
-0.94
-0.47
0.0
0.47
mV
EMG(5-250Hzw/notch)
-0.83
-0.41
0.00
0.41
mV
EMG(5-250Hzw/notch)
EMG based Vision-based
20Alternative methods of Human-Computer Interaction - Aleksandra Królak2014-06-17