1. KCET 01.04.2011
BLUE EYES
TECHNOLOGY
Human operator
monitoring system
presented by
DIVYA MOHAN
S.NAGA PRIYA
1
2. KCET 01.04.2011
?
WHAT IS BLUE EYES TECHNOLOGY?
Aims at creating computational machines
that have perceptual and sensory ability.
Use camera and microphone to identify
user actions and emotions
2
3. KCET 01.04.2011
THE TERM BLUE EYES
BLUE in the term stands for Bluetooth,
which enables reliable wireless
communication
EYES , because the eye movement enables
us to obtain a lot of interesting and
important information.
3
4. KCET 01.04.2011
NEED OF BLUE EYES TECHNOLOGY
To built a machine that can understand
your emotions
A pc that can listen, talk or scream
Verify your identity, feels your presence
and interact with you.
4
5. KCET 01.04.2011
TECHNOLGIES USED
Emotion Mouse
Manual And Gaze Input Cascaded (MAGIC)
Artificial Intelligent Speech Recognition
Simple User Interest Tracker (SUITOR)
The eye movement Sensor
5
6. KCET 01.04.2011
EMOTION MOUSE
Simplest way
People spend approximately
1/3 of their total computer
time touching input device
Physiological data is
obtained and emotional
state is determined
A user model will be
built that reflects the
personality of user. 6
8. KCET 01.04.2011
IBM RESEARCH
BLUE EYE – EMOTIONAL MOUSE
sensors in the mouse ,sense the physiological
attributes which are correlated to emotions using
corr- -elation model -by simply touching the
mouse ,the computer will be able to determine a
person’s emotional state.
BLUE EYE enabled TELEVISION
– could become active when the user makes an eye
contact.
8
9. KCET 01.04.2011
MAGIC POINTING
Reduce the cursor movement needed for target
selection
Click on the target with a regular manual
input device
Two magic pointing techniques
Liberal
Conservative
9
10. KCET 01.04.2011
APPROACHES
LIBERAL APPROACH
To warp the cursor to every new object user
looks at
CONSERVATIVE APPROACH
Does not warp the cursor target until the
manual input device has been actuated
10
11. KCET 01.04.2011
ARTIFICIAL INTELLIGIENT
SPEECH RECOGNITION
Input words are scanned and matched against
internally stored words
Identification causes some action to be taken
User speaks to the computer through microphone
Filtered and fed to ADC and then stored in RAM
pattern matching is designed to look for the best fit
because of variations in loudness, pitch, frequency
difference, time gap etc.
11
12. KCET 01.04.2011
APPLICATION OF ARTIFICIAL
INTELLIGIENT SPEECH RECOGNITION
To control weapons by voice commands
Pilot give commands to computers by speaking
into microphones
Can be connected to word processors and
instead of writing, simply dictate to them
12
13. KCET 01.04.2011
SUITOR
Help by fetching more information at
desktop
Notice where the user’s eyes focus on the
screen
Fills a scrolling ticker on a computer screen
with information related to user’s task
Ex. If reading headline ,pops up the story in
the browser window 13
14. KCET 01.04.2011
THE EYE MOVEMENT SENSOR
DESIGNING
A personal area network for linking all the
operators and the supervising system
Two major units
- DAU (data acquisition unit )
- CSU (central system unit )
14
15. KCET 01.04.2011
DAU
The DAU consists of the following components
ATMEL 8952 microcontroller
BLUE TOOTH MODULE – supports
synchronous voice
data transmission
central system sound feedback
microcontroller (115200 bps)
ALPHAUNUMERIC LCD display
LED indicators
ID CARD interface
15
16. KCET 01.04.2011
DAU - FEATURES
Data Acquisition Unit Lightweight
Atmel 89C52 Runs on batteries - low
microcontroller Bluetooth
power consumption
Jazz Easy to use - does not
Multisensor
disturb the operator
working
ID cards for operator
authorization
Voice transmission using 16
hardware PCM codec
17. KCET 01.04.2011
MICROCONTROLLER & BLUE
TOOTH MODULE
17
18. KCET 01.04.2011
CSU – COMPONENTS
CONNECTION MANAGER – main task to
perform low-level blue tooth communication
DATA ANALYSIS MODULE – performs the
analysis of the raw sensor data
DATA LOGGER MODULE – provides
support
for storing the monitored data.
VISULAIZATION MODULE – provides user
18
interface for the supervisors
19. KCET 01.04.2011
CSU FEATURES
Central System Unit
Connection management
Connection Visualization
Bluetooth
Data processing Manager Module
Data
Data Analysis
Logger
Data recording
Access verification
System maintenance
19
21. KCET 01.04.2011
FUTURE IMPROVEMENTS
DAU
small CMOS camera to monitor the
operator’s point of gaze single PCB (SMD
technology) low voltage ICs
CSU
data mining algorithms advanced data-
base encryption using
21
22. KCET 01.04.2011
EXPERIMENT
Measurement of heart rate, temperature,
galvanic skin response (GSR), general
somatic activity
Six basic emotions are anger, fear, sadness,
disgust, joy and surprise
22
23. KCET 01.04.2011
DATA SECURITY
Only registered mobile devices can connect
to the system
Bluetooth connection authentication
Bluetooth connection encryption
Access rights restrictions
Personal and physiological data encryption
23
24. KCET 01.04.2011
APPLICATIONS
In retailing record and interpret customer
movements
In automobile industry
In video games
To create “Face Responsive Display” and
“Perceptive Environment” Generic control
rooms
Power station
Flight control centres
o Operating theatres 24
25. KCET 01.04.2011
BLUE EYES ENABLED DEVICES
POD
Technology used in
cars
PONG
A Robot
25
26. KCET 01.04.2011
CONCLUSION
Provide more delicate and user friendly facilities
in computing devices
Gap between the electronic and physical world is
reduced
The computers can be run using implicit
commands instead of the explicit commands
26
27. KCET 01.04.2011
REFERENCES
n www.seminar4u.com
n www.howstuffswork.com
n www.cs.put.poznan.com
n www.whitepapers.com
n www.ibmresearchcenter.com
n www.almaden.ibm.com
27
