2. WHAT IS BLUE EYES TECHNOLOGY?
Aims at creating computational machines
that have perceptual and sensory ability.
Use camera and microphone to identify
user actions and emotions
?
KCET 01.04.2011
2
3. THE TERM BLUE EYES
BLUE in the term stands for Bluetooth,
which enables reliable wireless
communication
EYES , because the eye movement enables
us to obtain a lot of interesting and
important information.
KCET 01.04.2011
3
4. NEED OF BLUE EYES TECHNOLOGY
To built a machine that can understand
your emotions
A pc that can listen, talk or scream
Verify your identity, feels your presence
and interact with you.
KCET 01.04.2011
4
5. TECHNOLGIES USED
Emotion Mouse
Manual And Gaze Input Cascaded (MAGIC)
Artificial Intelligent Speech Recognition
Simple User Interest Tracker (SUITOR)
The eye movement Sensor
KCET 01.04.2011
5
6. EMOTION MOUSE
Simplest way
People spend approximately
1/3 of their total computer
time touching input device
Physiological data is
obtained and emotional
state is determined
A user model will be
built that reflects the
personality of user.
KCET 01.04.2011
6
8. IBM RESEARCH
BLUE EYE – EMOTIONAL MOUSE
sensors in the mouse ,sense the physiological
attributes which are correlated to emotions using
corr- -elation model -by simply touching the
mouse ,the computer will be able to determine a
person’s emotional state.
BLUE EYE enabled TELEVISION
– could become active when the user makes an eye
contact.
KCET 01.04.2011
8
9. MAGIC POINTING
Reduce the cursor movement needed for target
selection
Click on the target with a regular manual
input device
Two magic pointing techniques
Liberal
Conservative
KCET 01.04.2011
9
10. APPROACHES
LIBERAL APPROACH
To warp the cursor to every new object user
looks at
CONSERVATIVE APPROACH
Does not warp the cursor target until the
manual input device has been actuated
KCET 01.04.2011
10
11. ARTIFICIAL INTELLIGIENT
SPEECH RECOGNITION
Input words are scanned and matched against
internally stored words
Identification causes some action to be taken
User speaks to the computer through microphone
Filtered and fed to ADC and then stored in RAM
pattern matching is designed to look for the best fit
because of variations in loudness, pitch, frequency
difference, time gap etc.
KCET 01.04.2011
11
12. APPLICATION OF ARTIFICIAL
INTELLIGIENT SPEECH RECOGNITION
To control weapons by voice commands
Pilot give commands to computers by speaking
into microphones
Can be connected to word processors and
instead of writing, simply dictate to them
KCET 01.04.2011
12
13. SUITOR
Help by fetching more information at
desktop
Notice where the user’s eyes focus on the
screen
Fills a scrolling ticker on a computer screen
with information related to user’s task
Ex. If reading headline ,pops up the story in
the browser window
KCET 01.04.2011
13
14. THE EYE MOVEMENT SENSOR
DESIGNING
A personal area network for linking all the
operators and the supervising system
Two major units
- DAU (data acquisition unit )
- CSU (central system unit )
KCET 01.04.2011
14
15. DAU
The DAU consists of the following components
ATMEL 8952 microcontroller
BLUE TOOTH MODULE – supports
synchronous voice
data transmission
central system sound feedback
microcontroller (115200 bps)
ALPHAUNUMERIC LCD display
LED indicators
ID CARD interface
KCET 01.04.2011
15
16. DAU - FEATURES
Lightweight
Runs on batteries - low
power consumption
Easy to use - does not
disturb the operator
working
ID cards for operator
authorization
Voice transmission using
hardware PCM codec
Data Acquisition Unit
Atmel 89C52
microcontroller
Jazz
Multisensor
Bluetooth
KCET 01.04.2011
16
18. CSU – COMPONENTS
CONNECTION MANAGER – main task to
perform low-level blue tooth communication
DATA ANALYSIS MODULE – performs the
analysis of the raw sensor data
DATA LOGGER MODULE – provides
support
for storing the monitored data.
VISULAIZATION MODULE – provides user
interface for the supervisors
KCET 01.04.2011
18
19. CSU FEATURES
Central System Unit
Connection
Manager
Data Analysis
Visualization
ModuleBluetooth
Connection
Manager
Data
Logger
Connection management
Data processing
Data recording
Access verification
System maintenance
KCET 01.04.2011
19
21. FUTURE IMPROVEMENTS
DAU
small CMOS camera to monitor the
operator’s point of gaze single PCB (SMD
technology) low voltage ICs
CSU
data mining algorithms advanced data-
base encryption using
KCET 01.04.2011
21
22. EXPERIMENT
Measurement of heart rate, temperature,
galvanic skin response (GSR), general
somatic activity
Six basic emotions are anger, fear, sadness,
disgust, joy and surprise
KCET 01.04.2011
22
23. DATA SECURITY
Only registered mobile devices can connect
to the system
Bluetooth connection authentication
Bluetooth connection encryption
Access rights restrictions
Personal and physiological data encryption
KCET 01.04.2011
23
24. APPLICATIONS
In retailing record and interpret customer
movements
In automobile industry
In video games
To create “Face Responsive Display” and
“Perceptive Environment” Generic control
rooms
Power station
Flight control centres
o Operating theatres
KCET 01.04.2011
24
25. BLUE EYES ENABLED DEVICES
POD
Technology used in
cars
PONG
A Robot
KCET 01.04.2011
25
26. CONCLUSION
Provide more delicate and user friendly facilities
in computing devices
Gap between the electronic and physical world is
reduced
The computers can be run using implicit
commands instead of the explicit commands
KCET 01.04.2011
26
27. REFERENCES
n www.seminar4u.com
n www.howstuffswork.com
n www.cs.put.poznan.com
n www.whitepapers.com
n www.ibmresearchcenter.com
n www.almaden.ibm.com
KCET 01.04.2011
27
