2. WHAT IS BLUE EYES TECHNOLOGY?
Aims at creating computational machines that
have perceptual and sensory ability.
Use camera and microphone to identify user
actions and emotions
?
01.04.2011
2
3. THE TERM BLUE EYES
BLUE in the term stands for Bluetooth,
which enables reliable wireless communication
EYES , because the eye movement enables
us to obtain a lot of interesting and
important information.
01.04.2011
3
4. NEED OF BLUE EYES TECHNOLOGY
To built a machine that can understand your
emotions
A pc that can listen, talk or scream
Verify your identity, feels your presence and
interact with you.
01.04.2011
4
5. TECHNOLGIES USED
Emotion Mouse
Manual And Gaze Input Cascaded (MAGIC)
Artificial Intelligent Speech Recognition
Simple User Interest Tracker (SUITOR)
The eye movement Sensor
01.04.2011
5
6. EMOTION MOUSE
Simplest way
People spend approximately
1/3 of their total computer
time touching input device
Physiological data is
obtained and emotional
state is determined
A user model will be
built that reflects the
personality of user.
01.04.2011
6
8. IBM RESEARCH
BLUE EYE – EMOTIONAL MOUSE sensors
in the mouse ,sense the physiological attributes
which are correlated to emotions using corr- -
elation model -by simply touching the mouse ,the
computer will be able to determine a person’s
emotional state.
BLUE EYE enabled TELEVISION
– could become active when the user makes an eye
contact.
01.04.2011
8
9. MAGIC POINTING
Reduce the cursor movement needed for target
selection
Click on the target with a regular manual input
device
Two magic pointing techniques
Liberal
Conservative
01.04.2011
9
10. APPROACHES
LIBERAL APPROACH
To warp the cursor to every new object user
looks at
CONSERVATIVE APPROACH
Does not warp the cursor target until the
manual input device has been actuated
01.04.2011
10
11. ARTIFICIAL INTELLIGIENT
SPEECH RECOGNITION
Input words are scanned and matched against internally
stored words
Identification causes some action to be taken
User speaks to the computer through microphone
Filtered and fed to ADC and then stored in RAM
pattern matching is designed to look for the best fit
because of variations in loudness, pitch, frequency
difference, time gap etc.
01.04.2011
11
12. APPLICATION OF ARTIFICIAL INTELLIGIENT
SPEECH RECOGNITION
To control weapons by voice commands
Pilot give commands to computers by speaking into
microphones
Can be connected to word processors and instead of
writing, simply dictate to them
01.04.2011
12
13. SUITOR
Help by fetching more information at desktop
Notice where the user’s eyes focus on the
screen
Fills a scrolling ticker on a computer screen
with information related to user’s task
Ex. If reading headline ,pops up the story in the
browser window
01.04.2011
13
14. THE EYE MOVEMENT SENSOR
DESIGNING
A personal area network for linking all the operators
and the supervising system
Two major units
- DAU (data acquisition unit )
- CSU (central system unit )
01.04.2011
14
15. DAU
The DAU consists of the following components
ATMEL 8952 microcontroller
BLUE TOOTH MODULE – supports synchronous
voice
data transmission
central system sound feedback
microcontroller (115200 bps)
ALPHAUNUMERIC LCD display
LED indicators
ID CARD interface
01.04.2011
15
16. DAU - FEATURES
Lightweight
Runs on batteries - low
power consumption
Easy to use - does not
disturb the operator
working
ID cards for operator
authorization
Voice transmission using
hardware PCM codec
Data Acquisition Unit
Atmel 89C52
microcontroller
Jazz
Multisensor
Bluetooth
01.04.2011
16
18. CSU – COMPONENTS
CONNECTION MANAGER – main task to
perform low-level blue tooth communication
DATA ANALYSIS MODULE – performs the
analysis of the raw sensor data
DATA LOGGER MODULE – provides support
for storing the monitored data.
VISULAIZATION MODULE – provides user
interface for the supervisors
01.04.2011
18
19. CSU FEATURES
Central System Unit
Connection
Manager
Data Analysis
Visualization
ModuleBluetooth
Connection
Manager
Data
Logger
Connection management
Data processing
Data recording
Access verification
System maintenance
01.04.2011
19
21. FUTURE IMPROVEMENTS
DAU
small CMOS camera to monitor the
operator’s point of gaze single PCB (SMD
technology) low voltage ICs
CSU
data mining algorithms advanced data-
base encryption using
01.04.2011
21
22. EXPERIMENT
Measurement of heart rate, temperature,
galvanic skin response (GSR), general somatic
activity
Six basic emotions are anger, fear, sadness,
disgust, joy and surprise
01.04.2011
22
23. DATA SECURITY
Only registered mobile devices can connect to
the system
Bluetooth connection authentication
Bluetooth connection encryption
Access rights restrictions
Personal and physiological data encryption
01.04.2011
23
24. APPLICATIONS
In retailing record and interpret customer
movements
In automobile industry
In video games
To create “Face Responsive Display” and
“Perceptive Environment” Generic control
rooms
Power station
Flight control centres
o Operating theatres
01.04.2011
24
25. BLUE EYES ENABLED DEVICES
POD
Technology used in
cars
PONG
A Robot
01.04.2011
25
26. CONCLUSION
Provide more delicate and user friendly facilities in
computing devices
Gap between the electronic and physical world is
reduced
The computers can be run using implicit commands
instead of the explicit commands
01.04.2011
26
27. REFERENCES
n www.seminar4u.com
n www.howstuffswork.com
n www.cs.put.poznan.com
n www.whitepapers.com
n www.ibmresearchcenter.com
n www.almaden.ibm.com
01.04.2011
27
