The document discusses Blue Eyes technology, which aims to create machines that can perceive users' actions and emotions using cameras and microphones. It can identify users through eye movements, facial expressions, and physiological signals to understand emotions. The technology uses sensors in input devices like mice to determine emotional state. It also allows devices like televisions to react to eye contact. The document outlines several technologies used in Blue Eyes, such as MAGIC pointing and SUITOR, and describes applications in security monitoring, gaming, and vehicle control.

1. KCET 01.04.2011
BLUE EYES
TECHNOLOGY
Human operator
monitoring system
presented by
DIVYA MOHAN
S.NAGA PRIYA
1

2. KCET 01.04.2011
?
WHAT IS BLUE EYES TECHNOLOGY?
 Aims at creating computational machines
that have perceptual and sensory ability.
 Use camera and microphone to identify
user actions and emotions
2

3. KCET 01.04.2011
THE TERM BLUE EYES
 BLUE in the term stands for Bluetooth,
which enables reliable wireless
communication
 EYES , because the eye movement enables
us to obtain a lot of interesting and
important information.
3

4. KCET 01.04.2011
NEED OF BLUE EYES TECHNOLOGY
 To built a machine that can understand
your emotions
 A pc that can listen, talk or scream
 Verify your identity, feels your presence
and interact with you.
4

5. KCET 01.04.2011
TECHNOLGIES USED
 Emotion Mouse
 Manual And Gaze Input Cascaded (MAGIC)
 Artificial Intelligent Speech Recognition
 Simple User Interest Tracker (SUITOR)
 The eye movement Sensor
5

6. KCET 01.04.2011
EMOTION MOUSE
 Simplest way
 People spend approximately
1/3 of their total computer
time touching input device
 Physiological data is
obtained and emotional
state is determined
 A user model will be
built that reflects the
personality of user. 6

7. KCET 01.04.2011
7

8. KCET 01.04.2011
IBM RESEARCH
BLUE EYE – EMOTIONAL MOUSE
sensors in the mouse ,sense the physiological
attributes which are correlated to emotions using
corr- -elation model -by simply touching the
mouse ,the computer will be able to determine a
person’s emotional state.
BLUE EYE enabled TELEVISION
– could become active when the user makes an eye
contact.
8

9. KCET 01.04.2011
MAGIC POINTING
 Reduce the cursor movement needed for target
selection
 Click on the target with a regular manual
input device
 Two magic pointing techniques
 Liberal
 Conservative
9

10. KCET 01.04.2011
APPROACHES
 LIBERAL APPROACH
To warp the cursor to every new object user
looks at
 CONSERVATIVE APPROACH
Does not warp the cursor target until the
manual input device has been actuated
10

11. KCET 01.04.2011
ARTIFICIAL INTELLIGIENT
SPEECH RECOGNITION
 Input words are scanned and matched against
internally stored words
 Identification causes some action to be taken
User speaks to the computer through microphone
 Filtered and fed to ADC and then stored in RAM
 pattern matching is designed to look for the best fit
because of variations in loudness, pitch, frequency
difference, time gap etc.
11

12. KCET 01.04.2011
APPLICATION OF ARTIFICIAL
INTELLIGIENT SPEECH RECOGNITION
 To control weapons by voice commands
 Pilot give commands to computers by speaking
into microphones
 Can be connected to word processors and
instead of writing, simply dictate to them
12

13. KCET 01.04.2011
SUITOR
 Help by fetching more information at
desktop
 Notice where the user’s eyes focus on the
screen
 Fills a scrolling ticker on a computer screen
with information related to user’s task
 Ex. If reading headline ,pops up the story in
the browser window 13

14. KCET 01.04.2011
THE EYE MOVEMENT SENSOR
DESIGNING
 A personal area network for linking all the
operators and the supervising system
Two major units
- DAU (data acquisition unit )
- CSU (central system unit )
14

15. KCET 01.04.2011
DAU
 The DAU consists of the following components
 ATMEL 8952 microcontroller
 BLUE TOOTH MODULE – supports
synchronous voice
 data transmission
 central system sound feedback
 microcontroller (115200 bps)
 ALPHAUNUMERIC LCD display
 LED indicators
 ID CARD interface
15

16. KCET 01.04.2011
DAU - FEATURES
Data Acquisition Unit  Lightweight
Atmel 89C52  Runs on batteries - low
microcontroller Bluetooth
power consumption
Jazz  Easy to use - does not
Multisensor
disturb the operator
working
 ID cards for operator
authorization
 Voice transmission using 16
hardware PCM codec

17. KCET 01.04.2011
MICROCONTROLLER & BLUE
TOOTH MODULE
17

18. KCET 01.04.2011
CSU – COMPONENTS
CONNECTION MANAGER – main task to
perform low-level blue tooth communication
DATA ANALYSIS MODULE – performs the
analysis of the raw sensor data
 DATA LOGGER MODULE – provides
support
for storing the monitored data.
 VISULAIZATION MODULE – provides user
18
interface for the supervisors

19. KCET 01.04.2011
CSU FEATURES
Central System Unit
Connection management
Connection Visualization
Bluetooth
 Data processing Manager Module
Data
Data Analysis
Logger
 Data recording
Access verification
System maintenance
19

20. KCET 01.04.2011
MULTISENSORS
20

21. KCET 01.04.2011
FUTURE IMPROVEMENTS
 DAU
small CMOS camera to monitor the
operator’s point of gaze single PCB (SMD
technology) low voltage ICs
 CSU
data mining algorithms advanced data-
base encryption using
21

22. KCET 01.04.2011
EXPERIMENT
 Measurement of heart rate, temperature,
galvanic skin response (GSR), general
somatic activity
 Six basic emotions are anger, fear, sadness,
disgust, joy and surprise
22

23. KCET 01.04.2011
DATA SECURITY
 Only registered mobile devices can connect
to the system
 Bluetooth connection authentication
 Bluetooth connection encryption
 Access rights restrictions
 Personal and physiological data encryption
23

24. KCET 01.04.2011
APPLICATIONS
 In retailing record and interpret customer
movements
 In automobile industry
 In video games
 To create “Face Responsive Display” and
“Perceptive Environment” Generic control
rooms
 Power station
 Flight control centres
o Operating theatres 24

25. KCET 01.04.2011
BLUE EYES ENABLED DEVICES
 POD
Technology used in
cars
 PONG
A Robot
25

26. KCET 01.04.2011
CONCLUSION
 Provide more delicate and user friendly facilities
in computing devices
 Gap between the electronic and physical world is
reduced
 The computers can be run using implicit
commands instead of the explicit commands
26

27. KCET 01.04.2011
REFERENCES
 n www.seminar4u.com
 n www.howstuffswork.com
 n www.cs.put.poznan.com
 n www.whitepapers.com
 n www.ibmresearchcenter.com
 n www.almaden.ibm.com
27

28. KCET 01.04.2011
Thank u…
ANY
QUESTIONS ???
28