blue eyes technology is about human computers

2. • BLUE EYES is a technology, which aims at creating
computational machines that have perceptual and
sensory abilities like those of human beings.
• The basic idea behind this technology is to give
computer human power.
• It provides technical means for monitoring and
recording human-operator’s physiological condition.

3.  As the idea is to monitor and record operator’s basic
physiological parameters, the most important
physiological activity is the movement of eyes.
 For a computer to sense the eye movement, wiring
between operator and the system is required.
But, this is a serious limitation of the operator’s mobility
and disables his operations in large control rooms.
 So utilization of wireless technology becomes essential
which can be implemented through blue tooth technology.

4. Human error- A frequent reason of catastrophes and
accidents.
 Weariness
• Oversight
• Temporal indisposition
An aid to disabled persons.
Availability of capable sensors.

5. The complex solution for human-operator monitoring:
-conscious brain involvement monitoring
-triggering user-defined actions
-data recording
- use of BIOMETRICS
What is Blue Eyes not?
Doesn’t predict nor interfere with operator’s thoughts.
Cannot force directly the operator to work

6. Generic control rooms
-Power station
-Flight control centers
Common application
-A simpler system version for drivers
-An aid to disabled people

7. It has the ability to gather information about you and interact with
you through special techniques like facial recognition, speech
recognition, etc.
It can even understand your emotions at the touch of the mouse.
It can verify your identity, feel your presence, and start interacting
with you.
The machine can understand what a user wants, where he is
looking at, and even realize his physical or emotional states.

8. It realizes the urgency of the situation through the
mouse.
For instance if you ask the computer to dial to your
friend at his office, it understands the situation and
establishes a connection

9. Visual attention monitoring.
Physiological condition monitoring.
Operators position detection.
Wireless data acquisition using Bluetooth
technology.
Real time user defined alarm triggering.
Recorded data play back.

10.  Affective Computing
The process of making emotional computers with sensing
abilities is known as affective computing.
The steps used are:
1)Giving sensing abilities
- to give machines the equivalent of the eyes, ears, and
other sensory organs
- voice-recognition software
- cameras
2)Detecting human emotions
-by biometric techniques
3)Respond properly

11. •Affect detection:
detecting our emotional states from the expressions on
our face
•MAGIC pointing:
Manual Acquisition with Gaze Tracking Technology
•SUITOR:
Simple User Interface Tracker
•Emotion mouse:
expected accuracy is 75%

12. Facial expression detection
-face recognition
-expression detection
Speech Recognition
Emotion Mouse
-IR sensor, thermosister chip, galvanic sensor
Eye Gaze Tracking
Jazz Multi Sensor

14.  Eye position measuring - direct infrared occulography
 Oxy- and deoxyhaemoglobin measurement
 Two axial accelerometer
 Ambient light sensor
Jazz Multisensor

15. Bluetooth technology provides means for creating
a Personal Area Network linking the operators
and the central system.
Bluetooth Bluetooth
Connection
manager
Data
analysis
Visualization
module
Data logger
Atmel 89C52
microcontroller
Jazz
Multisensor

16. Data Acquisition Unit
 Atmel 89C52 microcontroller - system core
 Bluetooth module (based on ROK101008)
 HD44780 - small LCD display
 24C16 - I2C EEPROM (on a removable ID card)
 MC145483 - 13bit PCM codec
 Jazz Multisensor interface
 beeper and LED indicators
 6 AA batteries and voltage
level monitor

17. oLightweight
oRuns on batteries - low power
consumption
oEasy to use - does not disturb
the operator working
oID cards for operator
authorization
oVoice transmission using
hardware PCM codec
Data Acquisition Unit
Atmel 89C52
microcontroller
Jazz
Multisensor
Bluetooth

18.  Connection Manager
 Operator Manager
 Data Logger Module
 Data Analysis Module
 Alarm Dispatcher Module
 Visualization Module

19. • Connection management
• Data processing
• Visualization
• Data recording
• Access
verification
• System maintenance
Data
analysis
Data logger
Visualization
module
Connection
manager
Bluetooth

20. • Raw and processed data visualization

21.  Blue Eyes software is called “agent”.
 It analyzes and modifies the mother program,
according to the user’s needs and moods.

22.  Operators
 Supervisors
 System administrators

23.  Operator is a person whose physiological parameters
are supervised
 The operator wears the DAU
 The only functions offers to the operator are
Authorization to the system and receiving alarm
alerts.
 Authorization: Operator has to enter his personal PIN
into DAU, if PIN is accepted, authorization is said to
be complete.
 Receiving Alerts: This function supplies the operator
with the most important alerts about his and his co-
workers’ condition and mobile device state.

24.  He is the person responsible for analyzing operators’
condition and performance.
 The supervisor receives tools for inspecting present
values of the parameters (on-line browsing) as well as
browsing the results of the long-term analysis (off-
line browsing).

25.  He is the user that maintains the system
 The administrator is delivered tools for adding new
operators to the database. Defining alarm conditions.
 Configuring logging tools.
 Creating new analyzer modules.

26.  POD
 The first blue Eye enabled mass production device
 It’s a car manufactured by TOYOTA
 It could keep the driver alert and active
 It could tell the driver to go slow if he is driving
too fast
 It could hear the driver some sort of interesting
music when he is getting bored.

27.  PONG
 It’s a robot released by IBM designed for
demonstrating the new technology
 Its equipped with a computer capable of analyzing
a person's glances and other forms of expressions
of feelings
 It smiles when the person calls his name
 It expresses loneliness when it loses sight of the
person

28.  SECURE PAD
 an electronic badge that can identify the wearer and
track his movements and activities with an array of
sensors
 It knows who you are and where you are, and it has a
pretty good idea of what you are doing and when
you are doing it.
 The device was designed for a major health-care
provider to track the activities of doctors and other
personnel at large medical facilities
 it's interchangeable

29.  enables the computer to adapt a working style that
fits users personality to increase his productivity
 The technology can also be incorporated into
automobiles
 Blue Eyes is going to find its way in the routines of
human beings with application such as TV, washing
machine etc.
 In a company, the supervisor can be given the power
to access the database containing his employees
profile, which is linked with Blue Eyes technology.
hereby he can evaluate the performance of his
employees.

30.  The wireless link between the sensors worn by the
operator and the supervising system makes it possible
to improve overall reliability, safety and assures
proper quality of system performance.
 These new possibilities can cover areas such as
industry, transportation, military command centers or
operation theaters.
 Researchers are attempting to add more capabilities to
computers that will allow them to interact like
humans, recognize human presents, talk, listen, or
even guess their feelings.
 It avoids potential threats resulting from human errors,
such as weariness, oversight, tiredness.

31. THANK YOU FOR YOUR
ATTENTION

32. ANY QUESTIONS?