HRIDHYA JOY
Computer can feel you….
Contents…
● Introduction
● What is Blue Eyes Technology?
● Why Blue Eyes ?
● Technologies Used
● System Overview
● Applications
● Advantages & Limitations
● Conclusion
Introduction
● Blue Eyes is a technology conducted
by the research team of IBM at its
Almaden Research Center (ARC) in
San Jose, California since 1997.
● Blue eyes technology makes a
computer to understand and sense
human feelings and behaviour and
also enables the computer to react
according to the sensed emotional
What is Blue Eyes?
Blue refers to the reliable wireless
communication Bluetooth.
Eye act as a sensor for collecting
movement information.
Why Blue Eyes ?
● To avoid and reduce human limitations
such as tiredness,oversight,mental illness
etc..
● Monitoring of conscious brain involvement
● Build a machine that can understand your
emotions
● Verify your identity,feel your presence and
interact with you
Technologies used
● Emotion Mouse
● Manual And Gaze Input Cascaded(MAGIC)
● Artificial Intelligent speech recognition
● Simple User Interest Tracker(SUITOR)
● The Eye movement sensor
Emotion Mouse
● Simplest way
● People spend
approximately ⅓ of their
total computer time
touching the input device
● Physiological data is
obtained and emotional
state is determined
● The user model will be
built that reflects the
personality of the user
Emotion
mouse
implemented
on real
mouse.
Emotion
mouse
developed by
IBM In
research lab
Using touch recognition about
six types of emotions can be
sensed by the computer
● Anger
● Fear
● Sadness
● Disgust
● Joy
● Surprise
Expression Glass
● Expression Glass is an
alternative for the usually
available machine vision face or
eye recognition methods.
● By analyzing pattern recognition
methods and facial muscle
variations, the glass senses and
identifies the expressions such
as interest or confusion of the
user.
● The prototype used for this glass
uses piezoelectric sensors.
Manual And Gaze Input Cascaded(MAGIC)
● Pointing appears to user to
be a manual task
● Used for fine manipulation
and selection
● Webcam is used to
determine the glints and
pupils of the user
MAGIC Pointing Approaches
Liberal Approach Conservative Approach
Liberal Approach Conservative Approach
● To wrap the cursor to every
new object user looking at
● User takes control of the
target by find and search or
ignore it and search for next
● “Pro-Active” since cursor
waits for every potential
target
● “Over Active” when user
merely looks at something or
nothing.
● Does not wrap the cursor
target until manual pointing
device is activated or used
● Cursor is wrapped to the
gaze area through the eye
tracker
● Steer the cursor towards the
target to acquire it
● Cursor position is offset to
the intersection of manual
activating vector and
boundary of gaze area
Advantages Disadvantages
● Reduced physical effort
compared with the traditional
manual pointing techniques.
● Greater spontaneity than
traditional manual pointing.
● Greater accuracy.
● Faster speed of operation than
manual pointing.
● Sometimes it is not working
properly because if a user
does not look at a particular
target continuously for a
predetermined threshold
value, the target will not be
selected.
Artificial Intelligent Speech Recognition
● Input words are scanned and matched against internally stored words
● Identification causes some action to be taken ,user speak to computer
through microphone
● Filtered and fed to ADC and then stored to RAM
● Two basic ideas are included in the Artificial intelligence (AI),
○ Study the thought of human beings.
○ Represents the thought process of human beings through robots,
computers etc.
Simple User Interest Tracker(SUITOR)
● Help by fetching more
information at desktop
noticing where the user’s
eyes focus on the computer
screen
● More precise in determining
User’s topic of interest
● Eg: If reading a news
headline,the story will pop up
System Overview
Blue Eyes system is a
combination of hardware and
software components
● DAU(Data Acquisation
Unit)
● CSU(Central System Unit)
Hardware
➢ DAU(Data Acquisition Unit)
The Atmel 89C52 microcontroller
● A Bluetooth module
● A small LCD display
● A removable ID card i.e. 24C16-I2C EEPROM
● A 13 bit PCM code
● Jazz multi-sensors
● The LED indicators
● A beeper
● The 6AA batteries
● A voltage level monitor
DAU Components
● Lightweight
● Runs on batteries-low power consumption
● Easy to use-Does not disturb the operator
working
● ID cards for operator authorization
● Voice transmission using hardware PCM
codec
Features..
➢ CSU(Central System Unit)
● Connection Manager :low level bluetooth connection
● Data Analysis Module:Analysis of raw sensor data
● Data Logger Module:Support for storing monitored data
● Visualization Module:User interface for supervisors
CSU Compnents
Features...
● Connection Management
● Data Processing
● Data Recording
● Access Verification
● System Management
AT89C52
Microcontroller
Bluetooth module
Jazz sensor
Software
Applications
POD the car manufactured
by TOYOTA
PONG a robot released by
IBM
● Used in Video games
● Used to prevent Car
Accidents
Advantages Disadvantages
● High accuracy level
● Fast in speed
● Naturalness as compared
to the old traditional
pointing
● Less physical effort and
stress as compared to
manual pointing
● Distraction while
reading
● Reliability of the
system
Conclusion
BLUE EYES technological approach assure a
convenient technique, that simplifies the life by
supporting more elegant and user friendly provision
in computing devices. The day is very near, that this
Blue Eyes technology will advance its way towards
your house hold devices and makes you lazier. In
future, even this Blue Eyes will reach as your hand
held mobile device…
Blue Eyes Technology PPT

Blue Eyes Technology PPT

  • 1.
  • 2.
    Contents… ● Introduction ● Whatis Blue Eyes Technology? ● Why Blue Eyes ? ● Technologies Used ● System Overview ● Applications ● Advantages & Limitations ● Conclusion
  • 3.
    Introduction ● Blue Eyesis a technology conducted by the research team of IBM at its Almaden Research Center (ARC) in San Jose, California since 1997. ● Blue eyes technology makes a computer to understand and sense human feelings and behaviour and also enables the computer to react according to the sensed emotional
  • 4.
    What is BlueEyes? Blue refers to the reliable wireless communication Bluetooth. Eye act as a sensor for collecting movement information.
  • 5.
    Why Blue Eyes? ● To avoid and reduce human limitations such as tiredness,oversight,mental illness etc.. ● Monitoring of conscious brain involvement ● Build a machine that can understand your emotions ● Verify your identity,feel your presence and interact with you
  • 6.
    Technologies used ● EmotionMouse ● Manual And Gaze Input Cascaded(MAGIC) ● Artificial Intelligent speech recognition ● Simple User Interest Tracker(SUITOR) ● The Eye movement sensor
  • 7.
    Emotion Mouse ● Simplestway ● People spend approximately ⅓ of their total computer time touching the input device ● Physiological data is obtained and emotional state is determined ● The user model will be built that reflects the personality of the user Emotion mouse implemented on real mouse. Emotion mouse developed by IBM In research lab
  • 8.
    Using touch recognitionabout six types of emotions can be sensed by the computer ● Anger ● Fear ● Sadness ● Disgust ● Joy ● Surprise
  • 10.
    Expression Glass ● ExpressionGlass is an alternative for the usually available machine vision face or eye recognition methods. ● By analyzing pattern recognition methods and facial muscle variations, the glass senses and identifies the expressions such as interest or confusion of the user. ● The prototype used for this glass uses piezoelectric sensors.
  • 11.
    Manual And GazeInput Cascaded(MAGIC) ● Pointing appears to user to be a manual task ● Used for fine manipulation and selection ● Webcam is used to determine the glints and pupils of the user
  • 12.
    MAGIC Pointing Approaches LiberalApproach Conservative Approach
  • 13.
    Liberal Approach ConservativeApproach ● To wrap the cursor to every new object user looking at ● User takes control of the target by find and search or ignore it and search for next ● “Pro-Active” since cursor waits for every potential target ● “Over Active” when user merely looks at something or nothing. ● Does not wrap the cursor target until manual pointing device is activated or used ● Cursor is wrapped to the gaze area through the eye tracker ● Steer the cursor towards the target to acquire it ● Cursor position is offset to the intersection of manual activating vector and boundary of gaze area
  • 14.
    Advantages Disadvantages ● Reducedphysical effort compared with the traditional manual pointing techniques. ● Greater spontaneity than traditional manual pointing. ● Greater accuracy. ● Faster speed of operation than manual pointing. ● Sometimes it is not working properly because if a user does not look at a particular target continuously for a predetermined threshold value, the target will not be selected.
  • 15.
    Artificial Intelligent SpeechRecognition ● Input words are scanned and matched against internally stored words ● Identification causes some action to be taken ,user speak to computer through microphone ● Filtered and fed to ADC and then stored to RAM ● Two basic ideas are included in the Artificial intelligence (AI), ○ Study the thought of human beings. ○ Represents the thought process of human beings through robots, computers etc.
  • 16.
    Simple User InterestTracker(SUITOR) ● Help by fetching more information at desktop noticing where the user’s eyes focus on the computer screen ● More precise in determining User’s topic of interest ● Eg: If reading a news headline,the story will pop up
  • 17.
    System Overview Blue Eyessystem is a combination of hardware and software components ● DAU(Data Acquisation Unit) ● CSU(Central System Unit)
  • 18.
    Hardware ➢ DAU(Data AcquisitionUnit) The Atmel 89C52 microcontroller ● A Bluetooth module ● A small LCD display ● A removable ID card i.e. 24C16-I2C EEPROM ● A 13 bit PCM code ● Jazz multi-sensors ● The LED indicators ● A beeper ● The 6AA batteries ● A voltage level monitor
  • 19.
  • 20.
    ● Lightweight ● Runson batteries-low power consumption ● Easy to use-Does not disturb the operator working ● ID cards for operator authorization ● Voice transmission using hardware PCM codec Features..
  • 21.
    ➢ CSU(Central SystemUnit) ● Connection Manager :low level bluetooth connection ● Data Analysis Module:Analysis of raw sensor data ● Data Logger Module:Support for storing monitored data ● Visualization Module:User interface for supervisors
  • 22.
  • 23.
    Features... ● Connection Management ●Data Processing ● Data Recording ● Access Verification ● System Management
  • 24.
  • 25.
  • 26.
    Applications POD the carmanufactured by TOYOTA PONG a robot released by IBM
  • 27.
    ● Used inVideo games ● Used to prevent Car Accidents
  • 28.
    Advantages Disadvantages ● Highaccuracy level ● Fast in speed ● Naturalness as compared to the old traditional pointing ● Less physical effort and stress as compared to manual pointing ● Distraction while reading ● Reliability of the system
  • 29.
    Conclusion BLUE EYES technologicalapproach assure a convenient technique, that simplifies the life by supporting more elegant and user friendly provision in computing devices. The day is very near, that this Blue Eyes technology will advance its way towards your house hold devices and makes you lazier. In future, even this Blue Eyes will reach as your hand held mobile device…