The document describes an artificial passenger system that uses sensors and AI to monitor drivers for drowsiness and prevent accidents. It detects drowsiness through analysis of eye movement, blinking, yawning and other biometrics. When drowsiness is detected, it uses speech and other alerts to engage the driver. The system aims to provide conversation and entertainment to help drivers stay alert during long solo trips. It has potential to prevent accidents and be used to ensure alertness in other safety-critical roles.
3. EXISTING SYSTEM
Miniature System installed in driver’s hat
Use of simulation Drinks
Some tablets to prevent sleeping
4. INTRODUCTION
According to national survey in UK and USA , it is
observed that the driver fatigue annually causes.
10000 crashes
1500 deaths
7100 injuries
Majority of road accidents observed were caused
by eye closure of half and even 2-3 seconds, where
normal eye blinks at 0.2-0.3 seconds
5. BACKGROUND OF THE INVENTION
In order to overcome disadvantages of existing
methods IBM introduced a new sleep prevention
technology device “ARTIFICIAL PASSENGER”.
The name for the system was first suggested in an
article in New scientist magazine
This is designed to make solo journey more safer
6. TECHNOLOGY INVOLVED
Artificial intelligence (AI) is the intelligence of
machines and the branch of computer science "the
study and design of intelligent agents“
An intelligent agent is a system that perceives its
environment and takes actions that maximize its
chances of success .
7. WHAT IS ARTIFICIAL PASSENGER?
This is an artificial intelligence based companion.
Resident in software and chips embedded in the
automobile dashboard.
8. WHAT DOES IT DO?
Detects alarm conditions through sensors
Broadcast pre stored voice messages over the
speakers
Captures images of driver
9. WHY SUCH SYSTEM?
There are many accidents taking place daily
To avoid there must be some communication
between driver and vehicle
This communication helps to prevent unfortunate
things from happening
So , artificial passenger is pathway to overcome
such things
11. WORKLOAD MANAGER
These sensors in system:
allow for the monitoring of driver actions (e.g.
application of brakes, changing lanes)
provide information about local events (e.g. heavy
rain)
provide information about driver characteristics
(e.g. speaking speed, eyelid status).
12. DRIVER’S DROWSINESS PREVENTION
The invention suggests fighting drowsiness by
detecting drowsiness via speech biometrics
The purpose of Artificial Passenger is to provide a
higher level of interaction with a driver than current
media, such as CD players or radio stations
13. CONVERSATIONAL TELEMATICS
System takes care of every need
Has enough intelligence to anticipate needs.
Helps to perform certain actions within your car
hands-free:
turn on the radio
switch stations
make a cell phone call, and more
Reports car conditions and external hazards
Helps to stay awake with some form of
entertainment when it detects driver is getting
drowsy.
14. IMPROVES SPEECH RECOGNITION
IBM’s Audio Visual Speech Recognition (AVSR)
cuts through the noise.
It reads lips for speech recognition.
Cameras focused on the driver’s mouth do the lip
reading;
In places with moderate noise, speech recognition
has a 1% error rate, the error rate of AVSR < 1%.
In places roughly ten times noisier, speech
recognition has about a 2% error rate but AVSR’s is
1%
17. CONVERSATIONAL PLANNER (CP)
Heart of the system.
CP holds the profile of the driver.
Instruct the language generator to produce
response.
If the driver is in perfect condition CP instructs
language processor to continue conversation
otherwise it is instructed to change the conversation
(un expected joke).
18. EYE TRACKER
o Eye-tracking hardware is either mounted on a
user's head or mounted remotely.
o Both systems measure the corneal reflection of an
infrared light emitting diode (LED), which
illuminates and generates a reflection off the
surface of the eye.
o This action causes the pupil to appear as a bright
disk in contrast to the surrounding iris and creates a
small glint underneath the pupil. It is this glint that
head-mounted and remote systems use for
calibration and tracking.
19.
20. ALARM
If CP receives an info that driver is about to
Sleep then
Alarm system is activated
21. MICROPHONE
It pics up driver’s answer and breaks into separate
words with speech recognition software
22. EMBEDDED SPEECH RECOGNITION DEVICE
Driver can hear songs recorded in his mobile or any
another devices using embedded speech
recognition system
23. CAMERA
Will track lip movements of driver
Improves the accuracy of speech recognition
24. MOBILE DEVICE INDICATOR
When driver gets a call ,
The system takes up the call by driver’s
speech using speech recognition software
Even by driver’s lip movement with the help of
camera
25.
26. METHOD FOR DETECTING DRIVER VIGILANCE
COMPRISES THE FOLLOWING STEPS
o Detecting frequency of nodding and left to right
rotations of the head within a selected time period
of the driver with the camera.
o Determining frequency of eye blinking and eye
closings of the driver within the selected time period
with the camera.
o Determining frequency of yawning of the driver
within the select period with the camera.
o Generating an alarm signal in real time if a
frequency value of the number of the frequency of
the up and down nodding, the left to right rotations,
the eye blinking, the eye closings, the yawning
exceed a threshold value
27. ADVANTAGES
Broadly used to prevent accidents
Component establishes interface with other drivers
easily
If drivers gets heart attack or he is drunk it will send
signals to nearby drivers to make them alert
29. APPLICATIONS OF ARTIFICIAL
PASSENGER
prevent accidents
Used for entertainment such as telling jokes and
asking questions.
Automatically opens and close the window of car
and answers a call for you.
If a driver gets heart attack or he is drunk, it sends
a signal to vehicles nearby so that there driver
becomes alert.
.
30. CONTD……
Can be used in other situations where people must
be alert
Security guards
Operators at nuclear plants
Operators at manufacturing facilities
Pilots of air planes
31. FUTURE TECHNOLOGY
We can provide driver with a “shortest time” routing
based on
i. road conditions changing because of weather
and traffic
ii. remote diagnostics of his/her car and cars on
their route
iii. destination requirements and nearby incentives
32. CONCLUSION
Method for monitoring driver’s alertness
Sufficient time to avert an accident.
Monitoring of full facial occlusion of the driver.