The document discusses the development of an 'artificial passenger' system by IBM, designed to ensure driver alertness during long solo journeys by utilizing conversation and various detection technologies. It outlines the components and workings of the system, including sensors, voice recognition, and a conversational planner that assesses driver vigilance and can activate alerts if drowsiness is detected. The system aims to enhance safety and comfort while enabling additional functionalities like navigation and entertainment without distracting the driver.

1. (A Sleep Prevention Dialogue Based Car
System)
SUBMITTED TO: SUBMITTED BY:
Mr. Deepak Yadav Shivanshi Sharma
(Assistant Professor) CS-B(6TH
SEMESTER)
(1329210068)
1

2. o Introduction
o What is an Artificial Passenger?
o What does it do?
o Devices used in Artificial Passenger
o Detecting Driver Vigilance
o Applications
o Future Implementation
o Conclusion
1

3.  IBM (International Business Machines
Corporation, NY) has developed a software that
holds a conversation with the driver to
determine whether the driver can respond
alertly enough, called “Artificial PassengerArtificial Passenger”.
 This was designed to make long solo journeys
safer and more bearable.
2

4. o Natural language e-companion.
o Sleep preventive device in cars to overcome
drowsiness.
o Life safety system.
3

5. o Detects alarm conditions through sensors.
o Broadcasts pre-stored voice messages over the
speakers.
o Captures images of the driver.
4

6. o Eye tracker
o Voice recognizer or speech recognizer
o Natural language processor
o Driver analyzer
o Conversational planner
o Alarm
o Microphone
o Camera
5

7. Eye-TrackerEye-Tracker
 Collecting eye movement data requires both
hardware and software.
Hardware:: Head-Mounted systems or remote systemsHardware:: Head-Mounted systems or remote systems
 Head mounted systemsHead mounted systems use multiple data points
to record eye movement and measures pupil
glint from multiple angles.
 Remote systemsRemote systems ,in contrast, measure the
orientation of the eye relative to a fixed unit
such as camera.
6

8. Software:Software:
 Data collection and analysis is handled by eye-
tracking software.
7

9. Automatic Speech RecognitionAutomatic Speech Recognition
There are two ASRs used in the system:
oFirst one is “speaker independent” and used for
decoding voice signals of the driver.
oSecond one operates with voice car media and
decodes tapes, audio , telephones, mails etc.
8

10. Natural Language ProcessorNatural Language Processor
o Processes the decoded signals of voice or text
data provided from the ASR.
oIdentifies related meanings from the contents of
the decoded messages.
oThis output goes to the driver analyzer as an
input.
9

11. Driver AnalyzerDriver Analyzer
 Receives the textual data and voice data.
 Measures the time response using a clock.
 Time responses, conclusions about driver’s
alertness will be passed on to the conversational
planner.
10

12. Conversational PlannerConversational Planner
o It is the heart of the system.
o Instructs the language generator to produce the
response.
o If the driver is in perfect condition CP instructs
the language generator to continue the
conversation otherwise it will be instructed to
change the conversation.
11

13. AlarmAlarm
 If the CP (conversational planner) receives
information that the driver is about to fall
asleep an alarm system is activated.
MicrophoneMicrophone
 For picking up words and separate
them by some internally used software
for conversation.
12

14. CameraCamera
 This will track the lip movements of the driver.
 Used to improve the accuracy of the speech
recognition.
13

15.  Medical ApplicationMedical Application
 In any problem it alerts the vehicles near by , so
the driver there can become alert.
 Opens and closes the doors and windows of the
car automatically.
 It is also used for the entertainment.
 Also used in cabins in airplanes, trains, boats etc
14

16. o Method for monitoring driver alertness
o Sufficient time to avert an accident.
o Successful implementation of Artificial
passenger would allow use of various services in
car like reading emails, navigation,
downloading music files, voice games etc
without compromising on driver safety
15

17. Thank You…Thank You…
Questions?Questions?
16