In-Car Speech User Interfaces Andrew Kun

Students @ ECE Jon Oppelaar Oskar Palinko Zeljko Medenica Owen Derby Alex Shyrokov Puneet Lakhanpal

Outline Ubicomp and cars Studies What’s next?

Ubicomp and cars

Studies

What’s next?

Navigation

Music, phones

Cars in the age of ubicomp Car = docking port (Russell Shields, Ygomi) Good docking port = open interface Liability? Profit?

Car = docking port (Russell Shields, Ygomi)

Good docking port = open interface

Liability?

Profit?

Police cars Toys vs. tools Vanguard of in-car ubicomp

Toys vs. tools

Vanguard of in-car ubicomp

Project54

Outline Ubicomp and cars Studies What’s next?

Ubicomp and cars

Studies

What’s next?

Studies Problem: In car devices vs. driving performance

Problem:

In car devices vs. driving performance

Studies Goal: Evaluation tool Reduce distractions

Goal:

Evaluation tool

Reduce distractions

Studies Major hypotheses: UI characteristics Road conditions Psychological state

Major hypotheses:

UI characteristics

Road conditions

Psychological state

Evaluating hypotheses Driving simulator user studies

Driving simulator user studies

DriveSafety driving simulator tinyurl.com/p54sim

tinyurl.com/p54sim

Driving performance Variance: Lane position Steering wheel angle Velocity Distance to leading vehicle Lane departures Collisions Etc…

Variance:

Lane position

Steering wheel angle

Velocity

Distance to leading vehicle

Lane departures

Collisions

Etc…

Seeingmachines eye tracker tinyurl.com/eyetracker

tinyurl.com/eyetracker

Visual attention Fixations (> 100 ms): number, timing, etc. Scanning Time looking at road Etc…

Fixations (> 100 ms): number, timing, etc.

Scanning

Time looking at road

Etc…

Studies Glove PTT: Accuracy PTT usage PTT interaction type Navigation: Printed, GUI, speech City, highway, curves

Glove PTT:

Accuracy

PTT usage

PTT interaction type

Navigation:

Printed, GUI, speech

City, highway, curves

Glove PTT study

Fixed PTT operation

Fixed PTT – glances!

Glove PTT operation

Glove PTT – few glances

Navigation study Motivation: PNGs proliferating Task: follow directions to destination Design: Directions: paper map/GUI + speech/speech Road conditions: highway/suburban highway/city

Motivation: PNGs proliferating

Task: follow directions to destination

Design:

Directions: paper map/GUI + speech/speech

Road conditions: highway/suburban highway/city

Cabin setup

Printed directions

GUI and voice directions

Voice only directions

Outline Ubicomp and cars Studies What’s next?

Ubicomp and cars

Studies

What’s next?

Navigation study Why is LCD screen important?

Why is LCD screen important?

What’s next? Frustration?

Frustration?

Acknowledgements NSF US DOJ Microsoft Research Tellme

NSF

US DOJ

Microsoft Research

Tellme

www.eceblogger.com Facebook page: tinyurl.com/eceunhfacebook

www.eceblogger.com

Facebook page: tinyurl.com/eceunhfacebook