Project Title: Experimental Evaluation of Speech Based SMS

While Driving

ECE 791 – Oral Project ProposalProject Team: Carol Perkins

ECE Faculty Advisor: Andrew KunECE Courses Involved: 602, 796

Current Date

Thursday, October 27, 2011

Project Completion Date

May 2012

Contents

Background Problem Statement Design Specification Goals Implementation Budget Timeline

Background High Cell Phone Usage in the U.S.

Jan-96 Jan-01 Jan-06 Jan-110

50

100

150

200

250

300

350

38.2M

118.4M

219.6M

327.6M

Wireless Subscriber Connections

Date Recorded

Nu

mb

er

of

Su

bscri

ber

Con

necti

on

s (

Mil-

lion

)

Background

First SMS message sent on December 3, 1992

“Merry Christmas”

Neil Papworth’s personal computer

Richard Jarvis’s Orbitel 901 handset

Background

Drastic Increase In Text Messaging

Jan-01 Jan-06 Jan-110

50000000000

100000000000

150000000000

200000000000

250000000000

33.5M12.5B

196.9B

Monthly Text Messages in the U.S.

Date Recorded

Nu

mb

er

of

Text

Mess

ag

es

Sen

t (B

illi

on

)

Background Statistics shown here from study of people

texting and driving.

Drivers spent 400% more

time with their eyes off the road when

texting.

Drivers made 28% more lane excursions when texting.

The number of incorrect

lane changes

increased by 140% when

texting.

The variability in lateral lane position increased by

up to 70% when sending texts during the traffic light, pedestrian and car following

events.

Background 34 states and the District of Columbia

have banned text messaging for drivers

Background Commercial products exist to help Dragon Dictation Application

› Upside: High user rates and feedback People are proactively working to make the

road safer by use

Background

1 2 3

Dragon Dictation› Downside

Still require drivers to take their eyes off the road in order to start and finish sending a text

Background Research on improved text response

techniques by Ju and Paek› Canned (PCFG) vs. Dictation (SLM) vs.

Voice Search

Canned (PCFG) Dictation (SLM) Voice Search0%

10%20%30%40%50%60%70%80%90%

100%

44.1%

79.2%89.7%

Task completion rates for SMS Replies Covered by Template

Respone ApproachesPerc

enta

ge o

f Tasks C

om

ple

ted

Background Follow up study in driving simulator

› Dictation vs. Voice Search› Findings:

No apparent differences in terms of driving performance

Dictation Voice Search0

0.5

1

1.5

2

2.5

2.13

0.38

SMS Reply Task Errors Per Course

Response Approach

Mean

Nu

mb

er

of

Err

ors

Problem Statement

Expand the findings of Ju and Paek Pinpoint when driving is affected by

responding to SMS messages with speech

Use the Project54 driving simulator, eye tracker and physiological measures

Design Specifications

Two independent variables› SMS Reply Approach› Driving Condition

2 x 1 repeated measures

SMS Reply with Voice Search

SMS Reply with Dictation

Constant Driving Condition

Design Specification

Dictation Approach› Using a language model trained on typical

SMS responses

Voice Search› Using template matching

Design Specifications High fidelity driving simulator

› 180 degree field of view› Full-width car cab› Tilting motion platform› Audio› Vibrates

Design Specifications

Eye tracker› Pair of camera’s mounted on the

dashboard› Records gaze direction and pupil size

1 2 3

Design Specifications

Participant Recruitment

Goals

Which has a more significant impact on drivers? Dictation Approach

Deciphering the sometimes nonsensical misrecognitions of dictation

Search Response Approach Verifying whether SMS response

templates match the meaning of the intentional reply

Implementation

Primary Task - Driving› Straight Highway› Obey rules of road

Implementation Secondary Task – SMS Reply Task

“Message Received:‘E T A?’

Your Reply: ‘Bad

Traffic, in 20

minutes’”

“Bad Traffic, in 20

minutes”

1: 20 minutes bad traffic2: there’s traffic3: bad traffic4: give me about 20 minutes

“One”

Implementation

Measurements Recorded› Driving

Number of collisions Speeding Lane position Eye Gaze Pupil Dilation

› SMS Reply Duration of complete response (from message

received to send) The number of times drivers correctly identify

answer

Implementation

Follow up questionnaire from participants› Select correct answer from same list used

in experiment

Budget

Part Amount PriceDriving Simulation Setup 1 *Eye Tracker 1 *Participant Compensation 10-20 10pp

* Hardware provided by Project54

Timeline

Timeline

Questions?