Post on 19-Jan-2016
Project Title: Experimental Evaluation of Speech Based SMS
While Driving
ECE 791 – Oral Project ProposalProject Team: Carol Perkins
ECE Faculty Advisor: Andrew KunECE Courses Involved: 602, 796
Current Date
Thursday, October 27, 2011
Project Completion Date
May 2012
Contents
Background Problem Statement Design Specification Goals Implementation Budget Timeline
Background High Cell Phone Usage in the U.S.
Jan-96 Jan-01 Jan-06 Jan-110
50
100
150
200
250
300
350
38.2M
118.4M
219.6M
327.6M
Wireless Subscriber Connections
Date Recorded
Nu
mb
er
of
Su
bscri
ber
Con
necti
on
s (
Mil-
lion
)
Background
First SMS message sent on December 3, 1992
“Merry Christmas”
Neil Papworth’s personal computer
Richard Jarvis’s Orbitel 901 handset
Background
Drastic Increase In Text Messaging
Jan-01 Jan-06 Jan-110
50000000000
100000000000
150000000000
200000000000
250000000000
33.5M12.5B
196.9B
Monthly Text Messages in the U.S.
Date Recorded
Nu
mb
er
of
Text
Mess
ag
es
Sen
t (B
illi
on
)
Background Statistics shown here from study of people
texting and driving.
Drivers spent 400% more
time with their eyes off the road when
texting.
Drivers made 28% more lane excursions when texting.
The number of incorrect
lane changes
increased by 140% when
texting.
The variability in lateral lane position increased by
up to 70% when sending texts during the traffic light, pedestrian and car following
events.
Background 34 states and the District of Columbia
have banned text messaging for drivers
Background Commercial products exist to help Dragon Dictation Application
› Upside: High user rates and feedback People are proactively working to make the
road safer by use
Background
1 2 3
Dragon Dictation› Downside
Still require drivers to take their eyes off the road in order to start and finish sending a text
Background Research on improved text response
techniques by Ju and Paek› Canned (PCFG) vs. Dictation (SLM) vs.
Voice Search
Canned (PCFG) Dictation (SLM) Voice Search0%
10%20%30%40%50%60%70%80%90%
100%
44.1%
79.2%89.7%
Task completion rates for SMS Replies Covered by Template
Respone ApproachesPerc
enta
ge o
f Tasks C
om
ple
ted
Background Follow up study in driving simulator
› Dictation vs. Voice Search› Findings:
No apparent differences in terms of driving performance
Dictation Voice Search0
0.5
1
1.5
2
2.5
2.13
0.38
SMS Reply Task Errors Per Course
Response Approach
Mean
Nu
mb
er
of
Err
ors
Problem Statement
Expand the findings of Ju and Paek Pinpoint when driving is affected by
responding to SMS messages with speech
Use the Project54 driving simulator, eye tracker and physiological measures
Design Specifications
Two independent variables› SMS Reply Approach› Driving Condition
2 x 1 repeated measures
SMS Reply with Voice Search
SMS Reply with Dictation
Constant Driving Condition
Design Specification
Dictation Approach› Using a language model trained on typical
SMS responses
Voice Search› Using template matching
Design Specifications High fidelity driving simulator
› 180 degree field of view› Full-width car cab› Tilting motion platform› Audio› Vibrates
Design Specifications
Eye tracker› Pair of camera’s mounted on the
dashboard› Records gaze direction and pupil size
1 2 3
Design Specifications
Participant Recruitment
Goals
Which has a more significant impact on drivers? Dictation Approach
Deciphering the sometimes nonsensical misrecognitions of dictation
Search Response Approach Verifying whether SMS response
templates match the meaning of the intentional reply
Implementation
Primary Task - Driving› Straight Highway› Obey rules of road
Implementation Secondary Task – SMS Reply Task
“Message Received:‘E T A?’
Your Reply: ‘Bad
Traffic, in 20
minutes’”
“Bad Traffic, in 20
minutes”
1: 20 minutes bad traffic2: there’s traffic3: bad traffic4: give me about 20 minutes
“One”
Implementation
Measurements Recorded› Driving
Number of collisions Speeding Lane position Eye Gaze Pupil Dilation
› SMS Reply Duration of complete response (from message
received to send) The number of times drivers correctly identify
answer
Implementation
Follow up questionnaire from participants› Select correct answer from same list used
in experiment
Budget
Part Amount PriceDriving Simulation Setup 1 *Eye Tracker 1 *Participant Compensation 10-20 10pp
* Hardware provided by Project54
Timeline
Timeline
Questions?