EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

28
EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012

Transcript of EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Page 1: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

EcoCar User Interface

Mid Semester PresentationSenior Design IIOctober 2, 2012

Page 2: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Design Team

Sam KnightComputer Engineer

DBus ProgrammingCAN Bus Programming

Lukas CoxElectrical Engineer

Dictionary TrainingPhysical Interfacing

Adam JohnsComputer Engineer

Alternatives ResearchingRecognition Programming

Renz SantosComputer Engineer

Recognition ProgrammingWebsite Design

Dr. Marshall MolenAdvisor

Page 3: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Contents

• Problem and Solution• System Overview• Model• Technical and Practical Constraints• Refinements and Progress

– Accuracy– Installation Package

• Testing• Senior Design II Timeline• References

Page 4: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Problem and Solution

Page 5: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Problem

• The increasing technology in vehicles today unfortunately increases the amount of danger to drivers and passengers alike.

• “Driver distraction is a leading cause of crashes, although the exact figures are difficult to gauge because of the unreliability of the data” [1].

Page 6: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Solution

• EcoCar User Interface– Allows car’s infotainment center to be controlled

by voice– Helps lower the amount of attention needed to

run modules on car– Displays critical information relating to the vehicle

Page 7: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

System OverviewMicrophone CAN Bus

Computer

Voice Recognition Control

Overview, Radio, Media, GPS, Diagnostic Modules

Projector

Page 8: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Model

Page 9: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Technical and Practical Constraints

Page 10: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Technical ConstraintsName Description

Accuracy The system must correctly identify spoken commands with 90% accuracy.

Latency The EUI must acknowledge commands within 250ms.

Compatibility The system must run on Freescale SABRE platform computer.

Communication The EUI must communicate with CAN bus.

Vocabulary The system must recognize 12 voice commands

Page 11: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Practical ConstraintsType Name Description

Manufacturability Size The EUI must fit below the passenger seat and not obstruct the driver.

Sustainability Durability The system must be able to withstand the vibrations of normal driving conditions.

Page 12: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Manufacturability

• Fit below passenger seat• Microphone < 4”x2”x2”• Projector < 1” depth

[2]

Page 13: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Sustainability

• No short term problems• Works as long as hardware does not fail• Withstand normal car vibrations

Page 14: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Refinements and Progress

Page 15: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Accuracy

• Augment the audio recognition corpus• Driver dependent voice library

Page 16: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Enhancement Process

• Record a series of phrases from user• Sync the audio to the command keywords• Process into .mfc files• Assimilate into existing corpus

Page 17: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.
Page 18: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.
Page 19: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Installation Package

• Available as download or from PPA• Checks system for correct dependencies• Automatically installs program• Launch script checks Java version

Page 20: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.
Page 21: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.
Page 22: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.
Page 23: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.
Page 24: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Debian Package Control FilePackage: euiVersion: 1.0Section: contrib/miscPriority: optionalArchitecture: allMaintainer: Sam Knight <[email protected]>Homepage:http://www.ece.msstate.edu/courses/design/2012/team_knightDepends: libunixsocket-java, libmatthew-java-docDescription: Ecocar User Interface Voice recognition infotainment system designed for Mississippi State

University Ecocar

Page 25: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Testing

• Reevaluate the improved accuracy EUI• Test CAN Bus communication• Seamless automatic install in any new version

of EcoCar with installation package

Page 26: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

Senior Design II TimelineAugust September October November

Software Refinement

Projector Mounting

Software Integration

Testing

Page 27: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

References[1] (2012, February 22). “Music Related Car Crashes,” in Car Accidents [Online]. Available:

http://www.car-accidents.com/music-car-accidents-causes.html [2] Picture (2012, February 21). “Pico Projector,” in MicroVision [Online]. Available:

http://www.microvision.com/pico_projector_displays/index.html\

Page 28: EcoCar User Interface Mid Semester Presentation Senior Design II October 2, 2012.

EcoCar User Interface

Mid Semester PresentationSenior Design IIOctober 2, 2012