Multimodel HMI for Advanced Driver Assistance
-
Upload
visteon-corporation -
Category
Technology
-
view
1.111 -
download
2
Transcript of Multimodel HMI for Advanced Driver Assistance
![Page 1: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/1.jpg)
Patrick Nebout, Director Advanced TechnologiesSeptember 20th 2016
Multimodal HMI for Advanced Driver Assistance
![Page 2: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/2.jpg)
Content
Page 2
Introduction
HMI & Multimodal
Technical Concept
Proof of Concept
Customer Research Findings
Conclusion
![Page 3: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/3.jpg)
Visteon Fast Facts
Page 3
+11,000EMPLOYEES
9GLOBALTECH CENTERS
14 REGIONAL TECHCENTERS
MANUFACTURINGLOCATIONS22 3.0B
CONSOLIDATEDANNUAL SALES
$
21OPERATING INCOUNTRIES
ARGENTINA, BRAZIL, BULGARIA, CHINA, FRANCE, GERMANY, HUNGARY, INDIA, JAPAN, MACEDONIA, MEXICO, PORTUGAL, RUSSIA, SLOVAKIA, SOUTH AFRICA, SOUTH KOREA, SPAIN, THAILAND, TUNISIA, UNITED KINGDOM, UNITED STATES
![Page 4: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/4.jpg)
Page 4
Increased Focus on User Experience via Innovative Displays and Gesture
Market Technology Trends
![Page 5: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/5.jpg)
Page 5
ADAS
Forward Collision WarningLane Departure Warning
Surround ViewPark Assist
Autonomous Driving
V2XDriver MonitorNight VisionPlatooning
High Definition MapsPrecision Positioning
2010-2015 2015-2020
Roadmap for Autonomous Car Technology
Technology Trends Driving Opportunity in Adjacent Products
![Page 6: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/6.jpg)
Visteon Core Business
Page 6
Complete cockpit electronics portfolio positions Visteon well for continued growth
![Page 7: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/7.jpg)
Multimodal Perception
Page 7
Environment
Visual Acoustic Tactile Smell Taste
Brain
Environment
Multi Sensor Processing
Voice, Handy/Body Movement, Facial Expression, Gaze etc.
![Page 8: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/8.jpg)
Why visual HMI?
Page 8
Head-Up Display is Visual Assistance System to increase Driving Safety and User Experience
Goa
ls
Security - driver can keep the eyes on the road while reading an information Relaxed vision - no/low accommodation, excellent perceptibility Low distraction - relevant and intuitive information about driving and ADAS Fast information flow - direct relation between displayed info and environment.
![Page 9: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/9.jpg)
Why Audio HMI?
The human ear is always active.
The ear is permanently listening in all directions.
So far the acoustic channel is hardly used for automotive HMI.
Page 9
Goa
ls
Bikes
TrafficForward Collision Warning
Pedestrians
Using the capability of the human ear to perceive spatial sounds for intuitive information transfer.
Integrating the driver into his environment through acoustic cues.
![Page 10: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/10.jpg)
Proof of Concept – development pillars
Page 10
Vehicle & Sound
Vehicle & Sound Scenarios & Simulation Multi modal HMI & Tools
![Page 11: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/11.jpg)
Technical Concept
Page 11
Interface
3D Virtual Environmentor vehicle sensor frontend
Proximity & Audiocontrol algorithms
Goa
ls
Provide a full development tool chain to simulate, parameterize and test Audio HMI for Advanced Driver Assistance user scenarios
Use production near Software and frameworks for fast conversion to a product
Interface
Multi modal HMI
Parameters Parameters
![Page 12: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/12.jpg)
Proof of Concept – Vehicle & Sound
Page 12
Multi modal vehicle HMI Demo Scenarios and media
Audio System development Cockpit integration
![Page 13: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/13.jpg)
Proof of Concept – Scenarios & Simulation
Page 13
Customer specific scenarios in virtual environment
Simulator Experience design
![Page 14: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/14.jpg)
Proof of Concept – Multi modal HMI & Tools
Page 14
Tool chain for parameterization
GUIs for multi modality
![Page 15: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/15.jpg)
Customer Research – Test group
Page 15
69%
31%Female
Male
GenderVehicle Segments Age Range
26%
49%
26%18-32
33-45
46-65
2%
71%
27%
D
B
E
Sam
ples
Focus on D and E-segment vehicles Gender mixed population Majority of participants in mid-age range
![Page 16: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/16.jpg)
Customer Research – General Findings
Page 16
• Distracting in some situations/ too much (23%)
• Could be irritating (14%)
• Unsettling (7%)
• Needs adaptation (5%)
Initial Reaction to the TechnologyInitial Reaction to the Technology
Very Negative
Neutral
Very Positive
*Top 2 Box Score
84%*
• Increased safety, avoids accidents (30%)
• Useful, supportive (21%)
• Shows hints from every direction /for all risks(14%)
• Sounds raise attention (14%)
• Good in general (7%)
• Quicker reaction (5%)
• Especially pedestrian alert very good (5%)
“I don’t want to have signal alerts
all the time, it should be tuned”
Res
ults
Immersive Audio HMI received very positive feedback. Especially the safety factor and its usefulness was considered a benefit
Audio is generally a good addition to visual assistance support but need to be carefully applied
![Page 17: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/17.jpg)
Res
ults
Customer Research – Multi Modality
Page 17
43% 23% 34%
*Top 2 Box Score
Added value of visual/ audio support
Very Negative
Neutral
Very Positive
91%*
Evaluation of using vision and sound
80%*
56% 25% 19%
Audio Both equally Visual
Benefit of audio and visual warnings**
Importance of audio and visual support
Low
Neutral
High
Using visual and audio support is perceived as a high value add. Overall, an audio signal is perceived more important. Especially the
benefit of audio warnings is rated more important than visual warnings.
![Page 18: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/18.jpg)
Res
ults
Customer Research – Safety perception
Page 18
Only 1 out of 5 is concerned about potential distraction. The immersive audio HMI technology especially stands for safety. Vast majority imagine having this technology and would be happy to use it.
Safe
Imaginable for next car
Happy to get this support
Enjoyable
Real help
Distracting
82%
80%
75%
73%
64%
20%
![Page 19: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/19.jpg)
Res
ults
Customer Research – Dynamic Sound Evaluation
Page 19
Informative aspect of warning is significantly improved Dynamic sounds created by Object Based Audio are easier to locate. ADAS use cases can benefit from this technology.
Semantic evaluation of soundsDynamic (moving) sound objects evaluation
![Page 20: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/20.jpg)
Conclusion
Immersive audio HMI is a new dimension of augmented reality in addition to head-up display HMI
Multimodal HMI is an intuitive way for relevant information about driving environment, especially for dynamic objects
Visteon innovation lab framework enables this functionality in the vehicle
Page 20
![Page 21: Multimodel HMI for Advanced Driver Assistance](https://reader035.fdocuments.net/reader035/viewer/2022062522/587296311a28ab36118b75e5/html5/thumbnails/21.jpg)
Page 21
www.visteon.com