Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving...
Transcript of Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving...
![Page 1: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/1.jpg)
1© 2015 The MathWorks, Inc.
Designing Perception Systems for
Autonomous Driving
Avinash Nehemiah
November 3, 2016
![Page 2: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/2.jpg)
2
How Autonomous Driving Impact our Lives
1. Safety
Reduce traffic accidents 90%
Save 30,000 lives/year ( on-par with modern vaccines)
2. Redefine logistics – substantial fuel savings
Reduce cost
Environment friendly
3. Save us from our daily commutes
Engineers in autonomous driving choose MATLAB and Simulink.
![Page 3: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/3.jpg)
3
MATLAB and Simulink in Perception Systems for Autonomous Driving
Sensor
Design
Signal
Processing
Sensor
Fusion
Decision
Logic
DelphiRadar Sensor
Alignment Algorithm
for Automotive Active
Safety System
User
Story
ContinentalTraffic Sign
Recognition for
Driver Assistance
Systems
ScaniaModel-Based Approach
to Resource-Efficient
Object Fusion for an
Autonomous Braking
System
21:
21
Magna
![Page 4: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/4.jpg)
4
MATLAB Helps Engineers…
VisualizeImplementDesign
![Page 5: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/5.jpg)
5
Test Vehicle Equipped with Various Sensors
Delphi ESR
• 76GHz electronically scanning radar
• Dual FoVs, 90x60m, 20x174m
• CAN interface
Mobileye 560
• FoV: 38x150m
• CAN interface
Mobileye
560
Delphi
ESR
Point Grey Blackfly
• Stand “ice cube” vision camera
• 800x600, 27FPS
• GigE interface
XSENS MTI-G-700
• Stable and sensitive
• MEMS-based AHRS
• USB interface
Velodyne LiDAR HDL-32E
• Horizontal FoV: 360
• Vertical FoV: +10..-30
• Range: 80..100m
• 100 Mbps Ethernet
![Page 6: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/6.jpg)
7
Two Examples for Today
Sensor
Design
Signal
Processing
Sensor
Fusion
Decision
Logic
Sensor Fusion
(Camera + Radar) LiDAR Processing
![Page 7: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/7.jpg)
8
Visualize Data and Gain Insight
![Page 8: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/8.jpg)
9
MATLAB Helped Us…
VisualizeImplementDesign
Visualize sensors
– Cameras
– LiDAR
– Radar
Create custom apps
and visualizations
![Page 9: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/9.jpg)
10
Design Algorithms with MATLAB
![Page 10: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/10.jpg)
11
Design Algorithms with MATLAB
1. Filter false detections from radar
2. Sensor fusion and tracking
using Kalman filters
3. Decision logic
![Page 11: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/11.jpg)
12
MATLAB Helped Us…
VisualizeImplementDesign
Algorithms for multiple
domains:– Computer vision
– Radar
– Sensor fusion
Toolboxes just work
![Page 12: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/12.jpg)
13
Implement Algorithms in C Code
![Page 13: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/13.jpg)
14
MATLAB Helped Us…
VisualizeImplementDesign
Faster iteration by
generating C code
![Page 14: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/14.jpg)
15
Design LiDAR Processing for Autonomous Driving
![Page 15: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/15.jpg)
16
Design LiDAR Processing for Autonomous Driving
![Page 16: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/16.jpg)
17
MATLAB Helps Engineers…
VisualizeImplementDesign
Visualize most sensors– Cameras
– LiDAR
– Radar
Create custom apps
and visualizations
Faster iteration by
generating C code
Algorithms for multiple
domains:– Computer vision
– Deep learning
– Radar
Toolboxes just work
![Page 17: Designing Perception Systems for Autonomous Driving · November 3, 2016. 2 How Autonomous Driving Impact our Lives 1. Safety ... Logic Delphi Radar Sensor Alignment Algorithm for](https://reader034.fdocuments.net/reader034/viewer/2022051822/5fecf903b82bd1136a4feefa/html5/thumbnails/17.jpg)
18
See the demos in person at our booth