Autonomous Vehicle · Autonomous Vehicle . History of ... // ... •Each Autonomous Vehicles ...
BUILDING AUTONOMOUS VEHICLES USING DRIVE PX 2...Shri Sundaram, May 8, 2017 BUILDING AUTONOMOUS...
Transcript of BUILDING AUTONOMOUS VEHICLES USING DRIVE PX 2...Shri Sundaram, May 8, 2017 BUILDING AUTONOMOUS...
-
Shri Sundaram, May 8, 2017
BUILDING AUTONOMOUS VEHICLES USING DRIVE PX 2
-
2
Autonomous Vehicles Artificial Intelligence
NVIDIA AT THE CENTER OF AV REVOLUTION
-
3
Launched CES 2016
Spike in AV AI engagements after we powered on the discrete GPU late last year
DRIVE PX 2 DRIVING AV AI
-
4
DRIVE PLATFORM TODAY FOR LEVEL 3/4
DRIVE PX (Xavier)
-
5
BUILDING BLOCKS
Autonomous Driving SDK
Compute – APIs and Libraries
Compute Engines & IOs
• DriveWorks
• CUDA
• CuDNN
• Tensor RT
• NVMedia
• GPU
• Accelerators
• Sensors
-
6
BUILDING BLOCKS
Autonomous Driving SDK
Compute – APIs and Libraries
Compute Engines & IOs
• DriveWorks
• CUDA
• CuDNN
• Tensor RT
• NVMedia
• GPU
• Accelerators
• Sensors
-
7
COMPUTE & IO
System
IOs: 70+ Gbps
Compute: 20+ DL TOPS
SW: Linux, RFS, BSP, OTA
Sensors/Actuators
Camera, Lidar, Radar
DBW, CAN interface
+ More incl. IMU, GPS, V2X modules
-
8
BUILDING BLOCKS
Autonomous Driving SDK
Compute – APIs and Libraries
Compute Engines
• DriveWorks
• CUDA
• CuDNN
• Tensor RT
• NVMedia
• GPU
• Vision Processors
• Accelerators
-
9
CUDA
DRIVE PX 2 has latest CUDA-capable GPU – 4x!
Runs latest CUDA 8.
Includes CUDA accelerated DL SDK
TensorRT
CuDNN
CuBLAS.
-
10
TENSOR RTGPU Inference Engine
-
11
NVMEDIA
NVMedia: APIs to control cameras as well data
NVMedia abstracts:
• Image capture
• Image Signal processor
• 2D Engine
• Encoding
• Interop with other SW components
-
12
BUILDING BLOCKS
Autonomous Driving SDK
Compute – APIs and Libraries
Compute Engines
• DriveWorks
• CUDA
• CuDNN
• Tensor RT
• NVMedia
• GPU
• Vision Processors
• Accelerators
-
13
DRIVEWORKS
Input
Perceive
Localize
Visualize
Vehicle Control
APIsSensors
IMU
GPS
Image Processing
DNN interface
CV Modules
HD Maps interface
CAN/DBW Kit
interface
Tools -Calibration and sensor registration
Vehicle rig configuration
Data Logging/Acquisition
Samples/ Previews
Sensor visualization
DriveNet
LaneNet
Several CV examples
Occupancy Grid
*PilotNet
-
14
DRIVE PLATFORM
DriveWorks
CUDA, CuDNN, TensorRT
NVMedia
DRIVE PX 2 — System Software
DRIVE PX 2 — System Hardware Vehicle Control
DNNs and Autonomous Driving Applications
Sensors
HD Maps
-
15
PX2: ON WHEELS
HW
DRIVE PX 2 nicely mounted in the trunk of a car, pre-wired for cameras, and other sensors
Sensors - Your choice or NVIDIA’s configuration.
SW
All of what comes with DRIVE PX2
Photo Courtesy: AutonomouStuff
-
16
DRIVE PLATFORM
HW
ZF Pro AI – built on DRIVE PX 2 Auto Cruise
Bosch – building on DRIVE PX using Xavier
Xavier: 30 DL TOPS + ASIL-C for Level 4
SW
QNX - Common arch across Linux and QNX
Common APIs across CUDA, TensorRT, cuDNN, NvMedia + Support for POSIX APIs
For production
http://www.qnx.com/partners/partner.html?partnerid=161247
-
17
OTHER RESOURCES
Tools
Application Development tools
Developer Zone (developer.nvidia.com/DRIVE)
Developer Forums (devtalk.nvidia.com)
Schools
Deep Learning Institute – Autonomous Driving
Udacity Nanodegree
-
18
DRIVE Platform
DRIVE Platform – Open AI Autonomous Vehicle platform
One architecture, from L2 to L3 to L4 to AI Car
DRIVE PX 2 for L3, L4 development today