GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex...
Transcript of GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex...
![Page 1: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/1.jpg)
Saurabh Jain
GIVING 5G NETWORKS THE EDGE IN SMART CITIES
![Page 2: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/2.jpg)
2
AI AT THE EDGE IS A BIG OPPORTUNITY
5GIOT AI
![Page 3: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/3.jpg)
3
5G CLOUD-NATIVE MOBILE EDGE RUNS MANY WORKLOADS
VNF
5G vRAN
CLOUD NATIVE
AI
AR/VR
Gaming
OFF THE SHELF SERVERS
WITH GPUS (COTS)
![Page 4: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/4.jpg)
4
MANAGEMENTCLOUD NATIVE SECURITY
Continuous improvement and deployment
from cloud/data center to edge
Software and model deployment,
management and orchestration at scale
Enforce trust for every element
of the stack
CLOUD
DATA CENTER EDGE
CLOUD
EDGE
DATA CENTER
CLOUD DATA CENTER EDGE
THE CHALLENGE WITH AI AT THE EDGE
![Page 5: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/5.jpg)
5
NVIDIA EGX PLATFORM
APPLICATION FRAMEWORKS AND SDKs
NVIDIA EGX STACK
NGC SOFTWARE ECOSYSTEM PARTNER
Kubernetes Containers CUDA-X IoT Runtime
NVIDIA EGX SERVER
GPU | AI | STORAGE NETWORKING | SECURITY
![Page 6: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/6.jpg)
6
IOT SENSORS AND PIXELS TO INSIGHTS FOR EFFICIENCY
Access Control Public Transit Industrial Inspection Traffic Engineering
Retail Analytics Logistics Critical Infrastructure Public Safety
![Page 7: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/7.jpg)
7
![Page 8: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/8.jpg)
8
METROPOLIS FOR SMART CITIES
NVIDIA EDGE STACK
Kubernetes Containers CUDA-X IoT Runtime
METROPOLIS EGX APPLICATION FRAMEWORK
Sensor/Camera
Management
& Aggregation
Deepstream
RT AnalyticsSmart Indexing
& StorageRules
Engine
Visualization
Toolkit
NVIDIA EGX SERVER
GPU | AI | STORAGE NETWORKING | SECURITY
SOFTWARE APPLICATIONS
![Page 9: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/9.jpg)
9
CERTIFIED APPLICATIONS
Software Vendors EGX Servers NVIDIA Profiling Tools Application Certification
System Sizing Guide
NGC Ready Application Helm and Docker
Performance & Utilization Data
![Page 10: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/10.jpg)
10
AVAILABLE ON NGC
![Page 11: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/11.jpg)
11
APPLICATION EXAMPLES FOR EDGE DEPLOYMENT
Self check-out in retailBusiness intelligence
Operations and logistics
![Page 12: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/12.jpg)
12
NVIDIA METROPOLIS ISV PARTNERS
![Page 13: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/13.jpg)
13
START DEPLOYING WITH NVIDIA EGX AND METROPOLIS
EXPLORE METROPOLIS | EXPLORE EGX | METROPOLIS SOFTWARE PARTNERS
![Page 14: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/14.jpg)
14
![Page 15: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/15.jpg)
15
SENSORS TO INSIGHT WITH EDGE AI
![Page 16: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/16.jpg)
16
LEGACY APPROACH TO WIRELESSDedicated hardware for every function
DEDICATED FIXED-FUNCTION SYSTEMS
4G RAN
![Page 17: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/17.jpg)
17
![Page 18: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/18.jpg)
18
NVIDIA EGX BENEFITS
Largest domain of AI models
High throughput & low latency
One architecture scalable from device to cloud
NVIDIA is the Industry’s Most
Advanced AI Computing Platform
Hardware & software optimized for AI, storage, networking & security
Easy development & deployment of AI at edge
Optimized AI frameworks in NGC
NVIDIA EGX is AI-Optimized
for Industry Use Cases
Support for every platform — VMW, RH, NTNX, Azure, AWS, GCP
Rich 3rd party ISV ecosystem
Rich OEM & integrator ecosystem
NVIDIA is an
Open Platform
Every cloud
Hybrid cloud
Every system maker
Edge-to-data center-to-cloud
NVIDIA has a Pervasive
AI Platform
End-to-end, from development to deployment, from tools to experts
NVIDIA Research
DLI to reskill talent
SA & DevTech to co-engineer
NVIDIA has
Deep AI Expertise
Expertise in large verticals — M&E, healthcare, retail, manufacturing, transportation, & more
BD, SA, DevRel, DevTech, Research in every region
NVIDIA has Global Reach
and Support
![Page 19: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/19.jpg)
19
Restarts containers that fail, replaces
and reschedules when nodes die
Scale your application up and down
with a simple command, with a UI, or
automatically based on usage.
Kubernetes builds upon 15 years of
experience of running production
workloads at Google, combined with
best-of-breed ideas and practices
from the community
AUTO SCALINGSELF-HEALING INDUSTRY STANDARD
Kubernetes for Cloud Native
![Page 20: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/20.jpg)
20
Simplifies Deployments
• Easily deploy complex applications in one step
• Simple rollbacks
- Shareable through a local or cloud registry
Templated for Scalability
- Deploy many copies of an application without conflicts
- Deploy to multiple locations with a single command
Consistent CI/CD Integration
• Helm charts easily set up consistent environments for CI/CD pipelines
NGC HELM: ACCELERATING DEPLOYMENTS
Helm Registry
- Publish or share helm charts privately for inclusion in CI/CD
Curated ISV Software
• Readily deploy secured, GPU-optimized AI software
![Page 21: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/21.jpg)
21
THE MOST POWERFUL TECHNOLOGY FORCE OF OUR TIME
AI COMPUTING
AI CLOUD
AI EDGE
AI ROBOTICS
![Page 22: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/22.jpg)
22
AI COMPUTING
AI CLOUD
AI EDGE
AI ROBOTICS
![Page 23: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/23.jpg)
23NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE.
METROPOLIS VIRTUAL PLATFORM
GPU SERVER
METROPOLIS APPLICATION FRAMEWORKAPPLIC
ATIO
NS
WIDE RANGE OF INDUSTRIES & USE-CASES
NVDOCKER KUBERNETES DEEPSTREAM CUDAVIDEO STREAM
MANAGEMENTMETADATA HUB
Frictionless
access controlSecuring
infrastructure Smart parkingLoss
prevention &
checkout
Crowd
analytics &
management
Operations and
logistics
Intelligent
traffic systems
![Page 24: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/24.jpg)
24
Metropolis egx open Ai city platform
NVIDIA EDGE STACK
Kubernetes Containers CUDA-X IoT Runtime
METROPOLIS EGX APPLICATION FRAMEWORK
GPU | AI | STORAGE | NETWORKING | SECURITY
NVIDIA EGX EDGE COMPUTING PLATFORM
Sensor/Camera
Management
& Aggregation
Deepstream
RT AnalyticsSmart Indexing
& StorageRules
Engine
Visualization
Toolkit
![Page 25: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/25.jpg)
25
CLOUD-NATIVE INSTALLATIONS
BIGDATA
NVIDIA DGX/HGX
NVIDIA EGX
METROPOLIS
NGC
RAPIDS
NVIDIA DGX/HGX MELLANOX
CUML
CUGRAPH
CUDNN
GPU DIRECT
CUIO
CUDF
NVIDIA AI
DEPLOY
MANAGE
IOT
![Page 26: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/26.jpg)
26
Metropolis egx open Ai city platform
NVIDIA EDGE STACK
Kubernetes Containers CUDA-X IoT Runtime
METROPOLIS EGX APPLICATION FRAMEWORK
Sensor/Camera
Management
& Aggregation
Deepstream
RT AnalyticsSmart Indexing
& StorageRules
Engine
Visualization
Toolkit
NVIDIA EGX SERVER
GPU | AI | STORAGE NETWORKING | SECURITY
![Page 27: GIVING 5G NETWORKS THE EDGE IN SMART CITIES · Simplifies Deployments • Easily deploy complex applications in one step • Simple rollbacks - Shareable through a local or cloud](https://reader033.fdocuments.net/reader033/viewer/2022060310/5f0a922e7e708231d42c4933/html5/thumbnails/27.jpg)
27
$2T 1B+ 250M 30MMarket Sensors &
CamerasHours Spent Reviewing
Video Every YearEdge Appliances Sold Every Year
SMART city OPPORTUNITY