Interconnect Your Future - Dell Technologies HPC Community...Dell EMC - Mellanox HPC Ready Solutions...
Transcript of Interconnect Your Future - Dell Technologies HPC Community...Dell EMC - Mellanox HPC Ready Solutions...
1© 2018 Mellanox Technologies
Paving the Road to ExascaleJune 2018
Interconnect Your Future
2© 2018 Mellanox Technologies
The Need for Intelligent and Faster Interconnect
CPU-Centric (Onload) Data-Centric (Offload)
Must Wait for the DataCreates Performance Bottlenecks
Faster Data Speeds and In-Network Computing Enable Higher Performance and Scale
GPU
CPU
GPU
CPU
Onload Network In-Network Computing
GPU
CPU
CPU
GPU
GPU
CPU
GPU
CPU
GPU
CPU
CPU
GPU
Analyze Data as it Moves!Higher Performance and Scale
3© 2018 Mellanox Technologies
In-Network Computing to Enable Data-Centric Data Centers
GPU
CPU
GPU
CPU
GPU
CPU
CPU
GPU
GPUDirect
RDMA
Scalable Hierarchical
Aggregation and
Reduction Protocol
NVMeOver
Fabrics
4© 2018 Mellanox Technologies
SHARP AllReduce Performance Advantages 1500 Nodes, 60K MPI Ranks, Dragonfly+ Topology
SHARP Enables Highest Performance
5© 2018 Mellanox Technologies
Performs the Gradient AveragingReplaces all physical parameter serversAccelerate AI Performance
SHARP Accelerates AI Performance
The CPU in a parameter server becomes the bottleneck
6© 2018 Mellanox Technologies
Supporting Variety of Topologies
Torus DragonflyFat Tree Hypercube
7© 2018 Mellanox Technologies
Traditional Dragonfly vs Dragonfly+
Dragonfly+s
3
1
2 l1
s
3
1
2 l1
s
3
1
2 l1
s
3
1
2 l1
8© 2018 Mellanox Technologies
Dell EMC – Mellanox Deliver Leading HPC/AI Systems
9© 2018 Mellanox Technologies
Dell EMC - Mellanox HPC Ready Solutions
Research Quickly adopt HPC solutions that match the unique needs of a wide variety of workloads involving complex scientific
analysis http://en.community.dell.com/techcenter/high-performance-computing/b/general_hpc/archive/2016/11/11/deep-
learning-performance-with-p100-gpus
Life sciences Accelerate time-to-insight for a range of applications, including drug design, cancer research, agriculture, forensics,
genomics and bioinformatics http://en.community.dell.com/techcenter/blueprints/blueprint_for_hpc/m/mediagallery/20441607/download
Digital manufacturing Optimize the performance of your software licenses with HPC solutions designed specifically for computer-aided
engineering (CAE) http://en.community.dell.com/techcenter/blueprints/blueprint_for_hpc/m/mediagallery/20442894/download
High-performance data analytics (HPDA) Explore the possibilities of machine learning, deep learning and artificial intelligence (AI) with benchmarked and optimized
HPDA configurations https://www.dellemc.com/en-us/solutions/data-analytics/machine-learning/index.htm#overlay=/collateral/solution-
overview/ready-solns-for-ai-machinedeep-learning-sol-overview.pdf
10© 2018 Mellanox Technologies
Thank You