Computing Memory-Driven - Amazon Web...
23
Memory-Driven Computing A story about The Machine and Gen-Z
Transcript of Computing Memory-Driven - Amazon Web...
Memory-DrivenComputingA story about The Machine and Gen-Z
What is the motivation?
2
The New Normal: Compute is not keeping up
3
Data(Zettabytes)
Data nearly doubles every two years (2013-2020)
Data growth
Transistors(thousands)
Single-threadPerformance(SpecINT)
Frequency(MHz)
Typical Power(Watts)
Number of Cores
Microprocessors107
106
105
104
103
102
101
100
The past 60 years
4
1950s 1960s 1970s 1980s 1990s 2000s Today
It’s time to rethinkhow computers are built
RDBMS
httpd
Memory-Driven Computing
5
SoC SoC
SoCS
oC
SoC
SoCSoC
SoC
SoC
SoC
SoC
SoC
MemoryMemory
Mem
ory
Mem
oryM
emory
Memory
MemoryMemory
Mem
ory
Mem
ory
Mem
ory
Memory
Memory-DrivenComputing
Processor-Centric ComputingMemory
+Fabric
Customize the hardware to the workload
7
Special Purpose Compute
Reduced costLess energyLess spaceLess complex
GPU DSP
x86A
SIC
Phot
onic
Neuro
Quantum
POWER
SPARC
RIS
CV
ARM
FPGA
Memory
8
Q: How do we get to Memory-Driven
Computing?
The Machine Program: Memory fabric testbed
9
HPE demonstrated the world’s first Memory-Driven Computing architecture: Major milestone for The Machine project
10
On Nov 28, 2016, we announced the fundamental building blocks of the new architecture are working together demonstrated…
• Compute nodes accessing a shared pool of Fabric-Attached Memory;
• An optimized Linux-based operating system (OS) running on a customized System on a Chip (SOC);
• Photonics/Optical communication links, including the new X1 photonics module (our chip for optical transmission) are online and operational;
• New software programming tools designed to take advantage of abundant persistent memory.
Nod
e
Switch
11
4TB Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
SoC256GB DRAM
SoCDRAM
SoCDRAM
SoCDRAM
SoCDRAM
SoCDRAM
SoCDRAM
Fabric Switch
Switch
Switch
Switch
Switch
Switch
Switch
Transform performance with Memory-Driven programming
In-memory analytics
15xfaster
New algorithms Completely rethinkModify existing frameworks
Similarity search
20xfaster
Financial models
8,000xfaster
Large-scalegraph inference
100xfaster
12
The Emulated Machine The Simulated Machine The Machine
Hardware/Software co-development
Hardware development
Software development
13
The Machine DistributionSoftware stack for Memory-Driven Computing
Machine (Prototype) hardware
The Machine Distribution
Node Operating System
Persistent Memory Library
(pmem.io)
Librarian File System (LFS)
Fabric-attached memoryatomics library
Linux (L4TM)
Example Applications
ManagementServices
Librarian
Data Management & Programming FrameworksManaged data
structuresSPARKLE
Emulation/Simulation ToolsPerformance
emulation for NVMFabric attached
memory emulation
X’86 emulation hardware Open sourced components
Fault-tolerant programming
Fast optimistic engine
Programming and analytics toolsOperating system supportEmulation/simulation tools
14http://www.labs.hpe.com/research/themachine/TheMachineDistribution
What are core Memory-Driven Computing components?
15
Combining memory and storage in a stable
environment to increase processing speed and
improve energy efficiency
Using photonics where necessary to eliminate
distance and create otherwise impossible topologies
Optimizing processing from general to specific tasks
Radically simplifying programming and enabling
new applications that we can’t even begin to build today
Fast, persistentmemory Fast memory fabric Task-specific
processing New software
MDC drives new computer scienceOne architecture scales from the dense data center to the intelligent edge
16
Memory Abundance
– Similarity search– Search space optimization– Financials futures modeling
Non-volatilityof Memory
– Scalable transactional key value stores
– Managed data structures– Energy scalability and retention
Memory shared withjust the right compute
– Spark in-memory Hadoop– Deep neural net training– Network function virtualization
Dynamic Range
– Memory-Driven Computing edge
– Consistent node, enclosure, rack, row, data center
Memory-Driven Computing
Photonic fabrics destroy distance
17
Photonics
Hundreds of racks can behave as a single server
= 4096 yottabytes292bytes
High BandwidthLow Latency
Advanced workloads & technologies
CompatibleEconomical
Gen-ZA new data access technology
Open Standard
I/O
Accelerators
FPGA GPU
CPUs
SoC SoC GPUFPGA
MemoryMemoryMemory Memory
Pooled Memory Network Storage
Direct Attach, Switched, or Fabric Topology
18
Gen-Z – Interconnect for Fabric Attached Memory
I/O
Accelerators
FPGA GPU
CPUs
SoC SoC GPUFPGA
MemoryMemoryMemory Memory
Pooled Memory Network Storage
19
Gen-Z – Interconnect for Messaging
I/O
Accelerators
FPGA GPU
CPUs
SoC SoC GPUFPGA
MemoryMemoryMemory Memory
Pooled Memory Network Storage
20
Gen-Z – Interconnect for Composable IO
I/O
Accelerators
FPGA GPU
CPUs
SoC SoC GPUFPGA
MemoryMemoryMemory Memory
Pooled Memory Network Storage
21
Industry collaboration on interconnect technology
Industry leaders developing anext generation, memory-semantic interconnect
22
For more resources on MDC & The Machine
23
Overview − The Machine www.hpe.com/themachine− The Machine news room https://www.hpe.com/us/en/newsroom/news-archive/feature/2016/06/The-Machine-Discover.html − Memory-Driven Computing https://www.labs.hpe.com/next-next/mdc
Articles and important announcements− Adapting to Thrive in a New Economy of Memory Abundance
https://www.labs.hpe.com/pdf/IEEE_Adapting_to_Thrive_in_a_New_Economy_of_Memory_Abundance.pdf − HPE Demonstrates World’s First Memory-Driven Computing Architecture
https://www.hpe.com/us/en/newsroom/news-archive/press-release/2016/11/1287610-hewlett-packard-enterprise-demonstrates-worlds-first-memory-driven-computing-architecture.html
− The Data Center of the Future, Here Today https://www.hpe.com/us/en/newsroom/news-archive/featured-article/2016/11/The-Data-Center-of-the-Future-Here-Today-Technologies-from-The-Machine-Program-Drive-Hybrid-Infrastructure-Portfolio-and-Future-Innovations.html
Technical articles− Drilling Down Into The Machine From HPE https://www.nextplatform.com/2016/01/04/drilling-down-into-the-machine-from-hpe/ − The Intertwining Of Memory And Performance Of HPE’s Machine
https://www.nextplatform.com/2016/01/11/the-intertwining-of-memory-and-performance-of-hpes-machine/ − Weaving Together The Machine’s Fabric Memory https://www.nextplatform.com/2016/01/18/weaving-together-the-machines-fabric-memory/ − The Bits And Bytes Of The Machine’s Storage https://www.nextplatform.com/2016/01/25/the-bits-and-bytes-of-the-machines-storage/ − Non Volatile Heaps And Object Stores In The Machine https://www.nextplatform.com/2016/02/08/non-volatile-heaps-object-stores-machine/ − Operating Systems, Virtualization, And The Machine https://www.nextplatform.com/2016/02/01/operating-systems-virtualization-machine/ − Future Systems: How HP Will Adapt The Machine To HPC
https://www.nextplatform.com/2015/08/17/future-systems-how-hp-will-adapt-the-machine-to-hpc/ − Spark on Superdome X Previews in-memory on The Machine
https://www.nextplatform.com/2016/04/11/spark-superdome-x-previews-memory-machine/
