"Session ID: BUD17-503 Session Name: The HPE Machine and Gen-Z - BUD17-503 Speaker: Grant Likely Track: ★ Session Summary ★ With the exponential rise in quantity of data to manage, the modern data centre is increasingly limited by the capacity of individual machines. Since storage and compute demand more capacity than can be provided by a single machine, we distribute both over large clusters and use the network to transfer data between where it is stored and where it is processed. Moving all that data around uses deep storage stacks which incur a significant performance impact. If we could somehow flatten the storage stack and provide applications with direct access to data, then we could improve performance by orders of magnitude. Hewlett Packard Enterprise recently demonstrated that we can do exactly with their research project, ""The Machine"". Instead of moving data around with a network, The Machine uses multi terabytes of persistent memory and a next generation fabric-attached memory interconnect to provide a single pool of storage which can be accessed by any processor in the cluster. It shows that we can provide applications with immediate load/store access to huge data sets in a model called Memory-Driven Computing. Proof in hand, now it is time to bring Memory-Defined Computing to the data centre. Gen-Z is an open systems interconnect designed to provide memory semantic access to data and devices via direct attached, switched or fabric topologies. HPE has joined the Gen-Z consortium and is using the knowledge gained with The Machine to help shape Gen-Z to set the stage for true Memory-Driven Computing. With putting memory at the centre, this enables us to overcome the limitations of today's computing systems and power innovations. This session will cover two topics. It will start with a status update on The Machine and an overview of how it works. Then we'll shift into an introduction of Gen-Z, and how it can reshape the architecture of computing in the years to come. --------------------------------------------------- ★ Resources ★ Event Page: http://connect.linaro.org/resource/bud17/bud17-503/ Presentation: Video: https://youtu.be/1BVtChDQVyQ --------------------------------------------------- ★ Event Details ★ Linaro Connect Budapest 2017 (BUD17) 6-10 March 2017 Corinthia Hotel, Budapest, Erzsébet krt. 43-49, 1073 Hungary --------------------------------------------------- Keyword: HPE, Gen-Z http://www.linaro.org http://connect.linaro.org --------------------------------------------------- Follow us on Social Media https://www.facebook.com/LinaroOrg https://twitter.com/linaroorg https://www.youtube.com/user/linaroorg?sub_confirmation=1 https://www.linkedin.com/company/1026961"

1. Memory-Driven
Computing
A story about The Machine and Gen-Z

2. What is the motivation?
2

3. The New Normal: Compute is not keeping up
3
Data
(Zettabytes)
Data nearly doubles every
two years (2013-2020)
Data growth
Transistors
(thousands)
Single-thread
Performance
(SpecINT)
Frequency
(MHz)
Typical Power
(Watts)
Number of
Cores
Microprocessors
107
106
105
104
103
102
101
100

4. The past 60 years
4
1950s 1960s 1970s 1980s 1990s 2000s
Toda
y
It’s time to rethink
how computers are built
RDBMS
httpd

5. Memory-Driven Computing
5

6. SoC SoC
SoC
SoC
SoC
SoC
SoC
SoC
SoC
SoC
SoC
SoC
Memory
Memory
Memory
Memory
Memory
Memory
Memory
Memory
Memory
Memory
Memory
Memory
Memory-Driven
Computing
Processor-Centric
Computing
Memory
+
Fabric

7. Customize the hardware to the workload
7
Special
Purpose
Compute
Reduced cost
Less energy
Less space
Less complex
GPU DSP
x86
ASIC
Photonic
Neuro
Quantum
POWER
SPARC
RISC
VARM
FPGA
Memory

8. 8
Q: How do we get to
Memory-Driven
Computing?

9. The Machine Program: Memory fabric testbed
9

10. HPE demonstrated the world’s first Memory-Driven Computing
architecture: Major milestone for The Machine project
10
On Nov 28, 2016, we announced the fundamental building
blocks of the new architecture are working together
demonstrated…
• Compute nodes accessing a shared pool of
Fabric-Attached Memory;
• An optimized Linux-based operating system (OS)
running on a customized System on a Chip (SOC);
• Photonics/Optical communication links, including
the new X1 photonics module (our chip for optical
transmission) are online and operational;
• New software programming tools designed to take
advantage of abundant persistent memory.

11. Node
Switch
11
4TB Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
Fabric-attached memory
SoC
256GB
DRAM
SoCDRAM
SoCDRAM
SoCDRAM
SoCDRAM
SoCDRAM
SoCDRAM
Fabric Switch
Switch
Switch
Switch
Switch
Switch
Switch

12. Transform performance with Memory-Driven programming
In-memory analytics
15xfaster
New algorithms Completely rethink
Modify existing
frameworks
Similarity search
20xfaster
Financial models
8,000xfaster
Large-scale
graph inference
100xfaster
12

13. The Emulated Machine The Simulated Machine The Machine
Hardware/Software co-development
Hardware development
Software development
13

14. The Machine Distribution
Software stack for Memory-Driven Computing
Machine (Prototype) hardware
The Machine Distribution
Node Operating System
Persistent
Memory Library
(pmem.io)
Librarian File System (LFS)
Fabric-attached memory
atomics library
Linux
(L4TM)
Example Applications
Management
Services
Librarian
Data Management & Programming Frameworks
Managed data
structures
SPARKLE
Emulation/Simulation Tools
Performance
emulation for NVM
Fabric attached
memory emulation
X’86 emulation hardware Open sourced components
Fault-tolerant
programming
Fast optimistic
engine
Programming and
analytics tools
Operating system support
Emulation/simulation tools
14
http://www.labs.hpe.com/research/themachine/TheMachineDistribution

15. What are core Memory-Driven Computing components?
15
Combining memory and
storage in a stable
environment to increase
processing speed and
improve energy efficiency
Using photonics where
necessary to eliminate
distance and create otherwise
impossible topologies
Optimizing processing from
general to specific tasks
Radically simplifying
programming and enabling
new applications that we can’t
even begin to build today
Fast, persistent
memory
Fast memory fabric
Task-specific
processing
New software

16. MDC drives new computer science
One architecture scales from the dense data center to the intelligent edge
16
Memory Abundance
– Similarity search
– Search space optimization
– Financials futures modeling
Non-volatility
of Memory
– Scalable transactional key
value stores
– Managed data structures
– Energy scalability and retention
Memory shared with
just the right compute
– Spark in-memory Hadoop
– Deep neural net training
– Network function virtualization
Dynamic Range
– Memory-Driven Computing
edge
– Consistent node, enclosure,
rack, row, data center
Memory-Driven
Computing

17. Photonic fabrics destroy distance
17
Photonics
Hundreds of racks
can behave as a
single server
= 4096 yottabytes292
bytes

18. High Bandwidth
Low Latency
Advanced workloads & technologies
Compatible
Economical
Gen-Z
A new data access technology
Open Standard
I/O
Accelerators
FPGA GPU
CPUs
SoC SoC GPUFPGA
MemoryMemoryMemory Memory
Pooled Memory
Network Storage
Direct Attach, Switched, or Fabric Topology
18

19. Gen-Z – Interconnect for Fabric Attached Memory
I/O
Accelerators
FPGA GPU
CPUs
SoC SoC GPUFPGA
MemoryMemoryMemory Memory
Pooled Memory
Network Storage
19

20. Gen-Z – Interconnect for Messaging
I/O
Accelerators
FPGA GPU
CPUs
SoC SoC GPUFPGA
MemoryMemoryMemory Memory
Pooled Memory
Network Storage
20

21. Gen-Z – Interconnect for Composable IO
I/O
Accelerators
FPGA GPU
CPUs
SoC SoC GPUFPGA
MemoryMemoryMemory Memory
Pooled Memory
Network Storage
21

22. Industry collaboration on interconnect technology
Industry leaders developing a
next generation, memory-semantic
interconnect
22

23. For more resources on MDC & The Machine
23
Overview
− The Machine www.hpe.com/themachine
− The Machine news room https://www.hpe.com/us/en/newsroom/news-archive/feature/2016/06/The-Machine-Discover.html
− Memory-Driven Computing https://www.labs.hpe.com/next-next/mdc
Articles and important announcements
− Adapting to Thrive in a New Economy of Memory Abundance
https://www.labs.hpe.com/pdf/IEEE_Adapting_to_Thrive_in_a_New_Economy_of_Memory_Abundance.pdf
− HPE Demonstrates World’s First Memory-Driven Computing Architecture
https://www.hpe.com/us/en/newsroom/news-archive/press-release/2016/11/1287610-hewlett-packard-enterprise-demonstrates-worlds-first-
memory-driven-computing-architecture.html
− The Data Center of the Future, Here Today
https://www.hpe.com/us/en/newsroom/news-archive/featured-article/2016/11/The-Data-Center-of-the-Future-Here-Today-Technologies-from
-The-Machine-Program-Drive-Hybrid-Infrastructure-Portfolio-and-Future-Innovations.html
Technical articles
− Drilling Down Into The Machine From HPE https://www.nextplatform.com/2016/01/04/drilling-down-into-the-machine-from-hpe/
− The Intertwining Of Memory And Performance Of HPE’s Machine
https://www.nextplatform.com/2016/01/11/the-intertwining-of-memory-and-performance-of-hpes-machine/
− Weaving Together The Machine’s Fabric Memory https://www.nextplatform.com/2016/01/18/weaving-together-the-machines-fabric-memory/
− The Bits And Bytes Of The Machine’s Storage https://www.nextplatform.com/2016/01/25/the-bits-and-bytes-of-the-machines-storage/
− Non Volatile Heaps And Object Stores In The Machine https://www.nextplatform.com/2016/02/08/non-volatile-heaps-object-stores-machine/
− Operating Systems, Virtualization, And The Machine https://www.nextplatform.com/2016/02/01/operating-systems-virtualization-machine/
− Future Systems: How HP Will Adapt The Machine To HPC
https://www.nextplatform.com/2015/08/17/future-systems-how-hp-will-adapt-the-machine-to-hpc/
− Spark on Superdome X Previews in-memory on The Machine
https://www.nextplatform.com/2016/04/11/spark-superdome-x-previews-memory-machine/