The 2020 Q2 update for Asia OEMs/ODMs about Arm server SOC.

1. Copyright © 2020 Arm Limited
The Cloud to Edge Infrastructure Foundation
for a World of 1T Intelligent Devices
arm NEOVERSE
Paul Yang, Arm
Infrastructure Line of Business
Q2 2020
Arm Neoverse Market
Opportunities

2. 2 Confidential © 2020 Arm Limited
Agenda
1 Arm Footprint in Data Center and Edge
2 Arm-based Server Introduction
3 SmartNIC Use Cases
4 Arm uCPE as Edge Use Case
5 Arm Neoverse Roadmap
6 Open Discussion on Future Areas for Engagement

3. 3 Confidential © 2020 Arm Limited
Arm Neoverse Momentum in Data Center
2018
2019
2020
AWS announced 2nd Generation
Arm-based Graviton2 Server CPU
Marvell's ThunderX2 Solution
for Microsoft Azure Development
Nvidia brings its CUDA
stack to Arm Platforms
VMware demonstrated
ESXi on 64-bit ARM
Huawei releases Kunpeng 920
CPU and TaiShan servers
Ampere announced industry’s
1st 80-Core Server SoC
Arm Neoverse Announced
Neoverse N1 & E1
Platforms announced
Marvell Announced 96-core
ThunderX3 Server SoC
Amazon Launches
ARM AWS Graviton CPU
Tencent to use Huawei TaiShan
servers for Cloud gaming
Baidu selects Broadcom
Stingray2 for SmartNIC
Docker and Arm Partner for
Cloud-native Software Dev

4. 4 Confidential © 2020 Arm Limited
Expansive Arm footprint from end-point to Cloud
Routing à Industrial, SMB, Embedded
Switching à Industrial, Enterprise
End points + Device Gateway à Network Edge à Edge Servers à Cloud / Data Center + HPC

5. 5 Confidential © 2020 Arm Limited
Breadth of SW Ecosystem Supporting Arm
Workloads
Container &
Virtualization
Language & Library
Operating System
Networking
CI/CD
Drone.io

6. 6 Confidential © 2020 Arm Limited
AWS Graviton2 - an Arm based Server Processor
First Arm-based processor
available in major cloud
Up to 16 vCPUs, 10Gbps
enhanced networking, 3.5Gbps
EBS bandwidth
Built on 64-bit Arm Neoverse cores
with AWS-designed silicon using
16nm manufacturing technology
Graviton Processor
Built with 64-bit Arm Neoverse
cores with AWS-designed silicon
using 7nm manufacturing
technology
Up to 64 vCPUs, 25Gbps
enhanced networking, 18Gbps
EBS bandwidth
7x performance, 4x compute cores,
and 5x faster memory
Graviton2 Processor

7. 7 Confidential © 2020 Arm Limited
On a broad range of workloads Arm N1 outperforms Xeon
Performance uplift: M6g (AWS Graviton2) over M5 (Intel Xeon)
SPEC
jvm2008
Memcached
x264
Media
Encoding
Machine
Learning:
On-CPU
Inference
EDA Simulation on
Cadence Xcellium
SPECint2017
M5 (Intel Xeon) = 100%
M6g (AWS Graviton2)
% uplift over M5
124% 124%
126%
Nginx
Reverse Proxy
SPECfp2017
128%
143% 143%
144%
154%

8. 8 Confidential © 2020 Arm Limited
Marvell ThunderX based servers for Cloud & HPC
Project Olympus OCP C50
Exeggcute Series 5U 10 node
R281-T91/R281-T90 H261-T61/H261-T60
R181-T90
Available NOW – winning in cloud and HPC
For more information contact Marvell
Coming SOON
>25% IPC performance improvement
>60% Single Thread performance improvement
>3x Socket Level performance improvement
ThunderX3
• Up to 96-cores, 384-threads Arm v8.3+
• 8 DDR4-3200 memory controllers
• 64 lanes PCIe 4.0, 16 controllers per CPU
• 4 128-bit SIMD (Neon) units
• Single and Dual-socket support
• Enterprise class RAS and virtualization

9. 9 Confidential © 2020 Arm Limited
© 2020 Marvell. All Rights Reserved.
9
ThunderX3 Leadership in Target Cloud Workloads
Integer Databases Web Tier Media Streaming Web Search Latency
(Higher is better) (Higher is better) (Higher is better) (Higher is better) (Lower is better)
ThunderX3 delivers best in class performance for targeted cloud workloads
Source: All performance numbers are Marvell measured data or Marvell estimates

10. 10 Confidential © 2020 Arm Limited
2016 2018 2020
© 2020 Marvell. All Rights Reserved.
0
ThunderX Roadmap
Driving >2X Generational Performance Improvement
Production
Production
Stay tuned
7nm
16nm
28nm
2022

11. 11 Confidential © 2020 Arm Limited
Ampere based servers for Cloud & 5G
Lenovo HR330A &
HR350A
Ampere eMAG – available NOW Ampere Altra – coming SOON
Wywinn OpenEDGE
Ampere Altra
• Up to 80 Arm Neoverse N1-cores, up to 3.0GHz (turbo) in 210W TDP
• 8 DDR4-3200 memory controllers
• 128 lanes PCIe 4.0, up to 64 lanes for CCIX off-chip accelerator
connectivity
• Single and Dual-socket support
• Enterprise class RAS and virtualization
Single-Socket Mt.
Snow Platform
Dual-Socket Mt.
Jade Platform
Industry excitement for Ampere Altra:
For more information contact Sales@amperecomputing.com
(available in 1U
and 2U)

12. 12 Confidential © 2020 Arm Limited
Ampere openEDGE Compute Platform
Contact sales@amperecomputing.com for further details
Overview
• Compatible with OCP openEDGE Chassis CPU sled
• 6.5" x 13.85"
• 32 and 16 core eMAG SKUs
• 32bit and 64bit Support
• TSMC 16 nm FinFET
Processor
• 32/16 Ampere eMAG Armv8 64-bit CPU cores @ 3.3
GHz Sustained Turbo
• 32 KB L1 I-cache, 32 KB L1 D-cache per core
• Shared 256 KB L2 cache per 2 cores
• 32MB globally shared L3 cache
Memory
• 8x 72-bit DDR4-2667 channels
• Up to 16 DIMMs and 1 TB/socket
• ECC, ChipKill, and DDR4 RAS features
I/O
• OCP Mezzanine v2 (Conn. A/B) 10/40/100 GbE NIC
• 1 x16 PCIe slot
• 2 x M.2 x4 NVME
• 4 x SATA3
• 2 x USB 2.0
Power
• 125W TDP for 32 cores
• 75W TDP for 16 cores
• Advanced Power Management
Performance
• SPECrate2017_int_peak est.: 68*
• SPECrate2006_int_peak est.: 502*
Availability
• Sampling: Q4’19
• Volume Production: Q1’20
* Estimated based on measured Ampere 8180 and 8140 using gcc 8.2 -ofast, lto, jemalloc

13. 13 Confidential © 2020 Arm Limited
Leadership Performance/TCO
Maximize Performance1/TCO2 with
the Ampere™ Altra™ Processor:
•41% higher Performance/TCO
compared to AMD EPYC 7702
•63% higher Performance/TCO
compared to Intel® Xeon® Gold 6238R
Processor (announced Feb 24th 2020)
1Rack Config: 42U w/ 12.5kw rack power
2
Performance based on projections for Est. SPECrate®2017_int_base; TCO
calculated using costs of server ingredients publicly available.
Ampere Altra AMD EPYC 7702
Intel Xeon Gold 6238R Intel Xeon Platinum 8276
1.63x
1.41x
Performance/TCO
3.96x

14. 14 Confidential © 2020 Arm Limited
2020 2021 2022
Ampere™
Altra™
80 Cores; 7nm
Mystique
In Development
Siryn
Defined
Ampere’s Committed Annual Cadence

15. 15 Confidential © 2020 Arm Limited
Evolving Role of SmartNICs
Host Processor
• Runs all OS, virtualization and
application stacks
Accelerator
• Fix function off-load device
(including I/O)
• Application drivers for smart acceleration
• Increase use of virtualized networks and storage
• Increasing network speeds (10GbE, 25GbE,
100GbE)
• Storage increase from 1000’s to Millions of IOPS
• Up to 50%+ of the host processors
consumed by networking and storage tasks
• Smart-Acceleration reduces overhead to <5%*
• Self-Hosted Accelerators running OS
stack with VMs, Containers
• Merging of networking, storage,
security, analytics, ML with
combination of accelerators
* Smart-NIC with virtual switch is an example application
Processor
NIC
Storage/
NVM
PCIe block data transfers (512B-4K)
between Host and Accelerator
Applications
Hypervisor
Accelerator
NIC
Storage/
NVM
Accelerator Accelerator
Accel
SW
Processor
Applications
Hypervisor
Processor
Applications
NIC
Accelerator
Hypervisor
Analytics Security NVMe
Shared Virtual Memory
Applications
Hypervisor
&
applications

16. 16 Confidential © 2020 Arm Limited
SmartNIC physical deployment models
• Security, software-defined networking, storage initiator
• Hyper-Converged Infrastructure (HCI) servers
SmartNIC in a host server
• Disaggregated storage target: JBOF/JBOD with NVMe-oF
• Controller for PCIe connected accelerators: e.g. OCP Universal Base-board
+ Open Accelerator Module based designs
• Edge and Telco networking: SD-WAN
• SmartNICs as standalone server: Edge, Telco uCPE
SmartNIC appliance

17. 17 Confidential © 2020 Arm Limited
SmartNIC use-cases
• Virtual switching/Software-defined networking
Networking offload
•Disaggregated storage (NVMe-oF)
•Storage application offload (Redis, Ceph, etc.)
•Compression, dedupe
Storage offload
• Separating datacenter and VM networks
• Deep packet inspection
Security offload
• Offloading hypervisor to Arm CPUs on SmartNIC
Virtual machine management
• I/O intensive use-cases for Edge and Telco
Standalone server

18. 18 Confidential © 2020 Arm Limited
Why Neoverse-based SmartNIC solutions in Data Centers?
Network offload
EC2 m4.16xlarge instance
EC2 m5.24xlarge instance
Four cores per server
are allocated to
network & storage
management
$4,052/server/year1
in un-sellable capacity
All cores can be
sold for IaaS
+ AWS Nitro
No
SmartNIC
With
SmartNIC
Storage Services
2 CPU, no SmartNIC:
CapEx: ~$8,000 platform
OpEx: ~380W platform
2013
No Nitro System
2-socket, 16-core
“Broadwell”-
based instances
2017
Nitro System is
responsible for
network &
storage
management
2-socket, 24-core
“Skylake”-based
instances
+
Of 36 total cores:
18 typically unused
(@50% utilization)
~4-6 consumed by
storage services
~2-4 consumed by
networking services
Of 36 total cores:
Only 8-12 cores
available for
applications
+
1 CPU + SmartNIC:
Of 18 total cores:
Minimal virtualization
overhead (@50%
utilization)
Storage services run on
SmartNIC
Networking services run
on SmartNIC
Of 36 total cores:
16-18 cores
available for
applications
CapEx: ~$4,000 platform
OpEx: ~200W platform

19. 19 Confidential © 2020 Arm Limited
Broadcom Stingray Family of SmartNIC Adapters
PS1100R
Storage Target or 100G Server
Glass Creek
Storage Virtualization
PS225
Server SmartNIC
2x 25 Gb
Ethernet
PCIe Gen3 x 8
Host Interface
OVS & NVMe-oF Offload
iSCSI to NVMe-oF
8-core 3GHz
Cortex-A72
NVMe-oF Storage for any
OS with NVMe Driver
PCIe Gen3 x16 Root Complex
100 Gb QSFP28 Ethernet
Up to 8x M.2 or 4x U.2 NVMe Drive
Connectivity
8-core 3GHz Cortex-A72
“Broadcom's Stingray allows us
to offload network and
storage workloads from
expensive x86 CPU cores,
while at the same time
delivering strict secure
separation between
infrastructure workloads and
customers' workloads.”
- Liu Ning, Systems Department
Director, Baidu

20. 20 Confidential © 2020 Arm Limited
Mellanox BlueField-21 I/O Processing Unit
8x Armv8 Cortex-A72 cores
Dual ports of 10/25/40/50/100Gb/s or single port of
200Gb/s; supports Ethernet and Infiniband protocols
DDR4 memory controller with ECC
16-lane PCIe Gen3/4 switch
Hardware offloads including:
• NVMe SNAP, IPsec/TLS data-in-motion, AES-XTS data-at-
rest, SHA 256b HW acceleration, RegEx, DPI and more
Hardware Root of Trust (RoT)
1GbE out-of-band management port
1. https://www.mellanox.com/related-docs/prod_adapter_cards/PB_BlueField-2_SmartNIC_ETH.pdf
For more information see https://store.mellanox.com/customer-service/contact-us
Mellanox BlueField Family of SmartNIC Solutions
Bluefield-2 Controller Card
Bluefield-2 SmartNIC
Features:
• Dual 100GbE or Single 200GbE
• 16x Gen4 PCIe FHHL form-factor
• 16GB on-board DDR4
Applications:
• NVMe oF storage systems
• JBOF, All-Flash Array, Storage Appliances
• Network Functions Virtualization
• Cloud and Machine Learning
Features:
• Up to 200Gb/s Ethernet and Infiniband
• HHHL, FHHL, OCP 3.0 form-factors
Applications:
• Virtualized & Bare metal cloud
• NVMe SNAP storage virtualization
• Network Functions Virtualization
• End-point security (DDoS, DPI, etc)

21. 21 Confidential © 2020 Arm Limited
uCPE Market Forecast
• uCPE HW shipments
expected to reach
3M units and $1B in
revenue by 2023
• Mid Range uCPE
HW configurations
with 4-8 cores are
highest volume
• Arm based HW will
offer compelling ROI
vs x86
0
0.5
1
1.5
2
2.5
3
3.5
2019 2020 2021 2022 2023
Millions
of
Units
uCPE Hardware Unit Shipment Forecast
Entry Mid Large
Source: IHS Markit
Cores
HW Price Range
(x86) # of VNFs
Entry 2-4 $400-600 1-2
Mid Range 4-8 $800-1500 2-4
Large 12-16 $3500-$5000 4+

22. 22 Confidential © 2020 Arm Limited
The Transition to Universal CPE
WAN
Acceleration
PE Router NAT
DPI ADC
Firewall
uCPE Approach:
Whitebox, Flexible, Open
Service providers looking to simplify
customer site deployments
Replace multiple dedicated
appliances with VNFs running on a
uCPE – a single, universal platform
Customers can provision VNFs from
different vendors on uCPE boxes via
operator platforms
uCPE should leverage white box
servers with no proprietary
extensions
Arm ecosystem provides cost, power, & acceleration advantages
Traditional Approach:
Dedicated HW
VNF VNF VNF
Improved
Utilization

23. 23 Confidential © 2020 Arm Limited
Value of Arm in uCPE Applications
INTEGRATED PACKET PROCESSOR IN SOCS
VARIETY OF SOCS (Option in CPU Core Counts)
BETTER PERFORMANCE/COST
ARM TRUSTZONE SECURITY (Hardware Root of Trust)
PROGRAMMABLE ACCELERATION LIBRARIES

24. 24 Confidential © 2020 Arm Limited
Arm uCPE Ecosystem
Any Virtual Network
Functions
Hardware
Software
Certified
VNFs
(examples)
Operating System
MANO
uCPE Hardware
SoC
On White Box
Hardware
(examples)

25. 25 Confidential © 2020 Arm Limited
Arm uCPE HW Segmentation
Low End Mid-End High-End
Large Packet
Throughput
1-2Gbs 2.5-6Gbps 7-15Gbps
Memory (RAM) 4GB-8GB 8GB-32GB 32-64GB
VNF capability Yes Yes Yes
vCPUs 4 8 12-16
Arm 64-bit SoC Marvell Armada 8040 4 Core
NXP LS1048 4 Core
Marvell Armada 8082 8 Core
NXP LS2088A 8 Core
NXP LX2120A 12-core
NXP LX2160A 16-core
Ampere 8140 16-core
Cooling Fan-Less Fan-Less or With Fan With Fan
Performance using large packet payload (1280-byte)

26. 26 Confidential © 2020 Arm Limited
Exceptional performance with hardware acceleration
Utilizing Arm SoC programmable packet processing engine
X86-based SoC
(no hardware packet processing)
VNF1 VNF2
Arm-based SoC (with hardware packet processing)
VNF1 VNF2 VNF3
SW-Accelerated
OVS + DPDK
HW-Accelerated
OVS offload
OVS fast-path firmware
1.6Gbps w/IMIX traffic
VNF3 VNF4 VNF5 VNF6
VNF4 VNF5 VNF6 VNF7
15Gbps with IMIX traffic (over 9X increase!!)
OS
OVS / Data Plane
Available for VNFs
Hardware Packet Processing on Arm SoC improves
performance and frees up cores for additional
VNFs
Multiple cores + hardware offload drive uCPE TCO
Consumes CPU cores for datapath
performance resulting in lowest
utilization and TCO

27. 27 Confidential © 2020 Arm Limited
Each platform generation brings faster performance and new
infrastructure specific features
16/14nm
Cosmos
Platform
(A72/A75)
7nm
Ares
Platform
(N1)
7/5nm+
Zeus
Platform
Poseidon
Platform
5nm
2021
2020
2019
2018
30% Faster System Performance per Generation + New Features

28. Confidential © 2020 Arm Limited
The Arm trademarks featured in this presentation are registered
trademarks or trademarks of Arm Limited (or its subsidiaries) in
the US and/or elsewhere. All rights reserved. All other marks
featured may be trademarks of their respective owners.
www.arm.com/company/policies/trademarks