(x)PU: High-End CPU and GPU for Datacenter Applications 2020 report by Yole Développement

From Technologies to Markets
© 2019
© 2019
(x)PU:
High-End CPU and GPU
for Datacenter
Applications 2020
Market and Technology
Report
© 2020
Sample

2
TABLE OF CONTENTS
o Scope, objectives, and methodology 7
o Three-slides summary 16
o Executive summary 18
o Introduction - Context 48
o Market forecast 63
o Market trends 81
o High-Performance Computing 87
o Cloud gaming 106
o Technology trends 122
o CPU 127
o GPU 145
o In-memory computing 165
o Focus on packaging 174
(x)PU: high-end CPU and GPU for datacenter applications 2020 | Sample | www.yole.fr | ©2020
o Ecosystem 194
o High-Performance Computing 201
o Cloud gaming 228
o Mergers and acquisitions 233
o Summary and conclusions 239
o Noteworthy news 2018 - 2019 245
o How to use our data? 254
o Yole Développement’s presentation 255

33
Simone Bertolazzi, PhD
Simone is a Technology & Market Analyst at Yole Développement (Yole), working within the Semiconductor & Software division. He is a member of
Yole’s Memory team and contributes daily to the analysis of memory markets and technologies, as well as their related materials and fabrication
processes. Previously, Simone conducted experimental research in the fields of nanoscience and nanotechnology, focused on emerging
semiconducting materials and their device applications. He has authored or co-authored more than 15 papers in high-impact scientific journals
(3,000+ citations) and was awarded the prestigious Marie Curie Intra-European Fellowship. In 2015, Simone obtained a PhD in Physics from École
Polytechnique Fédérale de Lausanne (EPFL, Switzerland), where he developed flash memory cells based on heterostructures of 2D materials and high-
κ dielectrics. Simone earned a double M. A. Sc. degree from Polytechnique de Montréal (Canada) and Politecnico di Milano (Italy), graduating with
honors.
Contact: simone.bertolazzi@yole.fr
Yohann Tschudi, PhD
As a Software & Market Analyst, Dr. Yohann Tschudi is a member of the Semiconductor & Software division at Yole Développement (Yole). Yohann
works daily with his team to identify, understand, and analyze the role of software and computing parts within any semiconductor product, from
machine code to the most advanced algorithms. Following his thesis at CERN (Geneva, Switzerland), Yohann developed dedicated software for fluid
mechanics and thermodynamics applications. Afterwards, he served for two years at the University of Miami (FL, United-States) as an AI scientist.
Yohann has a PhD in High-Energy Physics and a master’s degree in Physical Sciences from Claude Bernard University (Lyon, France).
Contact: yohann.tschudi@yole.fr
ABOUT THE AUTHORS
Biographies & contacts

44
AMD, Ampere eMAG, Apple, ARM, Atipa, Atos, Amazon Web Services (AWS), Barefoot Networks,
Blade, Bull, Cisco, Cluster Vision, Cray, Data Direct Networks, Dell, Electronic Arts, Fujitsu,
GlobalFoundries (GF), Google Cloud, Google Stadia, Gyrfalcon Technology, Hitachi, HP, HP
Enterprise, Huawei, Ibiden, IBM, Intel, Inspur, Jump, Lenovo, Marvell, Mediatek, Megatel, Megware,
Mellanox, Microchip, Microsoft Azure, Movidius, Mythic, NEC, National Research Center of Parallel
Computer Engineering & Technology (NRCPC), NTT Communications, National University of
Defense Technology (NUDT), NVidia, Oracle, Penguin Computing, Pezy Computing, Qualcomm,
Samsung, Sony, STMicroelectronics (STM), Sugon, SuperMicro, Syntiant, TSMC, UPMEM, Vortex, and
more.
COMPANIES CITED IN THIS REPORT

5
REPORT OBJECTIVES
1. Provide market data on key datacenter players’ metrics and dynamics
o Semiconductor-level revenue forecast, volume shipments, and component share
o Market dynamics, segmentation breakdown per application
o Two axes of focus: high-performance computing and cloud gaming
2. Deliver an in-depth understanding of the high-end datacenter ecosystem
o Who are the players (OEMs, computing hardware players, foundries), and how are they related?
o Who are the key suppliers to watch - and more generally, how will the technology & market
evolve?
1. Present key technical insights and analysis regarding future technology trends
and challenges
o Manufacturing technologies: design structure
o Device technologies and applications across markets
o Technology insights for game-changing topics like deep learning and Cloud gaming

6
METHODOLOGIES & DEFINITIONS
Market segmentation
volume (in Munits),
ASP (in $),
revenue (in $M)
Yole’s market forecast model is based on matching “top-down” vs. “bottom-up” approaches:
Aggregate
information
Preexisting
information
Reconciliation
Bottom-up
approach
Top-down
approach

7
REPORT SCOPE - APPLICATIONS
(x)PU: high-end CPU and GPU for datacenter applications 2020 | Sample | www.yole.fr |
©2020
High-performance
computing
Storage/Databases
Social and media
Cloud gaming Meteorology
Genomics
Computing for data
management
Computing for data
transfer
Computing for gaming
and data transfer
Computing for heavy
computation algorithms
High-end
Low-end
Not included in this
report
Supercomputers
HPC-as-a-Service

8
REPORT SCOPE - TECHNOLOGIES
Accelerators
A central processing unit (CPU),
also called a central processor or
main processor, is the electronic
circuitry within a computer that
carries out the instructions of a
computer program by performing
the basic arithmetic, logic,
controlling, and input/output
(I/O) operations specified by
the instructions.
Sequential
computation
A graphics processing unit (GPU)
is a specialized electronic circuit
designed to rapidly manipulate
and alter memory to accelerate
the creation of images in a
frame buffer intended for output
to a display device. Their highly
parallel structure makes them
more efficient than general-
purpose central processing units
(CPUs) for algorithms that
process large blocks of data in
parallel.
Parallel computation
A field-programmable gate array
(FPGA) is an integrated circuit
designed to be configured by a
customer or a designer after
manufacturing - hence the term
"field-programmable". Any FPGAs
can be reprogrammed to
implement different logic
functions,[2] allowing flexible
reconfigurable computing as
performed in computer software.
Configurable,
flexibility
Accelerators are an application-
specific integrated circuit (ASIC)
dedicated for a particular use
(rather than a general-purpose
use) as a neural processing unit
(NPU) / neural network
processor (NNP) for computing
AI algorithms.
Going further, emerging
technology such as in-memory
computing chips are even more
performant and less versatile.
Performance
Not included in this
report
PerformanceVersatility
Arithmetic Vector Matrix Specialization

99(x)PU: high-end CPU and GPU for datacenter applications 2020 | Sample | www.yole.fr | ©2020
WHAT RUNS ON THE CLOUD? MAIN APPLICATIONS
High-performance
computing
Storage/databases Social and media Cloud gaming
Meteorology
Genomics
Store data, i.e.
docs, photos,
small videos, and
database
Diffuse data, i.e.
videos, movies,
TV shows, and
music, to users
Stream video
games to user
platform
Perform heavy
computations and
storage
These last two applications in
particular need powerful computing
hardware

1010
TRAINING AND INFERENCE, EDGE AND CLOUD COMPUTING
These three
approaches
fulfill different
needs, evolve
in parallel, and
do not
represent
different
levels of
advancement.
Training and Inference
in the Cloud
• No latency issues
• Data control
• Technology on the edge not ready
Training on the Cloud
Inference on the Edge
Virtual Personal Assistant
• Latency constraints
• Cost control
• Regulations
Autonomous Driving
Authentication
Augmented Reality
Training and Inference
on the Edge
• Latency constraints
• Behavior evolution needed
• Privacy constraints
• In development for now
Robotics
Surveillance

1111(x)PU: high-end CPU and GPU for datacenter applications 2020 | Sample | www.yole.fr | ©2020
SEGMENTATION
3 markets
Cloud gaming
2
technologies
Supercomputers
HPC-as-a-service
Central Processing Unit
CPU
Graphic Processing Unit
GPU

12
WHO SHOULD BE INTERESTED IN THIS REPORT?
IC manufacturers and vendors, and IP sellers:
o Evaluate the market potential of future
technologies and products for new applicative
markets
o Screen potential new suppliers for introducing new
disruptive technologies
o Monitor and benchmark your competitors’
advancements
Computing hardware players:
o Gauge the market potential of Cloud gaming and
high-performance computing
o Review potential applications and partners
o Monitor and benchmark your competitors’
advancements
Open foundries and IDMs:
o Spot new opportunities and define diversification
strategies
o Position your company in the future of AI
Equipment & materials manufacturers:
o Understand the neuromorphic revolution and
ecosystem dynamics
o Discern the differentiated value of your products
and technologies in this market
o Identify new business opportunities and prospects
Financial & strategic investors:
o See the potential of new imaging technologies
o Obtain a list of key emerging start-ups

1313
MARKET EVOLUTION FROM 2019 TO 2025
• Among the leading-edge datacenter applications, Cloud gaming is the fastest-growing market segment, with a CAGR19-25 exceeding
XX% for CPUs and GPUs.
• HPC-as-a-service will remain the largest market segment for GPUs/CPUs, driven by ever-growing GPU demand from
data/compute-intensive AI applications performed in the Cloud.
Cloud gaming – CPU, CAGR19-25 ≈ XX%
Cloud gaming – GPU, CAGR19-25 ≈ XX%
HPC-as-a-service – CPU, CAGR19-25 ≈ XX%
HPC-as-a-service – GPU, CAGR19-25 ≈ XX%
Supercomputer – CPU, CAGR19-25 ≈ XX%
Supercomputer – GPU, CAGR19-25 ≈ XX%
Total CPU + GPU market CAGR19-25 ≈ XX%

14
FORECAST 2018-2025

15
MARKET TRENDS

16
TECHNOLOGY TRENDS

17
TECHNOLOGY TRENDS

1818
KEY PLAYERS IN THE CPU AND GPU MARKETS
Just three players hold most of the GPU/CPU markets
Company
(revenue)
CPU
(ranking)
Discrete GPU
(ranking)
FY 2018: $70.8B (+13%) 1st
Exascale GPU card unveiled. Xe GPU cards likely after 2020.
FY 2019: $11.7B (+21%) 1st
FY 2018: $6.5B (+23%) 2nd 2nd
• AMD is the only player focused on both CPU and GPU, using a foundry business model that relies on collaboration with the leading foundry,
TSMC. NVidia focuses exclusively on GPUs, whereas Intel’s sole focus is CPUs. However, Intel has repeatedly stated its intention of entering
the discrete GPU market. The starting point will be exascale computing (“Ponte Vecchio” cards unveiled at the SC ‘19 conference).

19
ECOSYSTEM

20
CPU/GPU BUSINESS - GEOSTRATECIC ANALYSIS

21
Contact our
Sales Team
for more
information
21
Contact our
Sales Team
for more
information
Artificial Intelligence Computing
for Automotive
Artificial Intelligence Computing
for Consumer
Image Signal Processor and
Vision Processor: Market and
Technology
Neuromorphic Technologies for
Sensing and Computing
Status of the Memory Industry
2019
RELATED REPORTS
Yole Développement

22
Contact our
Sales Team
for more
information
22
Contact our
Sales Team
for more
information
Intel’s Embedded Multi-Die
Interconnect Bridge (EMIB)
RELATED REPORT
System Plus Consulting

23
CONTACT INFORMATION
o CONSULTING AND SPECIFICANALYSIS, REPORT BUSINESS
• North America:
• Steve LaFerriere, Senior Sales Director forWestern US & Canada
Email: laferriere@yole.fr – + 1 310 600-8267
• ChrisYouman, Senior Sales Director for Eastern US & Canada
Email: chris.youman@yole.fr – +1 919 607 9839
• Japan & Rest of Asia:
• Takashi Onozawa, General Manager,Asia Business Development
(India & ROA)
Email: onozawa@yole.fr - +81 34405-9204
• Miho Ohtake, Account Manager (Japan)
Email: ohtake@yole.fr - +81 3 4405 9204
• Itsuyo Oshiba, Account Manager (Japan & Singapore)
Email: oshiba@yole.fr - +81-80-3577-3042
• Toru Hosaka, Business Development Manager (Japan)
Email: toru.hosaka@yole.fr - +81 90 1775 3866
• Korea: Peter Ok, Business Development Director
Email: peter.ok@yole.fr - +82 10 4089 0233
• Greater China: Mavis Wang, Director of Greater China Business
Development
Email: wang@yole.fr - +886 979 336 809 / +86 136 61566824
• Europe & RoW: Lizzie Levenez, EMEA Business Development Manager
Email: levenez@yole.fr - +49 15 123 544 182
o FINANCIAL SERVICES (in partnership withWoodside Capital
Partners)
• Jean-Christophe Eloy, CEO & President
Email: eloy@yole.fr - +33 4 72 83 01 80
• Ivan Donaldson,VP of Financial Market Development
Email: ivan.donaldson@yole.fr - +1 208 850 3914
o CUSTOM PROJECT SERVICES
• Jérome Azémar,Technical Project Development Director
Email: azemar@yole.fr - +33 6 27 68 69 33
o GENERAL
• CamilleVeyrier, Director, Marketing & Communication
Email: veyrier@yole.fr - +33 472 83 01 01
• Sandrine Leroy, Director, Public Relations
Email: leroy@yole.fr - +33 4 72 83 01 89
• Email: info@yole.fr - +33 4 72 83 01 80
Follow us on
About Yole Développement | www.yole.fr | ©2020

(x)PU: High-End CPU and GPU for Datacenter Applications 2020 report by Yole Développement

More Related Content

What's hot

Similar to (x)PU: High-End CPU and GPU for Datacenter Applications 2020 report by Yole Développement

More from Yole Developpement

Recently uploaded

(x)PU: High-End CPU and GPU for Datacenter Applications 2020 report by Yole Développement