Acceleratorer för AI och nya laster Talare: Danny Kiernan, NVIDIA Presentation från Watson Kista Summit 2018

1. DANNY KIERNAN|AI on IBM POWERAI| Feb. 7th, 2018
THE ACCELERATED
DATACENTER WITH IBM

2. 2
Democratizing AI
Autonomous MachinesInference Acceleration Self-driving Cars
Accelerated Computing Gaming
1980 1990 2000 2010 2020
GPU-Computing perf
1.5X per year
1000X
by 2025
102
103
104
105
106
107
Single-threaded perf
1.5X per year
1.1X per year
concat
Batch
nm
batch
nm
batch
nm
batch
nm
max
pool
input
relu relu relu relu
1x1
conv
3x3
conv
5x5
conv
1x1
conv
relu
batch
nm
1x1
conv
relu
batch
nm
1x1
conv
next input
next input
3x3
CR
5x5
CR
batch
nm
max
pool
input
copy
1x1 CR
NVIDIA

3. 3
1980 1990 2000 2010 2020
GPU-Computing perf
1.5X per year
1000X
by
2025
RISE OF GPU COMPUTING
Original data up to the year 2010 collected and plotted by M. Horowitz, F. Labonte, O. Shacham, K.
Olukotun, L. Hammond, and C. Batten New plot and data collected for 2010-2015 by K. Rupp
102
103
104
105
106
107
Single-threaded perf
1.5X per year
1.1X per year
APPLICATIONS
SYSTEMS
ALGORITHMS
CUDA
ARCHITECTURE

4. 4
TWELVE YEARS OF GPU COMPUTING
2010
Fermi: World’s
First HPC GPU
World’s First Atomic
Model of HIV Capsid
GPU-Trained AI Machine
Beats World Champion in Go
2014
Stanford Builds AI
Machine using GPUs
World’s First 3-D Mapping
of Human Genome
Google Outperforms
Humans in ImageNet
2012
Discovered How H1N1
Mutates to Resist Drugs
Oak Ridge Deploys World’s
Fastest Supercomputer w/ GPUs
2008
World’s First GPU
Top500 System
2006
CUDA Launched
AlexNet beats expert code
by huge margin using GPUs
Top 13 Greenest
Supercomputers Powered
by NVIDIA GPUs
2017

5. 5
3000
AI MOMENTUM
TODAY BY 2020
AI startups
85% $47B 20%
of all customer
service interactions will
be powered by
AI bots
spend on AI
technologies
of companies will
dedicate workers to
monitor and guide
neural networks

6. 6
AI REVOLUTIONIZING OUR WORLD
Search, Assistants, Translation,
Recommendations, Shopping, Photos…
Detect, Diagnose and Treat Diseases Powering Breakthroughs in Agriculture,
Manufacturing, EDA

7. 7
EVERY INDUSTRY HAS AWOKEN TO AI
2014 2017
1,549
26,895
Higher Ed
Internet
Healthcare
Finance
Automotive
Others
Government
Developer Tools
Organizations engaged with NVIDIA on Deep Learning

8. 8
PLATFORM BUILT FOR AI
Delivering 125 TFLOPS of DL Performance with Volta
TENSOR CORE
VOLTA-OPTIMIZED cuDNN
MATRIX DATA OPTIMIZATION:
Dense Matrix of Tensor Compute
TENSOR-OP CONVERSION:
FP32 to Tensor Op Data for
Frameworks
TENSOR CORE
VOLTA TENSOR CORE
4x4 matrix processing array
D[FP32] = A[FP16] * B[FP16] + C[FP32]
Optimized For Deep Learning
ALL MAJOR FRAMEWORKS

9. 9
TESLA V100 WITH IBM POWER9
The Fastest and Most Productive GPU for AI and HPC
Volta Architecture
Most Productive GPU
Tensor Core
125 Programmable
TFLOPS Deep Learning
Improved SIMT Model
New Algorithms
Volta MPS
Inference Utilization
Improved NVLink &
HBM2
Efficient Bandwidth

10. 10
VOLTA ARCHITECTURE WITH IBM POWER9

11. 11
NEXT GEN NVLINK WITH IBM POWER9
10

12. 12
INDUSTRY USE CASES

13. 13
The number of mobile banking users is estimated to
reach 2 billion by the year 2021. So it’s not surprising
to see the rising popularity of Chatbots in the finance
industry. Through convenience and ease-of-use,
Chatbots optimize digital services at scale.
Capital One is piloting an SMS text-based intelligent
assistant named Eno. Eno uses GPU-powered deep
learning to respond to natural language text messages
from customers inquiring about their accounts.
Customers text Eno to track their balance, recent
charges, or to pay their bill. Eno takes mobile
banking to the next level, which is just a text
message away.
AI CHATBOT THAT
SPEAKS EMOJI

14. 14
AI TOOL BOOSTS
CUSTOMER SERVICE
KLM’s 350 social media service agents engage in 15K
conversations each week on channels like Facebook
Messenger, Twitter and Whatsapp, 24/7. To support
the overwhelming volume of messages, KLM uses
GPU-accelerated deep learning with CUDA from
DigitalGenius, to predict the best response to an
incoming message and shows it to a contact center
agent for approval or personalization before sending
it to the customer. The resulting time savings for KLM
service agents means they can focus on customers
with more pressing needs and handle a greater
volume of questions while still maintaining a high
degree of customer satisfaction.

15. 15
AI IMPROVES
THE CUSTOMER
EXPERIENCE
AI is dramatically changing the online shopping
experience with tangible improvements to retailers
and consumers. In 2016 online British grocery giant
Ocado improved customer service with their AI-
enhanced contact center, and is applying machine
learning and NVIDIA GPUs with CUDA to develop
humanoid robotics to assist maintenance
technicians, and advanced computer vision for
image classification and recognition to replace
barcode systems. Computer vision will expedite the
picking process and better ensure orders are filled
correctly so customers receive exactly what they
ordered.

16. 16
IDC predicts that by 2021 AI will boost global
business revenue by $1.1 trillion. Businesses are
embracing AI to optimize processes, decrease
costs, and remain competitive.
SalesHero's AI assistant, Robin, performs tedious
sales tasks that detract from productivity. Using
GPUs for deep learning and inference, Robin learns
from CRM systems, customer interactions, and
SalesHero’s Account Graph database to automate
sales processes such as updating sales records,
prospect mining, and predicting close dates. With
the time savings Robin delivers, sales teams can
increase productivity up to 30%.
AI SALES ASSISTANT
INCREASES
PRODUCTIVITY

17. 17
The United States Post Office delivers >1.5 billion
pieces of mail each year but increases in demand
and complexity of route management had
introduced costly inefficiencies. Analyzing and
optimizing routes using geographic data of 200,000+
mail carriers in real-time required an advanced
computing infrastructure so the USPS turned to
Kinetica and its GPU-accelerated data analytics
platform to accurately provide immediate visibility
to the location of carriers and the status of
deliveries. The USPS can now modify routes for
optimal efficiencies—it’s using fewer trucks,
handling a greater number of deliveries, and
narrowing delivery windows.
AI-ANALYTICS
OPTIMIZES
LOGISTICS
MANAGEMENT

18. 18
Even more than its meticulous engineering,
Mercedes-Benz is defined by its continuous
innovation. Since inventing the car in 1886, the
company has never stopped reinventing it. And
now Mercedes-Benz is using AI to enhance the
user experience behind the wheel by having its
cars predict where drivers want to go.
Trained on driver behavior data from 24,000 road
trips, the NVIDIA GPU-accelerated destination
prediction AI learns the driver’s habits over time
in order to make better suggestions.
AI-POWERED
DESTINATION
PREDICTION AND
ROUTE PLANNING

19. 19
NVIDIA DEEP LEARNING INSTITUTE WITH IBM
Helping the world to solve challenging problems using AI and deep learning
Online training and on-site workshops presented by certified instructors
Covering complete workflows for proven application use cases
Autonomous Vehicles, Healthcare, Intelligent Video Analytics, IoT/Robotics, Finance and more
www.nvidia.com/dli
Hands-on Training for Data Scientists, Developers and Researchers
VALIDAT
E

20. Thank you!