Journée ROMEO, 9 juin 2016
Frédéric Parienté, Tesla Accelerated Computing, NVIDIA Corporation
LA RÉVOLUTION DU DEEP LEARNING
Deep Learning Achieves
“Superhuman” Results
A NEW COMPUTING MODEL
Traditional Computer Vision
Experts + Time
Deep Learning Object Detection
DNN + Data + HPC
ImageNet
KEY DRIVERS FOR DEEP LEARNING
Big Data GPU AccelerationBetter Algorithms
350 millions
images uploaded
per day
2.5 Petabytes of
customer data
hourly
300 hours of video
uploaded every
minute
“The Three Breakthroughs that have
Finally Unleashed A.I. on the World”
NVIDIA DEEP LEARNING SDK
High Performance GPU-Acceleration for Deep Learning
COMPUTER VISION SPEECH AND AUDIO BEHAVIOR
Object Detection Voice Recognition Translation
Recommendation
Engines
Sentiment Analysis
DEEP LEARNING
cuDNN
MATH LIBRARIES
cuBLAS cuSPARSE
MULTI-GPU
NCCL
cuFFT
Mocha.jl
Image Classification
DEEP LEARNING
SDK
FRAMEWORKS
APPLICATIONS
EVERY INDUSTRY WANTS DEEP LEARNING
Cloud Service Provider Medicine Media & Entertainment Security & Defense Autonomous Machines
 Cancer cell detection
 Diabetic grading
 Drug discovery
 Pedestrian detection
 Lane tracking
 Recognize traffic sign
 Face recognition
 Video surveillance
 Cyber security
 Video captioning
 Content based search
 Real time translation
 Image/Video classification
 Speech recognition
 Natural language processing
AUTONOMOUS DRIVING
https://www.youtube.com/watch?v=qhUvQiKec2U
ROBOTICS
https://www.youtube.com/watch?v=JeVppkoloXs
SPEECH RECOGNITION
https://www.youtube.com/watch?v=l5eparXPc7Q
ART
https://www.youtube.com/watch?v=Khuj4ASldmU
MEDICAL
https://www.youtube.com/watch?v=BmH5_BQUYT0
BAIDU: DL DEVELOPERS NEED HPC
“Investments in computer systems — and I
think the bleeding-edge of AI, and deep
learning specifically, is shifting to HPC
(high performance computing) — can cut
down the time to run an experiment, and
therefore go around the circle, from a
week to a day and sometimes even faster.”
“Those of us that grew up doing machine
learning often didn’t grow up with an HPC
or computer systems background …
partnerships between machine learning
researchers and computer systems
researchers tend to help both teams drive
a lot of machine learning progress.”
— Andrew Ng
MICROSOFT: “SUPER DEEP NETWORKS”
Microsoft Deep ResNet
http://arxiv.org/pdf/1512.03385v1.pdf
18 LAYERS
1.8 GF
152 LAYERS
11.3 GF
>6X MORE FLOPSRevolution of Depth
NVIDIA DGX-1
WORLD’S FIRST DEEP LEARNING SUPERCOMPUTER
170 TFLOPS FP16
8x Tesla P100 16GB
NVLink Hybrid Cube Mesh
Accelerates Major AI Frameworks
Dual Xeon
7 TB SSD Deep Learning Cache
Dual 10GbE, Quad IB 100Gb
3RU – 3200W
DEEP LEARNING &
ARTIFICIAL INTELLIGENCE
Sep 28-29, 2016 | Amsterdam
www.gputechconf.eu #GTC16
SELF-DRIVING CARS VIRTUAL REALITY &
AUGMENTED REALITY
SUPERCOMPUTING & HPC
GTC Europe is a two-day conference designed to expose the innovative ways developers, businesses and academics are
using parallel computing to transform our world.
EUROPE’S BRIGHTEST MINDS & BEST IDEAS
2 Days | 800 Attendees | 50+ Exhibitors | 50+ Speakers | 15+ Tracks | 15+ Workshops | 1-to-1 Meetings

The Revolution of Deep Learning

  • 1.
    Journée ROMEO, 9juin 2016 Frédéric Parienté, Tesla Accelerated Computing, NVIDIA Corporation LA RÉVOLUTION DU DEEP LEARNING
  • 2.
    Deep Learning Achieves “Superhuman”Results A NEW COMPUTING MODEL Traditional Computer Vision Experts + Time Deep Learning Object Detection DNN + Data + HPC ImageNet
  • 3.
    KEY DRIVERS FORDEEP LEARNING Big Data GPU AccelerationBetter Algorithms 350 millions images uploaded per day 2.5 Petabytes of customer data hourly 300 hours of video uploaded every minute “The Three Breakthroughs that have Finally Unleashed A.I. on the World”
  • 4.
    NVIDIA DEEP LEARNINGSDK High Performance GPU-Acceleration for Deep Learning COMPUTER VISION SPEECH AND AUDIO BEHAVIOR Object Detection Voice Recognition Translation Recommendation Engines Sentiment Analysis DEEP LEARNING cuDNN MATH LIBRARIES cuBLAS cuSPARSE MULTI-GPU NCCL cuFFT Mocha.jl Image Classification DEEP LEARNING SDK FRAMEWORKS APPLICATIONS
  • 5.
    EVERY INDUSTRY WANTSDEEP LEARNING Cloud Service Provider Medicine Media & Entertainment Security & Defense Autonomous Machines  Cancer cell detection  Diabetic grading  Drug discovery  Pedestrian detection  Lane tracking  Recognize traffic sign  Face recognition  Video surveillance  Cyber security  Video captioning  Content based search  Real time translation  Image/Video classification  Speech recognition  Natural language processing
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
    BAIDU: DL DEVELOPERSNEED HPC “Investments in computer systems — and I think the bleeding-edge of AI, and deep learning specifically, is shifting to HPC (high performance computing) — can cut down the time to run an experiment, and therefore go around the circle, from a week to a day and sometimes even faster.” “Those of us that grew up doing machine learning often didn’t grow up with an HPC or computer systems background … partnerships between machine learning researchers and computer systems researchers tend to help both teams drive a lot of machine learning progress.” — Andrew Ng
  • 12.
    MICROSOFT: “SUPER DEEPNETWORKS” Microsoft Deep ResNet http://arxiv.org/pdf/1512.03385v1.pdf 18 LAYERS 1.8 GF 152 LAYERS 11.3 GF >6X MORE FLOPSRevolution of Depth
  • 13.
    NVIDIA DGX-1 WORLD’S FIRSTDEEP LEARNING SUPERCOMPUTER 170 TFLOPS FP16 8x Tesla P100 16GB NVLink Hybrid Cube Mesh Accelerates Major AI Frameworks Dual Xeon 7 TB SSD Deep Learning Cache Dual 10GbE, Quad IB 100Gb 3RU – 3200W
  • 14.
    DEEP LEARNING & ARTIFICIALINTELLIGENCE Sep 28-29, 2016 | Amsterdam www.gputechconf.eu #GTC16 SELF-DRIVING CARS VIRTUAL REALITY & AUGMENTED REALITY SUPERCOMPUTING & HPC GTC Europe is a two-day conference designed to expose the innovative ways developers, businesses and academics are using parallel computing to transform our world. EUROPE’S BRIGHTEST MINDS & BEST IDEAS 2 Days | 800 Attendees | 50+ Exhibitors | 50+ Speakers | 15+ Tracks | 15+ Workshops | 1-to-1 Meetings