SlideShare a Scribd company logo
Welcome
Maximizing the utilization of GPU resources on-premise and in the cloud
1
Agenda
• Welcome and introduction
• What's new from NVIDIA – Barton Fiske
• Technical overview of Multi-instance GPU (MIG) on the NVIDIA A100 Tensor Core GPU –
Adam Tetelman
• Advanced scheduling of GPUs on-premise and in the cloud - Docker and NVIDIA HW &
SW - portability of GPU-based applications - Bill Bryce
• Q&A and panel discussion
Univa delivers business value
3
Extreme Scale
Largest single cluster in AWS cloud
50 Employees
Chicago, Munich, Toronto
475+ years
of collective HPC experience
Largest independent provider
of software-defined computing and
workload orchestration
250
3.3M+ cores
Under management
Univa clients are
global leaders in
their fields
Innovation Platform
A source of competitive
differentiation for market leaders
Cross-industry Customers
7 of top 10 Life Sciences, 2 of the
largest Oil & Gas, 5 top HPC ISVs
World-class Support
Most satisfied enterprise customers
Boost application
performance
Increase user
productivity
Maximize existing
resources
Migrate to
the cloud
Acquired by
52%
Analytics
Chemistry
Structural
CFD
Life Sciences
Visualization
ML/DL/AI
2020 Univa State of the GPU in HPC Survey
83%
Rely on GPUs
for HPC
Applications Limited usePilot
17% 21%
Production
62%
What GPU workloads do they run?
57%
40%
33%
28%
26%
24%
19%
Application
compatibility
Cost
of GPUs
Lack of skills
or experience
What are the top three barriers to
GPU adoption?
69%
80%
of users run three
or more distinct
GPU workloads
57% 40%
Public clouds
On-prem desktops
On-prem servers
Where do GPU workloads run?
71%
60%
52%
Most GPU applications are in production
57%
26%
17%
7%
33% run distributed GPU
applications using MPI or
other parallel frameworks.
33%
run
parallel
jobs
57%
use HPC
workload managers
use public cloud
48%
run in
containers
14% Docker
33% Singularity
Panel Discussion and Q&A
Maximizing the utilization of GPU resources on-premise and in the cloud
5
Thank you
6

More Related Content

What's hot

GTC Taiwan 2017 在 Google Cloud 當中使用 GPU 進行效能最佳化
GTC Taiwan 2017 在 Google Cloud 當中使用 GPU 進行效能最佳化GTC Taiwan 2017 在 Google Cloud 當中使用 GPU 進行效能最佳化
GTC Taiwan 2017 在 Google Cloud 當中使用 GPU 進行效能最佳化
NVIDIA Taiwan
 
Harnessing the virtual realm for successful real world artificial intelligence
Harnessing the virtual realm for successful real world artificial intelligenceHarnessing the virtual realm for successful real world artificial intelligence
Harnessing the virtual realm for successful real world artificial intelligence
Alison B. Lowndes
 
Arm Neoverse solutions @Graviton2-AWS Japan Webinar Oct2020
Arm Neoverse solutions @Graviton2-AWS Japan Webinar Oct2020Arm Neoverse solutions @Graviton2-AWS Japan Webinar Oct2020
Arm Neoverse solutions @Graviton2-AWS Japan Webinar Oct2020
Toshinori Kujiraoka
 
1043: Applications and porting to OpenPOWER
1043: Applications and porting to OpenPOWER1043: Applications and porting to OpenPOWER
1043: Applications and porting to OpenPOWER
NVIDIA Japan
 
Nutanix basic
Nutanix basicNutanix basic
Nutanix basic
ganang saputro
 
InfluxDB + Kepware: Start Monitoring Industrial Data Quickly
InfluxDB + Kepware: Start Monitoring Industrial Data QuicklyInfluxDB + Kepware: Start Monitoring Industrial Data Quickly
InfluxDB + Kepware: Start Monitoring Industrial Data Quickly
InfluxData
 
Tanny Ng, Nadeem Syed [WP Engine] | How WP Engine Transformed Monitoring Into...
Tanny Ng, Nadeem Syed [WP Engine] | How WP Engine Transformed Monitoring Into...Tanny Ng, Nadeem Syed [WP Engine] | How WP Engine Transformed Monitoring Into...
Tanny Ng, Nadeem Syed [WP Engine] | How WP Engine Transformed Monitoring Into...
InfluxData
 
Managing serverless workloads with knative
Managing serverless workloads with knativeManaging serverless workloads with knative
Managing serverless workloads with knative
GDG Cloud Bengaluru
 
DUG'20: 10 - Storage Orchestration for Composable Storage Architectures
DUG'20: 10 - Storage Orchestration for Composable Storage ArchitecturesDUG'20: 10 - Storage Orchestration for Composable Storage Architectures
DUG'20: 10 - Storage Orchestration for Composable Storage Architectures
Andrey Kudryavtsev
 
AI + E-commerce
AI + E-commerceAI + E-commerce
AI + E-commerce
Alison B. Lowndes
 
Red hat on_power-ibm _lop_day_2015
Red hat on_power-ibm _lop_day_2015Red hat on_power-ibm _lop_day_2015
Red hat on_power-ibm _lop_day_2015
cmilsted
 
“Parallelizing Machine Learning Applications in the Cloud with Kubernetes: A ...
“Parallelizing Machine Learning Applications in the Cloud with Kubernetes: A ...“Parallelizing Machine Learning Applications in the Cloud with Kubernetes: A ...
“Parallelizing Machine Learning Applications in the Cloud with Kubernetes: A ...
Edge AI and Vision Alliance
 
GPU Computing with Python and Anaconda: The Next Frontier
GPU Computing with Python and Anaconda: The Next FrontierGPU Computing with Python and Anaconda: The Next Frontier
GPU Computing with Python and Anaconda: The Next Frontier
NVIDIA
 
OneAPI dpc++ Virtual Workshop 9th Dec-20
OneAPI dpc++ Virtual Workshop 9th Dec-20OneAPI dpc++ Virtual Workshop 9th Dec-20
OneAPI dpc++ Virtual Workshop 9th Dec-20
Tyrone Systems
 
OneAPI Series 2 Webinar - 9th, Dec-20
OneAPI Series 2 Webinar - 9th, Dec-20OneAPI Series 2 Webinar - 9th, Dec-20
OneAPI Series 2 Webinar - 9th, Dec-20
Tyrone Systems
 
Continuous Deployment using Kubernetes
Continuous Deployment using KubernetesContinuous Deployment using Kubernetes
Continuous Deployment using Kubernetes
Arun Veeramani
 
Container world 2019 Canary Release
Container world 2019 Canary ReleaseContainer world 2019 Canary Release
Container world 2019 Canary Release
Billy Yuen
 
OpenACC Monthly Highlights- December
OpenACC Monthly Highlights- DecemberOpenACC Monthly Highlights- December
OpenACC Monthly Highlights- December
NVIDIA
 
Building the World's Largest GPU
Building the World's Largest GPUBuilding the World's Largest GPU
Building the World's Largest GPU
Renee Yao
 
[OpenInfra Days Korea 2018] (NetApp) Open Source with NetApp - 전국섭 상무
[OpenInfra Days Korea 2018] (NetApp) Open Source with NetApp - 전국섭 상무[OpenInfra Days Korea 2018] (NetApp) Open Source with NetApp - 전국섭 상무
[OpenInfra Days Korea 2018] (NetApp) Open Source with NetApp - 전국섭 상무
OpenStack Korea Community
 

What's hot (20)

GTC Taiwan 2017 在 Google Cloud 當中使用 GPU 進行效能最佳化
GTC Taiwan 2017 在 Google Cloud 當中使用 GPU 進行效能最佳化GTC Taiwan 2017 在 Google Cloud 當中使用 GPU 進行效能最佳化
GTC Taiwan 2017 在 Google Cloud 當中使用 GPU 進行效能最佳化
 
Harnessing the virtual realm for successful real world artificial intelligence
Harnessing the virtual realm for successful real world artificial intelligenceHarnessing the virtual realm for successful real world artificial intelligence
Harnessing the virtual realm for successful real world artificial intelligence
 
Arm Neoverse solutions @Graviton2-AWS Japan Webinar Oct2020
Arm Neoverse solutions @Graviton2-AWS Japan Webinar Oct2020Arm Neoverse solutions @Graviton2-AWS Japan Webinar Oct2020
Arm Neoverse solutions @Graviton2-AWS Japan Webinar Oct2020
 
1043: Applications and porting to OpenPOWER
1043: Applications and porting to OpenPOWER1043: Applications and porting to OpenPOWER
1043: Applications and porting to OpenPOWER
 
Nutanix basic
Nutanix basicNutanix basic
Nutanix basic
 
InfluxDB + Kepware: Start Monitoring Industrial Data Quickly
InfluxDB + Kepware: Start Monitoring Industrial Data QuicklyInfluxDB + Kepware: Start Monitoring Industrial Data Quickly
InfluxDB + Kepware: Start Monitoring Industrial Data Quickly
 
Tanny Ng, Nadeem Syed [WP Engine] | How WP Engine Transformed Monitoring Into...
Tanny Ng, Nadeem Syed [WP Engine] | How WP Engine Transformed Monitoring Into...Tanny Ng, Nadeem Syed [WP Engine] | How WP Engine Transformed Monitoring Into...
Tanny Ng, Nadeem Syed [WP Engine] | How WP Engine Transformed Monitoring Into...
 
Managing serverless workloads with knative
Managing serverless workloads with knativeManaging serverless workloads with knative
Managing serverless workloads with knative
 
DUG'20: 10 - Storage Orchestration for Composable Storage Architectures
DUG'20: 10 - Storage Orchestration for Composable Storage ArchitecturesDUG'20: 10 - Storage Orchestration for Composable Storage Architectures
DUG'20: 10 - Storage Orchestration for Composable Storage Architectures
 
AI + E-commerce
AI + E-commerceAI + E-commerce
AI + E-commerce
 
Red hat on_power-ibm _lop_day_2015
Red hat on_power-ibm _lop_day_2015Red hat on_power-ibm _lop_day_2015
Red hat on_power-ibm _lop_day_2015
 
“Parallelizing Machine Learning Applications in the Cloud with Kubernetes: A ...
“Parallelizing Machine Learning Applications in the Cloud with Kubernetes: A ...“Parallelizing Machine Learning Applications in the Cloud with Kubernetes: A ...
“Parallelizing Machine Learning Applications in the Cloud with Kubernetes: A ...
 
GPU Computing with Python and Anaconda: The Next Frontier
GPU Computing with Python and Anaconda: The Next FrontierGPU Computing with Python and Anaconda: The Next Frontier
GPU Computing with Python and Anaconda: The Next Frontier
 
OneAPI dpc++ Virtual Workshop 9th Dec-20
OneAPI dpc++ Virtual Workshop 9th Dec-20OneAPI dpc++ Virtual Workshop 9th Dec-20
OneAPI dpc++ Virtual Workshop 9th Dec-20
 
OneAPI Series 2 Webinar - 9th, Dec-20
OneAPI Series 2 Webinar - 9th, Dec-20OneAPI Series 2 Webinar - 9th, Dec-20
OneAPI Series 2 Webinar - 9th, Dec-20
 
Continuous Deployment using Kubernetes
Continuous Deployment using KubernetesContinuous Deployment using Kubernetes
Continuous Deployment using Kubernetes
 
Container world 2019 Canary Release
Container world 2019 Canary ReleaseContainer world 2019 Canary Release
Container world 2019 Canary Release
 
OpenACC Monthly Highlights- December
OpenACC Monthly Highlights- DecemberOpenACC Monthly Highlights- December
OpenACC Monthly Highlights- December
 
Building the World's Largest GPU
Building the World's Largest GPUBuilding the World's Largest GPU
Building the World's Largest GPU
 
[OpenInfra Days Korea 2018] (NetApp) Open Source with NetApp - 전국섭 상무
[OpenInfra Days Korea 2018] (NetApp) Open Source with NetApp - 전국섭 상무[OpenInfra Days Korea 2018] (NetApp) Open Source with NetApp - 전국섭 상무
[OpenInfra Days Korea 2018] (NetApp) Open Source with NetApp - 전국섭 상무
 

Similar to Part 1 Maximizing the utilization of GPU resources on-premise and in the cloud

Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloudWebinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Thomas Francis
 
Univa: Optimizing On-Premise Clusters and Migration to the Cloud
Univa: Optimizing On-Premise Clusters and Migration to the CloudUniva: Optimizing On-Premise Clusters and Migration to the Cloud
Univa: Optimizing On-Premise Clusters and Migration to the Cloud
inside-BigData.com
 
Hyperconverged Systems for Digital Transformation
Hyperconverged Systems for Digital TransformationHyperconverged Systems for Digital Transformation
Hyperconverged Systems for Digital Transformation
Hitachi Vantara
 
Univa Presentation at DAC 2020
Univa Presentation at DAC 2020 Univa Presentation at DAC 2020
Univa Presentation at DAC 2020
Univa, an Altair Company
 
CoreLogic Innovation Fueled By Cloud Foundry (Cloud Foundry Summit 2014)
CoreLogic Innovation Fueled By Cloud Foundry (Cloud Foundry Summit 2014)CoreLogic Innovation Fueled By Cloud Foundry (Cloud Foundry Summit 2014)
CoreLogic Innovation Fueled By Cloud Foundry (Cloud Foundry Summit 2014)
VMware Tanzu
 
Give Your Organization Better, Faster Insights & Answers with High Performanc...
Give Your Organization Better, Faster Insights & Answers with High Performanc...Give Your Organization Better, Faster Insights & Answers with High Performanc...
Give Your Organization Better, Faster Insights & Answers with High Performanc...
Dell World
 
CSCMP 2014: Traditional vs Cloud-Based WMS -- Cornerstone V Track 18 Warehous...
CSCMP 2014: Traditional vs Cloud-Based WMS -- Cornerstone V Track 18 Warehous...CSCMP 2014: Traditional vs Cloud-Based WMS -- Cornerstone V Track 18 Warehous...
CSCMP 2014: Traditional vs Cloud-Based WMS -- Cornerstone V Track 18 Warehous...
InterimONE
 
Technology & Innovation - Barclays
Technology & Innovation - BarclaysTechnology & Innovation - Barclays
Technology & Innovation - Barclays
Devon Energy Corporation
 
Dell Solutions Tour 2015 - Hvordan bygger man et optimalt grønt datasenter i ...
Dell Solutions Tour 2015 - Hvordan bygger man et optimalt grønt datasenter i ...Dell Solutions Tour 2015 - Hvordan bygger man et optimalt grønt datasenter i ...
Dell Solutions Tour 2015 - Hvordan bygger man et optimalt grønt datasenter i ...
Kenneth de Brucq
 
Rambus corporate-overview
Rambus corporate-overviewRambus corporate-overview
Rambus corporate-overview
Rambus
 
FlexPod-Performance-Fall2014-slideshare
FlexPod-Performance-Fall2014-slideshareFlexPod-Performance-Fall2014-slideshare
FlexPod-Performance-Fall2014-slideshare
Michael Harding
 
Container Technologies and Transformational value
Container Technologies and Transformational valueContainer Technologies and Transformational value
Container Technologies and Transformational value
Mihai Criveti
 
RCM EQS Overview
RCM EQS OverviewRCM EQS Overview
RCM EQS Overview
rcmtechnologies
 
IBM ALM for aviation safety compliance aerospace
IBM ALM for aviation safety compliance aerospaceIBM ALM for aviation safety compliance aerospace
IBM ALM for aviation safety compliance aerospace
Imran Hashmi
 
Plan with confidence: Route to a successful Do178c multicore certification
Plan with confidence: Route to a successful Do178c multicore certificationPlan with confidence: Route to a successful Do178c multicore certification
Plan with confidence: Route to a successful Do178c multicore certification
Massimo Talia
 
Ray Simar cv 7 july 2019
Ray Simar cv 7 july 2019Ray Simar cv 7 july 2019
Ray Simar cv 7 july 2019
Ray Simar
 
2024-2027 IT Digitalization Roadmapp.pptx
2024-2027 IT Digitalization Roadmapp.pptx2024-2027 IT Digitalization Roadmapp.pptx
2024-2027 IT Digitalization Roadmapp.pptx
Azra'ee Mamat
 
CloudBlu
CloudBluCloudBlu
IoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
IoT Solutions for Smart Energy Smart Grid and Smart Utility ApplicationsIoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
IoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
Eurotech
 
Event Streaming Architecture for Industry 4.0 - Abdelkrim Hadjidj & Jan Kuni...
Event Streaming Architecture for Industry 4.0 -  Abdelkrim Hadjidj & Jan Kuni...Event Streaming Architecture for Industry 4.0 -  Abdelkrim Hadjidj & Jan Kuni...
Event Streaming Architecture for Industry 4.0 - Abdelkrim Hadjidj & Jan Kuni...
Flink Forward
 

Similar to Part 1 Maximizing the utilization of GPU resources on-premise and in the cloud (20)

Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloudWebinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
 
Univa: Optimizing On-Premise Clusters and Migration to the Cloud
Univa: Optimizing On-Premise Clusters and Migration to the CloudUniva: Optimizing On-Premise Clusters and Migration to the Cloud
Univa: Optimizing On-Premise Clusters and Migration to the Cloud
 
Hyperconverged Systems for Digital Transformation
Hyperconverged Systems for Digital TransformationHyperconverged Systems for Digital Transformation
Hyperconverged Systems for Digital Transformation
 
Univa Presentation at DAC 2020
Univa Presentation at DAC 2020 Univa Presentation at DAC 2020
Univa Presentation at DAC 2020
 
CoreLogic Innovation Fueled By Cloud Foundry (Cloud Foundry Summit 2014)
CoreLogic Innovation Fueled By Cloud Foundry (Cloud Foundry Summit 2014)CoreLogic Innovation Fueled By Cloud Foundry (Cloud Foundry Summit 2014)
CoreLogic Innovation Fueled By Cloud Foundry (Cloud Foundry Summit 2014)
 
Give Your Organization Better, Faster Insights & Answers with High Performanc...
Give Your Organization Better, Faster Insights & Answers with High Performanc...Give Your Organization Better, Faster Insights & Answers with High Performanc...
Give Your Organization Better, Faster Insights & Answers with High Performanc...
 
CSCMP 2014: Traditional vs Cloud-Based WMS -- Cornerstone V Track 18 Warehous...
CSCMP 2014: Traditional vs Cloud-Based WMS -- Cornerstone V Track 18 Warehous...CSCMP 2014: Traditional vs Cloud-Based WMS -- Cornerstone V Track 18 Warehous...
CSCMP 2014: Traditional vs Cloud-Based WMS -- Cornerstone V Track 18 Warehous...
 
Technology & Innovation - Barclays
Technology & Innovation - BarclaysTechnology & Innovation - Barclays
Technology & Innovation - Barclays
 
Dell Solutions Tour 2015 - Hvordan bygger man et optimalt grønt datasenter i ...
Dell Solutions Tour 2015 - Hvordan bygger man et optimalt grønt datasenter i ...Dell Solutions Tour 2015 - Hvordan bygger man et optimalt grønt datasenter i ...
Dell Solutions Tour 2015 - Hvordan bygger man et optimalt grønt datasenter i ...
 
Rambus corporate-overview
Rambus corporate-overviewRambus corporate-overview
Rambus corporate-overview
 
FlexPod-Performance-Fall2014-slideshare
FlexPod-Performance-Fall2014-slideshareFlexPod-Performance-Fall2014-slideshare
FlexPod-Performance-Fall2014-slideshare
 
Container Technologies and Transformational value
Container Technologies and Transformational valueContainer Technologies and Transformational value
Container Technologies and Transformational value
 
RCM EQS Overview
RCM EQS OverviewRCM EQS Overview
RCM EQS Overview
 
IBM ALM for aviation safety compliance aerospace
IBM ALM for aviation safety compliance aerospaceIBM ALM for aviation safety compliance aerospace
IBM ALM for aviation safety compliance aerospace
 
Plan with confidence: Route to a successful Do178c multicore certification
Plan with confidence: Route to a successful Do178c multicore certificationPlan with confidence: Route to a successful Do178c multicore certification
Plan with confidence: Route to a successful Do178c multicore certification
 
Ray Simar cv 7 july 2019
Ray Simar cv 7 july 2019Ray Simar cv 7 july 2019
Ray Simar cv 7 july 2019
 
2024-2027 IT Digitalization Roadmapp.pptx
2024-2027 IT Digitalization Roadmapp.pptx2024-2027 IT Digitalization Roadmapp.pptx
2024-2027 IT Digitalization Roadmapp.pptx
 
CloudBlu
CloudBluCloudBlu
CloudBlu
 
IoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
IoT Solutions for Smart Energy Smart Grid and Smart Utility ApplicationsIoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
IoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
 
Event Streaming Architecture for Industry 4.0 - Abdelkrim Hadjidj & Jan Kuni...
Event Streaming Architecture for Industry 4.0 -  Abdelkrim Hadjidj & Jan Kuni...Event Streaming Architecture for Industry 4.0 -  Abdelkrim Hadjidj & Jan Kuni...
Event Streaming Architecture for Industry 4.0 - Abdelkrim Hadjidj & Jan Kuni...
 

Recently uploaded

Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 

Recently uploaded (20)

Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 

Part 1 Maximizing the utilization of GPU resources on-premise and in the cloud

  • 1. Welcome Maximizing the utilization of GPU resources on-premise and in the cloud 1
  • 2. Agenda • Welcome and introduction • What's new from NVIDIA – Barton Fiske • Technical overview of Multi-instance GPU (MIG) on the NVIDIA A100 Tensor Core GPU – Adam Tetelman • Advanced scheduling of GPUs on-premise and in the cloud - Docker and NVIDIA HW & SW - portability of GPU-based applications - Bill Bryce • Q&A and panel discussion
  • 3. Univa delivers business value 3 Extreme Scale Largest single cluster in AWS cloud 50 Employees Chicago, Munich, Toronto 475+ years of collective HPC experience Largest independent provider of software-defined computing and workload orchestration 250 3.3M+ cores Under management Univa clients are global leaders in their fields Innovation Platform A source of competitive differentiation for market leaders Cross-industry Customers 7 of top 10 Life Sciences, 2 of the largest Oil & Gas, 5 top HPC ISVs World-class Support Most satisfied enterprise customers Boost application performance Increase user productivity Maximize existing resources Migrate to the cloud Acquired by
  • 4. 52% Analytics Chemistry Structural CFD Life Sciences Visualization ML/DL/AI 2020 Univa State of the GPU in HPC Survey 83% Rely on GPUs for HPC Applications Limited usePilot 17% 21% Production 62% What GPU workloads do they run? 57% 40% 33% 28% 26% 24% 19% Application compatibility Cost of GPUs Lack of skills or experience What are the top three barriers to GPU adoption? 69% 80% of users run three or more distinct GPU workloads 57% 40% Public clouds On-prem desktops On-prem servers Where do GPU workloads run? 71% 60% 52% Most GPU applications are in production 57% 26% 17% 7% 33% run distributed GPU applications using MPI or other parallel frameworks. 33% run parallel jobs 57% use HPC workload managers use public cloud 48% run in containers 14% Docker 33% Singularity
  • 5. Panel Discussion and Q&A Maximizing the utilization of GPU resources on-premise and in the cloud 5