SlideShare a Scribd company logo
1 of 17
Download to read offline
HPC Trends for 2017 –
HPCAC Stanford
Addison Snell
@addisonsnell, addison@intersect360.com
Intersect360 Research in 2017
10 year history of HPC analyst business
Covering “high performance data center” markets, including
traditional HPC and supercomputing, high-performance enterprise,
cloud, big data, and hyperscale
New hyperscale advisory service
Weekly podcast, “This Week in HPC”
Contributing editors to The Next Platform, market research partners
of TOP500.org, media partnerships with HPCwire, insideHPC
Sponsors of HPC Advisory Council
Key Topics from Yesterday
• Architecture specialization
• HPC in the Cloud
• HPC vs. Hyperscale
• Machine learning and AI
HPC User Forward-Looking Views
FAVORABLEUNFAVORABLE
Intersect360 Research special study, 2016
Plans for POWER/OpenPOWER
Will Definitely
Use
13%
Will Evaluate
40%
No plans to evaluate
or use
47%
Plans to Use or EvaluatePower/OpenPOWER for HPC
"over the next few years"
Intersect360Research special study, 2016
Plans for ARM
Will Definitely
Use
12%
Will Evaluate
47%
No plans to evaluate
or use
41%
Plans to Use or EvaluateARM for HPC
"over the next few years"
Intersect360Research special study, 2016
Top Accelerator* Supplier
• 38% of the systems reported have accelerators installed
• NVidia was installed in the majority of systems with
accelerators and accounted for the majority of accelerators
installed.
• Intel Xeon Phi was installed in less than 20% of systems.
• FPGAs are reported, yet account for less than 2% of systems
and less than 1% of accelerators installed.
Top Suppliers by Share of Systems
(N=316 systems)
Top Suppliers by Share of Total Accelerators
(N=54,375 accelerators)
* Accelerators includes GPUs, co-processors, and FPGAs
Top Interconnects/Network Suppliers
• In all locales, two vendors account for over 50% of the mentions, with
Mellanox being the only supplier in all three locales. Entries not specifying
supplier were not included in total.
• InfiniBand continues to be the performance system network of choice for
system interconnects, with about two-thirds of the mentions. Ethernet 10G+
and InfiniBand have about equal shares for storage systems networks.
• Intel’s Omni-Path was reported for a few systems and storage systems, with
expectations for increased share in 2017.
Top System Interconnect Suppliers Top Storage Interconnect Suppliers Top LAN Suppliers
• About 76% of applications reported were Open Source or ISV
software (generally-available applications).
• ISV and in-house packages are still the majority at commercial
sites, representing about 84% of the packages reported.
• Open source accounts for more than 50% of the packages reported
at academic and government sites.
Top Generally-Available Applications
Top Open Source Applications Top ISV Applications
Total HPC Market (Combined HPTC and HPBC)
Revenue by Product Class ($M)
The Hyperscale Market
• Included since our 2007 HPC methodology as
“ultrascale internet”
• In 2015, recognized “Hyperscale” as distinct
market in proximity to HPC; began process of
separating it from HPC
• Defined hyperscale methodology with market
research and feedback from interested clients
• Published definitions and methodology report in
April 2016
Hyperscale Market Definition
The hyperscale market
consists of arbitrarily
scalable, web-facing
application infrastructure
that is distinct from general
IT investment
Hyperscale Market Size and Tiers
• Intersect360 Research has a tiered model for
the hyperscale market, as follows:
Tier Annual IT Orgs Market Size
Tier 1 > $1B 8 ~$20B
Tier 2 > $100M ~40 ~$10B
Tier 3 > $1M hundreds ~$5B
Total: ~$35B
DRAFT, Intersect360 Research, 2016
• We anticipate publication of market size very
soon, possibly by end of year
Deep Learning
• Intersect360 Research tracks AI (including deep
learning, machine learning, cognitive computing,
etc.) as part of the hyperscale market
– Similar to but distinct from HPC
– Low precision, intensely parallel, strong affinity to
public cloud
• DL is not a vertical market. It is more akin to an
algorithm or method of computation, like an FFT
• Cloud providers and end users are in early
stages of investment for their applications
Sizing Deep Learning
• We have looked at the size of the deep learning
market opportunity from several angles:
– Supplier-side information on market expansion
– Demand-side market analysis on acquisitions
– Top-down analysis of the hyperscale market
– Analyst opinion
• Our independent methods have produced
consistent views of the current opportunity in
deep learning
Deep Learning Size and Growth
• According to our analysis, the deep learning
market opportunity is $2.0B to $2.5B for 2016
– Represents about 6.5% of the hyperscale market
– This is a pre-publication figure
• We expect growth rate to be very high for the
next two years, 2017-18, close to 100% Y/Y
• After that, growth will moderate, and possibly
even contract by end of five-year period
The Next Ten Years in HPC
(Write These Down; Grade Me in 2027)
1. Fundamental drivers of HPC remain strong. Forever.
2. Specialization proliferates again. Custom architectures will
reemerge in the market.
3. Public cloud (utility) remains well below 10% of the HPC market
through the next 10 years.
4. Object storage will take off in commercial markets.
5. The hyperscale market will have a tremendous effect:
– Consuming HPC-associated technologies like GPU, InfiniBand
– Defining system configurations and product specifications
– Influencing software and middleware
– Introducing new revolutionary applications based on AI
(including deep learning) and augmented reality. These are
hyperscale applications that will predominant be run on cloud-
based resources.

More Related Content

What's hot

Application Profiling at the HPCAC High Performance Center
Application Profiling at the HPCAC High Performance CenterApplication Profiling at the HPCAC High Performance Center
Application Profiling at the HPCAC High Performance Centerinside-BigData.com
 
IDC Report on HPC Market Trends June 2013
IDC Report on HPC Market Trends June 2013IDC Report on HPC Market Trends June 2013
IDC Report on HPC Market Trends June 2013inside-BigData.com
 
Development Trends of Next-Generation Supercomputers
Development Trends of Next-Generation SupercomputersDevelopment Trends of Next-Generation Supercomputers
Development Trends of Next-Generation Supercomputersinside-BigData.com
 
Big Data Meetup: Data Science & Big Data in Telecom
Big Data Meetup: Data Science & Big Data in TelecomBig Data Meetup: Data Science & Big Data in Telecom
Big Data Meetup: Data Science & Big Data in TelecomProvectus
 
Abivin - Big Data Analytics & Optimization
Abivin - Big Data Analytics & OptimizationAbivin - Big Data Analytics & Optimization
Abivin - Big Data Analytics & OptimizationLong Pham
 
Big Data Analytics in Energy & Utilities
Big Data Analytics in Energy & UtilitiesBig Data Analytics in Energy & Utilities
Big Data Analytics in Energy & UtilitiesAnders Quitzau
 
The Soft Grid 2013 Opening Presentation
The Soft Grid 2013 Opening PresentationThe Soft Grid 2013 Opening Presentation
The Soft Grid 2013 Opening PresentationGTMevents
 
Needle in the Haystack by Anshul Vikram Pandey at QuantCon 2016
Needle in the Haystack by Anshul Vikram Pandey at QuantCon 2016Needle in the Haystack by Anshul Vikram Pandey at QuantCon 2016
Needle in the Haystack by Anshul Vikram Pandey at QuantCon 2016Quantopian
 
Whitepaper - Transforming the Energy & Utilities Industry with Smart Analytics
Whitepaper - Transforming the Energy & Utilities Industry with Smart AnalyticsWhitepaper - Transforming the Energy & Utilities Industry with Smart Analytics
Whitepaper - Transforming the Energy & Utilities Industry with Smart AnalyticseInfochips (An Arrow Company)
 
The Interesting IoT: Digitizing Operations
The Interesting IoT: Digitizing OperationsThe Interesting IoT: Digitizing Operations
The Interesting IoT: Digitizing OperationsGordon Haff
 
That's not a metric! Data for cloud-native success
That's not a metric! Data for cloud-native successThat's not a metric! Data for cloud-native success
That's not a metric! Data for cloud-native successGordon Haff
 
Big Data Ecosystem at InMobi, Nasscom ATC 2013 Noida
Big Data Ecosystem at InMobi, Nasscom ATC 2013 NoidaBig Data Ecosystem at InMobi, Nasscom ATC 2013 Noida
Big Data Ecosystem at InMobi, Nasscom ATC 2013 NoidaSharad Agarwal
 
State street edmc swaps pilot
State street edmc swaps pilotState street edmc swaps pilot
State street edmc swaps pilotMarty Loughlin
 
Putting together AI pipelines with Acumos
Putting together AI pipelines with AcumosPutting together AI pipelines with Acumos
Putting together AI pipelines with AcumosPantelis Monogioudis
 

What's hot (19)

Application Profiling at the HPCAC High Performance Center
Application Profiling at the HPCAC High Performance CenterApplication Profiling at the HPCAC High Performance Center
Application Profiling at the HPCAC High Performance Center
 
IDC Report on HPC Market Trends June 2013
IDC Report on HPC Market Trends June 2013IDC Report on HPC Market Trends June 2013
IDC Report on HPC Market Trends June 2013
 
Hot Technology Topics in 2017
Hot Technology Topics in 2017Hot Technology Topics in 2017
Hot Technology Topics in 2017
 
OrionX AI Survey
OrionX AI SurveyOrionX AI Survey
OrionX AI Survey
 
Outlook on Hot Technologies
Outlook on Hot TechnologiesOutlook on Hot Technologies
Outlook on Hot Technologies
 
Development Trends of Next-Generation Supercomputers
Development Trends of Next-Generation SupercomputersDevelopment Trends of Next-Generation Supercomputers
Development Trends of Next-Generation Supercomputers
 
Big Data Meetup: Data Science & Big Data in Telecom
Big Data Meetup: Data Science & Big Data in TelecomBig Data Meetup: Data Science & Big Data in Telecom
Big Data Meetup: Data Science & Big Data in Telecom
 
Abivin - Big Data Analytics & Optimization
Abivin - Big Data Analytics & OptimizationAbivin - Big Data Analytics & Optimization
Abivin - Big Data Analytics & Optimization
 
Big Data Analytics in Energy & Utilities
Big Data Analytics in Energy & UtilitiesBig Data Analytics in Energy & Utilities
Big Data Analytics in Energy & Utilities
 
The Soft Grid 2013 Opening Presentation
The Soft Grid 2013 Opening PresentationThe Soft Grid 2013 Opening Presentation
The Soft Grid 2013 Opening Presentation
 
Needle in the Haystack by Anshul Vikram Pandey at QuantCon 2016
Needle in the Haystack by Anshul Vikram Pandey at QuantCon 2016Needle in the Haystack by Anshul Vikram Pandey at QuantCon 2016
Needle in the Haystack by Anshul Vikram Pandey at QuantCon 2016
 
Whitepaper - Transforming the Energy & Utilities Industry with Smart Analytics
Whitepaper - Transforming the Energy & Utilities Industry with Smart AnalyticsWhitepaper - Transforming the Energy & Utilities Industry with Smart Analytics
Whitepaper - Transforming the Energy & Utilities Industry with Smart Analytics
 
The Interesting IoT: Digitizing Operations
The Interesting IoT: Digitizing OperationsThe Interesting IoT: Digitizing Operations
The Interesting IoT: Digitizing Operations
 
The Data Asset
The Data AssetThe Data Asset
The Data Asset
 
That's not a metric! Data for cloud-native success
That's not a metric! Data for cloud-native successThat's not a metric! Data for cloud-native success
That's not a metric! Data for cloud-native success
 
Big Data Ecosystem at InMobi, Nasscom ATC 2013 Noida
Big Data Ecosystem at InMobi, Nasscom ATC 2013 NoidaBig Data Ecosystem at InMobi, Nasscom ATC 2013 Noida
Big Data Ecosystem at InMobi, Nasscom ATC 2013 Noida
 
SlideShare
SlideShareSlideShare
SlideShare
 
State street edmc swaps pilot
State street edmc swaps pilotState street edmc swaps pilot
State street edmc swaps pilot
 
Putting together AI pipelines with Acumos
Putting together AI pipelines with AcumosPutting together AI pipelines with Acumos
Putting together AI pipelines with Acumos
 

Similar to HPC Computing Trends

Hyperion Research HPC Market Briefing Breakfast at SC19
Hyperion Research HPC Market Briefing Breakfast at SC19Hyperion Research HPC Market Briefing Breakfast at SC19
Hyperion Research HPC Market Briefing Breakfast at SC19inside-BigData.com
 
High Performance Data Analysis (HPDA): HPC - Big Data Convergence
High Performance Data Analysis (HPDA): HPC - Big Data ConvergenceHigh Performance Data Analysis (HPDA): HPC - Big Data Convergence
High Performance Data Analysis (HPDA): HPC - Big Data Convergenceinside-BigData.com
 
Hadoop Twelve Predictions for 2012
Hadoop Twelve Predictions for 2012Hadoop Twelve Predictions for 2012
Hadoop Twelve Predictions for 2012Cloudera, Inc.
 
Research Findings: HPC-Enabled AI
Research Findings: HPC-Enabled AIResearch Findings: HPC-Enabled AI
Research Findings: HPC-Enabled AIinside-BigData.com
 
Augmented Analytics Market Outlook
Augmented Analytics Market OutlookAugmented Analytics Market Outlook
Augmented Analytics Market OutlookAman Soni
 
Big data analytic market opportunity
Big data analytic market opportunityBig data analytic market opportunity
Big data analytic market opportunityStanley Wang
 
State of the Mainframe for 2017
State of the Mainframe for 2017State of the Mainframe for 2017
State of the Mainframe for 2017Precisely
 
The changing landscape of hyperconvergence. Key statistics your customers sho...
The changing landscape of hyperconvergence. Key statistics your customers sho...The changing landscape of hyperconvergence. Key statistics your customers sho...
The changing landscape of hyperconvergence. Key statistics your customers sho...Tech Data
 
Mapping presentation THAG big data from space
Mapping presentation THAG big data from spaceMapping presentation THAG big data from space
Mapping presentation THAG big data from spaceBartosz Szkudlarek
 
Analytical Innovation: How to Build the Next Generation Data Platform
Analytical Innovation: How to Build the Next Generation Data PlatformAnalytical Innovation: How to Build the Next Generation Data Platform
Analytical Innovation: How to Build the Next Generation Data PlatformVMware Tanzu
 
R and Big Data using Revolution R Enterprise with Hadoop
R and Big Data using Revolution R Enterprise with HadoopR and Big Data using Revolution R Enterprise with Hadoop
R and Big Data using Revolution R Enterprise with HadoopRevolution Analytics
 
Worldwide Hybrid Cloud Computing Market - Solutions, Service Model, Verticals...
Worldwide Hybrid Cloud Computing Market - Solutions, Service Model, Verticals...Worldwide Hybrid Cloud Computing Market - Solutions, Service Model, Verticals...
Worldwide Hybrid Cloud Computing Market - Solutions, Service Model, Verticals...Market Research Reports, Inc.
 
Technology Breakout – Simon Hardy, Elemica: “Next Generation Apps and Analytics”
Technology Breakout – Simon Hardy, Elemica: “Next Generation Apps and Analytics”Technology Breakout – Simon Hardy, Elemica: “Next Generation Apps and Analytics”
Technology Breakout – Simon Hardy, Elemica: “Next Generation Apps and Analytics”Elemica
 
Worldwide Hybrid Cloud Computing Market – Drivers, Opportunities, Trends, and...
Worldwide Hybrid Cloud Computing Market – Drivers, Opportunities, Trends, and...Worldwide Hybrid Cloud Computing Market – Drivers, Opportunities, Trends, and...
Worldwide Hybrid Cloud Computing Market – Drivers, Opportunities, Trends, and...Infoholic Research
 
Splunk-hortonworks-risk-management-oct-2014
Splunk-hortonworks-risk-management-oct-2014Splunk-hortonworks-risk-management-oct-2014
Splunk-hortonworks-risk-management-oct-2014Hortonworks
 
Compaq AR Portal Presentation 2001
Compaq AR Portal Presentation 2001Compaq AR Portal Presentation 2001
Compaq AR Portal Presentation 2001Erick Lamothe
 

Similar to HPC Computing Trends (20)

HPC Trends for 2017
HPC Trends for 2017HPC Trends for 2017
HPC Trends for 2017
 
The New HPC
The New HPCThe New HPC
The New HPC
 
The New HPC
The New HPCThe New HPC
The New HPC
 
Hyperion Research HPC Market Briefing Breakfast at SC19
Hyperion Research HPC Market Briefing Breakfast at SC19Hyperion Research HPC Market Briefing Breakfast at SC19
Hyperion Research HPC Market Briefing Breakfast at SC19
 
High Performance Data Analysis (HPDA): HPC - Big Data Convergence
High Performance Data Analysis (HPDA): HPC - Big Data ConvergenceHigh Performance Data Analysis (HPDA): HPC - Big Data Convergence
High Performance Data Analysis (HPDA): HPC - Big Data Convergence
 
Hadoop Twelve Predictions for 2012
Hadoop Twelve Predictions for 2012Hadoop Twelve Predictions for 2012
Hadoop Twelve Predictions for 2012
 
Research Findings: HPC-Enabled AI
Research Findings: HPC-Enabled AIResearch Findings: HPC-Enabled AI
Research Findings: HPC-Enabled AI
 
Augmented Analytics Market Outlook
Augmented Analytics Market OutlookAugmented Analytics Market Outlook
Augmented Analytics Market Outlook
 
Market study of PAAS
Market study of PAASMarket study of PAAS
Market study of PAAS
 
Big data analytic market opportunity
Big data analytic market opportunityBig data analytic market opportunity
Big data analytic market opportunity
 
State of the Mainframe for 2017
State of the Mainframe for 2017State of the Mainframe for 2017
State of the Mainframe for 2017
 
The changing landscape of hyperconvergence. Key statistics your customers sho...
The changing landscape of hyperconvergence. Key statistics your customers sho...The changing landscape of hyperconvergence. Key statistics your customers sho...
The changing landscape of hyperconvergence. Key statistics your customers sho...
 
Mapping presentation THAG big data from space
Mapping presentation THAG big data from spaceMapping presentation THAG big data from space
Mapping presentation THAG big data from space
 
Analytical Innovation: How to Build the Next Generation Data Platform
Analytical Innovation: How to Build the Next Generation Data PlatformAnalytical Innovation: How to Build the Next Generation Data Platform
Analytical Innovation: How to Build the Next Generation Data Platform
 
R and Big Data using Revolution R Enterprise with Hadoop
R and Big Data using Revolution R Enterprise with HadoopR and Big Data using Revolution R Enterprise with Hadoop
R and Big Data using Revolution R Enterprise with Hadoop
 
Worldwide Hybrid Cloud Computing Market - Solutions, Service Model, Verticals...
Worldwide Hybrid Cloud Computing Market - Solutions, Service Model, Verticals...Worldwide Hybrid Cloud Computing Market - Solutions, Service Model, Verticals...
Worldwide Hybrid Cloud Computing Market - Solutions, Service Model, Verticals...
 
Technology Breakout – Simon Hardy, Elemica: “Next Generation Apps and Analytics”
Technology Breakout – Simon Hardy, Elemica: “Next Generation Apps and Analytics”Technology Breakout – Simon Hardy, Elemica: “Next Generation Apps and Analytics”
Technology Breakout – Simon Hardy, Elemica: “Next Generation Apps and Analytics”
 
Worldwide Hybrid Cloud Computing Market – Drivers, Opportunities, Trends, and...
Worldwide Hybrid Cloud Computing Market – Drivers, Opportunities, Trends, and...Worldwide Hybrid Cloud Computing Market – Drivers, Opportunities, Trends, and...
Worldwide Hybrid Cloud Computing Market – Drivers, Opportunities, Trends, and...
 
Splunk-hortonworks-risk-management-oct-2014
Splunk-hortonworks-risk-management-oct-2014Splunk-hortonworks-risk-management-oct-2014
Splunk-hortonworks-risk-management-oct-2014
 
Compaq AR Portal Presentation 2001
Compaq AR Portal Presentation 2001Compaq AR Portal Presentation 2001
Compaq AR Portal Presentation 2001
 

More from inside-BigData.com

Preparing to program Aurora at Exascale - Early experiences and future direct...
Preparing to program Aurora at Exascale - Early experiences and future direct...Preparing to program Aurora at Exascale - Early experiences and future direct...
Preparing to program Aurora at Exascale - Early experiences and future direct...inside-BigData.com
 
Transforming Private 5G Networks
Transforming Private 5G NetworksTransforming Private 5G Networks
Transforming Private 5G Networksinside-BigData.com
 
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...inside-BigData.com
 
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...inside-BigData.com
 
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...inside-BigData.com
 
HPC Impact: EDA Telemetry Neural Networks
HPC Impact: EDA Telemetry Neural NetworksHPC Impact: EDA Telemetry Neural Networks
HPC Impact: EDA Telemetry Neural Networksinside-BigData.com
 
Biohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring
Biohybrid Robotic Jellyfish for Future Applications in Ocean MonitoringBiohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring
Biohybrid Robotic Jellyfish for Future Applications in Ocean Monitoringinside-BigData.com
 
Machine Learning for Weather Forecasts
Machine Learning for Weather ForecastsMachine Learning for Weather Forecasts
Machine Learning for Weather Forecastsinside-BigData.com
 
HPC AI Advisory Council Update
HPC AI Advisory Council UpdateHPC AI Advisory Council Update
HPC AI Advisory Council Updateinside-BigData.com
 
Fugaku Supercomputer joins fight against COVID-19
Fugaku Supercomputer joins fight against COVID-19Fugaku Supercomputer joins fight against COVID-19
Fugaku Supercomputer joins fight against COVID-19inside-BigData.com
 
Energy Efficient Computing using Dynamic Tuning
Energy Efficient Computing using Dynamic TuningEnergy Efficient Computing using Dynamic Tuning
Energy Efficient Computing using Dynamic Tuninginside-BigData.com
 
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPOD
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPODHPC at Scale Enabled by DDN A3i and NVIDIA SuperPOD
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPODinside-BigData.com
 
Versal Premium ACAP for Network and Cloud Acceleration
Versal Premium ACAP for Network and Cloud AccelerationVersal Premium ACAP for Network and Cloud Acceleration
Versal Premium ACAP for Network and Cloud Accelerationinside-BigData.com
 
Zettar: Moving Massive Amounts of Data across Any Distance Efficiently
Zettar: Moving Massive Amounts of Data across Any Distance EfficientlyZettar: Moving Massive Amounts of Data across Any Distance Efficiently
Zettar: Moving Massive Amounts of Data across Any Distance Efficientlyinside-BigData.com
 
Scaling TCO in a Post Moore's Era
Scaling TCO in a Post Moore's EraScaling TCO in a Post Moore's Era
Scaling TCO in a Post Moore's Erainside-BigData.com
 
CUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computingCUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computinginside-BigData.com
 
Introducing HPC with a Raspberry Pi Cluster
Introducing HPC with a Raspberry Pi ClusterIntroducing HPC with a Raspberry Pi Cluster
Introducing HPC with a Raspberry Pi Clusterinside-BigData.com
 

More from inside-BigData.com (20)

Major Market Shifts in IT
Major Market Shifts in ITMajor Market Shifts in IT
Major Market Shifts in IT
 
Preparing to program Aurora at Exascale - Early experiences and future direct...
Preparing to program Aurora at Exascale - Early experiences and future direct...Preparing to program Aurora at Exascale - Early experiences and future direct...
Preparing to program Aurora at Exascale - Early experiences and future direct...
 
Transforming Private 5G Networks
Transforming Private 5G NetworksTransforming Private 5G Networks
Transforming Private 5G Networks
 
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
 
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
 
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
Evolving Cyberinfrastructure, Democratizing Data, and Scaling AI to Catalyze ...
 
HPC Impact: EDA Telemetry Neural Networks
HPC Impact: EDA Telemetry Neural NetworksHPC Impact: EDA Telemetry Neural Networks
HPC Impact: EDA Telemetry Neural Networks
 
Biohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring
Biohybrid Robotic Jellyfish for Future Applications in Ocean MonitoringBiohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring
Biohybrid Robotic Jellyfish for Future Applications in Ocean Monitoring
 
Machine Learning for Weather Forecasts
Machine Learning for Weather ForecastsMachine Learning for Weather Forecasts
Machine Learning for Weather Forecasts
 
HPC AI Advisory Council Update
HPC AI Advisory Council UpdateHPC AI Advisory Council Update
HPC AI Advisory Council Update
 
Fugaku Supercomputer joins fight against COVID-19
Fugaku Supercomputer joins fight against COVID-19Fugaku Supercomputer joins fight against COVID-19
Fugaku Supercomputer joins fight against COVID-19
 
Energy Efficient Computing using Dynamic Tuning
Energy Efficient Computing using Dynamic TuningEnergy Efficient Computing using Dynamic Tuning
Energy Efficient Computing using Dynamic Tuning
 
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPOD
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPODHPC at Scale Enabled by DDN A3i and NVIDIA SuperPOD
HPC at Scale Enabled by DDN A3i and NVIDIA SuperPOD
 
State of ARM-based HPC
State of ARM-based HPCState of ARM-based HPC
State of ARM-based HPC
 
Versal Premium ACAP for Network and Cloud Acceleration
Versal Premium ACAP for Network and Cloud AccelerationVersal Premium ACAP for Network and Cloud Acceleration
Versal Premium ACAP for Network and Cloud Acceleration
 
Zettar: Moving Massive Amounts of Data across Any Distance Efficiently
Zettar: Moving Massive Amounts of Data across Any Distance EfficientlyZettar: Moving Massive Amounts of Data across Any Distance Efficiently
Zettar: Moving Massive Amounts of Data across Any Distance Efficiently
 
Scaling TCO in a Post Moore's Era
Scaling TCO in a Post Moore's EraScaling TCO in a Post Moore's Era
Scaling TCO in a Post Moore's Era
 
CUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computingCUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computing
 
Introducing HPC with a Raspberry Pi Cluster
Introducing HPC with a Raspberry Pi ClusterIntroducing HPC with a Raspberry Pi Cluster
Introducing HPC with a Raspberry Pi Cluster
 
Overview of HPC Interconnects
Overview of HPC InterconnectsOverview of HPC Interconnects
Overview of HPC Interconnects
 

Recently uploaded

Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 

Recently uploaded (20)

Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 

HPC Computing Trends

  • 1. HPC Trends for 2017 – HPCAC Stanford Addison Snell @addisonsnell, addison@intersect360.com
  • 2. Intersect360 Research in 2017 10 year history of HPC analyst business Covering “high performance data center” markets, including traditional HPC and supercomputing, high-performance enterprise, cloud, big data, and hyperscale New hyperscale advisory service Weekly podcast, “This Week in HPC” Contributing editors to The Next Platform, market research partners of TOP500.org, media partnerships with HPCwire, insideHPC Sponsors of HPC Advisory Council
  • 3. Key Topics from Yesterday • Architecture specialization • HPC in the Cloud • HPC vs. Hyperscale • Machine learning and AI
  • 4. HPC User Forward-Looking Views FAVORABLEUNFAVORABLE Intersect360 Research special study, 2016
  • 5. Plans for POWER/OpenPOWER Will Definitely Use 13% Will Evaluate 40% No plans to evaluate or use 47% Plans to Use or EvaluatePower/OpenPOWER for HPC "over the next few years" Intersect360Research special study, 2016
  • 6. Plans for ARM Will Definitely Use 12% Will Evaluate 47% No plans to evaluate or use 41% Plans to Use or EvaluateARM for HPC "over the next few years" Intersect360Research special study, 2016
  • 7. Top Accelerator* Supplier • 38% of the systems reported have accelerators installed • NVidia was installed in the majority of systems with accelerators and accounted for the majority of accelerators installed. • Intel Xeon Phi was installed in less than 20% of systems. • FPGAs are reported, yet account for less than 2% of systems and less than 1% of accelerators installed. Top Suppliers by Share of Systems (N=316 systems) Top Suppliers by Share of Total Accelerators (N=54,375 accelerators) * Accelerators includes GPUs, co-processors, and FPGAs
  • 8. Top Interconnects/Network Suppliers • In all locales, two vendors account for over 50% of the mentions, with Mellanox being the only supplier in all three locales. Entries not specifying supplier were not included in total. • InfiniBand continues to be the performance system network of choice for system interconnects, with about two-thirds of the mentions. Ethernet 10G+ and InfiniBand have about equal shares for storage systems networks. • Intel’s Omni-Path was reported for a few systems and storage systems, with expectations for increased share in 2017. Top System Interconnect Suppliers Top Storage Interconnect Suppliers Top LAN Suppliers
  • 9. • About 76% of applications reported were Open Source or ISV software (generally-available applications). • ISV and in-house packages are still the majority at commercial sites, representing about 84% of the packages reported. • Open source accounts for more than 50% of the packages reported at academic and government sites. Top Generally-Available Applications Top Open Source Applications Top ISV Applications
  • 10. Total HPC Market (Combined HPTC and HPBC) Revenue by Product Class ($M)
  • 11. The Hyperscale Market • Included since our 2007 HPC methodology as “ultrascale internet” • In 2015, recognized “Hyperscale” as distinct market in proximity to HPC; began process of separating it from HPC • Defined hyperscale methodology with market research and feedback from interested clients • Published definitions and methodology report in April 2016
  • 12. Hyperscale Market Definition The hyperscale market consists of arbitrarily scalable, web-facing application infrastructure that is distinct from general IT investment
  • 13. Hyperscale Market Size and Tiers • Intersect360 Research has a tiered model for the hyperscale market, as follows: Tier Annual IT Orgs Market Size Tier 1 > $1B 8 ~$20B Tier 2 > $100M ~40 ~$10B Tier 3 > $1M hundreds ~$5B Total: ~$35B DRAFT, Intersect360 Research, 2016 • We anticipate publication of market size very soon, possibly by end of year
  • 14. Deep Learning • Intersect360 Research tracks AI (including deep learning, machine learning, cognitive computing, etc.) as part of the hyperscale market – Similar to but distinct from HPC – Low precision, intensely parallel, strong affinity to public cloud • DL is not a vertical market. It is more akin to an algorithm or method of computation, like an FFT • Cloud providers and end users are in early stages of investment for their applications
  • 15. Sizing Deep Learning • We have looked at the size of the deep learning market opportunity from several angles: – Supplier-side information on market expansion – Demand-side market analysis on acquisitions – Top-down analysis of the hyperscale market – Analyst opinion • Our independent methods have produced consistent views of the current opportunity in deep learning
  • 16. Deep Learning Size and Growth • According to our analysis, the deep learning market opportunity is $2.0B to $2.5B for 2016 – Represents about 6.5% of the hyperscale market – This is a pre-publication figure • We expect growth rate to be very high for the next two years, 2017-18, close to 100% Y/Y • After that, growth will moderate, and possibly even contract by end of five-year period
  • 17. The Next Ten Years in HPC (Write These Down; Grade Me in 2027) 1. Fundamental drivers of HPC remain strong. Forever. 2. Specialization proliferates again. Custom architectures will reemerge in the market. 3. Public cloud (utility) remains well below 10% of the HPC market through the next 10 years. 4. Object storage will take off in commercial markets. 5. The hyperscale market will have a tremendous effect: – Consuming HPC-associated technologies like GPU, InfiniBand – Defining system configurations and product specifications – Influencing software and middleware – Introducing new revolutionary applications based on AI (including deep learning) and augmented reality. These are hyperscale applications that will predominant be run on cloud- based resources.