SlideShare a Scribd company logo
1 of 2
Download to read offline
Meeting the challenges of AI
workloads with the Dell AI portfolio
A comparison of the Dell AI portfolio
vs. similar offerings from HPE
AI adoption presents new challenges for businesses and their data center
IT staff, including:
• Addressing the existing skill gaps in their current
staff through training or external hiring
• Understanding the data preparation needs of AI, including the
quality, quantity, location, and current state of the business’s data
• Assessing business goals to determine which AI models
and implementations will provide benefits
• Assessing the computational, networking, and storage needs
of the planned AI systems and acquiring these systems
With AI-ready portfolios, infrastructure vendors such as Dell Technologies
and HPE offer integrated solutions that encompass the entire AI lifecycle. We
researched publicly available information about both the Dell and HPE AI
portfolios, and examined benchmark testing from MLPerf®
. We found that Dell
is poised to help businesses embrace AI with a portfolio comprising high-
performing server and storage options, validated solutions, and professional
services that guide the process from planning to production.
AI model benchmark performance: MLPerf result comparison
Publicly available MLPerf®
Benchmark testing shows that offerings in the Dell AI
portfolio offer consistent, strong performance for AI workloads. MLPerf®
tests
performance for both training and inferencing on several AI models. The data
referenced in this report is based on MLPerf®
v3.1 Inference Datacenter results
published on the MLCommons®
website from November 2023.1
We compared
both 8- and 4-GPU servers and include one result from each category in this
summary; to see them all, read the full report at https://facts.pt/zPmSx4c.
1. MLCommons, “MLPerf Inference: Datacenter Benchmark Suite Results,” accessed December
12, 2023, https://mlcommons.org/en/inference-datacenter-31/.
Executive summary
Our research
found Dell has:
Broadest Generative
AI portfolio*
Per MLPerf®
results, the
Dell PowerEdge XE8640
server with four NVIDIA
H100 SXM5 GPUs achieved
the highest AI throughput
among all four-GPU
submissions in nine
different categories
A broader portfolio of
professional services
tailored for AI *Based on Dell analysis, August 2023. Dell Technologies offers solutions engineered to support AI
workloads from Workstations PCs (mobile and fixed) to Servers for High-performance Computing, Data
Storage, Cloud Native Software-Defined Infrastructure, Networking Switches, Data Protection, HCI and
Services. Data from: “Robert McNeal, “Dell, VMware and NVIDIA Bring AI to Your Data,” accessed
January 17, 2024, https://www.dell.com/en-us/blog/dell-vmware-and-nvidia-bring-ai-to-your-data/.
Meeting the challenges of AI workloads with the Dell AI portfolio January 2024
A Principled Technologies report: Hands-on testing. Real-world results.
Comparing MLPerf performance for eight-GPU servers
In the MLPerf®
v3.1 results for eight-GPU servers, the Dell PowerEdge XE9680 with NVIDIA SXM5 H100 GPUs out-
performed the HPE ProLiant XL675d Gen10 Plus with NVIDIA SXM4 A100 GPUs by up to 4.25x (see Figure 1).
Normalized MLPerf®
results: Dell PowerEdge XE9680 with H100 SXM5 vs.
HPE ProLiant XL675d Gen10 Plus with A100 SXM4 (Larger is better)
0.00
1.00
2.00
3.00
4.00
Server Offline Server Offline Offline Offline Server Offline Server Offline
99 99 99 99.9 99 99.9
ResNet Retinanet 3D-UNet BERT
Dell PowerEdge XE9680 HPE ProLiant XL675d Gen10 Plus
Accuracy
Model
2.03 2.07 2.22 2.14
1.67 1.67
2.25
2.47
3.99
4.25
1 1 1 1 1 1 1 1 1 1
Comparing MLPerf performance for four-GPU servers
The Dell PowerEdge XE8640 server with four NVIDIA H100 SXM5 GPUs achieved the highest AI throughput among all
four-GPU submissions in nine different categories. As Figure 2 shows, compared to the HPE ProLiant DL380a server, it
scored up to 2.07 times as high on the MLPerf®
benchmark.
In brief: Additional contributors to AI success
AI models require more than high performance servers for success. You must also consider storage for unstructured data
and professional services to plan, prepare, deploy, and manage your AI solution. The Dell portfolio offers storage for AI
datasets with the PowerScale series for file storage and Elastic Cloud Storage or ObjectScale storage for object storage.
Organizations can reap the advantages of Dell’s professional
and consulting services for AI, which offers some services
that HPE does not, such as data preparation. The Dell
portfolio also includes Validated Designs for AI, which takes
the guesswork out of designing and deploying AI.
*Verified MLPerf. score of v3.1 Inference Closed. Retrieved from https://ml-
commons.org/benchmarks/inference-datacenter/ 5 December 2023, entries
3.1-0069, 3.1-0085, 3.1-0067, and 3.1-0084. The MLPerf. name and logo are
registered and unregistered trademarks of MLCommons. Association in the
United States and other countries. All rights reserved. Unauthorized use strictly
prohibited. See www.mlcommons.org for more information.
Figure 1: Published MLPerf®
results for the Dell PowerEdge XE9680 and HPE ProLiant XL675d Gen10 Plus as of 11/29/23. The Dell system uses the
NVIDIA H100 GPU, while the GPUs in the HPE system are one generation older. Source: Principled Technologies using data from MLCommons®
.*
Normalized MLPerf®
results: Dell PowerEdge XE8640 with H100 SXM5 vs.
HPE ProLiant DL380a Gen 11 with H100 PCIe (Larger is better)
Dell PowerEdge XE8640 HPE ProLiant DL380a Gen11
0.00
1.00
2.00
Accuracy
Model
99 99 99 99.9 99 99.9
ResNet Retinanet 3D-UNet BERT
Server Offline Server Offline Offline Offline Server Offline Server Offline
1.65 1.56 1.68 1.52 1.34 1.34
2.07
1.54
1.82
1.55
1 1 1 1 1 1 1 1 1 1
Figure 2: Published MLPerf®
results for the Dell PowerEdge XE8640 and HPE ProLiant DL380a Gen11 as of 11/29/23. The Dell system uses the NVIDIA
H100 SXM form factor, while the HPE system uses the less powerful PCIe form factor. Source: Principled Technologies using data
from MLCommons®
.*
Principled Technologies is a registered trademark of Principled Technologies, Inc.
All other product names are the trademarks of their respective owners.
For additional information, review the report.
Principled
Technologies®
Facts matter.®
Principled
Technologies®
Facts matter.®
Read the report at https://facts.pt/zPmSx4c
Meeting the challenges of AI workloads with the Dell AI portfolio January 2024 | 2

More Related Content

Similar to Meeting the challenges of AI workloads with the Dell AI portfolio - Summary

Dell poweredge-r730-spec-sheet
Dell poweredge-r730-spec-sheetDell poweredge-r730-spec-sheet
Dell poweredge-r730-spec-sheet
IndrawanIT
 
Cloudwatt pioneers big_data
Cloudwatt pioneers big_dataCloudwatt pioneers big_data
Cloudwatt pioneers big_data
xband
 

Similar to Meeting the challenges of AI workloads with the Dell AI portfolio - Summary (20)

A single-socket Dell EMC PowerEdge R7515 solution delivered better value on a...
A single-socket Dell EMC PowerEdge R7515 solution delivered better value on a...A single-socket Dell EMC PowerEdge R7515 solution delivered better value on a...
A single-socket Dell EMC PowerEdge R7515 solution delivered better value on a...
 
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
 
Streamline End-to-End AI Pipelines with Intel, Databricks, and OmniSci
Streamline End-to-End AI Pipelines with Intel, Databricks, and OmniSciStreamline End-to-End AI Pipelines with Intel, Databricks, and OmniSci
Streamline End-to-End AI Pipelines with Intel, Databricks, and OmniSci
 
Dell_R730xd_RedHat_Ceph_Performance_SizingGuide_WhitePaper.pdf
Dell_R730xd_RedHat_Ceph_Performance_SizingGuide_WhitePaper.pdfDell_R730xd_RedHat_Ceph_Performance_SizingGuide_WhitePaper.pdf
Dell_R730xd_RedHat_Ceph_Performance_SizingGuide_WhitePaper.pdf
 
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
 
Upgrade to Dell EMC PowerEdge R6515 servers and gain better OLTP and VDI perf...
Upgrade to Dell EMC PowerEdge R6515 servers and gain better OLTP and VDI perf...Upgrade to Dell EMC PowerEdge R6515 servers and gain better OLTP and VDI perf...
Upgrade to Dell EMC PowerEdge R6515 servers and gain better OLTP and VDI perf...
 
Dell poweredge-r730-spec-sheet
Dell poweredge-r730-spec-sheetDell poweredge-r730-spec-sheet
Dell poweredge-r730-spec-sheet
 
Performance advantages of Hadoop ETL offload with the Intel processor-powered...
Performance advantages of Hadoop ETL offload with the Intel processor-powered...Performance advantages of Hadoop ETL offload with the Intel processor-powered...
Performance advantages of Hadoop ETL offload with the Intel processor-powered...
 
Dell EMC Ready Solutions for Big Data
Dell EMC Ready Solutions for Big DataDell EMC Ready Solutions for Big Data
Dell EMC Ready Solutions for Big Data
 
Dell PowerEdge M820 blade storage solution: Software cost advantages with Mic...
Dell PowerEdge M820 blade storage solution: Software cost advantages with Mic...Dell PowerEdge M820 blade storage solution: Software cost advantages with Mic...
Dell PowerEdge M820 blade storage solution: Software cost advantages with Mic...
 
Dell PowerEdge M820 blades: Balancing performance, density, and high availabi...
Dell PowerEdge M820 blades: Balancing performance, density, and high availabi...Dell PowerEdge M820 blades: Balancing performance, density, and high availabi...
Dell PowerEdge M820 blades: Balancing performance, density, and high availabi...
 
Improve AI inference performance with HPE ProLiant DL380 Gen11 servers, power...
Improve AI inference performance with HPE ProLiant DL380 Gen11 servers, power...Improve AI inference performance with HPE ProLiant DL380 Gen11 servers, power...
Improve AI inference performance with HPE ProLiant DL380 Gen11 servers, power...
 
Inside story on Intel Data Center @ IDF 2013
Inside story on Intel Data Center @ IDF 2013Inside story on Intel Data Center @ IDF 2013
Inside story on Intel Data Center @ IDF 2013
 
Get stronger SQL Server performance for less with Dell EMC PowerEdge R6515 cl...
Get stronger SQL Server performance for less with Dell EMC PowerEdge R6515 cl...Get stronger SQL Server performance for less with Dell EMC PowerEdge R6515 cl...
Get stronger SQL Server performance for less with Dell EMC PowerEdge R6515 cl...
 
Cloudwatt pioneers big_data
Cloudwatt pioneers big_dataCloudwatt pioneers big_data
Cloudwatt pioneers big_data
 
Give Your Organization Better, Faster Insights & Answers with High Performanc...
Give Your Organization Better, Faster Insights & Answers with High Performanc...Give Your Organization Better, Faster Insights & Answers with High Performanc...
Give Your Organization Better, Faster Insights & Answers with High Performanc...
 
Run more applications without expanding your datacenter
Run more applications without expanding your datacenterRun more applications without expanding your datacenter
Run more applications without expanding your datacenter
 
VxRail Appliance - Modernize your infrastructure and accelerate IT transforma...
VxRail Appliance - Modernize your infrastructure and accelerate IT transforma...VxRail Appliance - Modernize your infrastructure and accelerate IT transforma...
VxRail Appliance - Modernize your infrastructure and accelerate IT transforma...
 
Dell PowerEdge M820 blade storage solution: Software cost advantages with Ora...
Dell PowerEdge M820 blade storage solution: Software cost advantages with Ora...Dell PowerEdge M820 blade storage solution: Software cost advantages with Ora...
Dell PowerEdge M820 blade storage solution: Software cost advantages with Ora...
 
Redington Value Journal - July 2017
Redington Value Journal - July 2017Redington Value Journal - July 2017
Redington Value Journal - July 2017
 

More from Principled Technologies

Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Principled Technologies
 
Improve performance and gain room to grow by easily migrating to a modern Ope...
Improve performance and gain room to grow by easily migrating to a modern Ope...Improve performance and gain room to grow by easily migrating to a modern Ope...
Improve performance and gain room to grow by easily migrating to a modern Ope...
Principled Technologies
 
Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...
Principled Technologies
 
Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...
Principled Technologies
 

More from Principled Technologies (20)

Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
 
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
 
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
 
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
 
Realize 2.1X the performance with 20% less power with AMD EPYC processor-back...
Realize 2.1X the performance with 20% less power with AMD EPYC processor-back...Realize 2.1X the performance with 20% less power with AMD EPYC processor-back...
Realize 2.1X the performance with 20% less power with AMD EPYC processor-back...
 
Improve performance and gain room to grow by easily migrating to a modern Ope...
Improve performance and gain room to grow by easily migrating to a modern Ope...Improve performance and gain room to grow by easily migrating to a modern Ope...
Improve performance and gain room to grow by easily migrating to a modern Ope...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
 
A comparison of security features in Dell, HP, and Lenovo PC systems
A comparison of security features in Dell, HP, and Lenovo PC systemsA comparison of security features in Dell, HP, and Lenovo PC systems
A comparison of security features in Dell, HP, and Lenovo PC systems
 
Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...
 
Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...
 
Scale up your storage with higher-performing Dell APEX Block Storage for AWS ...
Scale up your storage with higher-performing Dell APEX Block Storage for AWS ...Scale up your storage with higher-performing Dell APEX Block Storage for AWS ...
Scale up your storage with higher-performing Dell APEX Block Storage for AWS ...
 
Scale up your storage with higher-performing Dell APEX Block Storage for AWS
Scale up your storage with higher-performing Dell APEX Block Storage for AWSScale up your storage with higher-performing Dell APEX Block Storage for AWS
Scale up your storage with higher-performing Dell APEX Block Storage for AWS
 
Get in and stay in the productivity zone with the HP Z2 G9 Tower Workstation
Get in and stay in the productivity zone with the HP Z2 G9 Tower WorkstationGet in and stay in the productivity zone with the HP Z2 G9 Tower Workstation
Get in and stay in the productivity zone with the HP Z2 G9 Tower Workstation
 
Open up new possibilities with higher transactional database performance from...
Open up new possibilities with higher transactional database performance from...Open up new possibilities with higher transactional database performance from...
Open up new possibilities with higher transactional database performance from...
 
Improving database performance and value with an easy migration to Azure Data...
Improving database performance and value with an easy migration to Azure Data...Improving database performance and value with an easy migration to Azure Data...
Improving database performance and value with an easy migration to Azure Data...
 
Realize better value and performance migrating from Azure Database for Postgr...
Realize better value and performance migrating from Azure Database for Postgr...Realize better value and performance migrating from Azure Database for Postgr...
Realize better value and performance migrating from Azure Database for Postgr...
 
Realize better value and performance migrating from Azure Database for Postgr...
Realize better value and performance migrating from Azure Database for Postgr...Realize better value and performance migrating from Azure Database for Postgr...
Realize better value and performance migrating from Azure Database for Postgr...
 
Set up students and teachers to excel now and in the future with Intel proces...
Set up students and teachers to excel now and in the future with Intel proces...Set up students and teachers to excel now and in the future with Intel proces...
Set up students and teachers to excel now and in the future with Intel proces...
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Modernizing Legacy Systems Using Ballerina
Modernizing Legacy Systems Using BallerinaModernizing Legacy Systems Using Ballerina
Modernizing Legacy Systems Using Ballerina
 
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data PlatformLess Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Decarbonising Commercial Real Estate: The Role of Operational Performance
Decarbonising Commercial Real Estate: The Role of Operational PerformanceDecarbonising Commercial Real Estate: The Role of Operational Performance
Decarbonising Commercial Real Estate: The Role of Operational Performance
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 

Meeting the challenges of AI workloads with the Dell AI portfolio - Summary

  • 1. Meeting the challenges of AI workloads with the Dell AI portfolio A comparison of the Dell AI portfolio vs. similar offerings from HPE AI adoption presents new challenges for businesses and their data center IT staff, including: • Addressing the existing skill gaps in their current staff through training or external hiring • Understanding the data preparation needs of AI, including the quality, quantity, location, and current state of the business’s data • Assessing business goals to determine which AI models and implementations will provide benefits • Assessing the computational, networking, and storage needs of the planned AI systems and acquiring these systems With AI-ready portfolios, infrastructure vendors such as Dell Technologies and HPE offer integrated solutions that encompass the entire AI lifecycle. We researched publicly available information about both the Dell and HPE AI portfolios, and examined benchmark testing from MLPerf® . We found that Dell is poised to help businesses embrace AI with a portfolio comprising high- performing server and storage options, validated solutions, and professional services that guide the process from planning to production. AI model benchmark performance: MLPerf result comparison Publicly available MLPerf® Benchmark testing shows that offerings in the Dell AI portfolio offer consistent, strong performance for AI workloads. MLPerf® tests performance for both training and inferencing on several AI models. The data referenced in this report is based on MLPerf® v3.1 Inference Datacenter results published on the MLCommons® website from November 2023.1 We compared both 8- and 4-GPU servers and include one result from each category in this summary; to see them all, read the full report at https://facts.pt/zPmSx4c. 1. MLCommons, “MLPerf Inference: Datacenter Benchmark Suite Results,” accessed December 12, 2023, https://mlcommons.org/en/inference-datacenter-31/. Executive summary Our research found Dell has: Broadest Generative AI portfolio* Per MLPerf® results, the Dell PowerEdge XE8640 server with four NVIDIA H100 SXM5 GPUs achieved the highest AI throughput among all four-GPU submissions in nine different categories A broader portfolio of professional services tailored for AI *Based on Dell analysis, August 2023. Dell Technologies offers solutions engineered to support AI workloads from Workstations PCs (mobile and fixed) to Servers for High-performance Computing, Data Storage, Cloud Native Software-Defined Infrastructure, Networking Switches, Data Protection, HCI and Services. Data from: “Robert McNeal, “Dell, VMware and NVIDIA Bring AI to Your Data,” accessed January 17, 2024, https://www.dell.com/en-us/blog/dell-vmware-and-nvidia-bring-ai-to-your-data/. Meeting the challenges of AI workloads with the Dell AI portfolio January 2024 A Principled Technologies report: Hands-on testing. Real-world results.
  • 2. Comparing MLPerf performance for eight-GPU servers In the MLPerf® v3.1 results for eight-GPU servers, the Dell PowerEdge XE9680 with NVIDIA SXM5 H100 GPUs out- performed the HPE ProLiant XL675d Gen10 Plus with NVIDIA SXM4 A100 GPUs by up to 4.25x (see Figure 1). Normalized MLPerf® results: Dell PowerEdge XE9680 with H100 SXM5 vs. HPE ProLiant XL675d Gen10 Plus with A100 SXM4 (Larger is better) 0.00 1.00 2.00 3.00 4.00 Server Offline Server Offline Offline Offline Server Offline Server Offline 99 99 99 99.9 99 99.9 ResNet Retinanet 3D-UNet BERT Dell PowerEdge XE9680 HPE ProLiant XL675d Gen10 Plus Accuracy Model 2.03 2.07 2.22 2.14 1.67 1.67 2.25 2.47 3.99 4.25 1 1 1 1 1 1 1 1 1 1 Comparing MLPerf performance for four-GPU servers The Dell PowerEdge XE8640 server with four NVIDIA H100 SXM5 GPUs achieved the highest AI throughput among all four-GPU submissions in nine different categories. As Figure 2 shows, compared to the HPE ProLiant DL380a server, it scored up to 2.07 times as high on the MLPerf® benchmark. In brief: Additional contributors to AI success AI models require more than high performance servers for success. You must also consider storage for unstructured data and professional services to plan, prepare, deploy, and manage your AI solution. The Dell portfolio offers storage for AI datasets with the PowerScale series for file storage and Elastic Cloud Storage or ObjectScale storage for object storage. Organizations can reap the advantages of Dell’s professional and consulting services for AI, which offers some services that HPE does not, such as data preparation. The Dell portfolio also includes Validated Designs for AI, which takes the guesswork out of designing and deploying AI. *Verified MLPerf. score of v3.1 Inference Closed. Retrieved from https://ml- commons.org/benchmarks/inference-datacenter/ 5 December 2023, entries 3.1-0069, 3.1-0085, 3.1-0067, and 3.1-0084. The MLPerf. name and logo are registered and unregistered trademarks of MLCommons. Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information. Figure 1: Published MLPerf® results for the Dell PowerEdge XE9680 and HPE ProLiant XL675d Gen10 Plus as of 11/29/23. The Dell system uses the NVIDIA H100 GPU, while the GPUs in the HPE system are one generation older. Source: Principled Technologies using data from MLCommons® .* Normalized MLPerf® results: Dell PowerEdge XE8640 with H100 SXM5 vs. HPE ProLiant DL380a Gen 11 with H100 PCIe (Larger is better) Dell PowerEdge XE8640 HPE ProLiant DL380a Gen11 0.00 1.00 2.00 Accuracy Model 99 99 99 99.9 99 99.9 ResNet Retinanet 3D-UNet BERT Server Offline Server Offline Offline Offline Server Offline Server Offline 1.65 1.56 1.68 1.52 1.34 1.34 2.07 1.54 1.82 1.55 1 1 1 1 1 1 1 1 1 1 Figure 2: Published MLPerf® results for the Dell PowerEdge XE8640 and HPE ProLiant DL380a Gen11 as of 11/29/23. The Dell system uses the NVIDIA H100 SXM form factor, while the HPE system uses the less powerful PCIe form factor. Source: Principled Technologies using data from MLCommons® .* Principled Technologies is a registered trademark of Principled Technologies, Inc. All other product names are the trademarks of their respective owners. For additional information, review the report. Principled Technologies® Facts matter.® Principled Technologies® Facts matter.® Read the report at https://facts.pt/zPmSx4c Meeting the challenges of AI workloads with the Dell AI portfolio January 2024 | 2