SlideShare a Scribd company logo

Building Efficient Edge Nodes for Content Delivery Networks

Supermicro, Intel®, and Varnish are delivering an optimized CDN solution built with the Intel Xeon-D processor in a Supermicro Superserver running Varnish Enterprise. This solution delivers strong performance in a compact form factor with low idle power and excellent performance per watt. Join Supermicro, Intel, and Varnish experts as they discuss their collaboration and how their respective technologies work together to improve the performance and lower the TCO of an edge caching server.

1 of 31
Download to read offline
Building Efficient Edge Nodes for Content
Delivery Networks
Frank Miller, Chief Technology Officer, Varnish Software
Raymond Chung, Director, Product Management, Supermicro
Nash Kleppan, Cloud Solutions Engineer, Intel
Data Platforms Group 2
Notices & Disclaimers
 Performance varies by use, configuration and other factors. Learn
more on the Performance Index site.
 Performance results are based on testing as of dates shown in
configurations and may not reflect all publicly available ​updates. See
backup for configuration details. No product or component can be
absolutely secure.
 Your costs and results may vary.
 Intel technologies may require enabled hardware, software or service
activation.
 © Intel Corporation. Intel, the Intel logo, and other Intel marks are
trademarks of Intel Corporation or its subsidiaries. Other names and
brands may be claimed as the property of others.
Data Platforms Group 3
Agenda
• Background
• Varnish Software
• Supermicro SuperServer System for CDN
• Intel® Xeon® D-1700 and D-2700
• Test Environment
• Power and Performance Testing
• Sizing Considerations
• Conclusions
Data Platforms Group 4
Background
• There has been an explosion of live streaming consumption, estimated to be nearly 4
billion hours in 20201
• The growth of high definition (1080p) and ultra-high definition (4K) content increases
the performance demands on a CDN
• The deployment of 5G networks allows users of mobile devices to consume video at
higher speed
• Performance and optimization depend upon software efficiency and system design
• The goal of this Varnish - Supermicro – Intel collaboration on CDN is to improve the
performance per TCO and performance per Watt of edge caching servers
1: https://www.digitaltveurope.com/2020/05/14/almost-4-billion-hours-watched-as-live-streaming-industry-benefits-from-lockdown/
Data Platforms Group 5
Trends in Storage Systems
• Increased demand for NVMe storage
• 25GbE and 100GbE networking at the edge
• High-performance workloads on broadly available servers
• Workloads include: CDN and scale-out storage
• Traditional high performance storage systems
• Performance typically prioritized over other concerns
• May not be suitable for reduced performance, power constrained deployments
• Efficient storage systems
• Require appropriately sized server and processor(s) running efficient software.
• Must be appropriately sized to intended performance target for optimal power and
performance
• Watts turn into kilowatts – Need to keep sustainability goals and OpEx in mind.
Varnish Enterprise
Frank Miller
Chief Technology Officer

Recommended

Hci solution with VxRail
Hci solution with VxRailHci solution with VxRail
Hci solution with VxRailAnton An
 
DNSSEC Tutorial; USENIX LISA 2013
DNSSEC Tutorial; USENIX LISA 2013DNSSEC Tutorial; USENIX LISA 2013
DNSSEC Tutorial; USENIX LISA 2013Shumon Huque
 
Cybersecurity Interview Questions Part -2.pdf
Cybersecurity Interview Questions Part -2.pdfCybersecurity Interview Questions Part -2.pdf
Cybersecurity Interview Questions Part -2.pdfInfosec Train
 
Introdução do DEVSECOPS
Introdução do DEVSECOPSIntrodução do DEVSECOPS
Introdução do DEVSECOPSGDGFoz
 
Advanced Wi-Fi pentesting
Advanced Wi-Fi pentestingAdvanced Wi-Fi pentesting
Advanced Wi-Fi pentestingYunfei Yang
 
200308 Active Directory Security
200308 Active Directory Security200308 Active Directory Security
200308 Active Directory SecurityArmando Leon
 
FlexiWAN Webinar - The Role of Open Source in Your SD-WAN Strategy
FlexiWAN Webinar - The Role of Open Source in Your SD-WAN StrategyFlexiWAN Webinar - The Role of Open Source in Your SD-WAN Strategy
FlexiWAN Webinar - The Role of Open Source in Your SD-WAN StrategyAmir Zmora
 

More Related Content

What's hot

EDR(End Point Detection And Response).pptx
EDR(End Point Detection And Response).pptxEDR(End Point Detection And Response).pptx
EDR(End Point Detection And Response).pptxSMIT PAREKH
 
7 Steps to Build a SOC with Limited Resources
7 Steps to Build a SOC with Limited Resources7 Steps to Build a SOC with Limited Resources
7 Steps to Build a SOC with Limited ResourcesLogRhythm
 
Building a Next-Generation Security Operation Center Based on IBM QRadar and ...
Building a Next-Generation Security Operation Center Based on IBM QRadar and ...Building a Next-Generation Security Operation Center Based on IBM QRadar and ...
Building a Next-Generation Security Operation Center Based on IBM QRadar and ...IBM Security
 
HPE Data Protector Best Practice Guide
HPE Data Protector Best Practice GuideHPE Data Protector Best Practice Guide
HPE Data Protector Best Practice GuideAndrey Karpov
 
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
2021/0/15 - Solarwinds supply chain attack: why we should take it sereouslySirris
 
Chapter 8 overview
Chapter 8 overviewChapter 8 overview
Chapter 8 overviewali raza
 
Disaster Recovery Planning
Disaster Recovery PlanningDisaster Recovery Planning
Disaster Recovery PlanningJohn Wilson
 
Using a secured, cloud-delivered SD-WAN to transform your business network
Using a secured, cloud-delivered SD-WAN to transform your business networkUsing a secured, cloud-delivered SD-WAN to transform your business network
Using a secured, cloud-delivered SD-WAN to transform your business networkNetpluz Asia Pte Ltd
 
Identity's Role in a Zero Trust Strategy
Identity's Role in a Zero Trust StrategyIdentity's Role in a Zero Trust Strategy
Identity's Role in a Zero Trust StrategyOkta-Inc
 
Raising information security awareness
Raising information security awarenessRaising information security awareness
Raising information security awarenessTerranovatraining
 
VMware - Virtual SAN - IT Changes Everything
VMware - Virtual SAN - IT Changes EverythingVMware - Virtual SAN - IT Changes Everything
VMware - Virtual SAN - IT Changes EverythingVMUG IT
 
Orion Network Performance Monitor (NPM) Optimization and Tuning Training
Orion Network Performance Monitor (NPM) Optimization and Tuning TrainingOrion Network Performance Monitor (NPM) Optimization and Tuning Training
Orion Network Performance Monitor (NPM) Optimization and Tuning TrainingSolarWinds
 
Wireless Device and Network level security
Wireless Device and Network level securityWireless Device and Network level security
Wireless Device and Network level securityChetan Kumar S
 
Présentation ELK/SIEM et démo Wazuh
Présentation ELK/SIEM et démo WazuhPrésentation ELK/SIEM et démo Wazuh
Présentation ELK/SIEM et démo WazuhAurélie Henriot
 

What's hot (20)

EDR(End Point Detection And Response).pptx
EDR(End Point Detection And Response).pptxEDR(End Point Detection And Response).pptx
EDR(End Point Detection And Response).pptx
 
Database engineering
Database engineeringDatabase engineering
Database engineering
 
ClearPass Policy Manager 6.3 User Guide
ClearPass Policy Manager 6.3 User GuideClearPass Policy Manager 6.3 User Guide
ClearPass Policy Manager 6.3 User Guide
 
cn-series-se-presentation.pptx
cn-series-se-presentation.pptxcn-series-se-presentation.pptx
cn-series-se-presentation.pptx
 
7 Steps to Build a SOC with Limited Resources
7 Steps to Build a SOC with Limited Resources7 Steps to Build a SOC with Limited Resources
7 Steps to Build a SOC with Limited Resources
 
Ready
ReadyReady
Ready
 
Building a Next-Generation Security Operation Center Based on IBM QRadar and ...
Building a Next-Generation Security Operation Center Based on IBM QRadar and ...Building a Next-Generation Security Operation Center Based on IBM QRadar and ...
Building a Next-Generation Security Operation Center Based on IBM QRadar and ...
 
SD WAN
SD WANSD WAN
SD WAN
 
HPE Data Protector Best Practice Guide
HPE Data Protector Best Practice GuideHPE Data Protector Best Practice Guide
HPE Data Protector Best Practice Guide
 
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
2021/0/15 - Solarwinds supply chain attack: why we should take it sereously
 
Chapter 8 overview
Chapter 8 overviewChapter 8 overview
Chapter 8 overview
 
Disaster Recovery Planning
Disaster Recovery PlanningDisaster Recovery Planning
Disaster Recovery Planning
 
Using a secured, cloud-delivered SD-WAN to transform your business network
Using a secured, cloud-delivered SD-WAN to transform your business networkUsing a secured, cloud-delivered SD-WAN to transform your business network
Using a secured, cloud-delivered SD-WAN to transform your business network
 
Identity's Role in a Zero Trust Strategy
Identity's Role in a Zero Trust StrategyIdentity's Role in a Zero Trust Strategy
Identity's Role in a Zero Trust Strategy
 
Raising information security awareness
Raising information security awarenessRaising information security awareness
Raising information security awareness
 
VMware - Virtual SAN - IT Changes Everything
VMware - Virtual SAN - IT Changes EverythingVMware - Virtual SAN - IT Changes Everything
VMware - Virtual SAN - IT Changes Everything
 
Orion Network Performance Monitor (NPM) Optimization and Tuning Training
Orion Network Performance Monitor (NPM) Optimization and Tuning TrainingOrion Network Performance Monitor (NPM) Optimization and Tuning Training
Orion Network Performance Monitor (NPM) Optimization and Tuning Training
 
Wireless Device and Network level security
Wireless Device and Network level securityWireless Device and Network level security
Wireless Device and Network level security
 
IBM Aspera overview
IBM Aspera overview IBM Aspera overview
IBM Aspera overview
 
Présentation ELK/SIEM et démo Wazuh
Présentation ELK/SIEM et démo WazuhPrésentation ELK/SIEM et démo Wazuh
Présentation ELK/SIEM et démo Wazuh
 

Similar to Building Efficient Edge Nodes for Content Delivery Networks

Introduction to container networking in K8s - SDN/NFV London meetup
Introduction to container networking in K8s - SDN/NFV  London meetupIntroduction to container networking in K8s - SDN/NFV  London meetup
Introduction to container networking in K8s - SDN/NFV London meetupHaidee McMahon
 
Re-Imagining the Data Center with Intel
Re-Imagining the Data Center with IntelRe-Imagining the Data Center with Intel
Re-Imagining the Data Center with IntelIntel IT Center
 
Yashi dealer meeting settembre 2016 tecnologie xeon intel italia
Yashi dealer meeting settembre 2016 tecnologie xeon intel italiaYashi dealer meeting settembre 2016 tecnologie xeon intel italia
Yashi dealer meeting settembre 2016 tecnologie xeon intel italiaYashi Italia
 
Inside story on Intel Data Center @ IDF 2013
Inside story on Intel Data Center @ IDF 2013Inside story on Intel Data Center @ IDF 2013
Inside story on Intel Data Center @ IDF 2013Intel IT Center
 
Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013
Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013
Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013Jaroslav Prodelal
 
NVMe_Infrastructure_final1.pdf
NVMe_Infrastructure_final1.pdfNVMe_Infrastructure_final1.pdf
NVMe_Infrastructure_final1.pdfIrfanBroadband
 
Accelerating Innovation from Edge to Cloud
Accelerating Innovation from Edge to CloudAccelerating Innovation from Edge to Cloud
Accelerating Innovation from Edge to CloudRebekah Rodriguez
 
5G Multi-Access Edge Compute
5G Multi-Access Edge Compute5G Multi-Access Edge Compute
5G Multi-Access Edge ComputeMichelle Holley
 
Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013
Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013
Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013Jaroslav Prodelal
 
Acceleration_and_Security_draft_v2
Acceleration_and_Security_draft_v2Acceleration_and_Security_draft_v2
Acceleration_and_Security_draft_v2Srinivasa Addepalli
 
Intel® Xeon® Scalable Processors Enabled Applications Marketing Guide
Intel® Xeon® Scalable Processors Enabled Applications Marketing GuideIntel® Xeon® Scalable Processors Enabled Applications Marketing Guide
Intel® Xeon® Scalable Processors Enabled Applications Marketing GuideIntel IT Center
 
“Smarter Manufacturing with Intel’s Deep Learning-Based Machine Vision,” a Pr...
“Smarter Manufacturing with Intel’s Deep Learning-Based Machine Vision,” a Pr...“Smarter Manufacturing with Intel’s Deep Learning-Based Machine Vision,” a Pr...
“Smarter Manufacturing with Intel’s Deep Learning-Based Machine Vision,” a Pr...Edge AI and Vision Alliance
 
DAOS - Scale-Out Software-Defined Storage for HPC/Big Data/AI Convergence
DAOS - Scale-Out Software-Defined Storage for HPC/Big Data/AI ConvergenceDAOS - Scale-Out Software-Defined Storage for HPC/Big Data/AI Convergence
DAOS - Scale-Out Software-Defined Storage for HPC/Big Data/AI Convergenceinside-BigData.com
 
Performance out of the box developers
Performance   out of the box developersPerformance   out of the box developers
Performance out of the box developersMichelle Holley
 
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & WieckIBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & WieckIBM Events
 
Simplify Data Management and Go Green with Supermicro & Qumulo
Simplify Data Management and Go Green with Supermicro & QumuloSimplify Data Management and Go Green with Supermicro & Qumulo
Simplify Data Management and Go Green with Supermicro & QumuloRebekah Rodriguez
 
Extend HPC Workloads to Amazon EC2 Instances with Intel and Rescale (CMP373-S...
Extend HPC Workloads to Amazon EC2 Instances with Intel and Rescale (CMP373-S...Extend HPC Workloads to Amazon EC2 Instances with Intel and Rescale (CMP373-S...
Extend HPC Workloads to Amazon EC2 Instances with Intel and Rescale (CMP373-S...Amazon Web Services
 
Edge Computing and 5G - SDN/NFV London meetup
Edge Computing and 5G - SDN/NFV London meetupEdge Computing and 5G - SDN/NFV London meetup
Edge Computing and 5G - SDN/NFV London meetupHaidee McMahon
 
ONS 2018 LA - Intel Tutorial: Cloud Native to NFV - Alon Bernstein, Cisco & K...
ONS 2018 LA - Intel Tutorial: Cloud Native to NFV - Alon Bernstein, Cisco & K...ONS 2018 LA - Intel Tutorial: Cloud Native to NFV - Alon Bernstein, Cisco & K...
ONS 2018 LA - Intel Tutorial: Cloud Native to NFV - Alon Bernstein, Cisco & K...Kuralamudhan Ramakrishnan
 

Similar to Building Efficient Edge Nodes for Content Delivery Networks (20)

Introduction to container networking in K8s - SDN/NFV London meetup
Introduction to container networking in K8s - SDN/NFV  London meetupIntroduction to container networking in K8s - SDN/NFV  London meetup
Introduction to container networking in K8s - SDN/NFV London meetup
 
The Intel Xeon Scalable Processor and IoT
The Intel Xeon Scalable Processor and IoTThe Intel Xeon Scalable Processor and IoT
The Intel Xeon Scalable Processor and IoT
 
Re-Imagining the Data Center with Intel
Re-Imagining the Data Center with IntelRe-Imagining the Data Center with Intel
Re-Imagining the Data Center with Intel
 
Yashi dealer meeting settembre 2016 tecnologie xeon intel italia
Yashi dealer meeting settembre 2016 tecnologie xeon intel italiaYashi dealer meeting settembre 2016 tecnologie xeon intel italia
Yashi dealer meeting settembre 2016 tecnologie xeon intel italia
 
Inside story on Intel Data Center @ IDF 2013
Inside story on Intel Data Center @ IDF 2013Inside story on Intel Data Center @ IDF 2013
Inside story on Intel Data Center @ IDF 2013
 
Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013
Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013
Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013
 
NVMe_Infrastructure_final1.pdf
NVMe_Infrastructure_final1.pdfNVMe_Infrastructure_final1.pdf
NVMe_Infrastructure_final1.pdf
 
Accelerating Innovation from Edge to Cloud
Accelerating Innovation from Edge to CloudAccelerating Innovation from Edge to Cloud
Accelerating Innovation from Edge to Cloud
 
5G Multi-Access Edge Compute
5G Multi-Access Edge Compute5G Multi-Access Edge Compute
5G Multi-Access Edge Compute
 
Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013
Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013
Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013
 
Acceleration_and_Security_draft_v2
Acceleration_and_Security_draft_v2Acceleration_and_Security_draft_v2
Acceleration_and_Security_draft_v2
 
Intel® Xeon® Scalable Processors Enabled Applications Marketing Guide
Intel® Xeon® Scalable Processors Enabled Applications Marketing GuideIntel® Xeon® Scalable Processors Enabled Applications Marketing Guide
Intel® Xeon® Scalable Processors Enabled Applications Marketing Guide
 
“Smarter Manufacturing with Intel’s Deep Learning-Based Machine Vision,” a Pr...
“Smarter Manufacturing with Intel’s Deep Learning-Based Machine Vision,” a Pr...“Smarter Manufacturing with Intel’s Deep Learning-Based Machine Vision,” a Pr...
“Smarter Manufacturing with Intel’s Deep Learning-Based Machine Vision,” a Pr...
 
DAOS - Scale-Out Software-Defined Storage for HPC/Big Data/AI Convergence
DAOS - Scale-Out Software-Defined Storage for HPC/Big Data/AI ConvergenceDAOS - Scale-Out Software-Defined Storage for HPC/Big Data/AI Convergence
DAOS - Scale-Out Software-Defined Storage for HPC/Big Data/AI Convergence
 
Performance out of the box developers
Performance   out of the box developersPerformance   out of the box developers
Performance out of the box developers
 
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & WieckIBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
 
Simplify Data Management and Go Green with Supermicro & Qumulo
Simplify Data Management and Go Green with Supermicro & QumuloSimplify Data Management and Go Green with Supermicro & Qumulo
Simplify Data Management and Go Green with Supermicro & Qumulo
 
Extend HPC Workloads to Amazon EC2 Instances with Intel and Rescale (CMP373-S...
Extend HPC Workloads to Amazon EC2 Instances with Intel and Rescale (CMP373-S...Extend HPC Workloads to Amazon EC2 Instances with Intel and Rescale (CMP373-S...
Extend HPC Workloads to Amazon EC2 Instances with Intel and Rescale (CMP373-S...
 
Edge Computing and 5G - SDN/NFV London meetup
Edge Computing and 5G - SDN/NFV London meetupEdge Computing and 5G - SDN/NFV London meetup
Edge Computing and 5G - SDN/NFV London meetup
 
ONS 2018 LA - Intel Tutorial: Cloud Native to NFV - Alon Bernstein, Cisco & K...
ONS 2018 LA - Intel Tutorial: Cloud Native to NFV - Alon Bernstein, Cisco & K...ONS 2018 LA - Intel Tutorial: Cloud Native to NFV - Alon Bernstein, Cisco & K...
ONS 2018 LA - Intel Tutorial: Cloud Native to NFV - Alon Bernstein, Cisco & K...
 

More from Rebekah Rodriguez

Delivering Supermicro Software Defined Storage Solutions with OSNexus QuantaStor
Delivering Supermicro Software Defined Storage Solutions with OSNexus QuantaStorDelivering Supermicro Software Defined Storage Solutions with OSNexus QuantaStor
Delivering Supermicro Software Defined Storage Solutions with OSNexus QuantaStorRebekah Rodriguez
 
Supermicro and The Green Grid (TGG)
Supermicro and The Green Grid (TGG)Supermicro and The Green Grid (TGG)
Supermicro and The Green Grid (TGG)Rebekah Rodriguez
 
Supermicro Servers with Micron DDR5 & SSDs: Accelerating Real World Workloads
Supermicro Servers with Micron DDR5 & SSDs: Accelerating Real World WorkloadsSupermicro Servers with Micron DDR5 & SSDs: Accelerating Real World Workloads
Supermicro Servers with Micron DDR5 & SSDs: Accelerating Real World WorkloadsRebekah Rodriguez
 
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
 X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance ViewRebekah Rodriguez
 
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance ViewX13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance ViewRebekah Rodriguez
 
Supermicro AI Pod that’s Super Simple, Super Scalable, and Super Affordable
Supermicro AI Pod that’s Super Simple, Super Scalable, and Super AffordableSupermicro AI Pod that’s Super Simple, Super Scalable, and Super Affordable
Supermicro AI Pod that’s Super Simple, Super Scalable, and Super AffordableRebekah Rodriguez
 
X13 Pre-Release Update featuring 4th Gen Intel® Xeon® Scalable Processors
X13 Pre-Release Update featuring 4th Gen Intel® Xeon® Scalable Processors X13 Pre-Release Update featuring 4th Gen Intel® Xeon® Scalable Processors
X13 Pre-Release Update featuring 4th Gen Intel® Xeon® Scalable Processors Rebekah Rodriguez
 
The Power of HPC with Next Generation Supermicro Systems
The Power of HPC with Next Generation Supermicro Systems The Power of HPC with Next Generation Supermicro Systems
The Power of HPC with Next Generation Supermicro Systems Rebekah Rodriguez
 
New Accelerated Compute Infrastructure Solutions from Supermicro
New Accelerated Compute Infrastructure Solutions from SupermicroNew Accelerated Compute Infrastructure Solutions from Supermicro
New Accelerated Compute Infrastructure Solutions from SupermicroRebekah Rodriguez
 
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI InferencingInnovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI InferencingRebekah Rodriguez
 
Zero Trust for Private 5G and Edge
Zero Trust for Private 5G and EdgeZero Trust for Private 5G and Edge
Zero Trust for Private 5G and EdgeRebekah Rodriguez
 
Benefits of Operating an On-Premises Infrastructure
Benefits of Operating an On-Premises InfrastructureBenefits of Operating an On-Premises Infrastructure
Benefits of Operating an On-Premises InfrastructureRebekah Rodriguez
 
Supermicro’s Universal GPU: Modular, Standards Based and Built for the Future
Supermicro’s Universal GPU: Modular, Standards Based and Built for the FutureSupermicro’s Universal GPU: Modular, Standards Based and Built for the Future
Supermicro’s Universal GPU: Modular, Standards Based and Built for the FutureRebekah Rodriguez
 
Consumption Based On-Demand Private Cloud in a Box
Consumption Based On-Demand Private Cloud in a BoxConsumption Based On-Demand Private Cloud in a Box
Consumption Based On-Demand Private Cloud in a BoxRebekah Rodriguez
 
High Performance Object Storage in 30 Minutes with Supermicro and MinIO
High Performance Object Storage in 30 Minutes with Supermicro and MinIOHigh Performance Object Storage in 30 Minutes with Supermicro and MinIO
High Performance Object Storage in 30 Minutes with Supermicro and MinIORebekah Rodriguez
 
Modular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU ServerModular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU ServerRebekah Rodriguez
 
Modular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU ServerModular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU ServerRebekah Rodriguez
 
Rack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRebekah Rodriguez
 
Supermicro X12 Performance Update
Supermicro X12 Performance UpdateSupermicro X12 Performance Update
Supermicro X12 Performance UpdateRebekah Rodriguez
 
The Power of One: Supermicro’s High-Performance Single-Processor Blade Systems
The Power of One: Supermicro’s High-Performance Single-Processor Blade SystemsThe Power of One: Supermicro’s High-Performance Single-Processor Blade Systems
The Power of One: Supermicro’s High-Performance Single-Processor Blade SystemsRebekah Rodriguez
 

More from Rebekah Rodriguez (20)

Delivering Supermicro Software Defined Storage Solutions with OSNexus QuantaStor
Delivering Supermicro Software Defined Storage Solutions with OSNexus QuantaStorDelivering Supermicro Software Defined Storage Solutions with OSNexus QuantaStor
Delivering Supermicro Software Defined Storage Solutions with OSNexus QuantaStor
 
Supermicro and The Green Grid (TGG)
Supermicro and The Green Grid (TGG)Supermicro and The Green Grid (TGG)
Supermicro and The Green Grid (TGG)
 
Supermicro Servers with Micron DDR5 & SSDs: Accelerating Real World Workloads
Supermicro Servers with Micron DDR5 & SSDs: Accelerating Real World WorkloadsSupermicro Servers with Micron DDR5 & SSDs: Accelerating Real World Workloads
Supermicro Servers with Micron DDR5 & SSDs: Accelerating Real World Workloads
 
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
 X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
 
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance ViewX13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
X13 Products + Intel® Xeon® CPU Max Series–An Applications & Performance View
 
Supermicro AI Pod that’s Super Simple, Super Scalable, and Super Affordable
Supermicro AI Pod that’s Super Simple, Super Scalable, and Super AffordableSupermicro AI Pod that’s Super Simple, Super Scalable, and Super Affordable
Supermicro AI Pod that’s Super Simple, Super Scalable, and Super Affordable
 
X13 Pre-Release Update featuring 4th Gen Intel® Xeon® Scalable Processors
X13 Pre-Release Update featuring 4th Gen Intel® Xeon® Scalable Processors X13 Pre-Release Update featuring 4th Gen Intel® Xeon® Scalable Processors
X13 Pre-Release Update featuring 4th Gen Intel® Xeon® Scalable Processors
 
The Power of HPC with Next Generation Supermicro Systems
The Power of HPC with Next Generation Supermicro Systems The Power of HPC with Next Generation Supermicro Systems
The Power of HPC with Next Generation Supermicro Systems
 
New Accelerated Compute Infrastructure Solutions from Supermicro
New Accelerated Compute Infrastructure Solutions from SupermicroNew Accelerated Compute Infrastructure Solutions from Supermicro
New Accelerated Compute Infrastructure Solutions from Supermicro
 
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI InferencingInnovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
Innovative Solutions for Cloud Gaming, Media, Transcoding, & AI Inferencing
 
Zero Trust for Private 5G and Edge
Zero Trust for Private 5G and EdgeZero Trust for Private 5G and Edge
Zero Trust for Private 5G and Edge
 
Benefits of Operating an On-Premises Infrastructure
Benefits of Operating an On-Premises InfrastructureBenefits of Operating an On-Premises Infrastructure
Benefits of Operating an On-Premises Infrastructure
 
Supermicro’s Universal GPU: Modular, Standards Based and Built for the Future
Supermicro’s Universal GPU: Modular, Standards Based and Built for the FutureSupermicro’s Universal GPU: Modular, Standards Based and Built for the Future
Supermicro’s Universal GPU: Modular, Standards Based and Built for the Future
 
Consumption Based On-Demand Private Cloud in a Box
Consumption Based On-Demand Private Cloud in a BoxConsumption Based On-Demand Private Cloud in a Box
Consumption Based On-Demand Private Cloud in a Box
 
High Performance Object Storage in 30 Minutes with Supermicro and MinIO
High Performance Object Storage in 30 Minutes with Supermicro and MinIOHigh Performance Object Storage in 30 Minutes with Supermicro and MinIO
High Performance Object Storage in 30 Minutes with Supermicro and MinIO
 
Modular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU ServerModular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU Server
 
Modular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU ServerModular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU Server
 
Rack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC Supercomputer
 
Supermicro X12 Performance Update
Supermicro X12 Performance UpdateSupermicro X12 Performance Update
Supermicro X12 Performance Update
 
The Power of One: Supermicro’s High-Performance Single-Processor Blade Systems
The Power of One: Supermicro’s High-Performance Single-Processor Blade SystemsThe Power of One: Supermicro’s High-Performance Single-Processor Blade Systems
The Power of One: Supermicro’s High-Performance Single-Processor Blade Systems
 

Recently uploaded

Launching New Products In Companies Where It Matters Most by Product Director...
Launching New Products In Companies Where It Matters Most by Product Director...Launching New Products In Companies Where It Matters Most by Product Director...
Launching New Products In Companies Where It Matters Most by Product Director...Product School
 
"AIRe - AI Reliability Engineering", Denys Vasyliev
"AIRe - AI Reliability Engineering", Denys Vasyliev"AIRe - AI Reliability Engineering", Denys Vasyliev
"AIRe - AI Reliability Engineering", Denys VasylievFwdays
 
"DevOps Practisting Platform on EKS with Karpenter autoscaling", Dmytro Kozhevin
"DevOps Practisting Platform on EKS with Karpenter autoscaling", Dmytro Kozhevin"DevOps Practisting Platform on EKS with Karpenter autoscaling", Dmytro Kozhevin
"DevOps Practisting Platform on EKS with Karpenter autoscaling", Dmytro KozhevinFwdays
 
Relationship Counselling: From Disjointed Features to Product-First Thinking ...
Relationship Counselling: From Disjointed Features to Product-First Thinking ...Relationship Counselling: From Disjointed Features to Product-First Thinking ...
Relationship Counselling: From Disjointed Features to Product-First Thinking ...Product School
 
LF Energy Webinar: Introduction to TROLIE
LF Energy Webinar: Introduction to TROLIELF Energy Webinar: Introduction to TROLIE
LF Energy Webinar: Introduction to TROLIEDanBrown980551
 
Mind your App Footprint 🐾⚡️🌱 (@FlutterHeroes 2024)
Mind your App Footprint 🐾⚡️🌱 (@FlutterHeroes 2024)Mind your App Footprint 🐾⚡️🌱 (@FlutterHeroes 2024)
Mind your App Footprint 🐾⚡️🌱 (@FlutterHeroes 2024)François
 
National Institute of Standards and Technology (NIST) Cybersecurity Framework...
National Institute of Standards and Technology (NIST) Cybersecurity Framework...National Institute of Standards and Technology (NIST) Cybersecurity Framework...
National Institute of Standards and Technology (NIST) Cybersecurity Framework...MichaelBenis1
 
Introduction to Multimodal LLMs with LLaVA
Introduction to Multimodal LLMs with LLaVAIntroduction to Multimodal LLMs with LLaVA
Introduction to Multimodal LLMs with LLaVARobert McDermott
 
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...UiPathCommunity
 
Pragmatic UI testing with Compose Semantics.pdf
Pragmatic UI testing with Compose Semantics.pdfPragmatic UI testing with Compose Semantics.pdf
Pragmatic UI testing with Compose Semantics.pdfinfogdgmi
 
Are Human-generated Demonstrations Necessary for In-context Learning?
Are Human-generated Demonstrations Necessary for In-context Learning?Are Human-generated Demonstrations Necessary for In-context Learning?
Are Human-generated Demonstrations Necessary for In-context Learning?MENGSAYLOEM1
 
Battle of React State Managers in frontend applications
Battle of React State Managers in frontend applicationsBattle of React State Managers in frontend applications
Battle of React State Managers in frontend applicationsEvangelia Mitsopoulou
 
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...Neo4j
 
"How we created an SRE team in Temabit as a part of FOZZY Group in conditions...
"How we created an SRE team in Temabit as a part of FOZZY Group in conditions..."How we created an SRE team in Temabit as a part of FOZZY Group in conditions...
"How we created an SRE team in Temabit as a part of FOZZY Group in conditions...Fwdays
 
Artificial Intelligence, Design, and More-than-Human Justice
Artificial Intelligence, Design, and More-than-Human JusticeArtificial Intelligence, Design, and More-than-Human Justice
Artificial Intelligence, Design, and More-than-Human JusticeJosh Gellers
 
The Future of Product, by Founder & CEO, Product School
The Future of Product, by Founder & CEO, Product SchoolThe Future of Product, by Founder & CEO, Product School
The Future of Product, by Founder & CEO, Product SchoolProduct School
 
Leonis Insights: The State of AI (7 trends for 2023 and 7 predictions for 2024)
Leonis Insights: The State of AI (7 trends for 2023 and 7 predictions for 2024)Leonis Insights: The State of AI (7 trends for 2023 and 7 predictions for 2024)
Leonis Insights: The State of AI (7 trends for 2023 and 7 predictions for 2024)Jay Zhao
 
Unleash the Solace Pub Sub connector | Banaglore MuleSoft Meetup #31
Unleash the Solace Pub Sub connector | Banaglore MuleSoft Meetup #31Unleash the Solace Pub Sub connector | Banaglore MuleSoft Meetup #31
Unleash the Solace Pub Sub connector | Banaglore MuleSoft Meetup #31shyamraj55
 
Harnessing the Power of GenAI for Exceptional Product Outcomes by Booking.com...
Harnessing the Power of GenAI for Exceptional Product Outcomes by Booking.com...Harnessing the Power of GenAI for Exceptional Product Outcomes by Booking.com...
Harnessing the Power of GenAI for Exceptional Product Outcomes by Booking.com...Product School
 

Recently uploaded (20)

Launching New Products In Companies Where It Matters Most by Product Director...
Launching New Products In Companies Where It Matters Most by Product Director...Launching New Products In Companies Where It Matters Most by Product Director...
Launching New Products In Companies Where It Matters Most by Product Director...
 
"AIRe - AI Reliability Engineering", Denys Vasyliev
"AIRe - AI Reliability Engineering", Denys Vasyliev"AIRe - AI Reliability Engineering", Denys Vasyliev
"AIRe - AI Reliability Engineering", Denys Vasyliev
 
"DevOps Practisting Platform on EKS with Karpenter autoscaling", Dmytro Kozhevin
"DevOps Practisting Platform on EKS with Karpenter autoscaling", Dmytro Kozhevin"DevOps Practisting Platform on EKS with Karpenter autoscaling", Dmytro Kozhevin
"DevOps Practisting Platform on EKS with Karpenter autoscaling", Dmytro Kozhevin
 
Relationship Counselling: From Disjointed Features to Product-First Thinking ...
Relationship Counselling: From Disjointed Features to Product-First Thinking ...Relationship Counselling: From Disjointed Features to Product-First Thinking ...
Relationship Counselling: From Disjointed Features to Product-First Thinking ...
 
LF Energy Webinar: Introduction to TROLIE
LF Energy Webinar: Introduction to TROLIELF Energy Webinar: Introduction to TROLIE
LF Energy Webinar: Introduction to TROLIE
 
In sharing we trust. Taking advantage of a diverse consortium to build a tran...
In sharing we trust. Taking advantage of a diverse consortium to build a tran...In sharing we trust. Taking advantage of a diverse consortium to build a tran...
In sharing we trust. Taking advantage of a diverse consortium to build a tran...
 
Mind your App Footprint 🐾⚡️🌱 (@FlutterHeroes 2024)
Mind your App Footprint 🐾⚡️🌱 (@FlutterHeroes 2024)Mind your App Footprint 🐾⚡️🌱 (@FlutterHeroes 2024)
Mind your App Footprint 🐾⚡️🌱 (@FlutterHeroes 2024)
 
National Institute of Standards and Technology (NIST) Cybersecurity Framework...
National Institute of Standards and Technology (NIST) Cybersecurity Framework...National Institute of Standards and Technology (NIST) Cybersecurity Framework...
National Institute of Standards and Technology (NIST) Cybersecurity Framework...
 
Introduction to Multimodal LLMs with LLaVA
Introduction to Multimodal LLMs with LLaVAIntroduction to Multimodal LLMs with LLaVA
Introduction to Multimodal LLMs with LLaVA
 
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
Dev Dives: Leverage APIs and Gen AI to power automations for RPA and software...
 
Pragmatic UI testing with Compose Semantics.pdf
Pragmatic UI testing with Compose Semantics.pdfPragmatic UI testing with Compose Semantics.pdf
Pragmatic UI testing with Compose Semantics.pdf
 
Are Human-generated Demonstrations Necessary for In-context Learning?
Are Human-generated Demonstrations Necessary for In-context Learning?Are Human-generated Demonstrations Necessary for In-context Learning?
Are Human-generated Demonstrations Necessary for In-context Learning?
 
Battle of React State Managers in frontend applications
Battle of React State Managers in frontend applicationsBattle of React State Managers in frontend applications
Battle of React State Managers in frontend applications
 
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...
 
"How we created an SRE team in Temabit as a part of FOZZY Group in conditions...
"How we created an SRE team in Temabit as a part of FOZZY Group in conditions..."How we created an SRE team in Temabit as a part of FOZZY Group in conditions...
"How we created an SRE team in Temabit as a part of FOZZY Group in conditions...
 
Artificial Intelligence, Design, and More-than-Human Justice
Artificial Intelligence, Design, and More-than-Human JusticeArtificial Intelligence, Design, and More-than-Human Justice
Artificial Intelligence, Design, and More-than-Human Justice
 
The Future of Product, by Founder & CEO, Product School
The Future of Product, by Founder & CEO, Product SchoolThe Future of Product, by Founder & CEO, Product School
The Future of Product, by Founder & CEO, Product School
 
Leonis Insights: The State of AI (7 trends for 2023 and 7 predictions for 2024)
Leonis Insights: The State of AI (7 trends for 2023 and 7 predictions for 2024)Leonis Insights: The State of AI (7 trends for 2023 and 7 predictions for 2024)
Leonis Insights: The State of AI (7 trends for 2023 and 7 predictions for 2024)
 
Unleash the Solace Pub Sub connector | Banaglore MuleSoft Meetup #31
Unleash the Solace Pub Sub connector | Banaglore MuleSoft Meetup #31Unleash the Solace Pub Sub connector | Banaglore MuleSoft Meetup #31
Unleash the Solace Pub Sub connector | Banaglore MuleSoft Meetup #31
 
Harnessing the Power of GenAI for Exceptional Product Outcomes by Booking.com...
Harnessing the Power of GenAI for Exceptional Product Outcomes by Booking.com...Harnessing the Power of GenAI for Exceptional Product Outcomes by Booking.com...
Harnessing the Power of GenAI for Exceptional Product Outcomes by Booking.com...
 

Building Efficient Edge Nodes for Content Delivery Networks

  • 1. Building Efficient Edge Nodes for Content Delivery Networks Frank Miller, Chief Technology Officer, Varnish Software Raymond Chung, Director, Product Management, Supermicro Nash Kleppan, Cloud Solutions Engineer, Intel
  • 2. Data Platforms Group 2 Notices & Disclaimers  Performance varies by use, configuration and other factors. Learn more on the Performance Index site.  Performance results are based on testing as of dates shown in configurations and may not reflect all publicly available ​updates. See backup for configuration details. No product or component can be absolutely secure.  Your costs and results may vary.  Intel technologies may require enabled hardware, software or service activation.  © Intel Corporation. Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries. Other names and brands may be claimed as the property of others.
  • 3. Data Platforms Group 3 Agenda • Background • Varnish Software • Supermicro SuperServer System for CDN • Intel® Xeon® D-1700 and D-2700 • Test Environment • Power and Performance Testing • Sizing Considerations • Conclusions
  • 4. Data Platforms Group 4 Background • There has been an explosion of live streaming consumption, estimated to be nearly 4 billion hours in 20201 • The growth of high definition (1080p) and ultra-high definition (4K) content increases the performance demands on a CDN • The deployment of 5G networks allows users of mobile devices to consume video at higher speed • Performance and optimization depend upon software efficiency and system design • The goal of this Varnish - Supermicro – Intel collaboration on CDN is to improve the performance per TCO and performance per Watt of edge caching servers 1: https://www.digitaltveurope.com/2020/05/14/almost-4-billion-hours-watched-as-live-streaming-industry-benefits-from-lockdown/
  • 5. Data Platforms Group 5 Trends in Storage Systems • Increased demand for NVMe storage • 25GbE and 100GbE networking at the edge • High-performance workloads on broadly available servers • Workloads include: CDN and scale-out storage • Traditional high performance storage systems • Performance typically prioritized over other concerns • May not be suitable for reduced performance, power constrained deployments • Efficient storage systems • Require appropriately sized server and processor(s) running efficient software. • Must be appropriately sized to intended performance target for optimal power and performance • Watts turn into kilowatts – Need to keep sustainability goals and OpEx in mind.
  • 7. Varnish is an HTTP Cache Varnish is infrastructure software. HTTP HTTP Origin
  • 8. The software core is kept lean and secure with only the necessary features to operate. Implemented in C and multi- threaded for linear scalability across CPU, RAM and I/O resources. A small privileged runtime minimizes the threat surface while worker threads, with limited privileges, perform the actual work with kernel and hardware awareness. Hardware Aware VMODs Varnish Enterprise (core) Varnish is fast with integration of hardware architectures and features (e.g. NUMA and TLS optimization into the Varnish runtime). Varnish is flexible with Varnish Modules (VMODS) for additional features. Implemented in Varnish Control Language (VCL) and compiled to a shared and dynamically linked library. 8 Varnish is Highly Performant, Flexible and Secure
  • 9. There are key benefits in high performance in compute The Value of High Performance This requires the harmonization of software, processor and system Efficient solutions drive for lower power utilization for the same amount of unit work (e.g. Gbs/Watt, Flops/Watt, etc.) This should be table stakes in the future of compute at scale: • We can do more for less. • We can even show benefit on current hardware, with optimized software, to gain power savings with only a software upgrade. • There is a clear North Star … to Save the Planet
  • 10. IoT/Embedded & Edge Computing Raymond Chung Director, Product Management raymondchung@supermicro.com Better Faster Greener™ © 2022 Supermicro
  • 11. Why Supermicro IoT/Embedded & Edge Computing 10/3/2022 Better Faster Greener™ © 2022 Supermicro 11 Better Faster Greener Supermicro building blocks solutions is Better for IoT architecture design Supermicro Data Center Technology empower Faster IoT and Edge Computing Supermicro Edge Computing with Muti-Node System is Greener for environment Supermicro is a global technology leader committed to delivering first to market innovation for Enterprise, Cloud, AI, and 5GTelco/Edge IT Infrastructure.We are transforming into aTotal IT Solutions provider with environmentally-friendly and energy-saving server, AI, storage, IoT, and switch systems, software, and services while delivering advanced high-volume motherboard, power, and chassis products.
  • 12. Edge Appliances SYS-220HE SYS-110P SYS-E5019A  Built for Net/Comms  2x workloads  Power Needs  Increased internal connections  Redundancy/HA  Expandability  Flexible  Rackmount or standalone  NEBS and harsher certifications  Cost Effective  Enterprise driven  Normalized Workloads  uCPE & Intel Select solutions  SMB capable  Lower power consumption Minimal Port / Throughput Maximum Port / Throughput SYS-E100/302 SYS-510D Better Faster Greener™ © 2021 Supermicro 12 10/3/2022 SYS-110D SYS-110A SYS-120U SYS-210SE SYS-E403 SYS-220U
  • 13. 10/3/2022 Better Faster Greener™ © 2022 Supermicro 13 SYS-110D-4C/8C/16C/20C-FR(A/D)N8TP Intel® Xeon D Compact 1U Embedded System https://www.supermicro.com/en/products/system/IoT/1U/SYS-110D-20C-FRDN8TP Processor Intel® Xeon D-2700 Processor, 4/8/14/16/20 Cores, 65W~125W Memory Capacity DDR4 3200MHz 1DPC, 4 slots RDIMM/LRDIMM, up to 256GB/512GB Expansion Slots 1x PCIe 4.0 x 16 1x M.2 M-Key SATA3.0/PCI-E 3.0 x4, 2242/2280 I/O Ports 1x IPMI dedicated LAN 4x GbE, 2x 10GbE, 2x 25G SFP28 2x USB 3.0 type A 1x VGA Drive Bays 2x Internal 2.5" drive bays Power Supply Redundant 800 W, 100-240 Vac Redundant 600 W, -48 Vdc System Cooling 5x 40x56mm Hot-swap Counter-rotation PWM Fans (one is optional) Motherboard: X12SDV-4/8/16/20C-SPT8F (7.5”x 8.5”) Chassis: 515M-R804/515M-R601 Dimension: W17.2” x D15.7” x H1.7” (437mm x 399mm x 43mm) Intel® Xeon D-2700 4/8/14/16/20 Cores Processor Up to DDR4 3200Mhz 4 channels, 4 slots RDIMM/LRDIMM up to 512GB 1x IPMI dedicated LAN; 4x GbE; 2x 10GbE; 2x 25G SFP28 2x USB 3.0 type A; 1x M.2 M-Key SATA/PCI-E 3.0 x4, 2280 2x SATA/U.2 2.5” drives Key features Applications 1x VGA PCIe 4.0 x16 M-Key M.2 Networking Application, Firewall, uCPE, Telecom Application Xeon D-2700 4/8/16/20C 4x GbE LAN, 2x 10GbE LAN 2x 25G SFP28 1 x IPMI 2x 2.5” drive bays 1 2 3 4 5 6 7
  • 14. 10/3/2022 Better Faster Greener™ © 2022 Supermicro 14 SYS-510D-4C/8C/10C-FN6P Intel® Xeon D Compact 1U Embedded System https://www.supermicro.com/en/products/system/iot/1u/sys-510d-10c-fn6p Processor Intel® Xeon D-1700 Processor, 4/8/10 Cores, 25W/50W/88W Memory Capacity 4 DIMM slots DDR4 2933MHz up to 256GB RDIMM/UDIMM ECC/Non-ECC Expansion Slots 1 x PCIe 4.0 x 16 1x M.2 M-Key SATA3.0/PCI-E 3.0 x4, 2280 1x M.2 E-Key PCI-E 3.0 x1, 2230 1x M.2 B-Key SATA/PCI-E 3.0 x2/USB 3.0, 2280/3042 I/O Ports 1x IPMI dedicated LAN 4x GbE, 2x 25G SFP28 2x USB 3.0 type A 1x VGA Drive Bays 1x Internal 3.5" or 4x Internal 2.5" drive bays Power Supply 200W AC-DC power supply System Cooling 3x 40x28mm 4-PIN PWM fans Motherboard: X12SDV-4C/8C/10C-SP6F (9.0” x 7.25” Flex ATX) Chassis: CSE-505-203B Dimension: W17.2” x D9.8” x H1.7” (437mm x 249mm x 43mm) Intel® Xeon D-1700 4/8/10 Cores Processor Up to 256GB RDIMM or 128GB UDIMM, DDR4 2933MHz in 4 Slots 1x IPMI dedicated LAN, 4x GbE,2x 25G SFP28, 2x USB 3.0 type A 1x M.2 M-Key SATA/PCI-E 3.0 x4, 2280, 1x M.2 E-Key PCI-E 3.0 x1, 2230 1x M.2 B-Key SATA3.0/PCI-E 3.0 x2/USB 3.0, 2280/3042 4x SATA drives Key features Applications 1x VGA PCIe 4.0 x16 M, B, E-Key M.2 Retail Application, Firewall, Gateway, uCPE Xeon D-1700 4/8/10C 4x GbE LAN, 2x 25G SFP28 1 x IPMI 1x 3.5” or 4x 2.5” drive bays 1 2 3 4 5 6 7
  • 15. DISCLAIMER Super Micro Computer, Inc. may make changes to specifications and product descriptions at any time, without notice. The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and typographical errors. Any performance tests and ratings are measured using systems that reflect the approximate performance of Super Micro Computer, Inc. products as measured by those tests. Any differences in software or hardware configuration may affect actual performance, and Super Micro Computer, Inc. does not control the design or implementation of third party benchmarks or websites referenced in this document. The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to any changes in product and/or roadmap, component and hardware revision changes, new model and/or product releases, software changes, firmware changes, or the like. Super Micro Computer, Inc. assumes no obligation to update or otherwise correct or revise this information. SUPER MICRO COMPUTER, INC. MAKES NO REPRESENTATIONS OR WARRANTIES WITH RESPECT TO THE CONTENTS HEREOF AND ASSUMES NO RESPONSIBILITY FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION. SUPER MICRO COMPUTER, INC. SPECIFICALLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE. IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE TO ANY PERSON FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION CONTAINED HEREIN, EVEN IF SUPER MICRO COMPUTER, Inc. IS EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. 10/3/2022 Better Faster Greener™ © 2021 Supermicro 15
  • 17. Data Platforms Group 17 Intel® Xeon® D-1700 and D-2700 Nash Kleppan, Cloud Solutions Engineer, Intel
  • 18. Data Platforms Group 18 Intel® Xeon® D-1700 • For CDN applications, these processors offer: • Integrated Ethernet up to 100 Gbps • Increased memory bandwidth (2 or 3 channels DDR4 2933 MT/s) • Support for 16 lanes PCIe Gen4 and 24 lanes HSIO • Increased core count and cache over prior gen. Up to 10 cores. • Intel® Software Guard Extensions (Intel® SGX) for more protected execution. • Intel® QAT Gen 2
  • 19. Data Platforms Group 19 Intel® Xeon® D-2700 • For CDN applications, these processors offer: • Integrated Ethernet up to 100 Gbps • Increased memory bandwidth (4 channels DDR4 3200 MT/s 1DPC) • Support for 32 lanes PCIe Gen4 and 24 lanes HSIO • Increased core count and cache over prior gen. Up to 20 cores. • Intel® Software Guard Extensions (Intel® SGX) for more protected execution. • Intel® QAT Gen 3
  • 20. Data Platforms Group 20 Test Configuration: Xeon® D-2700 Nash Kleppan, Cloud Solutions Engineer, Intel
  • 21. Data Platforms Group 21 Xeon® D-2700 Test Configuration Edge Cache Node CDN Application CPU Content Origin Client (wrk) 100GbE L2 Switch • 1RU server • Sufficient drive fanout • NICs bonded • 50Gbps line rate • Supermicro SuperServer SYS- 110D-8C-FRAN8TP • 1x Intel® Xeon® D-2733NT • 4x 32GB DDR4 3200 (128GB) • Integrated 2x25GbE • 2x Intel® SSD D7-P5510 3.84TB NVMe 25GbE
  • 22. Data Platforms Group 22 Xeon® D-2700 Test Configuration - Varnish Edge Cache Node Varnish CPU Content Origin Client (wrk) 100GbE L2 Switch • Supermicro SYS-110D-8C- FRAN8TP • 1x Intel® Xeon® D-2733NT • 4x 32GB DDR4 3200 (128GB) • Integrated 2x25GbE • 2x Intel® SSD D7-P5510 3.84TB NVMe • Ubuntu 22.04 • Varnish-Plus version 6.0.10r1 • OpenSSL 3.0.2 • Power consumption at both PSU inlets measured with Raritan PX3 PDU. 25GbE
  • 23. Data Platforms Group 23 Benchmarking Results: Intel Xeon® D-2700 Nash Kleppan, Cloud Solutions Engineer, Intel
  • 24. Data Platforms Group 24 Active-Idle Total System Power Measurements Power is measured at PDU outlets over 5 minutes. This measurement includes everything from the CPU to the LED status lights. See backup (slide 28) for workloads and configurations. Results may vary​. Edge Cache Node • Dedicated single socket server • Sufficient drive fanout • NICs bonded • 50Gbps line rate • Supermicro SYS-110D-8C-FRAN8TP • Ubuntu 22.04 • Using Intel_pstate CPU Scaling Driver • 90 watt average active-idle power in powersave mode • 113 watt average active-idle power in performance mode
  • 25. Data Platforms Group 25 Xeon® D-2733NT Video on Demand Test Results Up to 368Mb/s per watt. Power is measured at PDU outlets over duration of test. This measurement includes everything from the CPU to the LED status lights. Video-on-Demand, 100% TLS, 100% Cache Hit Rate, uniform random distribution, 315GB dataset on NVMe See backup (slide 28) for workloads and configurations. Results may vary​. Edge Cache Node Varnish • Dedicated single socket server • Sufficient drive fanout • NICs bonded • 50Gbps line rate
  • 26. Data Platforms Group 26 Xeon® D-2733NT Live-Linear Test Results Up to 386Mb/s per watt. Power is measured at PDU outlets over duration of test. This measurement includes everything from the CPU to the LED status lights. Live-Linear, 100% TLS, 93.3% Cache Hit Rate, uniform random distribution See backup (slide 28) for workloads and configurations. Results may vary​. Edge Cache Node Varnish • Dedicated single socket server • Sufficient drive fanout • NICs bonded • 50Gbps line rate
  • 27. Data Platforms Group 27 Sizing Considerations • With a good understanding of the workload and software efficiency, you can build the CDN system around expected NIC throughput. • Once NIC throughput is determined, the system can be selected. • The CPU(s) can then be specified based upon the performance requirements and solution capabilities. • Additional components (memory, storage, etc) can also then be specified based on performance requirements and system capabilities.
  • 28. Data Platforms Group 28 Conclusions • Solutions are systems of systems. Every component matters. • Determine the requirements and priorities • Software must be efficient and high performance • System must be appropriately sized for the workload • Processor(s) must also be appropriately sized for the workload and system constraints • Very low idle power, as low as 90 watts in powersave mode. • This solution provides excellent performance per watt. Up to 368Mb/s per watt VoD and 386Mb/s per watt for live-linear. • Efficient performance helps achieve both OpEx and sustainability goals
  • 29. Data Platforms Group 29 Configuration Details (Intel® Xeon® D-2700) • As low as 90 watts active-idle power. Active-idle, intel_pstate in active mode, powersave governor. 1 node, Supermicro 110D-8C-FRAN8TP,1x Intel® Xeon® D-2733NT Processor, 8 core HT ON Turbo ON, Total Memory 128GB (4 slots/32GB/3200MT/s), BIOS 1.0 (ucode: 0x10001a0), 2x Intel® P5510 3.84TB, Integrated 2x25GbE ethernet, Ubuntu 22.04, kernel 55.15.0-40-generic, gcc 11.2.0- 19ubuntu1 compiler, openssl 3.0.2, Varnish-Plus version 6.0.10r1 revision 46f744d2ab5e7c30737dfcf8bbe823b01341efe8. Test by Intel as of 7/27/2022. • Up to 50Gbps network throughput and 368Mbps per watt. CDN Video On Demand with Intel NVMe: 1 node, Supermicro 110D-8C-FRAN8TP,1x Intel® Xeon® D-2733NT Processor, 8 core HT ON Turbo ON, Total Memory 128GB (4 slots/32GB/3200MT/s), BIOS 1.0 (ucode: 0x10001a0), 2x Intel® P5510 3.84TB, Integrated 2x25GbE ethernet, Ubuntu 22.04, kernel 55.15.0-40-generic, gcc 11.2.0- 19ubuntu1 compiler, openssl 3.0.2, Varnish-Plus version 6.0.10r1 revision 46f744d2ab5e7c30737dfcf8bbe823b01341efe8. 1 client, wrk master 4/17/2019 (keep alive on, 100,1000, and 5000 total connections). Test by Intel as of 7/27/2022. Throughput measured with 100% Transport Layer Security (TLS) traffic with 100% target cache hit ratio. • Up to 50Gbps network throughput and 386Mbps per watt. CDN Live-Linear: 1 node, Supermicro 110D-8C-FRAN8TP, 1x Intel® Xeon® D-2733NT Processor, 8 core HT ON Turbo ON, Total Memory 128GB (4 slots/32GB/3200MT/s), BIOS 1.0 (ucode: 0x10001a0), 2x Intel® P5510 3.84TB, Integrated 2x25GbE ethernet, Ubuntu 22.04, kernel 55.15.0-40-generic, gcc 11.2.0-19ubuntu1 compiler, openssl 3.0.2, Varnish-Plus version 6.0.10r1 revision 46f744d2ab5e7c30737dfcf8bbe823b01341efe8. 1 client, wrk master 4/17/2019 (keep alive on, 100,1000, and 5000 total connections). Test by Intel as of 7/27/2022. Throughput measured with 100% Transport Layer Security (TLS) traffic with 93.3% target cache hit ratio.
  • 30. Data Platforms Group 30 To Learn More: • https://www.varnish-software.com/solutions/cdn/ • https://networkbuilders.intel.com/ecosystem/varnish-software • https://www.supermicro.com/en/products/system/IoT/1U/SYS- 110D-8C-FRAN8TP • https://www.intel.com/content/www/us/en/products/docs/processors /xeon-d/network-segments-product-brief.html • https://www.intel.com/content/www/us/en/products/docs/processors /xeon-d/intelligent-iot-edge-product-brief.html
  • 31. 31

Editor's Notes

  1. Varnish is infrastructure software - it is the bridge between the hardware and apps on top, a part of the stack. You sandwich it in between the clients and the conventional web servers, where it will cache data / assets, or anything HTTP, really. This is the basic picture, but it is more, of course. Why do we add a cache? Web servers are not necessarily slow, but they are complex, and a cache will always outperform generating content again. Also, the cache may be close to the clients, reducing bandwidth, and have a strategy for when the backend server goes down. Quite often, it is a good idea to serve stale content instead of 404s or 5xx. (Next slide, please). Image credits, Creative Commons Pixabay (flip phone) openclipart.org (PC), non-attribution license Wikimedia Commons (laptop). Server rack: https://www.maxpixel.net/Stack-Store-Drive-Storage-Rack-Hard-Disk-30459
  2. More beyond hardware NUMA awareness and TLS in process … The threading model with worker threads works because we use few context switches compared to the amount of requests and data flowing through the system. We optimize to reduce the amount of context switches and locking. The asynchronous direct IO is what separates MSE 3 from MSE 2 - we take control over the disk, performing disk optimization past challenges in Linux with the volume of soft page faults. A bit more on VCL - The VCL language provides a lot of flexibility when it comes to making decisions in the cache, for example when it comes to caching behavior. VCL is also allows logic for routing, can do request manipulation of various kinds, business logic, tool connectors … the opportunity is endless to add value while keeping the core highly tuned and reliable.