SlideShare a Scribd company logo
1 of 14
1
01 0111100100100001011100010011011000101000100101000110000110100011
10 1010000110100011001001010001100011100100100001010010000101110001
10 1010000110100011001001010001100011100100100001010010000101110001
01 0111100100100001011100010011011000101000100101000110000110100011
111011
111010
11
00
01
10
11
01
10
11
01
10
11
01
11
01
10
11
10
01
10
111011
11101011
00
01
10
11
01
10
01
10
11
01
11
01
10
11
10
01
10
111011
111010
11
00
01
10
11
01
10
11
01
10
11
01
11
01
10
11
10
01
10
111011
11101011
00
01
10
11
01
10
01
10
11
01
11
01
10
11
10
01
10
10
11
01
10
11
01
01111001001000010111000100110110
0010100010010100011000011010001111
01110110
1110
01
10
011011011101 11
01110110
1110
01
10
011011011101 11
01110110
1110
01
10
011011011101
Sales and Contact Information
• Website
- www.aha.com
• Sales Contact
- sales@aha.com
• White Paper to Presentation
- http://www.aha.com/Uploads/GZIP_Benefits_Whitepaper9.pdf
2
Introduction
• Purpose
- The purpose of this brief is illustrate the benefits hardware
GZIP compression on a 10G Ethernet link using the AHA
372.
• Outline
- AHA Product Introduction
- 10Gbps Web Server Experiment and Results
- Energy Break Even Point of AHA372
3
Who we are…
• AHA Products Group
- Business unit of Comtech EF DATA
- Advanced IP Development Center
• Brief History
- Established 1988 on Forward Error Correction
- 1992 Created first CAM in Data Compression
- 2006 Created First GZIP Compression IC
- 2009 Created Fastest GZIP Compression IC
• Expertise
- High Performance Data Compression
- Forward Error Correction
- Hardware and Software Development
4
AHA37XPCIe Family Features
• Interface
- PCIe 3.0x8 interface
• Algorithms
- GZIP, ZLIB, LZS
• Board by Compression Speed
- AHA371 – 10 Gbps
- AHA372 – 20 Gbps
- AHA374 – 40 Gbps
- AHA378 – 80 Gbps
5PCI Express® Compre
Decompression Accele
FEATURES
Supports open standard algorithms GZIP and
zlib
Supports LZS algorithm
Full duplex operation
PCIe 2.0 x8 interface
High compression ratio
Minimal expansion of uncompressible data
Supports streaming of large files or blocks
Supports compression of intermixed blocks
from different files
Low Profile PCIe Form Factor
APPLICATIONS
WAN acceleration app
Application servers
Load balance applianc
Storage appliances
Web servers
Table 1: AHA371 / AHA 372 Compression Ratio
Files GZIP
AHA37[1,2] – 10-20 Gbps
aha products group
PR
AHA37
40.0 Gbps GZIP Compression/Decom
Ac
FEATURES
Supports open standard algorithms GZIP and
zlib
APPLICATIONS
WAN acceleration applianc
Application servers
AHA37[4-8] – 40-80 Gbps
Experiment Setup
• Client Emulator sends HTTP requests
- Requests maximize throughput of 10 G link
• Webserver responds with GZIP’d page
- Requests are run continiously
6
 Supermicro X8DTL-6F Motherboard
 Intel Xeon E5620 CPU
 3 X 2GB Kingston KVR13R9S8K3/6I
 Seagate Barracuda ST3160815AS
 Intel 82598EB 10-Gigabit AT2 Server Adapter
 PowerEdge R720 Motherboard
 Intel Xeon E5-2643 3.30GHz (Total 8 cores)
 24 X 4GB RDIMM, 1600MT/s RAM
 Western Digital WD800JD-75MSA2
 Intel 82598EB 10-Gigabit AT2 Server Adapter
10 Gig-E
Page Responses
• No GZIP
• CPU GZIP
• Hardware GZIP
Page RequestsClient Emulator Apache Web Server
120
Power Meter
aha products group
PRODUCT BRIEF
AHA371 / AHA372
PCI Express® Compression and
Decompression Accelerator Card
FEATURES
Supports open standard algorithms GZIP and
zlib
Supports LZS algorithm
Full duplex operation
PCIe 2.0 x8 interface
High compression ratio
Minimal expansion of uncompressible data
Supports streaming of large files or blocks
Supports compression of intermixed blocks
from different files
Low Profile PCIe Form Factor
APPLICATIONS
WAN acceleration appliances
Application servers
Load balance appliances
Storage appliances
Web servers
Table 1: AHA371 / AHA 372 Compression Ratios
40 Gbps Compression:
2x AHA372 20Gbps GZIP Accelerators
aha products group
PRODUCT
AHA371 / AHA3
PCI Express® Compression
Decompression Accelerator C
FEATURES
Supports open standard algorithms GZIP and
zlib
Supports LZS algorithm
Full duplex operation
PCIe 2.0 x8 interface
High compression ratio
Minimal expansion of uncompressible data
Supports streaming of large files or blocks
Supports compression of intermixed blocks
from different files
Low Profile PCIe Form Factor
APPLICATIONS
WAN acceleration appliances
Application servers
Load balance appliances
Storage appliances
Web servers
Table 1: AHA371 / AHA 372 Compression Ratios
 Watts up? PRO ES
 Accuracy: +/- 1.5%
120 VAC
Scenarios and Measurements
• Observed Metrics
- Effective throughput of 10Gb Link
 Better compression ratio, more effective throughput
 Experiment average between 1:2, 1:3, compression ratios
- CPU Utilization
- Power/ Throughput (Watt/Gbps) or Energy/Bit (Joule/Gb)
• Compression Scenarios Ran
- No Compression
- CPU Compression : mod_deflate
- AHA Compression : 2 x AHA 372 20Gbps
7
Experiment Results
8
9 Gbps
15%
16 J/Gb 6.8 J/Gb
59%
35 Gbps2 Gbps
100 %
116 J/Gb
Throughput
CPU Load
Energy
Efficiency
No GZIP CPU GZIP AHA GZIP
CPUs are Inefficient at Performing GZIP
• CPU is Crippled
- Serving web pages drops from 9
Gbps to 2Gbps.
• CPU is Inefficient
- 8 Core CPU at 100% load and
consumes 7x more energy.
9
9 Gbps
15%
16 J/Gb
2 Gbps
100 %
116 J/Gb
Throughput
CPU Load
Energy
Efficiency
NoGZIP CPUGZIP
CPUs are not optimal for performing GZIP
GZIP Hardware Removes CPU Bottlenecks
• 18x Throughput over CPU
 At full load with 8 cores, CPU GZIP is
only capable of 6% of the throughput
of GZIP hardware.
• Available CPU cycles
 Not performing compression CPU can
perform tasks it is most efficient at.
• 17x energy efficiency
- Less energy cost
10
9 Gbps
15%
16 J/Gb 6.8 J/Gb
59%
35 Gbps2 Gbps
100 %
116 J/Gb
Throughput
CPU Load
Energy
Efficiency
NoGZIP CPUGZIP GZIP
9 Gbps
15%
16 J/Gb
2 Gbps
100 %
116 J/Gb
Throughput
CPU Load
Energy
Efficiency
NoGZIP CPUGZIP
GZIP Hardware is order of magnitudes more efficient at
GZIP than CPUs.
Energy Break Even Point (eBEP)
• Assumptions
- Card Price at Low Volumes
- Continuous Data Stream
- Power Usage Effectiveness 1.7
- Normalized Linear Performance
Adjustment for Power Consumption
• Hardware Pays Off FAST!
- 22 Days at Lowest Electricity Cost
11
Cost of Electricity
cents (kW/h)
eBEP of GZIP Hardware
Vs. CPU GZIP
15 22 days
20 17 days
25 14 days
30 11 days
35 10 days
GZIP Hardware Reduces OpEx and CapEx by creating
optimal performing systems using less hardware (CPU).
AHA vs Other Compression
12
bzip2, 47, 3.5:1
zlib, 70, 2.8:1
lzo, 640, 1.9:1
aha-gzip,
3.33Gbps/Chan
,2.7:1
0.0
0.5
1.0
1.5
2.0
2.5
3.0
3.5
4.0
1 10 100 1000 10000
CompressionRatioto1
Compresion Speed in Mbps
Comparative Compression Performance
(256 MB Wikipedia Corpus)
GZIP Hardware still orders of magnitude faster than the
fastest CPU compression and with good compression
ratios.
Integration
• Plug and Play
- Driver installs in minutes
- ZLIB library replacements
- Apache Webserver API
- JAVA API
• Full Engineering Support
- Development engineering support for all appliance integration.
13
www.aha.com
sales@aha.com
Sales and Contact Information
• Website
- www.aha.com
• Sales Contact
- sales@aha.com
• White Paper to Presentation
- http://www.aha.com/Uploads/GZIP_Benefits_Whitepaper9.pdf
14

More Related Content

Similar to Smashing Big Data with AHA Hardware GZIP

Deep Dive On Intel Optane SSDs And New Server Platforms
Deep Dive On Intel Optane SSDs And New Server PlatformsDeep Dive On Intel Optane SSDs And New Server Platforms
Deep Dive On Intel Optane SSDs And New Server PlatformsNEXTtour
 
HBaseCon 2015: Taming GC Pauses for Large Java Heap in HBase
HBaseCon 2015: Taming GC Pauses for Large Java Heap in HBaseHBaseCon 2015: Taming GC Pauses for Large Java Heap in HBase
HBaseCon 2015: Taming GC Pauses for Large Java Heap in HBaseHBaseCon
 
Hardware and Software Co-optimization to Make Sure Oracle Fusion Middleware R...
Hardware and Software Co-optimization to Make Sure Oracle Fusion Middleware R...Hardware and Software Co-optimization to Make Sure Oracle Fusion Middleware R...
Hardware and Software Co-optimization to Make Sure Oracle Fusion Middleware R...Intel IT Center
 
NetApp ontap simulator
NetApp ontap simulatorNetApp ontap simulator
NetApp ontap simulatorAshwin Pawar
 
SQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teamsSQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teamsSumeet Bansal
 
HPE ProLiant DL380 Gen9 Server Data Sheet
HPE ProLiant DL380 Gen9 Server Data SheetHPE ProLiant DL380 Gen9 Server Data Sheet
HPE ProLiant DL380 Gen9 Server Data Sheet美兰 曾
 
Boost UDP Transaction Performance
Boost UDP Transaction PerformanceBoost UDP Transaction Performance
Boost UDP Transaction PerformanceLF Events
 
3.INTEL.Optane_on_ceph_v2.pdf
3.INTEL.Optane_on_ceph_v2.pdf3.INTEL.Optane_on_ceph_v2.pdf
3.INTEL.Optane_on_ceph_v2.pdfhellobank1
 
Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...
Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...
Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...Danielle Womboldt
 
Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...
Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...
Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...Ceph Community
 
Enterprise Search Summit - Speeding Up Search
Enterprise Search Summit - Speeding Up SearchEnterprise Search Summit - Speeding Up Search
Enterprise Search Summit - Speeding Up SearchAzul Systems Inc.
 
z/VM Performance Analysis
z/VM Performance Analysisz/VM Performance Analysis
z/VM Performance AnalysisRodrigo Campos
 
Ceph Day Tokyo -- Ceph on All-Flash Storage
Ceph Day Tokyo -- Ceph on All-Flash StorageCeph Day Tokyo -- Ceph on All-Flash Storage
Ceph Day Tokyo -- Ceph on All-Flash StorageCeph Community
 
Cy7 introduction
Cy7 introductionCy7 introduction
Cy7 introductionKunhui Wu
 
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...Benoit Hudzia
 
PostgreSQL performance archaeology
PostgreSQL performance archaeologyPostgreSQL performance archaeology
PostgreSQL performance archaeologyTomas Vondra
 
Yashi dealer meeting settembre 2016 tecnologie xeon intel italia
Yashi dealer meeting settembre 2016 tecnologie xeon intel italiaYashi dealer meeting settembre 2016 tecnologie xeon intel italia
Yashi dealer meeting settembre 2016 tecnologie xeon intel italiaYashi Italia
 
15.) cloud (opex, capex or hybrid)
15.) cloud (opex, capex or hybrid)15.) cloud (opex, capex or hybrid)
15.) cloud (opex, capex or hybrid)Jeff Green
 
How to build a state-of-the-art rails cluster
How to build a state-of-the-art rails clusterHow to build a state-of-the-art rails cluster
How to build a state-of-the-art rails clusterTim Lossen
 

Similar to Smashing Big Data with AHA Hardware GZIP (20)

Deep Dive On Intel Optane SSDs And New Server Platforms
Deep Dive On Intel Optane SSDs And New Server PlatformsDeep Dive On Intel Optane SSDs And New Server Platforms
Deep Dive On Intel Optane SSDs And New Server Platforms
 
HBaseCon 2015: Taming GC Pauses for Large Java Heap in HBase
HBaseCon 2015: Taming GC Pauses for Large Java Heap in HBaseHBaseCon 2015: Taming GC Pauses for Large Java Heap in HBase
HBaseCon 2015: Taming GC Pauses for Large Java Heap in HBase
 
Hardware and Software Co-optimization to Make Sure Oracle Fusion Middleware R...
Hardware and Software Co-optimization to Make Sure Oracle Fusion Middleware R...Hardware and Software Co-optimization to Make Sure Oracle Fusion Middleware R...
Hardware and Software Co-optimization to Make Sure Oracle Fusion Middleware R...
 
NetApp ontap simulator
NetApp ontap simulatorNetApp ontap simulator
NetApp ontap simulator
 
SQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teamsSQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teams
 
HPE ProLiant DL380 Gen9 Server Data Sheet
HPE ProLiant DL380 Gen9 Server Data SheetHPE ProLiant DL380 Gen9 Server Data Sheet
HPE ProLiant DL380 Gen9 Server Data Sheet
 
Boost UDP Transaction Performance
Boost UDP Transaction PerformanceBoost UDP Transaction Performance
Boost UDP Transaction Performance
 
3.INTEL.Optane_on_ceph_v2.pdf
3.INTEL.Optane_on_ceph_v2.pdf3.INTEL.Optane_on_ceph_v2.pdf
3.INTEL.Optane_on_ceph_v2.pdf
 
Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...
Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...
Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...
 
Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...
Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...
Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...
 
Yeni Nesil Sunucular ile Veritabanınız
Yeni Nesil Sunucular ile VeritabanınızYeni Nesil Sunucular ile Veritabanınız
Yeni Nesil Sunucular ile Veritabanınız
 
Enterprise Search Summit - Speeding Up Search
Enterprise Search Summit - Speeding Up SearchEnterprise Search Summit - Speeding Up Search
Enterprise Search Summit - Speeding Up Search
 
z/VM Performance Analysis
z/VM Performance Analysisz/VM Performance Analysis
z/VM Performance Analysis
 
Ceph Day Tokyo -- Ceph on All-Flash Storage
Ceph Day Tokyo -- Ceph on All-Flash StorageCeph Day Tokyo -- Ceph on All-Flash Storage
Ceph Day Tokyo -- Ceph on All-Flash Storage
 
Cy7 introduction
Cy7 introductionCy7 introduction
Cy7 introduction
 
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...Enhancing Live Migration Process for CPU and/or  memory intensive VMs running...
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...
 
PostgreSQL performance archaeology
PostgreSQL performance archaeologyPostgreSQL performance archaeology
PostgreSQL performance archaeology
 
Yashi dealer meeting settembre 2016 tecnologie xeon intel italia
Yashi dealer meeting settembre 2016 tecnologie xeon intel italiaYashi dealer meeting settembre 2016 tecnologie xeon intel italia
Yashi dealer meeting settembre 2016 tecnologie xeon intel italia
 
15.) cloud (opex, capex or hybrid)
15.) cloud (opex, capex or hybrid)15.) cloud (opex, capex or hybrid)
15.) cloud (opex, capex or hybrid)
 
How to build a state-of-the-art rails cluster
How to build a state-of-the-art rails clusterHow to build a state-of-the-art rails cluster
How to build a state-of-the-art rails cluster
 

Recently uploaded

Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 

Recently uploaded (20)

Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 

Smashing Big Data with AHA Hardware GZIP

  • 1. 1 01 0111100100100001011100010011011000101000100101000110000110100011 10 1010000110100011001001010001100011100100100001010010000101110001 10 1010000110100011001001010001100011100100100001010010000101110001 01 0111100100100001011100010011011000101000100101000110000110100011 111011 111010 11 00 01 10 11 01 10 11 01 10 11 01 11 01 10 11 10 01 10 111011 11101011 00 01 10 11 01 10 01 10 11 01 11 01 10 11 10 01 10 111011 111010 11 00 01 10 11 01 10 11 01 10 11 01 11 01 10 11 10 01 10 111011 11101011 00 01 10 11 01 10 01 10 11 01 11 01 10 11 10 01 10 10 11 01 10 11 01 01111001001000010111000100110110 0010100010010100011000011010001111 01110110 1110 01 10 011011011101 11 01110110 1110 01 10 011011011101 11 01110110 1110 01 10 011011011101
  • 2. Sales and Contact Information • Website - www.aha.com • Sales Contact - sales@aha.com • White Paper to Presentation - http://www.aha.com/Uploads/GZIP_Benefits_Whitepaper9.pdf 2
  • 3. Introduction • Purpose - The purpose of this brief is illustrate the benefits hardware GZIP compression on a 10G Ethernet link using the AHA 372. • Outline - AHA Product Introduction - 10Gbps Web Server Experiment and Results - Energy Break Even Point of AHA372 3
  • 4. Who we are… • AHA Products Group - Business unit of Comtech EF DATA - Advanced IP Development Center • Brief History - Established 1988 on Forward Error Correction - 1992 Created first CAM in Data Compression - 2006 Created First GZIP Compression IC - 2009 Created Fastest GZIP Compression IC • Expertise - High Performance Data Compression - Forward Error Correction - Hardware and Software Development 4
  • 5. AHA37XPCIe Family Features • Interface - PCIe 3.0x8 interface • Algorithms - GZIP, ZLIB, LZS • Board by Compression Speed - AHA371 – 10 Gbps - AHA372 – 20 Gbps - AHA374 – 40 Gbps - AHA378 – 80 Gbps 5PCI Express® Compre Decompression Accele FEATURES Supports open standard algorithms GZIP and zlib Supports LZS algorithm Full duplex operation PCIe 2.0 x8 interface High compression ratio Minimal expansion of uncompressible data Supports streaming of large files or blocks Supports compression of intermixed blocks from different files Low Profile PCIe Form Factor APPLICATIONS WAN acceleration app Application servers Load balance applianc Storage appliances Web servers Table 1: AHA371 / AHA 372 Compression Ratio Files GZIP AHA37[1,2] – 10-20 Gbps aha products group PR AHA37 40.0 Gbps GZIP Compression/Decom Ac FEATURES Supports open standard algorithms GZIP and zlib APPLICATIONS WAN acceleration applianc Application servers AHA37[4-8] – 40-80 Gbps
  • 6. Experiment Setup • Client Emulator sends HTTP requests - Requests maximize throughput of 10 G link • Webserver responds with GZIP’d page - Requests are run continiously 6  Supermicro X8DTL-6F Motherboard  Intel Xeon E5620 CPU  3 X 2GB Kingston KVR13R9S8K3/6I  Seagate Barracuda ST3160815AS  Intel 82598EB 10-Gigabit AT2 Server Adapter  PowerEdge R720 Motherboard  Intel Xeon E5-2643 3.30GHz (Total 8 cores)  24 X 4GB RDIMM, 1600MT/s RAM  Western Digital WD800JD-75MSA2  Intel 82598EB 10-Gigabit AT2 Server Adapter 10 Gig-E Page Responses • No GZIP • CPU GZIP • Hardware GZIP Page RequestsClient Emulator Apache Web Server 120 Power Meter aha products group PRODUCT BRIEF AHA371 / AHA372 PCI Express® Compression and Decompression Accelerator Card FEATURES Supports open standard algorithms GZIP and zlib Supports LZS algorithm Full duplex operation PCIe 2.0 x8 interface High compression ratio Minimal expansion of uncompressible data Supports streaming of large files or blocks Supports compression of intermixed blocks from different files Low Profile PCIe Form Factor APPLICATIONS WAN acceleration appliances Application servers Load balance appliances Storage appliances Web servers Table 1: AHA371 / AHA 372 Compression Ratios 40 Gbps Compression: 2x AHA372 20Gbps GZIP Accelerators aha products group PRODUCT AHA371 / AHA3 PCI Express® Compression Decompression Accelerator C FEATURES Supports open standard algorithms GZIP and zlib Supports LZS algorithm Full duplex operation PCIe 2.0 x8 interface High compression ratio Minimal expansion of uncompressible data Supports streaming of large files or blocks Supports compression of intermixed blocks from different files Low Profile PCIe Form Factor APPLICATIONS WAN acceleration appliances Application servers Load balance appliances Storage appliances Web servers Table 1: AHA371 / AHA 372 Compression Ratios  Watts up? PRO ES  Accuracy: +/- 1.5% 120 VAC
  • 7. Scenarios and Measurements • Observed Metrics - Effective throughput of 10Gb Link  Better compression ratio, more effective throughput  Experiment average between 1:2, 1:3, compression ratios - CPU Utilization - Power/ Throughput (Watt/Gbps) or Energy/Bit (Joule/Gb) • Compression Scenarios Ran - No Compression - CPU Compression : mod_deflate - AHA Compression : 2 x AHA 372 20Gbps 7
  • 8. Experiment Results 8 9 Gbps 15% 16 J/Gb 6.8 J/Gb 59% 35 Gbps2 Gbps 100 % 116 J/Gb Throughput CPU Load Energy Efficiency No GZIP CPU GZIP AHA GZIP
  • 9. CPUs are Inefficient at Performing GZIP • CPU is Crippled - Serving web pages drops from 9 Gbps to 2Gbps. • CPU is Inefficient - 8 Core CPU at 100% load and consumes 7x more energy. 9 9 Gbps 15% 16 J/Gb 2 Gbps 100 % 116 J/Gb Throughput CPU Load Energy Efficiency NoGZIP CPUGZIP CPUs are not optimal for performing GZIP
  • 10. GZIP Hardware Removes CPU Bottlenecks • 18x Throughput over CPU  At full load with 8 cores, CPU GZIP is only capable of 6% of the throughput of GZIP hardware. • Available CPU cycles  Not performing compression CPU can perform tasks it is most efficient at. • 17x energy efficiency - Less energy cost 10 9 Gbps 15% 16 J/Gb 6.8 J/Gb 59% 35 Gbps2 Gbps 100 % 116 J/Gb Throughput CPU Load Energy Efficiency NoGZIP CPUGZIP GZIP 9 Gbps 15% 16 J/Gb 2 Gbps 100 % 116 J/Gb Throughput CPU Load Energy Efficiency NoGZIP CPUGZIP GZIP Hardware is order of magnitudes more efficient at GZIP than CPUs.
  • 11. Energy Break Even Point (eBEP) • Assumptions - Card Price at Low Volumes - Continuous Data Stream - Power Usage Effectiveness 1.7 - Normalized Linear Performance Adjustment for Power Consumption • Hardware Pays Off FAST! - 22 Days at Lowest Electricity Cost 11 Cost of Electricity cents (kW/h) eBEP of GZIP Hardware Vs. CPU GZIP 15 22 days 20 17 days 25 14 days 30 11 days 35 10 days GZIP Hardware Reduces OpEx and CapEx by creating optimal performing systems using less hardware (CPU).
  • 12. AHA vs Other Compression 12 bzip2, 47, 3.5:1 zlib, 70, 2.8:1 lzo, 640, 1.9:1 aha-gzip, 3.33Gbps/Chan ,2.7:1 0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 1 10 100 1000 10000 CompressionRatioto1 Compresion Speed in Mbps Comparative Compression Performance (256 MB Wikipedia Corpus) GZIP Hardware still orders of magnitude faster than the fastest CPU compression and with good compression ratios.
  • 13. Integration • Plug and Play - Driver installs in minutes - ZLIB library replacements - Apache Webserver API - JAVA API • Full Engineering Support - Development engineering support for all appliance integration. 13 www.aha.com sales@aha.com
  • 14. Sales and Contact Information • Website - www.aha.com • Sales Contact - sales@aha.com • White Paper to Presentation - http://www.aha.com/Uploads/GZIP_Benefits_Whitepaper9.pdf 14