Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Analyst Perspective:   Test Lab Report – 16 Gb Fibre Channel Performance    and Recommendations                  Dennis Ma...
AgendaAbout DemartekFibre Channel – 16 Gigabit and futuresCabling considerations and recommendationsDemartek performan...
About DemartekIndustry analysis with on-site test labLab includes servers, networking and storage infrastructure   –   F...
Fibre Channel► Marketplace*2012 was the year of 10-10-10   – 10 Million Fibre Channel ports (switches and adapters)   – $...
Fibre Channel► SAN Interface                  Doubles                  in speed                  every 3-4                ...
Fibre Channel► Disk Drive Interface4 Gb/s was the highest speed for FC interface disk drivesHDD/SSD vendors have moved t...
Fibre Channel► 16 Gigabit (16GFC)16 GFC is backward compatible with 4 GFC & 8 GFCUses 14 Gbps single-lane connectors   –...
Fibre Channel► 32 Gigabit and 64 GigabitFormal statement of direction:   “The INCITS Technical Committee T11 is currently...
Network Virtualization► NPIV and Virtual Fibre ChannelAvailable with Windows Server 2012 Hyper-V  – Similar in concept to...
Fibre Channel Adapter Specifications Fibre Channel can run in full-duplex mode, but storage  protocols generally operate ...
Encoding Schemes8b/10b  – For every 8 bits, adds 2 bits for command and control  – 20% overhead = (10-8)/1064b/66b  – Us...
Cabling Recommendations► Fiber Optic Cables Fiber optic cabling service life – 15 to 20 years Recommendation – OM4 cable...
ConnectorsSingle-lane – SFP, SFP+                 Four-lane – QSFP, QSFP+                           SFP              SFP+ ...
Performance Results
Performance Results► 16 GFC IOPS Test – Configuration
Performance Results► 16 GFC IOPS Test – 1 Million IOPS MySQL Clusters                            Aggregate Database IOPS ...
Performance Results► 16 GFC BandwidthTest – Configuration
Performance Results► 16 GFC Bandwidth Test – 7200 MB/sec                                      All-flash Array Aggregate Ba...
Performance Results► 16 GFC vs 8 GFC – Configuration   Windows Server 2012     SQL Server 2008
Performance Results► 16 GFC vs 8 GFC – Test Results  Source: Demartek Fibre Channel Zone – http://www.demartek.com/FC
Performance Results► Virtual Fibre Channel – Configuration
Performance Results► Virtual Fibre Channel – Test Results
Demartek Free Resources Demartek FC Zone   – www.demartek.com/FC               Performance reports, Demartek FCoE Zone  ...
• www.demartek.com/Demartek_Interface_Comparison.html• Or search for “storage interface comparison” in your favorite  sear...
Free Monthly NewsletterDemartek publishes a free monthlynewsletter, Demartek Lab Notes,highlighting recent reports, articl...
Thank You!                                   To learn more about Demartek:                                    Download th...
Analyst Perspective - Test Lab Report - 16 Gb Fibre Channel Performance and Recommendations
Upcoming SlideShare
Loading in …5
×

Analyst Perspective - Test Lab Report - 16 Gb Fibre Channel Performance and Recommendations

4,574 views

Published on

Fibre Channel (FC) storage is a multi-billion dollar industry and remains the dominant SAN fabric architecture with millions of FC ports deployed in large datacenters. 16Gb Fibre Channel (“16GFC”) can accommodate increased workloads that higher density virtualization, private cloud storage and the increasing deployment of SSD technology bring to SAN fabrics. In this session, Dennis will present the use cases for 16Gb FC, discuss what is available today, interoperability with previous generations of FC such as 8GFC and 4GFC and provide guidance for cabling, connectors, patch panels and other infrastructure as you plan ahead. In addition, we will share Demartek lab performance test results with 16Gb FC infrastructure including the use of virtualization and SSD technology, and see how much of a 16Gb pipe can be filled with real database workloads.

Published in: Technology
  • Be the first to comment

Analyst Perspective - Test Lab Report - 16 Gb Fibre Channel Performance and Recommendations

  1. 1. Analyst Perspective: Test Lab Report – 16 Gb Fibre Channel Performance and Recommendations Dennis Martin President, Demartek The original version of this presentation is available here:http://www.demartek.com/Demartek_Presenting_SNWUSA_2013-04.html
  2. 2. AgendaAbout DemartekFibre Channel – 16 Gigabit and futuresCabling considerations and recommendationsDemartek performance lab test resultsDemartek free resources
  3. 3. About DemartekIndustry analysis with on-site test labLab includes servers, networking and storage infrastructure – Fibre Channel – 4, 8 & 16 Gbps – Ethernet – 1 & 10 Gbps: NFS, SMB (CIFS), iSCSI & FCoE – Servers – 8+ cores, large RAM – Virtualization – VMware, Hyper-V, XenWe prefer to run real-world applications to test servers and storage solutions – Currently testing SSD, 10GbE, 16GFC and other technologiesWebsite: www.demartek.com
  4. 4. Fibre Channel► Marketplace*2012 was the year of 10-10-10 – 10 Million Fibre Channel ports (switches and adapters) – $10 Billion of Fibre Channel Enterprise Storage Systems – 10 Exabytes (EB) of external storage shipped with Fibre ChannelDatacenter standard for storage area networks – Vast majority of enterprise storage uses Fibre Channel as the host interface * Source: Fibre Channel Industry Association (FCIA)
  5. 5. Fibre Channel► SAN Interface Doubles in speed every 3-4 years FCoE (10 Gb) introduced in 2009
  6. 6. Fibre Channel► Disk Drive Interface4 Gb/s was the highest speed for FC interface disk drivesHDD/SSD vendors have moved to 6 Gb/s SAS for enterprise drives – First 12 Gb/s SAS drives announced in Spring 2012
  7. 7. Fibre Channel► 16 Gigabit (16GFC)16 GFC is backward compatible with 4 GFC & 8 GFCUses 14 Gbps single-lane connectors – Doubles speed of 8 GFC due to newer 64b/66b encodingThe first 16 GFC switches and HBAs shipped in 2011 – Some of these HBAs can also function as 10 Gb NICs16 GFC storage targets becoming availableFibre Channel speeds and server slots (dual-port) – 4 Gb: PCI-X 2.0, PCIe 1.0 – 8 Gb: PCIe 2.0 x4 or PCIe 1.0 x8 – 16 Gb: PCIe 3.0 x4 or PCIe 2.0 x8
  8. 8. Fibre Channel► 32 Gigabit and 64 GigabitFormal statement of direction: “The INCITS Technical Committee T11 is currently working on the 32 GFC Fibre Channel specifications. The 32 GFC specifications are going to letter ballot in April and should be complete this year. TheT11 committee is also investigating a multi-lane 128 GFC interface that is based on the 32GFC work. Work has not yet begun in T11 for developing the 64 GFC specifications, but 64 GFC is on the FCIA Speed roadmap.” Steve Wilson, Director of Technology and Standards, Brocade and INCITS Technical Committee T11 Chairman32 GFC will use 28 Gbps connectors (25/28G), and will double the speed of 16 GFC
  9. 9. Network Virtualization► NPIV and Virtual Fibre ChannelAvailable with Windows Server 2012 Hyper-V – Similar in concept to SR-IOV but for Fibre Channel – Supported by most FC HBAs (requires NPIV support) • NPIV is enabled by default in some FC HBAs, not in others – Requires support by the guest O.S. (Windows 2008R2/2012)Procedure – Assign a pair of virtual WWPNs to a guest O.S. – Add the WWPNs to the zoning and storage LUN maskingBenefits – VMs have their own virtual FC HBAs, just like physical servers – VMs can be moved and take their FC storage with them
  10. 10. Fibre Channel Adapter Specifications Fibre Channel can run in full-duplex mode, but storage protocols generally operate in half-duplex mode − Throughput numbers below are half-duplex (one-way) Host Adapter Requirements below are for dual-port cards Throughput Line Rate Host Adapter Encoding (MBps) (Gbaud) Requirements 1GFC 100 8b/10b 1.0625 PCI-X 2GFC 200 8b/10b 2.125 PCI-X PCI-X 2.0 or 4GFC 400 8b/10b 4.25 PCIe 1.0 (x4) PCIe 1.0 (x8) or 8GFC 800 8b/10b 8.5 PCIe 2.0 (x4) PCIe 2.0 (x8) or 16GFC 1600 64b/66b 14.025 PCIe 3.0 (x4)
  11. 11. Encoding Schemes8b/10b – For every 8 bits, adds 2 bits for command and control – 20% overhead = (10-8)/1064b/66b – Used by 10 GigE and 16 GFC – For every 64 bits, adds 2 bits for command and control – 3% overhead = (66-64)/66128b/130b – Used by PCIe 3.0 – For every 128 bits, adds 2 bits for command and control – 1.5% overhead = (130-128)/130
  12. 12. Cabling Recommendations► Fiber Optic Cables Fiber optic cabling service life – 15 to 20 years Recommendation – OM4 cables for current and future – OM4 will support 40/100 GigE and higher speeds of FC OM1 OM2 OM3 OM4 Jacket color Orange Orange Aqua Aqua 1 Gb/s 300m 500m 860m – 2 Gb/s 150m 300m 500m – 4 Gb/s 70m 150m 380m 400m 8 Gb/s 21m 50m 150m 190m 10 Gb/s 33m 82m Up to 300m Up to 400m 16 Gb/s 15m 35m 100m 125m
  13. 13. ConnectorsSingle-lane – SFP, SFP+ Four-lane – QSFP, QSFP+ SFP SFP+ QSFP+ Ethernet 1GbE 10GbE 40GbE Fibre Channel 1GFC, 2GFC, 4GFC 8GFC, 16GFC – Infiniband – – QDR, FDR
  14. 14. Performance Results
  15. 15. Performance Results► 16 GFC IOPS Test – Configuration
  16. 16. Performance Results► 16 GFC IOPS Test – 1 Million IOPS MySQL Clusters Aggregate Database IOPS – 10 servers, 4 1,100,000 instances of 1,000,000 101,754 mysql10 MySQL on each 900,000 102,932 mysql9 server 800,000 101,806 mysql8 700,000 mysql7 – Databases – 100,510 IOPS 600,000 mysql6 256 GB each 500,000 101,552 mysql5 instance 400,000 102,846 mysql4 103,270 – 8 mirrored 300,000 102,671 mysql3 mysql2 storage volumes, 200,000 101,670 mysql1 all flash 100,000 102,556 0 Source: Demartek Fibre Channel Zone – http://www.demartek.com/FC
  17. 17. Performance Results► 16 GFC BandwidthTest – Configuration
  18. 18. Performance Results► 16 GFC Bandwidth Test – 7200 MB/sec All-flash Array Aggregate Bandwidth Oracle RAC 8000 single large 7000 database cluster 6000 fc-5b fc-5a – “Select 5000 fc-4b MB/Sec count(*)” all 4000 fc-4a fc-3b 10.2 billion 3000 fc-3a rows fc-2b 2000 completed in fc-2a fc-1b < 8 minutes 1000 fc-1a 0 Source: Demartek Fibre Channel Zone – http://www.demartek.com/FC
  19. 19. Performance Results► 16 GFC vs 8 GFC – Configuration Windows Server 2012 SQL Server 2008
  20. 20. Performance Results► 16 GFC vs 8 GFC – Test Results Source: Demartek Fibre Channel Zone – http://www.demartek.com/FC
  21. 21. Performance Results► Virtual Fibre Channel – Configuration
  22. 22. Performance Results► Virtual Fibre Channel – Test Results
  23. 23. Demartek Free Resources Demartek FC Zone – www.demartek.com/FC Performance reports, Demartek FCoE Zone Deployment Guides – www.demartek.com/FCoE and commentary Demartek iSCSI Zone available for free – www.demartek.com/iSCSI download. Demartek SSD Zone – www.demartek.com/SSD Demartek SSD Deployment Guides – iSCSI and SSD available now, 16GFC coming…
  24. 24. • www.demartek.com/Demartek_Interface_Comparison.html• Or search for “storage interface comparison” in your favorite search engine
  25. 25. Free Monthly NewsletterDemartek publishes a free monthlynewsletter, Demartek Lab Notes,highlighting recent reports, articles and commentary. Look for the newsletter sign-up at: www.demartek.com/Newsletter
  26. 26. Thank You! To learn more about Demartek:  Download the Aurasma App (Android/iPhone) Dennis Martin, President dennis@demartek.com  Search and follow “Demartek”www.linkedin.com/in/dennismartin  View image below with viewfinder. (303) 940-7575 www.demartek.com http://twitter.com/Demartek www.youtube.com/Demartek Skype: Demartek *also on the back of Dennis’ business card Powered by:

×