Redhat summit b tolleyv7
•Download as PPTX, PDF•
2 likes•1,230 views
Maximizing Cloud Performance with Redhat KVM and SR-IOV
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Redhat summit b tolleyv7
Similar to Redhat summit b tolleyv7 (20)
Recently uploaded
Recently uploaded (20)
Redhat summit b tolleyv7
- 1. Copyright © 2012 Solarflare Communications, Slide 1 March 20th, 2012 OPEN CLOUD INFRASTRUCTURE BUILT ON RED HAT TECHNOLOGIES Bruce Tolley, PhD Optimizing Server I/O For OpenStack: Platform Hardware Choices Matter! 13 June 2013
- 2. Copyright © 2012 Solarflare Communications, Slide 2 March 20th, 2012 Network Hardware Choices Matter: KVM Support • Clouds and OpenStack promise the evolution of IT – Flexibility, automation, scale of compute, storage and networking • Server Virtualization in general enables the commoditization of hardware, use of industry standard servers. The end of vendor lock in(?) • Need hardware support for KVM in the network interface software and hardware (NIC) – performance to deliver SLAs and QOS with a Cloud • Hypervisor bypass to eliminate bottlenecks • Plug-in architecture to support both app acceleration and hypervisor services (e.g. migration)
- 3. Copyright © 2012 Solarflare Communications, Slide 3 March 20th, 2012 Introducing Solarflare • High-performance, low-latency 10GbE server adapters • Power the networks at all the banks and exchanges • Out of the box support: Red Hat Enterprise Linux with KVM, Red Hat Enterprise Virtualization for Servers and Desktop • Partner with Arista, Azul, Cisco, Fusion-io, Juniper, Red Hat, Vmware • OEM with IBM and HP • Over 700 customers worldwide • OpenStack Partner
- 4. Copyright © 2012 Solarflare Communications, Slide 4 March 20th, 2012 Broad Platform Support for Linux and OpenSource • High performance, low-latency – < 7uS 1⁄2 RTT UDP latency • Full integration into Linux kernel • Actively improving Linux networking – Solarflare is the maintainer of “ethtool” – Linux kernel RFS offload in hardware (w/Google) • Multiple OpenSource and FreeBSD products • We also do Windows, Vmware, and Solaris
- 5. Copyright © 2012 Solarflare Communications, Slide 5 March 20th, 2012 OpenStack and Cloud Computing • Cloud Networking – Virtualization, democratization, scalability, – Commoditization of infrastructure • Programmable network features – LANs, IP addresses,VLANs – Security Groups, Role based access control (RBAC) • Need network interfaces hardware and software(NICs) to support KVM • Near Bare metal performance SLAs and QoS over Cloud infrastructure
- 6. Copyright © 2012 Solarflare Communications, Slide 6 March 20th, 2012 Slide 6 of 9 | PROPRIETARY AND CONFIDENTIAL SR-IOV for Virtual Operating Systems (KVM) Solarflare Hybrid SR-IOV Model Typical SR-IOV Implementation Traditional Virtualization (no SR-IOV) Full hypervisor-based services and management, but poor network performance Improved performance, but loss of hypervisor-based services and management (eg, live migration) Improved performance AND full hypervisor-based services and management
- 7. Copyright © 2012 Solarflare Communications, Slide 7 March 20th, 2012 2.79 3.36 5.8 8.15 10.1 16.6 9.3 17.4 18.3 9.32 16.8 33.4 0 5 10 15 20 25 30 35 40 I/OPerformance(Gbps) SolarflareHybrid SR-IOV PerformanceAdvantage No SR-IOV With SR-IOV 0 5 10 15 20 25 30 35 40 1 VM 4 VMs No SR-IOV With SR-IOV Bare Metal Performance for Guest Applications Traffic Unidirectional Bi-directional Bi-directional Unidirectional Bi-directional Bi-directional 10GbE ports 1 1 2 1 1 2 * Solarflare test results • Solarflare scales and delivers near line-rate performance
- 8. Copyright © 2012 Solarflare Communications, Slide 8 March 20th, 2012 • Solarflare achieved the three best SPECvirt_sc2010 results for 2, 4, 8 processor configurations • Industry-leading SPECvirt_sc2010 scores achieved with Red Hat Enterprise Linux (RHEL) using KVM and Solarflare Adapters Future Proof for the Highest VM Density SPECvirt Benchmarks 2352 2442 4603 4682 7424 8956 0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 RHEL 6.2 (KVM) Intel x520 RHEV 3 (KVM) Solarflare RHEL 6.1 (KVM) Intel x520 RHEL 6.1 (KVM) Solarflare RHEL 6.1 (KVM) Intel x520 RHEL 6.1 (KVM) Solarflare 2 processors 4 processors 8 processors Solarflare with SR-IOV delivers record performance with 21% increase! Comparison based on best performing systems published at www.spec.org as of 25 June 2012. SPEC® and the benchmark SPECvirt_sc® are registered trademarks of the Standard Performance Evaluation Corporation. For more information about SPECvirt_sc2010, see www.spec.org/virt_sc2010/.
- 9. Copyright © 2012 Solarflare Communications, Slide 9 March 20th, 2012 Solarflare and Red Hat • Out-of-Box Accelerated Networking Support for – Red Hat Enterprise Linux with KVM Hypervisor – Red Hat Enterprise Virtualization for Servers and Desktop – Red Hat Enterprise MRG – Red Hat Storage • Partnerships and Certifications – Red Hat OpenStack – Red Hat Enterprise Linux Certified – Red Hat Ready ISV Partner – Open Virtualization Alliance Member – RHEL and KVM product documentation including • Red Hat Performance Brief – “Using Solarflare OpenOnload to Achieve Extreme Low Latency on Red Hat Enterprise Linux 6” • Solarflare Solution Brief – “Unified SR-IOV for Red Hat Linux KVM” *Based on best performing systems published at www.spec.org as of Dec 6, 2012
- 10. Copyright © 2012 Solarflare Communications, Slide 10 March 20th, 2012 Summary and Conclusions • Clouds and OpenStack promise the evolution of IT – Flexibility, automation, scale of compute, storage, and networking • Server virtualization in general enables the commoditization of hardware, use of industry standard servers. The end of vendor lock in (?) • Still need hardware support for KVM in the platform and the network interface software and hardware (NIC) – performance to deliver SLAs and QOS with a Cloud • Hypervisor bypass to eliminate bottlenecks • Plug-in architecture to support both app acceleration and hypervisor services (e.g. VM and storage migration) Solarflare+Redhat Office of CTO: “Make the NICs Move, Adventures in Performance Tuning” 11:00 am, Friday, Room 304
- 11. Copyright © 2012 Solarflare Communications, Slide 11 March 20th, 2012 BACKUP SLIDES
- 12. Copyright © 2012 Solarflare Communications, Slide 12 March 20th, 2012 VMVM NIC VM VM VM driver TCP/IP driver TCP/IP driver TCP/IP driver TCP/IP driver TCP/IP KVM Host VNICVNICVNIC VNICVNICVNIC PF VF VF VF VNICVNICVNIC VNICVNICVNIC VNICVNICVNIC Bridge Improving KVM Performance & Scalability • Core scaling enhances performance – Spreads I/O across all CPU cores – Improves 10GbE performance scalability – VM / vNIC core alignment – Mitigates hypervisor becoming I/O bottleneck • SR-IOV acceleration – Near native performance – VM direct access to VF / vNIC • More vNICs & VFs = better scaling across all VMs – Solarflare = 2048 vNICs
Editor's Notes
- High performance, low-latency < 7uS 1⁄2 RTT UDP latencyBidirectional line rate, both ports (40G) with < 20% CPU load – Stateless offloads (TSO, LRO, RSS)Performance scales with multiple CPU coresFull integration into Linux kernelDriver “intree” (kernel.org)Wide distribution and kernel supportIntegration with ethtool, MTD, hwmon (sensors)Actively improving Linux networkingSolarflare is the maintainer of “ethtool”Linux kernel RFS offload in hardware (w/Google)Multiple OpenSource and FreeBSD productsWe also do Windows and Solaris
- Manage and configure LANs and IPFlat, Flat DHCP, VLAN DHCP, IPv6Programmatically allocate IPs and VLANsfor rapid provisioning of network capabilities and security featuresFloating IP addressesAbility to assign (and re-assign) IP addresses to VMsSecurity GroupsFlexibility to assign and control access to VM instances by creating separation between resource pools Role based access control (RBAC)Set up security by user, role, and project
- TRADITIONALHypervisor emulates network hardwareFlexible!But, performance is poorLimits the workloads that can be virtualizedUses CPU cyclesTYPICAL with SR IOVNetwork driver binds directly to the PCIe VFNear native networking performanceBut, no longer virtualNo migrationPLUG INMaintains traditional software pathPlus VF pathNear native performanceKeep full virtualization features (e.g. migration)RSS within guest VMs127 VFs, 1024 VNICs
- 1:30:Solarflare’s unique approach to SR-IOV combines the benefits of accelerated cut-through performance while maintaining full compatibility with hypervisor-based services and management tools. In addition to improved performance and superior manageability, Solarflare adapters scale up to 254 VFs, each of which can support multiple DMA channels (up to a total of 2048), providing far more scalable workload consolidation for large data center environments and virtual desktop (VDI) deployments than is otherwise available from competitive products. To further improve performance, Solarflare adapters utilize the available DMA channels within a VF to support Receive Side Scaling (RSS) for guest VMs, spreading VM workloads across many CPU cores enabling performance to scale with the number of CPU cores.This chart illustrates the dramatic performance difference between SR-IOV and hypervisor-based I/O. The data taken for uni-directional traffic and bi-directional traffic for both single-port and dual-port server adapters. The setup consisted of two back to back physical hosts with 4 VMs each, and performance data was taken for single-VM and quad-VM operation.The red bars illustrate Solarflare’s benchmark results demonstrate that with SR-IOV performance increases to near line-rate, as the red bars approach the 10Gbps, 20Gbps and 40Gbps I/O performance levels. This represents up to a 5x performance improvement with SR-IOV. In all cases, except one Solarflare SR-IOV benchmarks at near line rate performance. The one exception is for a single VM which cannot generate enough bandwidth.Thank you for listening to how you can increase your KVM I/O performance and scalability, while simplifying your SR-IOV configuration and management for VM migration.And now I would like to return you to our moderator Richio Aikawa. Richio…