Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Building a cost-effective and high-performing public cloud


Published on

Sander Cruiming, founder of Cloud Provider, shows how to build a cost-effective and high-performing public cloud to meet the today's high demands and requirements for cloud infrastructure. Presented at the HPC Advisory Council in Lugano, Switzerland on the 14th of March, 2013.

The corresponding Youtube video with audio:
Please check for more information:

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Building a cost-effective and high-performing public cloud

  1. 1. Building a cost-effective andhigh-performing public cloudSander Cruiming, founder Cloud Provider 1
  2. 2. Agenda• Introduction of Cloud Provider• Overview of our previous cloud architecture• Challenges of that architecture due to evolving cloud market and clients’ needs• How we build an improved cloud architecture• Comparison between the old and new setup 2
  3. 3. Introduction: Company• Cloud hosting and Infrastructure-as-a-Service (IaaS) provider in the Netherlands• Founded in 2008, spin-off from a shared hosting provider• 2 products, both pay-as-you-go: – Cloud Servers – Cloud Apps• Cloud platform is build using KVM 3
  4. 4. Introduction: Differentiation• Localized: support in Dutch, datacenter in Amsterdam• Ease of use & simplicity: in-house developed management portal with value-added tools• Good performance/cost ratio: cloud based on SSD caching & Infiniband and low-latency network starting at 13,25 euro per month 4
  5. 5. Introduction: Clients• More than 500 clients and resellers• Focus on developers, webhosts & ISP’s, e-commerce, high-traffic sites• Federation with other cloud providers to buy/sell eachother’s cloud capacity• References: 5
  6. 6. Introduction: Cloud portal 6
  7. 7. Introduction: Cloud portal 7
  8. 8. Previous cloud architecture (1)• 4 layers: storage, hypervisors, management, backup• Hypervisors were connected with SAN using iSCSI over gigabit ethernet• Storage VLAN: Bonding 4 network interfaces for SAN, 2 interfaces for each hypervisor to increase bandwidth• 3 additional VLANs: public network, internal management network, and backup network 8
  9. 9. Previous cloud architecture (2) Internal management network InternetRouter Hypervisors SAN Control servers Backup SAN Public network Storage network Backup network 9
  10. 10. Cloud market evolving• Explosion of interest and adoption since 2011 – Number of clients growing, current clients deploy more and larger VMs – Expected cloud market growth from US$70.1 billion in 2012 to US$158.8 billion in 2014• Different workloads are deployed nowadays – Beside test/dev, also production environments – The rise of “big data” / high transaction volume applications and databases 10
  11. 11. Clients’ higher demands• Better reliability & availability• Higher performance & lower latency – External: internet connectivity between client and the cloud – Internal: connection between hypervisor and SAN, local network• Competitive pricing 11
  12. 12. Challenges of previous cloud architecture (1)• Internal storage network became a performance bottleneck – Clients experienced higher latency (iowait) – Storage performance was inconsistent – Creating backups (snapshots) took too much time – Only 30 VMs per hypervisor to keep performance under control (= lower ROI)• Difficult to manage and scale due to large number of networks and cables 12
  13. 13. Challenges of previouscloud architecture (2) 13
  14. 14. Alternative interconnects (1)• Faster alternatives to gigabit iSCSI: Fibrechannel, 10 Gig-E iSCSI, Infiniband• Important selection criteria: – Performance – Congestion control & Low latency – Scalability – Easy to manage – Density: number of VMs per hypervisor – Cost 14
  15. 15. Alternative interconnects (2) Host Cost adapter Number of Quality of connectivity Cost switch card in ports Service performance hypervisor 1 Gb iSCSI 2000 euro 2 Gb/s 5x NIC (included) ethernet (24 ports)10 Gb iSCSI 1x HBA + 24500 euro 10 Gb/s 530 euro ✓ ethernet 1x NIC (16 ports) 1x HBA + 3000 euro ✓Fibrechannel 2 Gb/s 175 euro 1x NIC (18 ports) 3500 euro ✓ Infiniband 40 Gb/s 1x HCA 500 euro (18 ports) 15
  16. 16. Infiniband selected (1)• Low latency: < 1 usec end-to-end• High performance: 40 Gb/s host connectivity• Consolidation: multiple fabrics on single cable – Up to 8 virtual lanes – No interdependency between between different traffic flows• Highly scalable: tens of nodes possible• Best performance/cost ratio 16
  17. 17. Infiniband selected (2)• Other cloud providers are using Infiniband successfully: 17
  18. 18. Infiniband selected (3)• Mellanox InfiniScaleo IV QDR InfiniBand Switch, 18 QSFP ports• Mellanox MHQH19B-XTR ConnectX-2 VPI adapter card single-port 40Gb/s QSFP, PCIe2.0 x8 5.0GT/s 18
  19. 19. New cloud architecture Infiniband switch 1 InternetRouter Hypervisors SAN Control servers Backup SAN Infiniband switch 2 19
  20. 20. Results of new cloud architecture (1)• Hdparm - timing buffered disk reads: – Old setup: 16.94 MB/sec – New setup: 83.09 MB/sec• Seeker - random access time: – Old setup: 16.23 ms – New setup: 4.679 ms 20
  21. 21. Results of new cloud architecture (2)• Larger number of VMs per hypervisor: – Old setup: 30 VMs in average – New setup: up to 120 VMs in average• Duration for backup creation largely reduced• Provisioning a new VM is faster• Easier to manage and scale, smaller amount of cables 21
  22. 22. Results of new cloud architecture (3)• Quote from one of our clients: “We develop high-traffic business websites with the Drupal CMS. On the old platform, we experienced disk performance issues, as Drupal needs fast storage access for a large number of MySQL database queries and for file-based caching. The new cloud platform based on Infiniband has given a great performance boost to our clients websites, making us and our clients happier.” - Rick Bosscher, General Manager, 22
  23. 23. Thank you! Questions? 23