All slides from the January 7th 2015 CloudCamp Chicago
Theme: "the guts of the cloud"
What happens when the cloud meets the ground? Where does your data live, and who can touch your servers? We'll look at the "guts" of the cloud, from datacenters to fiber and from servers to switches in real life.
Lightning Talks:
"Cloud Computing: A look under the hood of the next-gen cloud" - Bill Kleyman, Director of Strategy and Innovation at MTM Technologies @QuadStack
"Cloudy with a 100% chance of GigaWatts" - Russell Pease, Business Development Manager at CyrusOne Data Centers
"The Importance of the Network Enabled Cloud" - Ron Zirkin, Enterprise Account Manager at XO Communications @ronzirkin
"The Red Hat OS1 Cloud: You want guts?" - Dan Yocum, Principal Systems Engineer at Red Hat @yocum137
3. … sponsored by you!
Pete Kippes - Hegemony Consulting Group
Matt Chiera - Ice Nine Online
Michael Madeja - Scientific Games
Susan Emery -Viewpointe LLC
Michael Cartina - Orasi Software
Jim Hamilton - Skytap
Mark Calaguas - McDermott Will & Emery LLP
Jeff Stricker - BroadCloud
Adam Kallish - IBM
Andre Stubberfield - Equinix
Ralph Capasso - Skytap
Brian Lickenbrock - EY
5. 6:00 pm Introductions
6:05 pm: Lightning Talks
"Cloud Computing:A look under the hood of the next-gen
cloud" - Bill Kleyman
"Cloudy with a 100% chance of GigaWatts" - Russell Pease
"The Red Hat OS1 Cloud:You want guts?" - DanYocum
"The Importance of the Network Enabled Cloud" - Ron Zirkin
7:00 pm: Unpanel
7:45 pm: Unconference / Networking, drinks and pizza
Agenda
#cloudcamp
@CloudCamp_CHI
Sponsored by
Hosted by
6. "Cloud Computing:A look under
the hood of the next-gen cloud"
Bill Kleyman
Director of Strategy and Innovation, MTM
Technologies
Tweet: @QuadStack
#cloudcamp
#cloudcamp
@CloudCamp_CHI
Sponsored by
Hosted by
7. Cloud Computing:
A look under the hood of
the next-gen cloud
Bill Kleyman
Director of Strategy and Innovation | MTM
[Writer, Author, Blogger, IT Veteran]
01/07/2015
8. The “Defining” Trends
Annual global data center IP traffic will reach 8.6 zettabytes
(715 exabytes [EB] per month) by the end of 2018, up from 3.1
zettabytes (ZB) per year (255 EB per month) in 2013.
Global data center IP traffic will nearly triple (2.8-fold) over
the next 5 years. Overall, data center IP traffic will grow at a
compound annual growth rate (CAGR) of 23 percent from 2013
to 2018.
By 2018, more than three quarters (78 percent) of workloads
will be processed by cloud data centers; 22 percent will be
processed by traditional data centers.
[2015 Cisco Cloud Index Report]
9. What’s under the hood for Cloud in 2015?
1. APIs and cloud connectivity
2. Software-defined everything (SDx)
3. Hybrid technologies and extensions
4. Mobility – as defined by the user, data, and device
5. Security, Compliance, Regulations, and more…
10. APIs and Cloud Connectivity
Platforms from VMware, OpenStack, CloudStack, Eucalyptus, and Amazon are
all creating easier ways to connect via the cloud.
APIs are creating intelligent infrastructure cross-connects to reduce the
amount of resources required.
APIs at the software and hardware layer will continue to make cloud
communication easier on an application and infrastructure level.
Automation
Self-Healing Event-based Management
Quality of Service
Autonomics
REST API
vCenter vCAC vVol CloudStackOpenStack IBM SmartCloud
Policy-Based Control
Capacity
Performance
Availability
Performance Isolation
Cloud Services
High Availability
Auto Provisioning
Fast Cloning
Orchestration:
vCenter, vCOPS,
vCAC, OpenStack
11. Software-Defined Everything (SDx)
Network
SDN
Powerful logical network architectures
Compute
“Follow the sun data center”
Abstracting compute resources
Data Center
Putting it all together.
Creating a new control layer
#SDDC
Storage
Creating powerful pools at the logical layer
Optimizing data control
Virtual
Controllers
Performance
12. Hybrid Cloud and Beyond
There is going to be a lot of blurring when it comes to
cloud model definitions.
The future of the cloud will pretty much see everyone
adopt some type of hybrid cloud platform. Why?
1. Firstly, most organizations are already in the cloud.
2. Secondly, there are a lot of new options in terms of
connecting a private cloud with some cloud resources.
New cloud management solutions aim to control your
cloud regardless of the platform.
Hybrid, public, private and even community clouds can
all be controlled from a single console.
LinuxVDI
PrivateCloudPublicCloud
HybridCloud
13. Mobility –
As Defined by the User, Apps and Devices
Forget about devices. The fad around mobility being defined around the
device is over.
“BYOD” is only the tip of the iceberg and a very tactical conversation. Time to
switch to strategy when it comes to mobility.
Mobility revolves around the delivery of applications, workloads and data to an
ever-mobile user. This can be to any device.
In the future, the goal will be to deliver the best possible user experience
regardless of the device.
Here’s something we all need to come to terms with:
The age of the PC, as we know, is coming to a close.
Look for a much more mobile user, and a much more mobile data layer.
… of CIOs believe that mobility will
have as much impact or greater
impact than the web. (Accenture, 2014)
73%
14. Security, Compliance, Regulations… Oh my.
• Big regulations like SOX, PCI/DSS and HIPAA are making technology
adjustments.
• The recent Omnibus Rule as a modification to HIPAA can actually allow
you to store data for collaboration in the cloud.
• Solutions like Citrix Sharefile Cloud for Healthcare and even Rackspace
jumped all over this, signed a business associate agreement (BAA), and can
now process protected healthcare information (PHI) directly from the cloud.
• Microsoft announced in December that its Azure Cloud for Government
supports such standards as FedRAMP, FISMA, DOD Enterprise Cloud
Service Broker, HIPAA, IRS 1075 and CJIS.
• Microsoft and Amazon Web Services (AWS) offer tools that make it easier
for agencies to create hybrid systems
• Some applications reside in government-run clouds while others are in public
clouds.
• As for security – it’ll always be an ongoing battle.
• Look for more virtual services, more data center and network integration,
and more protections around mobile data.
1010SSL1010101010110SSL1010
16. "Cloudy with a 100% chance of
GigaWatts"
Russell Pease
Business Development Manager, CyrusOne
Data Centers
Tweet:
#cloudcamp
#cloudcamp
@CloudCamp_CHI
Sponsored by
Hosted by
17. Cloudy with a 100% chance of Gigawatts
Russell Pease
Featuring: 7 Billion People , millions of servers
18. Cloudy with a 100% chance of Gigawatts
• The Cloud –what it means to me (and me! and me!)
• Where exactly are the Clouds? (Public )
• What drives Cloud Location (MTDC)
• The guts- basics –physical aspect
19. The Cloud- then and now or where's my stuff?
• Mature /Silents - Huh?
• Baby Boomers - “It’s like an AS400 IBM Mainframe”
• Gen X‘ers - Place to store some “stuff”-”not on my PC”
• Gen Y / Millennials – Duh -“the link to the world”
20. Where are the Clouds?
Let’s focus on the Big 4 Public platforms–AWS, Apple, MSFT, IBM
AWS
-11 geographical "regions":
• US East , NoVa - majority of AWS servers are based here
• US West (NorCal, Oregon )
• Brazil (Sao Paolo)
• Europe (Ireland and Germany)
• Southeast Asia (Singapore)
• East Asia (Tokyo, Beijing)
• Australia (Sydney)
21. Where are the Clouds?
Apple
- “Maiden” built in 2010 500K sft. (North Carolina)
- Reno, NV 2,200 acres!
MSFT
- Americas- SC, Iowa, Georgia, OK, NC, Oregon, Chile
- Asia- Taiwan, Singapore
- Europe- Finland, Belgium, Ireland
IBM
-Investing 1.2B to build out local cloud Hubs -40 data centers in 5
continents
22. What drives Location?
Right Brained Rules! It’s about Efficiency
• Lots of POWER- low rates!
(In 2013, U.S. data centers consumed an estimated
91 billion kilowatt-hours of electricity)
• Cooling-including climate driven
efficiencies
• Interconnection(Content
accessibility)
• State sponsored tax incentives- TX,
AZ, NoVA, etc.
23. US Players in MTDC
There are over 510,000 Data Centers in the World- Newmark Grubb GCS
The global data center colocation market is expected to grow from $16.65 B in 2014 to $49.57 B by
2019. (CAGR of 17.6)
24. Skies for the Cloud
CyrusOne PHX 1M sft Phase 1 DFT NoVa ACC7 450K sft
25. Green field builds yield efficiency and speed to market!
Demand Capture A Modular approach is
common to mitigate ”THE RISK”
Time/effort/money is spent up front on
common platforms - land, building shell,
network, fire protection, security
Electrical and mechanical subsystems are
remanufactured offsite as needed
Supply chain engineering to deliver electrical
and mechanical subsystems onsite just-in-
time
Delivery of data centers in as little as 16
weeks
27. The Guts (Basics)
Power
• Generators (supports facility from utility failure)
• Battery back up
• UPS (Uninterruptible Power Supply /Source)
• PDU (Power Distribution Unit)
• Power WHIPS
Mechanical
• Chillers ( disperses heat from facility)
• CRAC- (Computer Room Air Conditioners- so servers are
cozy)
29. "The Red Hat OS1 Cloud:You want
guts?"
DanYocum
Principal Systems Engineer, Red Hat
Tweet: @yocum137
#cloudcamp
#cloudcamp
@CloudCamp_CHI
Sponsored by
Hosted by
30. 01/05/15 Red Hat, Inc. 1
O
P
EN
SH
IFT
TECH
O
P
S
The Red Hat OS1 Cloud
●You want guts?
Dan
Yocum
31. 01/05/15 Red Hat, Inc. 2
The Data Center
● Wholesale or Retail
– Digital Realty
– Internap
– Savvis
– Et al.
● Cage
● Rack(s)
● Electrical – 240V
● Cooling – enough tonnage
● Network – Internal and Edge
● SLAs
– Power
– Cooling
– Network
– Environmental monitoring
●
Temperature
●
Humidity
●
Fire supression
●
Access
32. 01/05/15 Red Hat, Inc. 3
Design Considerations
● High CPU usage?
● High Memory usage?
● High IO usage?
● High Availability?
● Monolithic Storage with a Clustered Filesystem?
● Fragmented Storage for HDFS? PVFS? NoSQL? Lustre?
● General Purpose?
33. 01/05/15 Red Hat, Inc. 4
Hardware Infrastructure
● Basic Specs
– Dual redundant rack PDUs, separate building circuits
– Dual redundant network switches (hire a network
admin!)
– Dual redundant power supplies for systems
– RAID system disks
– >=2 10GbT bonded NICs
34. 01/05/15 Red Hat, Inc. 5
Hardware Infrastructure
● Specs for a small OpenStack Cell – 64
compute nodes:
– Juniper EX4550 32port 10GbT TOR switch
– NetApp FAS2240-2 (maxes out at 60 clients &
~1500 active processes)
● Hitting Consistency Points
● Would buy larger model with ability to expand.
35. 01/05/15 Red Hat, Inc. 6
Hardware Infrastructure
– 2 MySQL database nodes
● 2 RAID1 SSDs, 16GB RAM, 4-core
● Multi-master Replication or galera
– 2 Operations nodes
● 4 RAID10 SATA, 128GB RAM, 8-core
● Libvirt for VMs
37. 01/05/15 Red Hat, Inc. 8
Software Infrastructure
● On each Operations node duplicates of these:
– 1 VM – provisioning (foreman) and configuration management
(puppet) – rsync for replication
– 1 VM – bind DNS – Designate
– 1 VM – software Load Balancer - LVS or haproxy
– 1 VM – messaging service – rabbitmq
– 1 VM – OpenStack control node – nova, glance, cinder, heat, etc.
– 1 VM – performance (ganglia) and availability (zabbix) monitoring
38. 01/05/15 Red Hat, Inc. 9
Conclusion
● Software Engineers over-abstract systems away.
● System Engineers can't abstract systems away.
● Hardware is hard (the hood is welded shut).
● Configuration management is hard.
● Performance monitoring is easy.
● Availability monitoring is less easy.
39. "The Importance of the Network
Enabled Cloud"
Ron Zirkin
Enterprise Account Manager, XO
Communications
Tweet: @ronzirkin
#cloudcamp
#cloudcamp
@CloudCamp_CHI
Sponsored by
Hosted by
40. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 1
41. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 2
44. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 5
The Importance of the
Network Enabled Cloud
45. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 6
46. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 7
Essential Characteristics
of The Cloud
47. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 8
On-demand self-service
Ubiquitous Broad network access
Resource pooling
Rapid elasticity
Measured service
5 Characteristics of the Cloud
48. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 9
Multi- Cloud Environment & Network
1
2
The Emergence of the Multi-Cloud
Ecosystem and Hybrid IT.
Network Enabled Cloud
Story and Why it Matters
to You.
49. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 10
Cloud Adoption Issues for Businesses Exist
Source: CDW, 2013 State of the Cloud Report, May 2013
Security once dominated, but cloud service performance and other issues are
emerging as concerns that slow adoption
46%say yes
…concerns with security of
proprietary data or applications?
32%say yes
…concerns with performance
of cloud services?
Biggest Barriers:*
25%say yes
…concerns with technical aspects of
integrating cloud applications or
infrastructure with legacy systems?
Other Impeding Factors
22% report ambiguous
agreements with
vendors about who’s
responsible for what
20% report senior-level
non-IT management is
holding them back
21% report concerns
with locating services
in multi-tenant
environments
20% report software
licensing policy issues
50. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 11
Yet Enterprises are Moving to the Cloud –
Comptia Survey Shows:
“More than 50% of IT decision-makers indicated they will be using four or more cloud
platforms.”
6 in 10 Installing other platforms beyond
initial projects.
90 % responded have moved some
processes to the cloud and expect
to expand to multi-cloud
60% use cloud for data storage,
48% to improve business
continuity and 44% say it has
increased data security
51. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 12
So What is the Multi-Cloud Ecosystem?
• Three or more interconnected
cloud-based platforms, such as
IaaS, PaaS, or SaaS, private or
public.
• A massive collection of network
accessible services/APIs.
• Managed through a single point
of abstraction, such as a cloud
management platform.
• Becomes a catalyst for the
development of Hybrid IT as well
as Hybrid Cloud architectures
According to Gartner the evolution of Hybrid IT will lead towards the IT organization emerging as a
trusted cloud broker in the Multi-cloud environment
52. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 13
How Does Multi-Cloud Impact the WAN?
• Growth in complex cloud
implementations has increased the
intra- and inter-company networking
requirements.
– Network performance is a key issue
when implementing multi-cloud
solutions.
– Network governance and management
a core concern, as is integrated
security and application performance.
A recent survey of 154 IT decision-makers from enterprises in the United States found that the
majority of organizations have embraced cloud services, but that their networks have kept them from
realizing the full potential of their cloud investments.
53. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 14
Define your
network strategy
in tandem with
your cloud
strategy
Move your
network
investment to
the forefront of
your IT
initiatives
Recognize that
everything you
do will affect
the network
Work with a
strategic
partner. Network
engineering is
not a core
competency of
most companies.
Lessons Learned from Forrester Study regarding Cloud Adoption and the network
54. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 15
Enterprise Cloud Computing
55. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 16
56. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 17
Less Bottlenecks seen in typical
expansion
Expansion and contraction on
demand through Virtualization
Power issues Mitigated
Physical data loss due to
malicious attack reduced
Faster, Cheaper, And Safer
Enterprise Objectives by adopting Cloud Strategy
57. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 18
• Readily Accessible
• Concerns for Dependability and Performance
• Best Efforts (No SLA)
• Need additional engineering for security
Internet
• Scalable
• Secure
• Provides only site to site connectivity
Private Line
• Scalable
• Secure
• Any to Any Site connectivity
• Quality of Service (QOS)
• Service Level Agreements (SLAs)
MPLS (Layer 3 IP-VPNs)
Network Connectivity Options
58. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 19
Nemertes refers to the strategy as the three-tiered WAN architecture.
(The notion behind the three-tiered WAN is that there's no one-size-fits-
all WAN technology. Instead, some technologies and services work
better in certain network tiers than others -- and most organizations
deploy a mix of two or more technologies to cover all three tiers.
59. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 20
The Network Enabled Cloud Vision
MPLS IP-VPN
(“IT Manages the WAN &
the Relationships with
the Cloud providers”)
Enterprise
Branch Site
Customer
Data
Center
Enterprise
HQ SiteAWS
Direct Connect
Equinix
Cloud
Exchange
Open Cloud
Exchange
Additional
Clouds
Customer
Data
Center
Enterprise
Branch Site
Additional
Clouds
:
60. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 21
Amazon Web Services Direct Connect
AWS Connection Options:
• 1 Gbps or 10 Gbps Private Line or MPLS (w/cross-connect)
• Can also leverage Bandwidth on Demand (BoD) option
• 50, 100, 200, 300, 400 & 500 Mbps via NNI connection (no
cross-connect required)
61. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 22
Amazon Web Services Direct Connect
Summary
• MPLS and Private Line options give customers dedicated,
secure, consistent, and reliable access to AWS Cloud services
• Minimizes security concerns when compared to accessing AWS
via the public Internet
• Connection speeds from 50 Mbps to 10 Gbps
• Ability to overlay additional services, including:
• Bandwidth on Demand (BoD)
• Premium Class of Service (CoS)
• Hosted Security
• Applications Performance Management (APM)
• Managed Services
62. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 23
63. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 24
64. Copyright 2013. XO Communications, LLC. All rights reserved. XO, the XO design logo, and all related marks are registered trademarks of XO Communications. 25
ron.zirkin@xo.com
@ronzirkin