CloudCamp

Edinburgh, March 2013

#cloudcamp
Sponsors

Schedule
Time Event
18:45-19:45 Lightning talks
Use your red cards to stop sales pitches

19:45-20:15 Unpanel
Use your red cards to change the panel

20:15-21:15 Pizza, beer and networking

Lightning talks
1.  Ali Khajeh-Hosseini, PlanForCloud/RightScale
2.  Per Hammer, JP Morgan Chase
3.  Tony Lucas, Flexiant
4.  Ian Sommerville, University of St Andrews
5.  Philipp Huber, Exception
6.  Tom Ray, Cloudreach
7.  Sebastien Goasguen, Citrix
8.  Duncan Johnston-Watt, Cloudsoft

The cloud has gone mainstream...
but what does cloud adoption mean for
Enterprise IT and how does the cloud fit into
the wider Enterprise IT strategy?

Ali Khajeh-Hosseini

@AliKhajeh

For startups…
the cloud is a no-brainer,
they just do it.
(innovators and early adopters)

Tech challenges
Auto scaling
Moving apps between public/private clouds
High Availability and Disaster Recovery

We’ve made good progress in
addressing these challenges…

And increasingly enterprises are
interested in using clouds BUT…

What are the challenges they
are going to face?

Who are the next success
stories?

Clouds
For the Enterprise?

March 2013
Per Hammer

1I NI T E R N A L L N L Y Y
NTERNA O ONL

Introduction

1. Who Am I?
2. Why Clouds Challenge ‘the Enterprise’
3. How and Why J.P. Morgan Uses Clouds
4. An Untapped Market
5. A Plea

2

Who Am I?

Per Hammer
• Software architect
• J.P. Morgan (aka JPMorganChase)

What do I mean by ‘Cloud’ anyway?
• Platform-as-a-Service

I am a Cloud Customer
• Mid-size team
• 80 people (60 developers)
• Global distribution
• Mid-size application
• 100+ components
• 50+ “logical” JVMs
• 200+ JVM instances

3

Clouds Challenge the Enterprise

“All that data in the Cloud? It’s not in the cloud. It’s on the ground somewhere, probably in
Virginia.”

Things We Worry About:
• Transborder Data Flow
• Data Privacy / PII
• Latency (Co-location)

4

How J.P. Morgan Uses Clouds

Not just one Cloud:
• VSI (Virtual Server Infrastructure, Iaas)
• CBB (Compute Back-bone)
• 8,000+ x86 servers, 25,000+ CPU cores
• 6,000+ Windows desktops for idle cycle scavenging
• 228 TeraFLoPs, #16 on Top 500 Supercomputers (May 2010)
• Compute tasks
• Portfolio models – large memory
• Derivatives – complex products
• Risk analysis – stress testing
• ABB (Application Back-bone)
• Virtual Application servers
• Scale horizontally (elastic), and vertically (inelastic)
• Multiple data-centres
• ATC (Application Testing Cloud)
• Virtual Windows desktops on demand!

5

An Untapped Market

On J.P. Morgan’s Application Back-Bone
• 2000+ Enterprise Applications
• 500+ Development Teams
• Every Line of Business represented
• Average application time-to-market improvement of nearly 60 days
• 175% increase in infrastructure utilisation, 45% drop in infrastructure costs
• 700% boost in developer productivity

What about the other financial institutions? What about other industries where traditional
(“external”) Clouds are challenging?

6

A Plea

Separation of duties
• No DevOps on Wall Street!

You must be command-line friendly!

7

Fin

Thanks for listening, ask me questions during the unpanel!

8

Cloud Camp Edinburgh
Tony Lucas, Founder, Flexiant
28 March 2013

Do You ‘Cloudwash’
What You Already Have?

Do you change to take
advantage?

@flexiant

@tonylucas

www.flexiant.com
Copyright © 2013, Flexiant

Clouds for the enterprise:"
It’s not just about the money!!

Ian Sommerville"
School of Computer Science"
University of St Andrews"
!

Cloudcamp Edinburgh 2013 !Slide 1!

Image credit: reputationenforcement.com!

Image credit: www.isaca.org!

www.cyprus-maps.com !

Image credit: www.cyprus-maps.com !

Image credit: goeurope.about.com!

Image credit: prmeetsmarketing.wordpress.com!


Cloudcamp Edinburgh 2013
Image credit: blogs.gartner.com! !Slide 9!

Image credit: www.patrina.com !


Image credit: blog.entitysolutions.com.au!

Image credit: IBM!


Image credit: www.hugthecloud.com!


Image credit: O’Reilly!


Enterprise “cloud-out” vs.
“cloud-in”

Philipp Huber
Practice Head Cloud Computing
March 2013

Back in 2007 things were easy

SaaS

PaaS

IaaS

The Enterprise context

!   Gartner predicts a 41.3% compound growth
for IaaS through to 2016.

!   Biggest growth area in larger Enterprises.

Enterprise IaaS – the two key options

SaaS

PaaS

IaaS

“cloud-out”
(VMware)
vs.
“cloud-in”
(Amazon)

Lydia Leong, Gartner

The IaaS Enterprise options

There are two primary ecosystems developing
in the world: VMware and Amazon.
Other possibilities, like Microsoft and
OpenStack, are completely secondary to those
two. You can think of VMware as “cloud-out”
and Amazon as “cloud-in” approaches.
Lydia Leong, April 2012, Gartner

Enterprise IaaS – the two key options

SaaS

PaaS

IaaS

Orchestration / Policy based
Cloud (VMware)
vs.
Designed for fail Clouds
(Amazon)

Massimo Re Ferre, VMware

How are they built

Orchestrated/Policy Cloud Designed for fail Cloud
!  Mostly private !   Public (mostly) and private
!  Often enterprise hardware !   Build on homogeneous x86
!  Enterprise storage commodity hardware
!  Resilience built into HW/CMP !   Very simple DAS storage model
!  Complex management layer !   Very little HW resilience
!  Rather complex to setup !   Relatively easy to setup

Characteristics

Orchestrated/Policy Cloud Designed for fail Cloud
!   Protects existing investment !   Top-down design as service
!   Runs legacy Apps unchanged levels determine requirements
!   Complete life-cycle !   Re-architect applications to …
management of resources !   benefit from cloud paradigm
!   scale at an unprecedented level
!   Protect existing processes
!   offer protection of failed components
!   Flexible and extensible
!  Simple APIs and self-service
!   Feature rich APIs and Admin
!  Basic lifecycle management
!   ITIL oriented
! DevOps oriented
!   Relatively scalable
!  Massively scalable
!   Highest unit costs
!  Lowest unit cost

What does it mean for me

!   There is no right or wrong answer
!   Your IT legacy will drive you strategy
!   Establish you key business drivers –
!   cost? scale? global reach? agility?

!   Consider a 2-way strategy for IaaS
!   Enterprise Cloud (VMware, HP, IBM, Microsoft) AND
Elastic Cloud (OpenStack, CloudStack, Eucalyptus)
!   Benefits: Best of both worlds, low risk, controlled
transition, integrates well into public Cloud

How we help

!   Exception can assist organisations in
establishing a strategic approach to Cloud
adoption through a completely vendor
neutral lens.

Thank You
philipp.huber@exceptionuk.com

So#ware(Deﬁned(Networking(
(in(CloudStack(
Sebas8en(Goasguen(
Citrix,(Apache(CloudStack(commi@er(
and(PMC(member(
@sebgoa(

CloudStack(
Inter
CloudStack( net(
Management(
Server(
Zone(1( Towards:(“So#ware(
L3 core Deﬁned(Data(
Pod(1( Access Layer Pod(N(
Centers” (
(
(
Secondary(
….( Storage(
Cluster(N(
!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
API!exposes!
….( management!of!
Cluster(1(
servers,!storage!
Host 1 and!network !
(
Primary(
Storage(
Host 2

SDN(
•  Server(Virtualiza8on(
–  Hypervisors(
•  Storage(Virtualiza8on(
–  Distributed(object(store(
–  Automa8c(replica8on(
•  Network!Virtualiza<on!
–  Isolated!guest!network!
–  Move!transparently!across!data!centers!
–  Op<mize!traﬃc!

SDN(in(CloudStack(

•  Na8ve(in(CloudStack((OVS(controller)(
–  GRE(isola8on(type(
•  No(OpenFlow(but(a(CloudStack(controller(
–  Programs(the(Open(Vswitch(
–  Supported(in(XenServer(
–  Creates(L2(overlays(within(the(datacenter(
–  Creates(L2(overlays(across(Zones(

Create(Overlay(L2(
Networks (
Tenant1( !  Create(Full(Mesh(of(GRE(
Tenant2( tunnels((if(they(don't(already(
exist)(between(hosts(on(which(
Host(1( Host(3( VMs(are(deployed(
V V V
V
M( M( M(
R(
!  CloudStack(SDN(controller(
1( 1( 3(
programs(the(Open(vSwitch(
(OVS)(on(XenServer(to(
GRE(Tunnel( conﬁgure(GRE(tunnels(

!  Assign('Tenant'(key(to(the(
customer(that(allows(traﬃc(
isola8on(from(other(tenants(
Host(2( Host(4(
V
M(
V
M(
V
M(
V !  New(customers(can(share(the(
2( 2( 3( R( established(GRE(tunnels(with(
separate(tenant(keys(
GRE(Tunnel( GRE(Tunnel(

SDN(“support”:(Nicira(

•  Nicira(NVP(Plugin(
–  Xen(
–  NVP(versions:(
2.1.0,(2.2.0(and(
2.2.1(
–  In(4.0.(
–  KVM(support(and(
UI(planned(for(4.1(

Future(SDN(“support”
(
•  Development(underway(from(Big(Switch(
–  Will(support(BigSwitch(products(
–  Floodlight(Open(Source(Open(Flow(controller(
–  In(master(branch,(planned(for((4.2(release(

SDN(“support”(Midonet
(
•  In(master(branch,(expected(for(4.2(
•  Announced(December(21st…(

Using cloud without losing control™
Autonomic computing and why you should care …

AMP Features & Benefits

•  Cloudsoft’s Application Management Platform (AMP) …
•  Enterprise version of the brooklyn open source project
•  See http://brooklyncentral.github.com/

•  Automates Application Deployment and Configuration
•  Implementation details are abstracted into reusable blueprints
•  Streamlines and enhances existing tooling

•  Optimizes Application Runtime Management
•  Driven by your technical and business policies
•  Autonomic control plane

•  Ensures Application Portability
•  Frees the business to exploit a multi-provider strategy
•  Avoids vendor lock-in

© 2013 Cloudsoft Corporation 28/03/2013 Page: 2

Autonomic computing … in theory

AMP Key Concepts

•  Entity
•  Always exposes a sensor / effector interface
•  Abstract – AMP specific construct e.g. Cluster, Fabric
•  Concrete – Proxy for real world construct e.g. JBoss7Server, MySQL

•  Driver
•  Pluggable (often customer specific) mechanism for implementing
concrete entity e.g. software component

•  Sensors & Effectors
•  Sensors publish attributes of an entity (either periodically or on change)
•  Effectors invoke operations on an entity (to change it in some way)
•  Existing metrics and APIs are used to ensure non-intrusive (agentless)
integration and management of a concrete entity


AMP Key Concepts

•  Topology
•  Entity wiring, groupings and management hierarchy

•  Policy
•  Governs an application’s behaviour e.g. horizontal scaling within a tier

•  Blueprint
•  Captures an application’s initial topology plus policies that will change
this over time

•  Location
•  Target environment for blueprint instantiation


Autonomic Management (M-A-P-E)

Escalate Delegate
Enrich
Sensors Effectors
Analyze Plan
Autonomic
Manager* Monitor Execute
State

Sensors Effectors
Managed
Element

*An autonomic manager can be a managed element

Hierarchical Autonomic Management

Granularity can be anything from individual application to overall control plane

Multi-Tier Application

Multi-Tier Application
Need to update targets
Load Balanced Cluster to match cluster
NGINX
OS

Cluster
Need to specify
autoscaling policy
JBoss7Server
OS
… JBoss7Server
OS

Need to publish MySQL
URL for cluster
MySQL
OS There has to be a better
way than scripting …
Strictly Confidential © 2013 Cloudsoft Corporation 28/03/2013 Page: 8

MyWebCluster – Topology
MyWebCluster

MySQL ControlledDynamicWebAppCluster

MySQL and NGINX could
be swapped out for their
clustered variants
NGINX DynamicWebAppCluster

Here we explicitly model the
app’s organizational structure JBoss7Server … JBoss7Server

Abstract Entities Autonomic Managers - AMP specific constructs or building blocks

Concrete Entities Managed Elements - AMP proxies for real world components


MyWebCluster – Blueprint
MyWebCluster


[targets] is a built in policy
whereas the auto scaling
[targets] Auto Scaler Policy
policy is explicitly added

An application blueprint is
completely portable JBoss7Server … JBoss7Server

Policies Attached to entities they effect but can subscribe to any sensor


MyWebCluster – Customization
MyWebCluster


MySQL


NGINX

The pluggable driver mechanism is an JBoss7Server … JBoss7Server
elegant way to customize a blueprint
for a particular environment JBoss7Server … JBoss7Server

Drivers Customer specific implementations (Bash, Puppet, Chef etc.)


MyWebCluster – Instantiation
Location + MyWebCluster


MySQL

OS [targets] Auto Scaler Policy

NGINX

OS
JBoss7Server … JBoss7Server

JBoss7Server … JBoss7Server

OS … OS
Instances Location dependent – can be virtual machine, LXC etc.

MongoDB @ Ballone Castle


Autonomic computing … in practice

Define New Blueprint

public class MyWebCluster extends AbstractApplication  
implements MyWebClusterConstants {

// TODO build the application

} This provides basic
lifecycle management


Create App Tier


def web = new JBoss7Server(this, war: WAR_PATH);

{
web.configure(httpPort: "8080+");
}

}

Use the first available

port 8080 or above


Add DB Tier


MySqlNode mysql = new MySqlNode(this, creationScriptUrl: DB_SETUP_SQL_URL);

{
web.configure(httpPort: "8080+");
}
Now we need to wire
}

up these two tiers


Wire up App and DB Tiers



{
web.configure(httpPort: "8080+").
configure(javaSysProp("brooklyn.example.db.url"),
valueWhenAttributeReady(mysql, MySqlNode.MYSQL_URL, this.&makeJdbcUrl));
}

}

Stored as a Java future Soft wiring using

so no explicit join sensor event


Introduce Elasticity in App Tier

Substitute cluster as it
has same signature


def web = new ControlledDynamicWebAppCluster(this, war: WAR_PATH);

{
web.factory.configure(httpPort: "8080+").
}

} Now configure

WebAppServer factory


Manage Elasticity in App Tier


def web = new ControlledDynamicWebAppCluster(this, war: WAR_PATH);

{
web.factory.configure(httpPort: "8080+").

web.cluster.addPolicy(
new AutoscalerPolicy(DynamicWebAppCluster.AVERAGE_REQUESTS_PER_SECOND).
setSizeRange(1, 5).
setMetricRange(10, 100));
}

}
Autonomic policy
attached to Cluster


MyWebCluster – Blueprint
MyWebCluster


[targets] is a built in policy
whereas the auto scaling
policy is explicitly added

An application blueprint is
completely portable JBoss7Server … JBoss7Server

Policies Attached to entities they effect but can subscribe to any sensor


Try it!


Using Cloud Without Losing Control™


Useful links

•  http://brooklyncentral.github.com/
•  http://www.youtube.com/watch?v=XkwQ6EjLdMQ
•  http://www.youtube.com/watch?v=kzw1_2b-I7A


Thank you for your time
duncan@cloudsoftcorp.com
@duncanjw

CloudCamp

Recommended

Recommended

More Related Content

What's hot

What's hot (17)

Viewers also liked

Viewers also liked (8)

Similar to CloudCamp

Similar to CloudCamp (20)

More from RightScale

More from RightScale (20)

Recently uploaded

Recently uploaded (20)

CloudCamp