CloudCamp

576 views

Published on

CloudCamp presentation by PlanForCloud.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
576
On SlideShare
0
From Embeds
0
Number of Embeds
10
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

CloudCamp

  1. 1. Edinburgh, March 2013 #cloudcampSponsors
  2. 2. ScheduleTime Event18:45-19:45 Lightning talks Use your red cards to stop sales pitches19:45-20:15 Unpanel Use your red cards to change the panel20:15-21:15 Pizza, beer and networking
  3. 3. Lightning talks1.  Ali Khajeh-Hosseini, PlanForCloud/RightScale2.  Per Hammer, JP Morgan Chase3.  Tony Lucas, Flexiant4.  Ian Sommerville, University of St Andrews5.  Philipp Huber, Exception6.  Tom Ray, Cloudreach7.  Sebastien Goasguen, Citrix8.  Duncan Johnston-Watt, Cloudsoft
  4. 4. The cloud has gone mainstream... but what does cloud adoption mean forEnterprise IT and how does the cloud fit into the wider Enterprise IT strategy? Ali Khajeh-Hosseini @AliKhajeh
  5. 5. For startups… the cloud is a no-brainer, they just do it. (innovators and early adopters)
  6. 6. Tech challengesAuto scalingMoving apps between public/private cloudsHigh Availability and Disaster Recovery
  7. 7. We’ve made good progress inaddressing these challenges…And increasingly enterprises areinterested in using clouds BUT…
  8. 8. What are the challenges theyare going to face?Who are the next successstories?
  9. 9. CloudsFor the Enterprise?March 2013Per Hammer1I NI T E R N A L L N L Y Y NTERNA O ONL
  10. 10. Introduction 1. Who Am I? 2. Why Clouds Challenge ‘the Enterprise’ 3. How and Why J.P. Morgan Uses Clouds 4. An Untapped Market 5. A Plea2
  11. 11. Who Am I? Per Hammer • Software architect • J.P. Morgan (aka JPMorganChase) What do I mean by ‘Cloud’ anyway? • Platform-as-a-Service I am a Cloud Customer • Mid-size team • 80 people (60 developers) • Global distribution • Mid-size application • 100+ components • 50+ “logical” JVMs • 200+ JVM instances3
  12. 12. Clouds Challenge the Enterprise “All that data in the Cloud? It’s not in the cloud. It’s on the ground somewhere, probably in Virginia.” Things We Worry About: • Transborder Data Flow • Data Privacy / PII • Latency (Co-location)4
  13. 13. How J.P. Morgan Uses Clouds Not just one Cloud: • VSI (Virtual Server Infrastructure, Iaas) • CBB (Compute Back-bone) • 8,000+ x86 servers, 25,000+ CPU cores • 6,000+ Windows desktops for idle cycle scavenging • 228 TeraFLoPs, #16 on Top 500 Supercomputers (May 2010) • Compute tasks • Portfolio models – large memory • Derivatives – complex products • Risk analysis – stress testing • ABB (Application Back-bone) • Virtual Application servers • Scale horizontally (elastic), and vertically (inelastic) • Multiple data-centres • ATC (Application Testing Cloud) • Virtual Windows desktops on demand!5
  14. 14. An Untapped Market On J.P. Morgan’s Application Back-Bone • 2000+ Enterprise Applications • 500+ Development Teams • Every Line of Business represented • Average application time-to-market improvement of nearly 60 days • 175% increase in infrastructure utilisation, 45% drop in infrastructure costs • 700% boost in developer productivity What about the other financial institutions? What about other industries where traditional (“external”) Clouds are challenging?6
  15. 15. A Plea Separation of duties • No DevOps on Wall Street! You must be command-line friendly!7
  16. 16. Fin Thanks for listening, ask me questions during the unpanel!8
  17. 17. Cloud Camp EdinburghTony Lucas, Founder, Flexiant28 March 2013
  18. 18. Is Cloud…
  19. 19. Or Is Cloud…
  20. 20. Or Is Cloud…
  21. 21. Do You Hide fromCloud?
  22. 22. Do You ‘Cloudwash’What You Already Have?
  23. 23. Do you change to take advantage?
  24. 24. @flexiant @tonylucaswww.flexiant.comCopyright © 2013, Flexiant
  25. 25. Clouds for the enterprise:" It’s not just about the money!! Ian Sommerville" School of Computer Science" University of St Andrews" !Cloudcamp Edinburgh 2013 !Slide 1!
  26. 26. Cloudcamp Edinburgh 2013 !Slide 2!
  27. 27. Cloudcamp Edinburgh 2013 !Slide 3!
  28. 28. Image credit: reputationenforcement.com!Cloudcamp Edinburgh 2013 !Slide 4!
  29. 29. Image credit: www.isaca.org!Cloudcamp Edinburgh 2013 !Slide 5!
  30. 30. www.cyprus-maps.com ! Image credit: www.cyprus-maps.com !Cloudcamp Edinburgh 2013 !Slide 6!
  31. 31. Cloudcamp Edinburgh 2013 !Slide 7! Image credit: goeurope.about.com!
  32. 32. Image credit: prmeetsmarketing.wordpress.com!Cloudcamp Edinburgh 2013 !Slide 8!
  33. 33. Cloudcamp Edinburgh 2013 Image credit: blogs.gartner.com! !Slide 9!
  34. 34. Image credit: www.patrina.com !Cloudcamp Edinburgh 2013 !Slide 10!
  35. 35. Image credit: blog.entitysolutions.com.au!Cloudcamp Edinburgh 2013 !Slide 11!
  36. 36. Image credit: IBM!Cloudcamp Edinburgh 2013 !Slide 12!
  37. 37. Image credit: www.hugthecloud.com!Cloudcamp Edinburgh 2013 !Slide 13!
  38. 38. Image credit: O’Reilly!Cloudcamp Edinburgh 2013 !Slide 14!
  39. 39. Cloudcamp Edinburgh 2013 !Slide 15!
  40. 40. Enterprise “cloud-out” vs.“cloud-in”Philipp HuberPractice Head Cloud ComputingMarch 2013
  41. 41. Back in 2007 things were easy SaaS PaaS IaaS
  42. 42. 5 years forward and …
  43. 43. The Enterprise context!   Gartner predicts a 41.3% compound growth for IaaS through to 2016.!   Biggest growth area in larger Enterprises.
  44. 44. Enterprise IaaS – the two key options SaaS PaaS IaaS “cloud-out” (VMware) vs. “cloud-in” (Amazon) Lydia Leong, Gartner
  45. 45. The IaaS Enterprise optionsThere are two primary ecosystems developing in the world: VMware and Amazon. Other possibilities, like Microsoft andOpenStack, are completely secondary to thosetwo. You can think of VMware as “cloud-out” and Amazon as “cloud-in” approaches.Lydia Leong, April 2012, Gartner
  46. 46. Enterprise IaaS – the two key options SaaS PaaS IaaS Orchestration / Policy based Cloud (VMware) vs. Designed for fail Clouds (Amazon) Massimo Re Ferre, VMware
  47. 47. How are they builtOrchestrated/Policy Cloud Designed for fail Cloud!  Mostly private !   Public (mostly) and private!  Often enterprise hardware !   Build on homogeneous x86!  Enterprise storage commodity hardware!  Resilience built into HW/CMP !   Very simple DAS storage model!  Complex management layer !   Very little HW resilience!  Rather complex to setup !   Relatively easy to setup
  48. 48. CharacteristicsOrchestrated/Policy Cloud Designed for fail Cloud!   Protects existing investment !   Top-down design as service!   Runs legacy Apps unchanged levels determine requirements!   Complete life-cycle !   Re-architect applications to … management of resources !   benefit from cloud paradigm !   scale at an unprecedented level!   Protect existing processes !   offer protection of failed components!   Flexible and extensible !  Simple APIs and self-service!   Feature rich APIs and Admin !  Basic lifecycle management!   ITIL oriented ! DevOps oriented!   Relatively scalable !  Massively scalable!   Highest unit costs !  Lowest unit cost
  49. 49. What does it mean for me!   There is no right or wrong answer !   Your IT legacy will drive you strategy !   Establish you key business drivers – !   cost? scale? global reach? agility?!   Consider a 2-way strategy for IaaS !   Enterprise Cloud (VMware, HP, IBM, Microsoft) AND Elastic Cloud (OpenStack, CloudStack, Eucalyptus) !   Benefits: Best of both worlds, low risk, controlled transition, integrates well into public Cloud
  50. 50. How we help!   Exception can assist organisations in establishing a strategic approach to Cloud adoption through a completely vendor neutral lens.
  51. 51. Thank Youphilipp.huber@exceptionuk.com
  52. 52. So#ware(Defined(Networking( (in(CloudStack( Sebas8en(Goasguen( Citrix,(Apache(CloudStack(commi@er( and(PMC(member( @sebgoa(
  53. 53. CloudStack( Inter CloudStack( net( Management( Server(Zone(1( Towards:(“So#ware( L3 core Defined(Data(Pod(1( Access Layer Pod(N( Centers” ( ( ( Secondary( ….( Storage( Cluster(N( ! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! API!exposes! ….( management!of! Cluster(1( servers,!storage! Host 1 and!network ! ( Primary( Storage( Host 2
  54. 54. SDN(•  Server(Virtualiza8on( –  Hypervisors(•  Storage(Virtualiza8on( –  Distributed(object(store( –  Automa8c(replica8on(•  Network!Virtualiza<on! –  Isolated!guest!network! –  Move!transparently!across!data!centers! –  Op<mize!traffic!
  55. 55. SDN(in(CloudStack(•  Na8ve(in(CloudStack((OVS(controller)( –  GRE(isola8on(type(•  No(OpenFlow(but(a(CloudStack(controller( –  Programs(the(Open(Vswitch( –  Supported(in(XenServer( –  Creates(L2(overlays(within(the(datacenter( –  Creates(L2(overlays(across(Zones(
  56. 56. Create(Overlay(L2( Networks (Tenant1( !  Create(Full(Mesh(of(GRE(Tenant2( tunnels((if(they(dont(already( exist)(between(hosts(on(which( Host(1( Host(3( VMs(are(deployed( V V V V M( M( M( R( !  CloudStack(SDN(controller( 1( 1( 3( programs(the(Open(vSwitch( (OVS)(on(XenServer(to(GRE(Tunnel( configure(GRE(tunnels( !  Assign(Tenant(key(to(the( customer(that(allows(traffic( isola8on(from(other(tenants( Host(2( Host(4( V M( V M( V M( V !  New(customers(can(share(the( 2( 2( 3( R( established(GRE(tunnels(with( separate(tenant(keys(GRE(Tunnel( GRE(Tunnel(
  57. 57. SDN(“support”:(Nicira(•  Nicira(NVP(Plugin( –  Xen( –  NVP(versions:( 2.1.0,(2.2.0(and( 2.2.1( –  In(4.0.( –  KVM(support(and( UI(planned(for(4.1(
  58. 58. Future(SDN(“support” (•  Development(underway(from(Big(Switch( –  Will(support(BigSwitch(products( –  Floodlight(Open(Source(Open(Flow(controller( –  In(master(branch,(planned(for((4.2(release(
  59. 59. SDN(“support”(Midonet (•  In(master(branch,(expected(for(4.2(•  Announced(December(21st…(
  60. 60. Using cloud without losing control™Autonomic computing and why you should care …
  61. 61. AMP Features & Benefits•  Cloudsoft’s Application Management Platform (AMP) … •  Enterprise version of the brooklyn open source project •  See http://brooklyncentral.github.com/•  Automates Application Deployment and Configuration •  Implementation details are abstracted into reusable blueprints •  Streamlines and enhances existing tooling•  Optimizes Application Runtime Management •  Driven by your technical and business policies •  Autonomic control plane•  Ensures Application Portability •  Frees the business to exploit a multi-provider strategy •  Avoids vendor lock-in© 2013 Cloudsoft Corporation 28/03/2013 Page: 2
  62. 62. Using cloud without losing control™ Autonomic computing … in theory
  63. 63. AMP Key Concepts•  Entity •  Always exposes a sensor / effector interface •  Abstract – AMP specific construct e.g. Cluster, Fabric •  Concrete – Proxy for real world construct e.g. JBoss7Server, MySQL•  Driver •  Pluggable (often customer specific) mechanism for implementing concrete entity e.g. software component•  Sensors & Effectors •  Sensors publish attributes of an entity (either periodically or on change) •  Effectors invoke operations on an entity (to change it in some way) •  Existing metrics and APIs are used to ensure non-intrusive (agentless) integration and management of a concrete entity© 2013 Cloudsoft Corporation 28/03/2013 Page: 4
  64. 64. AMP Key Concepts•  Topology •  Entity wiring, groupings and management hierarchy•  Policy •  Governs an application’s behaviour e.g. horizontal scaling within a tier•  Blueprint •  Captures an application’s initial topology plus policies that will change this over time•  Location •  Target environment for blueprint instantiation© 2013 Cloudsoft Corporation 28/03/2013 Page: 5
  65. 65. Autonomic Management (M-A-P-E) Escalate Delegate Enrich Sensors Effectors Analyze Plan Autonomic Manager* Monitor Execute State Sensors Effectors Managed Element *An autonomic manager can be a managed element© 2013 Cloudsoft Corporation 28/03/2013 Page: 6
  66. 66. Hierarchical Autonomic Management Granularity can be anything from individual application to overall control plane© 2013 Cloudsoft Corporation 28/03/2013 Page: 7
  67. 67. Multi-Tier Application Multi-Tier Application Need to update targets Load Balanced Cluster to match cluster NGINX OS Cluster Need to specify autoscaling policy JBoss7Server OS … JBoss7Server OS Need to publish MySQL URL for cluster MySQL OS There has to be a better way than scripting …Strictly Confidential © 2013 Cloudsoft Corporation 28/03/2013 Page: 8
  68. 68. MyWebCluster – Topology MyWebCluster MySQL ControlledDynamicWebAppCluster MySQL and NGINX could be swapped out for their clustered variants NGINX DynamicWebAppCluster Here we explicitly model the app’s organizational structure JBoss7Server … JBoss7Server Abstract Entities Autonomic Managers - AMP specific constructs or building blocks Concrete Entities Managed Elements - AMP proxies for real world components© 2013 Cloudsoft Corporation 28/03/2013 Page: 9
  69. 69. MyWebCluster – Blueprint MyWebCluster MySQL ControlledDynamicWebAppCluster [targets] is a built in policy whereas the auto scaling [targets] Auto Scaler Policy policy is explicitly added NGINX DynamicWebAppCluster An application blueprint is completely portable JBoss7Server … JBoss7Server Policies Attached to entities they effect but can subscribe to any sensor© 2013 Cloudsoft Corporation 28/03/2013 Page: 10
  70. 70. MyWebCluster – Customization MyWebCluster MySQL ControlledDynamicWebAppCluster MySQL [targets] Auto Scaler Policy NGINX DynamicWebAppCluster NGINX The pluggable driver mechanism is an JBoss7Server … JBoss7Server elegant way to customize a blueprint for a particular environment JBoss7Server … JBoss7Server Drivers Customer specific implementations (Bash, Puppet, Chef etc.)© 2013 Cloudsoft Corporation 28/03/2013 Page: 11
  71. 71. MyWebCluster – Instantiation Location + MyWebCluster MySQL ControlledDynamicWebAppCluster MySQL OS [targets] Auto Scaler Policy NGINX DynamicWebAppCluster NGINX OS JBoss7Server … JBoss7Server JBoss7Server … JBoss7Server OS … OS Instances Location dependent – can be virtual machine, LXC etc.© 2013 Cloudsoft Corporation 28/03/2013 Page: 12
  72. 72. MongoDB @ Ballone Castle© 2013 Cloudsoft Corporation 28/03/2013 Page: 13
  73. 73. Using cloud without losing control™ Autonomic computing … in practice
  74. 74. Define New Blueprint public class MyWebCluster extends AbstractApplication 
 implements MyWebClusterConstants { // TODO build the application } This provides basic lifecycle management © 2013 Cloudsoft Corporation 28/03/2013 Page: 15
  75. 75. Create App Tier public class MyWebCluster extends AbstractApplication 
 implements MyWebClusterConstants { def web = new JBoss7Server(this, war: WAR_PATH); { web.configure(httpPort: "8080+"); } } Use the first available port 8080 or above © 2013 Cloudsoft Corporation 28/03/2013 Page: 16
  76. 76. Add DB Tier public class MyWebCluster extends AbstractApplication 
 implements MyWebClusterConstants { def web = new JBoss7Server(this, war: WAR_PATH); MySqlNode mysql = new MySqlNode(this, creationScriptUrl: DB_SETUP_SQL_URL); { web.configure(httpPort: "8080+"); } Now we need to wire } up these two tiers © 2013 Cloudsoft Corporation 28/03/2013 Page: 17
  77. 77. Wire up App and DB Tiers public class MyWebCluster extends AbstractApplication 
 implements MyWebClusterConstants { def web = new JBoss7Server(this, war: WAR_PATH); MySqlNode mysql = new MySqlNode(this, creationScriptUrl: DB_SETUP_SQL_URL); { web.configure(httpPort: "8080+"). configure(javaSysProp("brooklyn.example.db.url"), valueWhenAttributeReady(mysql, MySqlNode.MYSQL_URL, this.&makeJdbcUrl)); } } Stored as a Java future Soft wiring using so no explicit join sensor event© 2013 Cloudsoft Corporation 28/03/2013 Page: 18
  78. 78. Introduce Elasticity in App Tier Substitute cluster as it has same signature public class MyWebCluster extends AbstractApplication 
 implements MyWebClusterConstants { def web = new ControlledDynamicWebAppCluster(this, war: WAR_PATH); MySqlNode mysql = new MySqlNode(this, creationScriptUrl: DB_SETUP_SQL_URL); { web.factory.configure(httpPort: "8080+"). configure(javaSysProp("brooklyn.example.db.url"), valueWhenAttributeReady(mysql, MySqlNode.MYSQL_URL, this.&makeJdbcUrl)); } } Now configure WebAppServer factory © 2013 Cloudsoft Corporation 28/03/2013 Page: 19
  79. 79. Manage Elasticity in App Tier public class MyWebCluster extends AbstractApplication 
 implements MyWebClusterConstants { def web = new ControlledDynamicWebAppCluster(this, war: WAR_PATH); MySqlNode mysql = new MySqlNode(this, creationScriptUrl: DB_SETUP_SQL_URL); { web.factory.configure(httpPort: "8080+"). configure(javaSysProp("brooklyn.example.db.url"), valueWhenAttributeReady(mysql, MySqlNode.MYSQL_URL, this.&makeJdbcUrl)); web.cluster.addPolicy( new AutoscalerPolicy(DynamicWebAppCluster.AVERAGE_REQUESTS_PER_SECOND). setSizeRange(1, 5). setMetricRange(10, 100)); } } Autonomic policy attached to Cluster© 2013 Cloudsoft Corporation 28/03/2013 Page: 20
  80. 80. MyWebCluster – Blueprint MyWebCluster MySQL ControlledDynamicWebAppCluster [targets] is a built in policy whereas the auto scaling [targets] Auto Scaler Policy policy is explicitly added NGINX DynamicWebAppCluster An application blueprint is completely portable JBoss7Server … JBoss7Server Policies Attached to entities they effect but can subscribe to any sensor© 2013 Cloudsoft Corporation 28/03/2013 Page: 21
  81. 81. Try it!© 2013 Cloudsoft Corporation 28/03/2013 Page: 22
  82. 82. Using Cloud Without Losing Control™Strictly Confidential © 2012 Cloudsoft Corporation 28/03/2013 Page: 23
  83. 83. Useful links•  http://brooklyncentral.github.com/•  http://www.youtube.com/watch?v=XkwQ6EjLdMQ•  http://www.youtube.com/watch?v=kzw1_2b-I7AStrictly Confidential © 2013 Cloudsoft Corporation 28/03/2013 Page: 24
  84. 84. Thank you for your time duncan@cloudsoftcorp.com @duncanjw

×