What's beyond Virtualization - The Future of Cloud Platforms

2,559 views
2,447 views

Published on

My updated talk om the future of IT at QCon NY

What lies beyond virtualization? How do we start the journey to a secure, composeable, and trusted hybrid platform that truly delivers the business value and velocity we all want?

In the era of software-defined everything, one goal is to reach a fluid infrastructure that has the level of plasticity needed to self heal itself and provide higher level SLAs for applications and services. Adding value to existing applications and services in a transparent fashion requires a rethinking of core technologies in the platform space. In this talk we will take a look at some low level technologies and approaches to achieving this goal. Topics will range from Intelligent layer 7 SDN with semantic awareness, distributed scheduling algorithms, policy distribution and invalidation, health monitoring and management, self healing techniques, and the role of unsupervised deep machine learning and anomaly detection.

Published in: Technology
0 Comments
14 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,559
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
81
Comments
0
Likes
14
Embeds 0
No embeds

No notes for slide

What's beyond Virtualization - The Future of Cloud Platforms

  1. 1. Derek Collison - Apcera, Inc.! @derekcollison! ! June 12, 2014 - QCon New York Beyond Virtualization
  2. 2. @derekcollison QCon NY: “Beyond Virtualization” About ! ! • Architected and built TIBCO Rendezvous and EMS Messaging Systems! • Co-founded AJAX APIs group at Google! • Designed and built Cloud Foundry! • Founder and CEO at Apcera! • Inspiration: Fast Distributed Systems 2 Derek Collison
  3. 3. @derekcollison QCon NY: “Beyond Virtualization” The future of enterprise IT lies beyond virtualization 3
  4. 4. @derekcollison QCon NY: “Beyond Virtualization” Virtualization == 4
  5. 5. @derekcollison QCon NY: “Beyond Virtualization” EVERYTHING is a distributed system these days 5
  6. 6. @derekcollison QCon NY: “Beyond Virtualization” So orchestration and composing systems will define the future 6
  7. 7. @derekcollison QCon NY: “Beyond Virtualization” To look into the future Let’s see where we are 7
  8. 8. @derekcollison QCon NY: “Beyond Virtualization” IT Today 8 Old school Virtualization IaaS IaaS, SaaS, PaaS Cloud ?
  9. 9. @derekcollison QCon NY: “Beyond Virtualization” We care about what’s next 9 ?
  10. 10. @derekcollison QCon NY: “Beyond Virtualization” Automate undifferentiated heavy lifting, speed up the mundane 10
  11. 11. @derekcollison QCon NY: “Beyond Virtualization” Orchestrate Secure and Compliant Composeable Systems 11
  12. 12. @derekcollison QCon NY: “Beyond Virtualization” Align the value to you with the value to your organization 12
  13. 13. @derekcollison QCon NY: “Beyond Virtualization” Build what you need.. 13
  14. 14. @derekcollison QCon NY: “Beyond Virtualization” Assemble the rest 14
  15. 15. @derekcollison QCon NY: “Beyond Virtualization” PaaS helps 15
  16. 16. @derekcollison QCon NY: “Beyond Virtualization” PaaS Helps 16 • Tries to speed up deployment! • Preset, biased approach! • Only a small piece of the puzzle! - Enterprises need lifecycle management, security, compliance, governance, etc.
  17. 17. @derekcollison QCon NY: “Beyond Virtualization” PaaS is Not Enough http://apcera.com/blog/paas-is-not-enough/ 17
  18. 18. @derekcollison QCon NY: “Beyond Virtualization” Docker helps 18
  19. 19. @derekcollison QCon NY: “Beyond Virtualization” Docker Helps 19 • The dawn of the composeable enterprise! • More control over the pieces! • Great Ecosystem!
  20. 20. @derekcollison QCon NY: “Beyond Virtualization” DockerCon Initiatives 20 • libSwarm! • libContainer! • libChan
  21. 21. @derekcollison QCon NY: “Beyond Virtualization” Docker The Future 21 • Identity! • Authorization! • Trust
  22. 22. @derekcollison QCon NY: “Beyond Virtualization” Docker TBDs 22 • How to compose and orchestrate the system?! • etcd? confd?! • Make it transparent! • Don’t make me rewrite! • libSwarm, libChan?! • What about compliance?! • Heartbleed?! • Linux zero-day exploit?! • Tell me if I am compliant! • Tell me what is at risk
  23. 23. @derekcollison QCon NY: “Beyond Virtualization” We Want Things to Just Work 23 • Self Service! • Composeable Systems (legos)! • Faster Iterative Development! • Faster Deployments! • Fault Tolerance! • High Availability! • Guaranteed SLAs
  24. 24. @derekcollison QCon NY: “Beyond Virtualization” We’re getting there 24
  25. 25. @derekcollison QCon NY: “Beyond Virtualization” The Future of IT 25 • Declarative! • Composeable! • Extreme Agility! • Security and Compliance - Transparently! • Fluid and Abstracted Infrastructure and Services! • Multiple delivery models in one system
  26. 26. @derekcollison QCon NY: “Beyond Virtualization” Declarative CCB 26 • App A needs: ! - X memory and Y CPU! - N storage! - I/O SLAs for talking to B and C! - available URL for trusted identities! - run on premise, co-located 
 near B App A B C talks to talks to
  27. 27. @derekcollison QCon NY: “Beyond Virtualization” Intelligent workloads 27 App A
  28. 28. @derekcollison QCon NY: “Beyond Virtualization” Intelligent systems 28 App A
  29. 29. @derekcollison QCon NY: “Beyond Virtualization” Where do we start? 29
  30. 30. @derekcollison QCon NY: “Beyond Virtualization” Required Functionality 30 • What App A needs! ! • Where App A runs! ! • How App A finds B and C! ! • How others find App A! ! • What happens on failures
  31. 31. @derekcollison QCon NY: “Beyond Virtualization” Required Functionality 31 • What App A needs
 Packaging & Dependencies! • Where App A runs Provisioning & Scheduling! • How App A finds B and C Addressing & Discovery! • How others find App A External Mapping! • What happens on failures Monitoring & Management
  32. 32. @derekcollison QCon NY: “Beyond Virtualization” Packaging & Dependencies 32 • What the job needs to run! • Changes from Dev to Prod! • Runtimes, OS, libraries! • Who defines what these are! • Whether existing tools are sufficient for consistency, compliance, auditing! - SCCS and Chef / Puppet! - AMIs or VMDKs! - Docker Images App A DEV PROD runtimes! OS! libraries runtimes! OS! libraries
  33. 33. @derekcollison QCon NY: “Beyond Virtualization” Provisioning & Scheduling 33 • Where workloads run! • Network perimeter security models! • Unit of work: VM, App, Image! • Automatic, instantaneous and transparent policy compliance! • Compliance and deployment handled independently! • New tools: Mesos, Fleet, Diego 500ms10 weeks 2 min. human! behavior ! change Speed
  34. 34. @derekcollison QCon NY: “Beyond Virtualization” Addressing & Discovery 34 • DNS is insufficient - inside! • Needs to fit what we have, without changing apps! • System reacts as things move! • Load balancing! • Scaling up and down ETCD / CONFD External Internal X ✓✓ ✓ ✓ RouterRouter
  35. 35. @derekcollison QCon NY: “Beyond Virtualization” External Mapping • HTTP/TCP connectivity! • How do you find something? ! • Load balancing! • Rapid scaling! • Health monitoring and repair! • DNS sufficient for external, but not internal 35 External Internal X ✓✓ ✓ ✓ RouterRouter
  36. 36. @derekcollison QCon NY: “Beyond Virtualization” Monitoring & Management 36 • What happens when something fails?! • Manual or Automatic?! • Who determines failure and whether we trust the system! • Its sick, not dead! - Latency vs. Chaos monkey! • Measure the effect of change beforehand?! • Extensible & Pluggable BORG / Omega LatencyChaos
  37. 37. @derekcollison QCon NY: “Beyond Virtualization” Bolt-on is not the way to get there 37
  38. 38. @derekcollison QCon NY: “Beyond Virtualization” What we need is a platform OS 38
  39. 39. @derekcollison QCon NY: “Beyond Virtualization” Programmable, pluggable, and composeable from the inside out 39
  40. 40. @derekcollison QCon NY: “Beyond Virtualization” The secure, hybrid, trusted platform OS for multi-datacenter 40
  41. 41. @derekcollison QCon NY: “Beyond Virtualization” A Platform OS 41 • All resources in a common pool! • Real-time networking, addressing, and discovery! • Awareness of ontologies AND communication semantics! • Contextual security and policy just work! • Built for rapid change - all change! • Policy-compliant resource isolation, connectivity, and SLAs CC App A C talks to pattern data behavior policy! on the fly
  42. 42. @derekcollison QCon NY: “Beyond Virtualization” We Have the Right Pieces 42 • Isolation Contexts - Docker! • SDN - Software-Defined Networking! • Management and Resource Pooling (CMPs)! • Intelligent and Compliant Job Scheduling! • Intelligent Canarying, A/B rollouts and testing Just not in one place
  43. 43. @derekcollison QCon NY: “Beyond Virtualization” Isolation Context • Isolation Context: isolated, insulated, autonomous! • Speed and weight! - Hypervisors for virtualization! - LXC, libContainer (containers) - Docker! - Micro-task virtualization! • Google chargeback diversion 43 Faster, more lightweight and purpose-built Virtualization Containerization Micro-task Virtualization
  44. 44. @derekcollison QCon NY: “Beyond Virtualization” SDN - Software-Defined Networking 44 • Network perimeter security! • Application-level changes! • Layer 7 semantics! - How many INSERTS per second from all of App A?! - Can I disallow DROP and DELETE calls between 1-3AM?! • Compliant and transparent network! - It just works, e.g. mobile
  45. 45. @derekcollison QCon NY: “Beyond Virtualization” Intelligent, Compliant Job Scheduling • Pick the best place to run for a given job and policy! • How the system rebalances and utilizes new resources! • Centralized or Distributed algorithms! • How policy affects decision- making (e.g., geography)! • New tools: Mesos, Fleet, Diego 45
  46. 46. @derekcollison QCon NY: “Beyond Virtualization” Intelligent Canarying Prod • Measured rollout success! • A/B testing! • Blue-green deployments ! • Automated rollout and rollback 46 10% traffic Dev 90% traffic App A v1 App A v2 Rollout Rollback
  47. 47. @derekcollison QCon NY: “Beyond Virtualization” Intelligent Canarying • A lot of data needed! - resource utilizations: CPU, Mem, Storage! - communication patterns: cascading effects! - temporal awareness! • All data will feed into automated, anomaly detection services! - Utilizing unsupervised deep machine learning 47
  48. 48. @derekcollison QCon NY: “Beyond Virtualization” The Future of IT - Platform OS 48 Hardware IaaS Diverse Workloads! (e.g., apps, services) Provisioning! Scheduling! Health Monitoring! Addressing! Discovery Governance! Compliance! Security! Automation! Orchestration Internal Services External Services One Platform
  49. 49. @derekcollison QCon NY: “Beyond Virtualization” Summary 49
  50. 50. @derekcollison QCon NY: “Beyond Virtualization” Summary 50 • Composeable platforms! • Intelligent workloads sans code changes! • Policy aware...! - Packaging and Dependency Management ! - Job Scheduling and Provisioning! - Addressing, Discovery, Networking! - Monitoring and Management! - Lifecycle Management and Intelligent Canarying A POLICY OF INNOVATION
  51. 51. @derekcollison QCon NY: “Beyond Virtualization” Resources 51 • Docker - https://www.docker.io! • Mesos - http://mesos.apache.org! • CoreOS - https://coreos.com! • Fleet, Etcd - https://coreos.com/using-coreos/etcd! • Consul - http://www.consul.io! • Continuum - http://apcera.com/continuum
  52. 52. Derek Collison - Apcera, Inc.! @derekcollison! ! June 12, 2014 - QCon New York Thank You

×