0
Derek Collison - Apcera, Inc.!
@derekcollison!
!
June 12, 2014 - QCon New York
Beyond Virtualization
@derekcollison QCon NY: “Beyond Virtualization”
About
!
!
• Architected and built TIBCO Rendezvous
and EMS Messaging Syste...
@derekcollison QCon NY: “Beyond Virtualization”
The future of enterprise IT lies
beyond virtualization
3
@derekcollison QCon NY: “Beyond Virtualization”
Virtualization ==
4
@derekcollison QCon NY: “Beyond Virtualization”
EVERYTHING is a distributed
system these days
5
@derekcollison QCon NY: “Beyond Virtualization”
So orchestration and composing
systems will define the future
6
@derekcollison QCon NY: “Beyond Virtualization”
To look into the future
Let’s see where we are
7
@derekcollison QCon NY: “Beyond Virtualization”
IT Today
8
Old school Virtualization IaaS IaaS, SaaS, PaaS Cloud
?
@derekcollison QCon NY: “Beyond Virtualization”
We care about what’s next
9
?
@derekcollison QCon NY: “Beyond Virtualization”
Automate undifferentiated
heavy lifting, speed up the
mundane
10
@derekcollison QCon NY: “Beyond Virtualization”
Orchestrate Secure
and Compliant 
Composeable Systems
11
@derekcollison QCon NY: “Beyond Virtualization”
Align the value to you with
the value to your organization
12
@derekcollison QCon NY: “Beyond Virtualization”
Build what you need..
13
@derekcollison QCon NY: “Beyond Virtualization”
Assemble the rest
14
@derekcollison QCon NY: “Beyond Virtualization”
PaaS helps
15
@derekcollison QCon NY: “Beyond Virtualization”
PaaS Helps
16
• Tries to speed up deployment!
• Preset, biased approach!
•...
@derekcollison QCon NY: “Beyond Virtualization”
PaaS is Not Enough

http://apcera.com/blog/paas-is-not-enough/
17
@derekcollison QCon NY: “Beyond Virtualization”
Docker helps
18
@derekcollison QCon NY: “Beyond Virtualization”
Docker Helps
19
• The dawn of the composeable
enterprise!
• More control o...
@derekcollison QCon NY: “Beyond Virtualization”
DockerCon Initiatives
20
• libSwarm!
• libContainer!
• libChan
@derekcollison QCon NY: “Beyond Virtualization”
Docker The Future
21
• Identity!
• Authorization!
• Trust
@derekcollison QCon NY: “Beyond Virtualization”
Docker TBDs
22
• How to compose and
orchestrate the system?!
• etcd? confd...
@derekcollison QCon NY: “Beyond Virtualization”
We Want Things to Just Work
23
• Self Service!
• Composeable Systems (lego...
@derekcollison QCon NY: “Beyond Virtualization”
We’re getting there
24
@derekcollison QCon NY: “Beyond Virtualization”
The Future of IT
25
• Declarative!
• Composeable!
• Extreme Agility!
• Sec...
@derekcollison QCon NY: “Beyond Virtualization”
Declarative
CCB
26
• App A needs: !
- X memory and Y CPU!
- N storage!
- I...
@derekcollison QCon NY: “Beyond Virtualization”
Intelligent workloads
27
App A
@derekcollison QCon NY: “Beyond Virtualization”
Intelligent systems
28
App A
@derekcollison QCon NY: “Beyond Virtualization”
Where do we start?
29
@derekcollison QCon NY: “Beyond Virtualization”
Required Functionality
30
• What App A needs!
!
• Where App A runs!
!
• Ho...
@derekcollison QCon NY: “Beyond Virtualization”
Required Functionality
31
• What App A needs

Packaging & Dependencies!
• ...
@derekcollison QCon NY: “Beyond Virtualization”
Packaging & Dependencies
32
• What the job needs to run!
• Changes from De...
@derekcollison QCon NY: “Beyond Virtualization”
Provisioning & Scheduling
33
• Where workloads run!
• Network perimeter se...
@derekcollison QCon NY: “Beyond Virtualization”
Addressing & Discovery
34
• DNS is insufficient - inside!
• Needs to fit wha...
@derekcollison QCon NY: “Beyond Virtualization”
External Mapping
• HTTP/TCP connectivity!
• How do you find something? !
• ...
@derekcollison QCon NY: “Beyond Virtualization”
Monitoring & Management
36
• What happens when
something fails?!
• Manual ...
@derekcollison QCon NY: “Beyond Virtualization”
Bolt-on is not the way to get
there
37
@derekcollison QCon NY: “Beyond Virtualization”
What we need is a platform OS
38
@derekcollison QCon NY: “Beyond Virtualization”
Programmable, pluggable, and
composeable from the inside
out
39
@derekcollison QCon NY: “Beyond Virtualization”
The secure, hybrid, trusted
platform OS for multi-datacenter
40
@derekcollison QCon NY: “Beyond Virtualization”
A Platform OS
41
• All resources in a common pool!
• Real-time networking,...
@derekcollison QCon NY: “Beyond Virtualization”
We Have the Right Pieces
42
• Isolation Contexts - Docker!
• SDN - Softwar...
@derekcollison QCon NY: “Beyond Virtualization”
Isolation Context
• Isolation Context: isolated, insulated, autonomous!
• ...
@derekcollison QCon NY: “Beyond Virtualization”
SDN - Software-Defined Networking
44
• Network perimeter security!
• Applic...
@derekcollison QCon NY: “Beyond Virtualization”
Intelligent, Compliant Job Scheduling
• Pick the best place to run for a
g...
@derekcollison QCon NY: “Beyond Virtualization”
Intelligent Canarying
Prod
• Measured rollout success!
• A/B testing!
• Bl...
@derekcollison QCon NY: “Beyond Virtualization”
Intelligent Canarying
• A lot of data needed!
- resource utilizations: CPU...
@derekcollison QCon NY: “Beyond Virtualization”
The Future of IT - Platform OS
48
Hardware
IaaS
Diverse Workloads!
(e.g., ...
@derekcollison QCon NY: “Beyond Virtualization”
Summary
49
@derekcollison QCon NY: “Beyond Virtualization”
Summary
50
• Composeable platforms!
• Intelligent workloads sans code
chan...
@derekcollison QCon NY: “Beyond Virtualization”
Resources
51
• Docker - https://www.docker.io!
• Mesos - http://mesos.apac...
Derek Collison - Apcera, Inc.!
@derekcollison!
!
June 12, 2014 - QCon New York
Thank You
Upcoming SlideShare
Loading in...5
×

What's beyond Virtualization - The Future of Cloud Platforms

2,091

Published on

My updated talk om the future of IT at QCon NY

What lies beyond virtualization? How do we start the journey to a secure, composeable, and trusted hybrid platform that truly delivers the business value and velocity we all want?

In the era of software-defined everything, one goal is to reach a fluid infrastructure that has the level of plasticity needed to self heal itself and provide higher level SLAs for applications and services. Adding value to existing applications and services in a transparent fashion requires a rethinking of core technologies in the platform space. In this talk we will take a look at some low level technologies and approaches to achieving this goal. Topics will range from Intelligent layer 7 SDN with semantic awareness, distributed scheduling algorithms, policy distribution and invalidation, health monitoring and management, self healing techniques, and the role of unsupervised deep machine learning and anomaly detection.

Published in: Technology

Transcript of "What's beyond Virtualization - The Future of Cloud Platforms"

  1. 1. Derek Collison - Apcera, Inc.! @derekcollison! ! June 12, 2014 - QCon New York Beyond Virtualization
  2. 2. @derekcollison QCon NY: “Beyond Virtualization” About ! ! • Architected and built TIBCO Rendezvous and EMS Messaging Systems! • Co-founded AJAX APIs group at Google! • Designed and built Cloud Foundry! • Founder and CEO at Apcera! • Inspiration: Fast Distributed Systems 2 Derek Collison
  3. 3. @derekcollison QCon NY: “Beyond Virtualization” The future of enterprise IT lies beyond virtualization 3
  4. 4. @derekcollison QCon NY: “Beyond Virtualization” Virtualization == 4
  5. 5. @derekcollison QCon NY: “Beyond Virtualization” EVERYTHING is a distributed system these days 5
  6. 6. @derekcollison QCon NY: “Beyond Virtualization” So orchestration and composing systems will define the future 6
  7. 7. @derekcollison QCon NY: “Beyond Virtualization” To look into the future Let’s see where we are 7
  8. 8. @derekcollison QCon NY: “Beyond Virtualization” IT Today 8 Old school Virtualization IaaS IaaS, SaaS, PaaS Cloud ?
  9. 9. @derekcollison QCon NY: “Beyond Virtualization” We care about what’s next 9 ?
  10. 10. @derekcollison QCon NY: “Beyond Virtualization” Automate undifferentiated heavy lifting, speed up the mundane 10
  11. 11. @derekcollison QCon NY: “Beyond Virtualization” Orchestrate Secure and Compliant Composeable Systems 11
  12. 12. @derekcollison QCon NY: “Beyond Virtualization” Align the value to you with the value to your organization 12
  13. 13. @derekcollison QCon NY: “Beyond Virtualization” Build what you need.. 13
  14. 14. @derekcollison QCon NY: “Beyond Virtualization” Assemble the rest 14
  15. 15. @derekcollison QCon NY: “Beyond Virtualization” PaaS helps 15
  16. 16. @derekcollison QCon NY: “Beyond Virtualization” PaaS Helps 16 • Tries to speed up deployment! • Preset, biased approach! • Only a small piece of the puzzle! - Enterprises need lifecycle management, security, compliance, governance, etc.
  17. 17. @derekcollison QCon NY: “Beyond Virtualization” PaaS is Not Enough http://apcera.com/blog/paas-is-not-enough/ 17
  18. 18. @derekcollison QCon NY: “Beyond Virtualization” Docker helps 18
  19. 19. @derekcollison QCon NY: “Beyond Virtualization” Docker Helps 19 • The dawn of the composeable enterprise! • More control over the pieces! • Great Ecosystem!
  20. 20. @derekcollison QCon NY: “Beyond Virtualization” DockerCon Initiatives 20 • libSwarm! • libContainer! • libChan
  21. 21. @derekcollison QCon NY: “Beyond Virtualization” Docker The Future 21 • Identity! • Authorization! • Trust
  22. 22. @derekcollison QCon NY: “Beyond Virtualization” Docker TBDs 22 • How to compose and orchestrate the system?! • etcd? confd?! • Make it transparent! • Don’t make me rewrite! • libSwarm, libChan?! • What about compliance?! • Heartbleed?! • Linux zero-day exploit?! • Tell me if I am compliant! • Tell me what is at risk
  23. 23. @derekcollison QCon NY: “Beyond Virtualization” We Want Things to Just Work 23 • Self Service! • Composeable Systems (legos)! • Faster Iterative Development! • Faster Deployments! • Fault Tolerance! • High Availability! • Guaranteed SLAs
  24. 24. @derekcollison QCon NY: “Beyond Virtualization” We’re getting there 24
  25. 25. @derekcollison QCon NY: “Beyond Virtualization” The Future of IT 25 • Declarative! • Composeable! • Extreme Agility! • Security and Compliance - Transparently! • Fluid and Abstracted Infrastructure and Services! • Multiple delivery models in one system
  26. 26. @derekcollison QCon NY: “Beyond Virtualization” Declarative CCB 26 • App A needs: ! - X memory and Y CPU! - N storage! - I/O SLAs for talking to B and C! - available URL for trusted identities! - run on premise, co-located 
 near B App A B C talks to talks to
  27. 27. @derekcollison QCon NY: “Beyond Virtualization” Intelligent workloads 27 App A
  28. 28. @derekcollison QCon NY: “Beyond Virtualization” Intelligent systems 28 App A
  29. 29. @derekcollison QCon NY: “Beyond Virtualization” Where do we start? 29
  30. 30. @derekcollison QCon NY: “Beyond Virtualization” Required Functionality 30 • What App A needs! ! • Where App A runs! ! • How App A finds B and C! ! • How others find App A! ! • What happens on failures
  31. 31. @derekcollison QCon NY: “Beyond Virtualization” Required Functionality 31 • What App A needs
 Packaging & Dependencies! • Where App A runs Provisioning & Scheduling! • How App A finds B and C Addressing & Discovery! • How others find App A External Mapping! • What happens on failures Monitoring & Management
  32. 32. @derekcollison QCon NY: “Beyond Virtualization” Packaging & Dependencies 32 • What the job needs to run! • Changes from Dev to Prod! • Runtimes, OS, libraries! • Who defines what these are! • Whether existing tools are sufficient for consistency, compliance, auditing! - SCCS and Chef / Puppet! - AMIs or VMDKs! - Docker Images App A DEV PROD runtimes! OS! libraries runtimes! OS! libraries
  33. 33. @derekcollison QCon NY: “Beyond Virtualization” Provisioning & Scheduling 33 • Where workloads run! • Network perimeter security models! • Unit of work: VM, App, Image! • Automatic, instantaneous and transparent policy compliance! • Compliance and deployment handled independently! • New tools: Mesos, Fleet, Diego 500ms10 weeks 2 min. human! behavior ! change Speed
  34. 34. @derekcollison QCon NY: “Beyond Virtualization” Addressing & Discovery 34 • DNS is insufficient - inside! • Needs to fit what we have, without changing apps! • System reacts as things move! • Load balancing! • Scaling up and down ETCD / CONFD External Internal X ✓✓ ✓ ✓ RouterRouter
  35. 35. @derekcollison QCon NY: “Beyond Virtualization” External Mapping • HTTP/TCP connectivity! • How do you find something? ! • Load balancing! • Rapid scaling! • Health monitoring and repair! • DNS sufficient for external, but not internal 35 External Internal X ✓✓ ✓ ✓ RouterRouter
  36. 36. @derekcollison QCon NY: “Beyond Virtualization” Monitoring & Management 36 • What happens when something fails?! • Manual or Automatic?! • Who determines failure and whether we trust the system! • Its sick, not dead! - Latency vs. Chaos monkey! • Measure the effect of change beforehand?! • Extensible & Pluggable BORG / Omega LatencyChaos
  37. 37. @derekcollison QCon NY: “Beyond Virtualization” Bolt-on is not the way to get there 37
  38. 38. @derekcollison QCon NY: “Beyond Virtualization” What we need is a platform OS 38
  39. 39. @derekcollison QCon NY: “Beyond Virtualization” Programmable, pluggable, and composeable from the inside out 39
  40. 40. @derekcollison QCon NY: “Beyond Virtualization” The secure, hybrid, trusted platform OS for multi-datacenter 40
  41. 41. @derekcollison QCon NY: “Beyond Virtualization” A Platform OS 41 • All resources in a common pool! • Real-time networking, addressing, and discovery! • Awareness of ontologies AND communication semantics! • Contextual security and policy just work! • Built for rapid change - all change! • Policy-compliant resource isolation, connectivity, and SLAs CC App A C talks to pattern data behavior policy! on the fly
  42. 42. @derekcollison QCon NY: “Beyond Virtualization” We Have the Right Pieces 42 • Isolation Contexts - Docker! • SDN - Software-Defined Networking! • Management and Resource Pooling (CMPs)! • Intelligent and Compliant Job Scheduling! • Intelligent Canarying, A/B rollouts and testing Just not in one place
  43. 43. @derekcollison QCon NY: “Beyond Virtualization” Isolation Context • Isolation Context: isolated, insulated, autonomous! • Speed and weight! - Hypervisors for virtualization! - LXC, libContainer (containers) - Docker! - Micro-task virtualization! • Google chargeback diversion 43 Faster, more lightweight and purpose-built Virtualization Containerization Micro-task Virtualization
  44. 44. @derekcollison QCon NY: “Beyond Virtualization” SDN - Software-Defined Networking 44 • Network perimeter security! • Application-level changes! • Layer 7 semantics! - How many INSERTS per second from all of App A?! - Can I disallow DROP and DELETE calls between 1-3AM?! • Compliant and transparent network! - It just works, e.g. mobile
  45. 45. @derekcollison QCon NY: “Beyond Virtualization” Intelligent, Compliant Job Scheduling • Pick the best place to run for a given job and policy! • How the system rebalances and utilizes new resources! • Centralized or Distributed algorithms! • How policy affects decision- making (e.g., geography)! • New tools: Mesos, Fleet, Diego 45
  46. 46. @derekcollison QCon NY: “Beyond Virtualization” Intelligent Canarying Prod • Measured rollout success! • A/B testing! • Blue-green deployments ! • Automated rollout and rollback 46 10% traffic Dev 90% traffic App A v1 App A v2 Rollout Rollback
  47. 47. @derekcollison QCon NY: “Beyond Virtualization” Intelligent Canarying • A lot of data needed! - resource utilizations: CPU, Mem, Storage! - communication patterns: cascading effects! - temporal awareness! • All data will feed into automated, anomaly detection services! - Utilizing unsupervised deep machine learning 47
  48. 48. @derekcollison QCon NY: “Beyond Virtualization” The Future of IT - Platform OS 48 Hardware IaaS Diverse Workloads! (e.g., apps, services) Provisioning! Scheduling! Health Monitoring! Addressing! Discovery Governance! Compliance! Security! Automation! Orchestration Internal Services External Services One Platform
  49. 49. @derekcollison QCon NY: “Beyond Virtualization” Summary 49
  50. 50. @derekcollison QCon NY: “Beyond Virtualization” Summary 50 • Composeable platforms! • Intelligent workloads sans code changes! • Policy aware...! - Packaging and Dependency Management ! - Job Scheduling and Provisioning! - Addressing, Discovery, Networking! - Monitoring and Management! - Lifecycle Management and Intelligent Canarying A POLICY OF INNOVATION
  51. 51. @derekcollison QCon NY: “Beyond Virtualization” Resources 51 • Docker - https://www.docker.io! • Mesos - http://mesos.apache.org! • CoreOS - https://coreos.com! • Fleet, Etcd - https://coreos.com/using-coreos/etcd! • Consul - http://www.consul.io! • Continuum - http://apcera.com/continuum
  52. 52. Derek Collison - Apcera, Inc.! @derekcollison! ! June 12, 2014 - QCon New York Thank You
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×