Download as PDF, PPTX
Uploaded byJohn Willis
Devopsdays State of the Union Amsterdam 2014
The document summarizes recent developments in devops, including findings from the 2014 Devops Survey showing correlations between organizational performance, IT performance, organizational culture, and job satisfaction. It also discusses trends toward software-defined architectures, composable infrastructure using containers and Docker, and orchestration tools like Mesos and Kubernetes. Racks of the future are envisioned with bare-metal switches, Docker engines, and CoreOS instead of traditional virtualization.
More Related Content
Similar to Devopsdays State of the Union Amsterdam 2014
Devopsdays State of the Union Amsterdam 2014
- 1. Devopsdays State ofthe Union John Willis VP of Customer Enablement Statelessnetworks @botchagalupe
- 2. Devops State of theUnion • The 2014 Devops Survey • Software Defined Everything • Consumable Composable Infrastructure #Sometimes presentations write themselves #I was trying to think of what are the latest and greatest things going on that have an impact on us #devops folk… ## last week was a good week for some cool disruptions…
- 3. Devops State of theUnion • The 2014 Devops Survey • Software Defined Everything • Consumable Composable Infrastructure The Big Fat Rethink #Sometimes presentations write themselves #I was trying to think of what are the latest and greatest things going on that have an impact on us #devops folk… ## last week was a good week for some cool disruptions…
- 4. Devops Survey #2013 wasa good first start… It proved out the actions of high performance orgs #2014 might not the perfect but…. it’s pretty awesome improvement in that the data is starting correlate high perf w/competitive advantage and in some cases financial improvements #Meta Points: (this is really good data) ##9200 vs 4000 ##Empl Size = 41% in the 500 to 10k+ range ##Dept = Almost 60% are in the right place ##Servers = Roughly 60% >100 - were significant orgs ##20% are rather large orbs (>2k which would be a good indicator of enterprise)
- 5. Devops Survey • OrganizationalPerformance • IT Performance • Organizational Culture • Job Satisfaction #In summary the report kind of describes this idea of “Org Perf” #Also points out IT Performance = Competitive Advantage (up to 2x) ##A smaller subset of the respondents volunteered co / pub traded name/ of that subset the findings were that there was a 2.5x of ones that fell into the high IT perf categories #Organizational Culture = IT Performance ( One of the strongest predictors of IT Perf ) ##High trust, ##Cross Functional Collaboration, ##Shared Responsibilities, ##Learning Organization #Job Satisfaction is a key indicator for Organizational Performance #We’ve know this all along .. this is devops.. # We already know this as #devops
- 6. Devops Survey • OrganizationalPerformance • IT Performance • Organizational Culture • Job Satisfaction = Devops #In summary the report kind of describes this idea of “Org Perf” #Also points out IT Performance = Competitive Advantage (up to 2x) ##A smaller subset of the respondents volunteered co / pub traded name/ of that subset the findings were that there was a 2.5x of ones that fell into the high IT perf categories #Organizational Culture = IT Performance ( One of the strongest predictors of IT Perf ) ##High trust, ##Cross Functional Collaboration, ##Shared Responsibilities, ##Learning Organization #Job Satisfaction is a key indicator for Organizational Performance #We’ve know this all along .. this is devops.. # We already know this as #devops
- 7. Devops Survey Devops Competitive Advantage = #However, this survey is the first form of proof that we are right… the data… # We can now use this data to start the “proof” that we are on to something. #We need a lot more data….
- 8.
- 9. The Big FatRethink #
- 10. Software Defined Everything • SoftwareDefined Data Center • Software Defined Computing • Software Defined Storage • Software Defined Networking #SDDC has also been referred to as Converged Infrastructure ! # SDC - ## First order abstractions: Hypervisors on physical, then/now LXC, libContainer (containers) - Docker! - Micro-task virtualization! ## Second order abstractions are distributed clusters (Cloud, Big Data ) .. well defined API’s ! #SDS ## First order abstractions virtualized storage hardware ## Second order abstractions ( Ceph, Swift, Swiftstack, S3).. well defined API’s (can you download the software) ! #SDN ##First order abstractions VLAN .. again virtualizing a single box.. switch L2) ##Second order abstractions Tunnels … VXLAN… .. well defined API’s ## SDN offers further service abstractions … ### .. adding functionality into the network routing fabric for example LB (SDAS), FW (SDSec) becomes smart routing ! # Major points… ## all three abstractions move one step away from the hardware. Second order abstractions are not directly coupled hardware. ## All three have high order programming interfaces (API’s). #These hight order highly programable abstractions changing the landscape of IT
- 11. SDN is theDecoupling of Control From the Data Plan http://networkstatic.net SDN is the decoupling of the control plane from the data plane... physically removing… ! Network gear has traditionally been a black box w/coupled arch D,C,M ! Data Plane.. packet-in packet-out .. nano second .. wire speed Control Plane.. Local distributed brains of the network (BGP, OSPF, MPLS), How the forwarding state gets to the data place .. milliseconds/days ! Stanford Seminar - Software-Defined Networking at the Crossroads http://www.youtube.com/watch?v=WabdXYzCAOU ! Nicira Notes: Nicira Networks was acquired by VMware for $1.26B. (7/23/12) Posted 7/23/12 at 6:14pm via techcrunch.com ! Nicira Networks added Alan Cohen as VP, Marketing. (10/1/11) Posted 10/21/11 at 4:42am ! Nicira Networks received $26M in Series C funding. (2/3/11) Posted 2/4/11 at 6:31pm via sec.gov ! Nicira Networks added John Vrionis as Investor. (2/1/11) Posted 9/4/12 at 9:08am !
- 12. Openflow is toSDN as HTTP is to Web http://networkstatic.net OpenFlow is not magic, just a low level primitive with momentum for FIB programming (forwarding plane programming). Explain the flow table... Interesting thing this can be a device as ( a router, switch, firewall, Nat and even a Load Balancer). ... now it starts getting very interesting... The OpenFlow Switch and Controller can communicate via the OpenFlow protocol, ! Service chains (firewalls, Load balancers, IDS, L3 Switching) !
- 13. Software Defined Everything • Disaggregationof Hardware/ Software • X86 Compute Servers • IP Based Storage • Bare Metal Switches # We saw disaggregation of compute about 15 years ago (Sun/IBM). # ISCSI over Fiber Channel .. # The latest and greatest is in networking… Cumulus Networks # OCP
- 14. ! ! • Software DefinedData Center • Rethink Declarative • Rethink Source of Truth • Rethink Layer 7 Semantics Software Defined Everything # We need to start to rethink declarative and desired state infrastructure. # We are somewhat Myopic on compute? ## It’s not just server config, packaging and vm provisioning anymore. ### How do you create declarative desired state converged infrastructure (SDE) ### Storage config, network configurations? ### Declarative Network topologies ### How are SDN flow tables declared (SDN gui’s/API abstractions). Frenetic/Pynetic ### When do we get/have converged Cloud API abstractions (e.g., a jClouds that abstracts SDC,SDS and SDN) ### What does provisioning look like for containers.. #### With things like Mesos ad Fleet the new Kubernetes) ## What is the original desired state and what is the ongoing operational state of truth .. who wins? ! #Do our new declarations start looking more like policies. ## I need service A ### it needs n amount of nodes with x amount of cpu/mem per node. ### How is storage allocated for this service (object storage/block storage) ### Does it need virtual perimeters for Networking (VXLAN) and Security (FW) and ### How is this application service request queuing managed (LB SDAS) and also QOS ! # infrastructure - is there a common definition of a node? Is there a single source of truth for all “nodes” ## DNS is not enough… ## Service Discovery/Mapping … go based derivatives of zookepper. Etcd/confd .. ### Consul .. someones needs to give Mitchell some Demerol and slow this kid down..
- 15. Composable Infrastructure Composability is asystem design principle that deals with the inter-relationships of components.A highly composable system provides recombinant components that can be selected and assembled in various combinations to satisfy specific user requirements. ! Wikipedia # Derek Collison (creator of CloudFoundry) says we are on the dawn of Composeable Infrastructure. Actually Google has been doing this very well of a number of years now. # The big difference in with things like docker containers are consumable…
- 16. • Bare Metal(8 weeks) • Virtualization ( 2 weeks) • IaaS ( 2 minutes) • PaaS ( 1 minutes) • Containers ( 500 ms) Consumable Composable Infrastructure #
- 17. • Docker ! • CommoditizedContainers • Portable Images • Using a Git Like Workflow Composeable Infrastructure # How to describe docker to a friend… ! ## Very easy to install and run LXC containers… ## Docker binaries are portable across multiple visualization infrastructures. ### Truly a create once run anywhere… (BM, VBOX, Vsphere, AWS, GCE, CF) ## My personal favorite is the Git like workflow… (docker pull,push, diff commit) ### The idea is you get the image from a repo, you change it, commit and push it). ### Docker uses “copy on write file system so you can do interesting workflows… ! #commit, diff, pull, push
- 18. Virtualization Docker Composeable Infrastructure # Fromthe #docker site…
- 19. • Orchestration • Mesos •Kubernetes • CloudOS • CoreOS • Atomic Composeable Infrastructure # Openstack is to KVM as Mesos/Kubernetes is to Docker ! ## Mesos mostly developed by ex google guys who went to Twitter ### Google had the borg—>omega — (OSS) ->Kubernetes ! ## Distributes container workloads across multiple physical boxes with no/OSS overhead ! # Will the real JEOS please stand up…
- 20. Racks of theFuture Cumulus Networks ! Opendaylight ! Mesos Server ! Docker Registry ! ETC/D Cumulus Networks ! OVSDB ! Openvswitch ! Mesos Client ! Docker Engine ! CoreOS # Left hand side is the management rack… (think Openstack Controller Node) # Right is the compute node .. (see what’s missing… i.e, hypervisor)
- 21. John Willis @botchagalupe Some Imageslicensed under Bigstock.com