Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Persistence in the cloud with bosh

657 views

Published on

Slides from a talk i gave at Sydney DevOps Meetup February 16th 2017.

Published in: Technology
  • Be the first to comment

Persistence in the cloud with bosh

  1. 1. Persistence in the Cloud with BOSH Michael Richardson - @m_richo
  2. 2. Agenda 1.What is BOSH? 2.Demo - ELK in AWS
  3. 3. What is BOSH?
  4. 4. * BOSH is an open source tool for release engineering, deployment, lifecycle management, and monitoring of distributed systems. * source https://bosh.io What is BOSH?
  5. 5. * BOSH is an open source tool for release engineering, deployment, lifecycle management, and monitoring of distributed systems. * source https://bosh.io What is BOSH?
  6. 6. WTF??
  7. 7. Packaging Config Management Monitoring Application Deployment Infrastructure Provisioning
  8. 8. Packaging Config Management Monitoring Application Deployment Infrastructure Provisioning fpm /bin/bash
  9. 9. Packaging Config Management Monitoring Application Deployment Infrastructure Provisioning fpm /bin/bash BOSH
  10. 10. 1.Packaging 2.Infrastructure Provisioning 3.Application Deployment 4.Configuration Management 5.Monitoring
  11. 11. Packaging
  12. 12. Packaging Piece of code or pre-compiled binaries required at either build-time or run-time
  13. 13. Infrastructure Provisioning
  14. 14. Infrastructure Provisioning - Resources Terraform CloudFormation 100s of cloud and SaaS resources 100s of cloud and SaaS resources
  15. 15. Infrastructure Provisioning - Resources Terraform CloudFormation BOSH 100s of cloud and SaaS resources 100s of cloud and SaaS resources ● Compute ● Block store ● ELB & EIP integration
  16. 16. Infrastructure Provisioning - Cloud Support Terraform CloudFormation Multi-cloud ● AWS ● Openstack ● Azure ● Google ● VMWare ● And many more AWS only
  17. 17. Infrastructure Provisioning - Cloud Support Terraform CloudFormation BOSH Multi-cloud ● AWS ● Openstack ● Azure ● Google ● VMWare ● And many more AWS only Multi-cloud ● AWS ● Openstack ● Azure ● Google ● VMWare
  18. 18. Application Deployment
  19. 19. Application Deployment Canary releases (canaries) Rolling Updates (max_in_flight)
  20. 20. Configuration Management
  21. 21. Configuration Management - Resources Puppet/Chef/Ansible 100s of resources
  22. 22. Configuration Management - Resources Puppet/Chef/Ansible BOSH 100s of resources 3 resources ● packages ● file template ● service
  23. 23. Configuration Management Traditional CM tool (puppet, chef, ansible) Configuration management for a server
  24. 24. Configuration Management Traditional CM tool (puppet, chef, ansible) Configuration management for a server BOSH Configuration Management for a service
  25. 25. Monitoring
  26. 26. Process monitoring (monit) Node (VM) monitoring Notifications Email Datadog PagerDuty Monitoring
  27. 27. Process monitoring (monit) Node (VM) monitoring Notifications Email Datadog PagerDuty Monitoring
  28. 28. Demo ELK in AWS
  29. 29. Demo - ELK stack in AWS AWS VPC Availability zone a BOSH subnet Availability zone b Public subnet Private subnet Public subnet Private subnet NAT Gateway NAT Gateway Internet Gateway S3 bucket - bosh artifacts BOSH Director https://github.com/AusDTO/aws-infrastructure-provision
  30. 30. Demo - ELK stack in AWS https://github.com/logsearch/logsearch-boshrelease parser ingestor queue ls-router haproxy Logstash redis logstash ES cluster ES data EBS EBS EBS ES data EBS ES master EBS kibana ES cluster monitor ES maintenance EBS Logstash S3 upload
  31. 31. Demo - Choose your own Adventure 1. Scale vertically 2. Scale horizontally 3. More disk space please 4. Kill a node with data 5. Add some more monitoring for your service

×