Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Fits docker into devops

1,325 views

Published on

Published in: Software
  • Be the first to comment

Fits docker into devops

  1. 1. Fits Docker into Devops Evans Ye 2014.10.6
  2. 2. Let’s discuss about Devops first #TrendInsight
  3. 3. PRE-Devops • Developer builds and tests on dev servers • Devloper hands off code to operation • likely deployed manually • Sometimes it broken in Production • Need to be fixed, Now
  4. 4. 4
  5. 5. Devops • Getting changes to users quickly, reliably, and securely • Quick release cycle from code to Production • More confidence due to automated testing • reproducibility – bugs are not always 100% reproducible
  6. 6. 6 Fast Iteration backed by automated testing
  7. 7. Google Devops (2013) • 75 million test cases are run daily "Automated tests transform fear into boredom." -- Eran Messeri, Google
  8. 8. Continuous Integration • Same environment in Dev, QA and Production • Auto deploy – deploy reliability and consistency • Automated tests – unit test – smoke test (integration test)
  9. 9. How do you test hadoop features? • Manually test on dev cluster – Hey folks, don’t move, I’m testing my own features. • Pig unit – adhoc-query? dev environment only • HBase mini-cluster – does not support Windows? • Still not exactly the same environment as Production • what if written in python, ruby, php?
  10. 10. What if we can do Dev and Test in the same way, efficiently? 10
  11. 11. Docker • lightweight, portable Linux containers (like VMs) – fast creation – system isolated – resource constrained • Build, ship, run containers everywhere – containers as dev and test environment
  12. 12. Containers offer faster automation
  13. 13. Introduction to Docker #TrendInsight
  14. 14. The Docker Engine runs containers 15
  15. 15. Architecture VM Docker
  16. 16. 17 The Docker Hub stores and ships images
  17. 17. Docker image • $ docker runs <IMAGE> to create a container • base image stores /bin, /etc, /usr (Linux distro.) • add you app(diff) on top of base image • commit containers • push, pull images
  18. 18. Docker offers you • Deploy efficiently • Quick start • Lightweight
  19. 19. Limitation of Docker • Any Linux with kernel > 3.8.x • Linux only (Linux container, after all) Linux
  20. 20. 21 What about Windows and Macbook…?
  21. 21. Vagrant • A open source command line VM(or IaaS) provisioning tool Providers Vagrantfile VM
  22. 22. Solution for OS X / Windows Container Container boot2docker (2XMB, tiny core Linux) OS X / Windows with vagrant and virtualbox installed  docker containers  docker platform auto provisioned by vagrant  $ vagrant up DONE!
  23. 23. Hadoop Integration 25
  24. 24. Develop and test hadoop related features 10/22/2014 link service (hadoop-client) data (hadoop-client) hadoop fs –put …
  25. 25. Q & A #TrendInsight

×