Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
How to choose tools for DevOps and Continuous Delivery 
Matthew Skelton, Skelton Thatcher Consulting 
DevOps Cardiff meetu...
Collaboration 
Learning 
Singleton tools 
Conway’s Law
Matthew Skelton 
•15 years building & operating software systems 
•Cybernetics + Neuroscience 
•control engineering 
•ps...
PIPELINE Conference 
London Continuous Delivery meetupgroup (#londoncd)
We help you to transform your technology and teams for ‘the cloud’ 
Interim CTO/Head of X, tech strategy, architecture, wo...
Recent clients 
•Legal 
•Donations 
•Tourism 
•Betting & gambling 
•Travel booking 
•Financial data & reporting 
•Healthca...
Common themes 
•Online since ~1999 
•Successful in their sector 
•Large, central core database(s) 
•Non-aligned goals 
•Ne...
Common needs 
•Technology selection ticklists 
•Team interactions 
•Collaboration opportunities 
•Tools as catalysts
Continuous Delivery 
•A scientific approach to changing software systems (Dave Farley) 
•Regular, rapid, repeatable, relia...
Continuous Delivery 
•Quality 
•Safety 
•Reliability 
•Psychology 
•Effectiveness
DevOps 
“Highly effective, daily collaboration between software developers and IT operations people to produce relevant, w...
Not DevOps 
“Automation” 
“Build & Release” 
“Infrastructure Development” 
“System Administration”
Collaboration
1. Version Control
2. Deployment Pipeline
A large online retailer 
•Travel sector 
•Since ~1999 
•UK market 
•‘Non-core’ applications
Challenges were: 
•Limited Git skills in Service team 
•Manual deployments 
•‘Snowflake’ servers 
•No CI 
•Risks: security...
http://bit.ly/thetrainline-weekly-deploy
What we did 
•Built a walking skeleton pipeline 
•Modelled security roles and stages 
•Included manual steps (at first) 
•...
Results 
•Security: happy 
•Service team: relieved (& happy) 
•Developers: won over (& happy) 
•Business: surprised (& hap...
3. Log Aggregation
LogStash 
•ElasticSearch+ LogStash+ Kibana 
•ELK 
•In Production, Pre-Prod, Test 
•On developer machines!!!
http://rashidkpc.github.io/Kibana/images/screenshots/searchss.png
Collaboration & tool choice 
Value collaboration as a key criterion 
Orthogonal to main purpose (?) 
“How does [the use of...
Learning
Learning & tool choice 
Bring people with you 
Appreciate current skills 
Prefer achievable gains now 
Avoid fear of too-s...
Singleton tools 
(or the ‘Prize Bull’ approach)
Singleton tools 
•Special database server 
•Costly log aggregation 
•Costly monitoring 
•Server configuration
http://www.walpapershddownload.com/highland-cattle-wallpapers/
“Better features”? 
Optimise globally across the teams that need to collaborate
Singleton tool 
Breaks feedback (learning) loop from Production 
Makes CI/CD more difficult 
Underestimates value of colla...
Conway’s Law
Mel Conway, 1968 
“organizations which design systems ... are constrained to produce designs which are copies of the commu...
DevOps Topologies
DevOps Topologies
DevOps Topologies
DevOps Topologies
Conway & Tool Choice 
See the organisation as a system 
Separate tools for separate teams 
Shared tools for collaborative ...
Conway’s Law 
•Allan Kelly -@allankellynet 
•https://vimeo.com/channels/londoncd
How to choose tools for DevOps 
Value collaboration aspects 
Avoid a learning mountain: evolve tooling 
Avoid Production-o...
Further reading 
Build Quality In 
buildqualityin.com 
70% of royalties donated to Code Club 
Discount for @DevOpsCardiffp...
Thank you 
matthewskelton.net / @matthewpskelton 
skeltonthatcher.com 
HT: @Squire_Matt, @alan_parkinson
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff
Upcoming SlideShare
Loading in …5
×

How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff

1,119 views

Published on

With an ever-increasing array of tools and technologies claiming to 'enable DevOps', how do we know which tools to try or to choose? In-house, open source, or commercial? Ruby or shell? Dedicated or plugins? It transpires that highly collaborative practices such as DevOps and Continuous Delivery require new ways of assessing tools and technologies in order to avoid creating new silos. Matthew Skelton shares his recent experience of helping many different organisations to evaluate and select tools to facilitate DevOps; the recommendations may surprise you.

Published in: Software

How to choose tools for DevOps and Continuous Delivery - DevOps Cardiff

  1. 1. How to choose tools for DevOps and Continuous Delivery Matthew Skelton, Skelton Thatcher Consulting DevOps Cardiff meetupgroup, 5thNovember 2014, Cardiff, Wales #devopscardiff
  2. 2. Collaboration Learning Singleton tools Conway’s Law
  3. 3. Matthew Skelton •15 years building & operating software systems •Cybernetics + Neuroscience •control engineering •psychology •‘network’ interactions @matthewpskelton
  4. 4. PIPELINE Conference London Continuous Delivery meetupgroup (#londoncd)
  5. 5. We help you to transform your technology and teams for ‘the cloud’ Interim CTO/Head of X, tech strategy, architecture, workshops, delivery
  6. 6. Recent clients •Legal •Donations •Tourism •Betting & gambling •Travel booking •Financial data & reporting •Healthcare
  7. 7. Common themes •Online since ~1999 •Successful in their sector •Large, central core database(s) •Non-aligned goals •Need to adopt DevOps and Continuous Delivery
  8. 8. Common needs •Technology selection ticklists •Team interactions •Collaboration opportunities •Tools as catalysts
  9. 9. Continuous Delivery •A scientific approach to changing software systems (Dave Farley) •Regular, rapid, repeatable, reliable changes
  10. 10. Continuous Delivery •Quality •Safety •Reliability •Psychology •Effectiveness
  11. 11. DevOps “Highly effective, daily collaboration between software developers and IT operations people to produce relevant, working systems” * *also QA/Testing, IT Service Desk, Programme Management, Commercial, Marketing, etc.
  12. 12. Not DevOps “Automation” “Build & Release” “Infrastructure Development” “System Administration”
  13. 13. Collaboration
  14. 14. 1. Version Control
  15. 15. 2. Deployment Pipeline
  16. 16. A large online retailer •Travel sector •Since ~1999 •UK market •‘Non-core’ applications
  17. 17. Challenges were: •Limited Git skills in Service team •Manual deployments •‘Snowflake’ servers •No CI •Risks: security, automation, etc
  18. 18. http://bit.ly/thetrainline-weekly-deploy
  19. 19. What we did •Built a walking skeleton pipeline •Modelled security roles and stages •Included manual steps (at first) •Walked people through steps •Finally: opened firewall so everyone could see the UI
  20. 20. Results •Security: happy •Service team: relieved (& happy) •Developers: won over (& happy) •Business: surprised (& happy)
  21. 21. 3. Log Aggregation
  22. 22. LogStash •ElasticSearch+ LogStash+ Kibana •ELK •In Production, Pre-Prod, Test •On developer machines!!!
  23. 23. http://rashidkpc.github.io/Kibana/images/screenshots/searchss.png
  24. 24. Collaboration & tool choice Value collaboration as a key criterion Orthogonal to main purpose (?) “How does [the use of] this tool help people to collaborate?”
  25. 25. Learning
  26. 26. Learning & tool choice Bring people with you Appreciate current skills Prefer achievable gains now Avoid fear of too-scary tools
  27. 27. Singleton tools (or the ‘Prize Bull’ approach)
  28. 28. Singleton tools •Special database server •Costly log aggregation •Costly monitoring •Server configuration
  29. 29. http://www.walpapershddownload.com/highland-cattle-wallpapers/
  30. 30. “Better features”? Optimise globally across the teams that need to collaborate
  31. 31. Singleton tool Breaks feedback (learning) loop from Production Makes CI/CD more difficult Underestimates value of collaboration and learning
  32. 32. Conway’s Law
  33. 33. Mel Conway, 1968 “organizations which design systems ... are constrained to produce designs which are copies of the communication structures of these organizations” http://www.melconway.com/Home/Conways_Law.html
  34. 34. DevOps Topologies
  35. 35. DevOps Topologies
  36. 36. DevOps Topologies
  37. 37. DevOps Topologies
  38. 38. Conway & Tool Choice See the organisation as a system Separate tools for separate teams Shared tools for collaborative teams http://bit.ly/DevOpsTopologies
  39. 39. Conway’s Law •Allan Kelly -@allankellynet •https://vimeo.com/channels/londoncd
  40. 40. How to choose tools for DevOps Value collaboration aspects Avoid a learning mountain: evolve tooling Avoid Production-only tools Consider Conway’s Law (this list is incomplete!)
  41. 41. Further reading Build Quality In buildqualityin.com 70% of royalties donated to Code Club Discount for @DevOpsCardiffpeople: http://leanpub.com/buildqualityin/ c/DevOpsCardiff2014 Contributors include: -James Betteley -Marc Cluet -Anna Shipman -John Clapham
  42. 42. Thank you matthewskelton.net / @matthewpskelton skeltonthatcher.com HT: @Squire_Matt, @alan_parkinson

×