Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

DevOps 101 for data professionals

562 views

Published on

In 2009 John Allspaw and Paul Hammond delivered the session “10 deploys per day – Dev & ops cooperation at Flickr.” In forty six minutes they changed the way millions of people would think about the software delivery process for years to come. It didn’t have a name yet, but DevOps was born. DevOps folk preached about the cloud, automation, rapid delivery and any database technology that wasn’t relational…

In 2013 Kenny Gorman declared “The DBA is Dead”.

For the record, I don’t believe that, but a lot of people do. What is certain is that the world of IT is changing, and the traditional DBA role, and most other data roles, are changing with it.

I’m going to explain what DevOps is, where it came from, and its implications for SQL Server. We’ll cover the human and technical basics of database DevOps – and I’m going to discuss some changes that data folk need to make.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

DevOps 101 for data professionals

  1. 1. @_AlexYates_ #GroupBy DevOps 101 for Data Professionals How your job will change AlexYates
  2. 2. @_AlexYates_ #GroupBy DLM Consultant workingwithdevs.com alex.yates@dlmconsultants.com AlexYates @_AlexYates_
  3. 3. @_AlexYates_ #GroupBy @_AlexYates_ | #GroupBy
  4. 4. @_AlexYates_ #GroupBy Agile Scrum Lean Iterative Continuous Delivery Developers
  5. 5. @_AlexYates_ #GroupBy Monitoring Deployment Integrity Performance DBAs
  6. 6. @_AlexYates_ #GroupBy 2009: A regular session, at a regular conference, that changed everything https://www.youtube.com/watch?v=LdOe18KhtT4/ @allspaw @ph
  7. 7. @_AlexYates_ #GroupBy A brief history of DevOps • 2008: Agile Toronto “Agile Infrastructure” • 2008: “Agile System Administrators” Google group • 2009 (June): “10+ Deploys Per Day” • 2009 (October): DevOps Days Ghent • #DevOps • 2013: The Phoenix Project • 2016: The DevOps handbook @littleidea @patrickdebois @allspaw @ph @realGeneKim @jezhumblehttps://www.amazon.co.uk/d/Books/Phoenix-Project-DevOps-Helping-Business/0988262509/ https://www.amazon.co.uk/Devops-Handbook-World-Class-Reliability-Organizations/dp/1942788002/
  8. 8. @_AlexYates_ #GroupBy Things that aren’t DevOps… Tools People, job roles or teams Processes or task lists Floating masses of visible, condensed water vapour http://itrevolution.com/the-three-ways-principles-underpinning-devops/
  9. 9. @_AlexYates_ #GroupBy CALMS C ulture A utomation L ean M easurements S haring
  10. 10. @_AlexYates_ #GroupBy The three ways Systems thinking Amplify feedback loops Culture of continual experimentation and learning http://itrevolution.com/the-three-ways-principles-underpinning-devops/ @realGeneKim
  11. 11. @_AlexYates_ #GroupBy The automated deployment pipeline
  12. 12. @_AlexYates_ #GroupBy Databases are hard
  13. 13. @_AlexYates_ #GroupBy Farm Credit Services of America (FCSA) • 100 person IT team, 14 sub-teams • Database version control inconsistent • Deployment process manual • Delivery was slow and unreliable
  14. 14. @_AlexYates_ #GroupBy • Standardised source control and delivery process • Automated manual deployment tasks Farm Credit Services of America (FCSA) • Deployments easier to review • Delivery faster and more reliable
  15. 15. @_AlexYates_ #GroupBy Farm Credit Services of America (FCSA) http://www.codeaperture.io/2016/09/13/how-redgate-helped-define-our-process/
  16. 16. @_AlexYates_ #GroupBy There’s more than one way to skin a cat
  17. 17. @_AlexYates_ #GroupBy There’s more than one way to skin automate a cat
  18. 18. @_AlexYates_ #GroupBy V1 V2 Migrations vs state
  19. 19. @_AlexYates_ #GroupBy V1 V2 Migrations vs state
  20. 20. @_AlexYates_ #GroupBy V1 V2 Migrations vs state
  21. 21. @_AlexYates_ #GroupBy
  22. 22. @_AlexYates_ #GroupBy “There's nothing more reliable than keeping track of exactly the scripts you intend to run, and running them, without trying to compare state and guess.”
  23. 23. @_AlexYates_ #GroupBy “There's nothing more reliable than keeping track of exactly the scripts you intend to run, and running them, without trying to compare state and guess.” Paul Stovell, Octopus Deploy http://docs.octopusdeploy.com/display/OD/SQL+Server+databases
  24. 24. @_AlexYates_ #GroupBy “As soon as you have multiple changes on a single aspect of an object, ordering and the ability to detect which change needs to be made gets very complicated.”
  25. 25. @_AlexYates_ #GroupBy “As soon as you have multiple changes on a single aspect of an object, ordering and the ability to detect which change needs to be made gets very complicated.” Gert Drapers, built DataDude https://blogs.msdn.microsoft.com/gertd/2009/06/05/declarative-database-development/
  26. 26. @_AlexYates_ #GroupBy Migrations vs state http://workingwithdevs.com/delivering-databases-migrations-vs-state/
  27. 27. @_AlexYates_ #GroupBy Migrations vs state http://workingwithdevs.com/delivering-databases-migrations-vs-state/
  28. 28. @_AlexYates_ #GroupBy Migrations vs state http://workingwithdevs.com/delivering-databases-migrations-vs-state/
  29. 29. @_AlexYates_ #GroupBy Migrations vs state http://workingwithdevs.com/delivering-databases-migrations-vs-state/
  30. 30. @_AlexYates_ #GroupBy Migrations vs state http://workingwithdevs.com/delivering-databases-migrations-vs-state/
  31. 31. @_AlexYates_ #GroupBy Migrations vs state http://workingwithdevs.com/delivering-databases-migrations-vs-state/
  32. 32. @_AlexYates_ #GroupBy Migrations vs state http://workingwithdevs.com/delivering-databases-migrations-vs-state/
  33. 33. @_AlexYates_ #GroupBy 11 2 Alter view: kittenTrainersNrLdn Alter table: kittenTrainers Both work! Same changes, versioned and deployed two ways
  34. 34. @_AlexYates_ #GroupBy Demo
  35. 35. @_AlexYates_ #GroupBy http://thenextweb.com/insider/2013/12/12/dba-dead/ @kennygorman
  36. 36. @_AlexYates_ #GroupBy http://www.scarydba.com/2015/02/24/devops-dba-word-no/@GFritchey
  37. 37. @_AlexYates_ #GroupBy http://www.devopsdba.com/devops-dba/ @DevOpsDBA
  38. 38. @_AlexYates_ #GroupBy What you can do • Don’t be the bottleneck – be the fix • Embrace co-operation, automation and DLM • (Learn Git, tSQLt, NuGet and PowerShell etc) • Pick a technical solution that suits your database/team • Design for deployability and testability • Data Platform, Cloud (not just on-prem SQL Server) • Be careful with the word “no”
  39. 39. @_AlexYates_ #GroupBy DLMConsultants.com/DevOps-101/
  40. 40. @_AlexYates_ #GroupBy Questions? Links: DLMConsultants.com/DevOps-101/ Rate me: GroupBy.org/go/session7 Contact me: alex.yates@dlmconsultants.com
  41. 41. @_AlexYates_ #GroupBy Image sources Author Source Information Chiltepinster Wikimedia Commons Mocking Bird Argument.jpg – Wikimedia Commons. This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license. Source on Wikimedia Commons: “Own work” Bit Boy Flickr The elephant in the room – Flickr. This file is licensed under the Creative Commons Attribution 2.0 Generic license. Nils Rinaldi Flickr Hippo fight 2/3 – Flickr. This file is licensed under the Creative Commons Attribution 2.0 Generic license. My own collection Taken by/property of Alex Yates Kitten, “There’s more than one way to skin a cat!” Memegenerator.net Memegenerator.net I don’t always edit database. Content designed to be shared and delivered with credit to memegenerator.net. BagoGames Flickr NBC takes another Whack at the IT crowd. This file is licensed under the Creative Commons Attribution 2.0 Generic license. Biso Wikimedia Commons Rusty tools.jpg – Wikimedia Commons. This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license. Omnisource5 Wikimedia Commons Lenticular Cloud over Harold's Cross Dublin Ireland taken at 11:30AM, 30th June 2015 – Wikimedia Commons. This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license. Source on Wikimedia Commons: “Own work”

×