Download to read offline
Uploaded byWinOps Conf
Eduardo Piairo - Deployment pipeline for databases (Azure SQL Database, SQL Server)
The document discusses the concept of deployment pipelines for databases, emphasizing the need for collaboration and visibility among teams involved in software delivery. It outlines stages of the pipeline, challenges specific to database changes, and the importance of automation to enhance speed, reliability, and reduce human intervention. Additionally, it presents various scenarios highlighting the relationship between application and database deployment processes.
More Related Content
Similar to Eduardo Piairo - Deployment pipeline for databases (Azure SQL Database, SQL Server)
Eduardo Piairo - Deployment pipeline for databases (Azure SQL Database, SQL Server)
- 1. DEPLOYMENT PIPELINE FORDATABASES Eduardo Piairo @EdPiairo #WinOpsAzure SQL Database, SQL Server
- 2. ABOUT ME Deployment pipelinefor databases @EdPiairo, #WinOps @EdPiairo https://pt.linkedin.com/in/jesuspiairo eduardopiairo@gmail.com http://www.eduardopiairo.com/ Eduardo Piairo Friend of Redgate Operations Engineer DevOps Porto Founder
- 3. INDEX 1. Deployment pipeline 2.Database challenges 3. Deployment pipeline stages 4. Deployment pipeline scenarios 5. Final thoughts Deployment pipeline for databases @EdPiairo, #WinOps
- 4. PIPELINE DEFINITION In softwareengineering, a pipeline consists of a chain of processing elements (processes, threads, coroutines, functions, etc.), arranged so that the output of each element is the input of the next. by Wikipedia @ https://en.wikipedia.org/wiki/Pipeline_(software) Deployment pipeline for databases @EdPiairo, #WinOps
- 5. DEPLOYMENT PIPELINE DEFINITION Adeployment pipeline should enable collaboration between the various groups involved in delivering software and provide everyone visibility about the flow of changes in the system, together with a thorough audit trail. by Martin Fowler @ https://martinfowler.com/bliki/DeploymentPipeline.html Deployment pipeline for databases @EdPiairo, #WinOps
- 6. DEPLOYMENT PIPELINE STAGES Deploymentpipeline for databases Stage 1 – Change description (Source Control) Stage 2 – Change validation (Continuous Integration) Stage 3 – Change implementation (Continuous Delivery) Source Control Continuous Integration Continuous Delivery @EdPiairo, #WinOps
- 7. DATABASE & DEPLOYMENTPIPELINE Deployment pipeline for databases Source Control Continuous Integration Continuous Delivery Database + Application @EdPiairo, #WinOps
- 8. WHAT’S SO SPECIALABOUT DATABASES? Deployment pipeline for databases @EdPiairo, #WinOps
- 9. DATABASE CHALLENGES Deployment pipelinefor databases • Database and application changes (most of the time) are handled differently • Different deployment pipeline • Synchronization needed • Database is not included (manual work) @EdPiairo, #WinOps
- 10. DATABASE CHALLENGES Deployment pipelinefor databases • Manual work … • Lack of traceability of database changes (changes history) • It’s the most expensive and risky work type • Prevent CI and CD utilization in their full extent • Promote the fear of changes @EdPiairo, #WinOps
- 11. DATABASE CHALLENGES Deployment pipelinefor databases Databases become a bottleneck in an agile delivery process @EdPiairo, #WinOps
- 12. AUTOMATION Deployment pipeline fordatabases @EdPiairo, #WinOps
- 13. THE VALUE OFAUTOMATION Deployment pipeline for databases • Enable control over database development • Increase speed of response to change • Greater reliability of the release process • Remove/reduce human intervention in the release process From (Re)Learn and forget it to Improve and forget it @EdPiairo, #WinOps
- 14. THE VALUE OFAUTOMATION Deployment pipeline for databases Fearless database changes @EdPiairo, #WinOps
- 15. SOURCE CONTROL Deployment pipelinefor databases @EdPiairo, #WinOps SQL Script Fundamental resource
- 16. SOURCE CONTROL Deployment pipelinefor databases • First step in your database deployment pipeline • Traceability through change history • SQL as documentation • Shared code-base and shared process • Enforceable standards to reduce conflicts @EdPiairo, #WinOps
- 17. • State basedsolutions • How the database should be • Migrations based solutions • How the database should change MIGRATIONS VS STATE Deployment pipeline for databases SQL Source Control @EdPiairo, #WinOps Migration Migration State Delta
- 18. SCRIPTING GUIDELINES Deployment pipelinefor databases • One script, one operation type, one object (small batches) • Merge conflicts management • Patterns identification • File system scripts history search @EdPiairo, #WinOps
- 19. CONTINOUS INTEGRATION Deployment pipelinefor databases • Integrate and validate changes • Tests: Unit, Integration • Small batches, less risk • Considerations: • What should be tested? And When? • Can the application help on this? @EdPiairo, #WinOps
- 20. CONTINUOUS DELIVERY Deployment pipelinefor databases • Delivering change(s) in the target environment • Considerations • Downtime • Time to recover • Small batches – low risk • Affected applications @EdPiairo, #WinOps
- 21. FAILED DEPLOYMENT Deployment pipelinefor databases • Rollback/roll forward scripts • Very fast • Please, do not make mistakes • It’s like working backwards • Backups (before deploy) • Safer but slower • Keep databases small • Avoid share databases between applications @EdPiairo, #WinOps
- 22. SCENARIO #1 Deployment pipelinefor databases Source Control Continuous Integration Continuous Delivery APP DB @EdPiairo, #WinOps • Independent deployment pipelines • High need of synchronization between DBA and development team
- 23. SCENARIO #2 Deployment pipelinefor databases Source Control Continuous Integration Continuous Delivery APP DB @EdPiairo, #WinOps • Different code repositories • Independent CI process • The contact point will be the deployment moment
- 24. SCENARIO #3 Deployment pipelinefor databases Source Control Continuous Integration Continuous Delivery APP DB @EdPiairo, #WinOps • Different code repositories • Connected/dependent CI process
- 25. SCENARIO #4 Deployment pipelinefor databases Source Control Continuous Integration Continuous Delivery APP DB @EdPiairo, #WinOps • Share the some code repository, CI process and CD process • No need of synchronization • Promotes learning within teams (database code reviews)
- 26. DEMO Deployment pipeline fordatabases @EdPiairo, #WinOps
- 27. MY DEPLOYMENT PIPELINEDEFINITION Pipeline: Cultural and technical tool for managing changes in the software development process (should contemplate databases, applications and infrastructure). by me ;) Show me your pipeline and I will tell you the way you work! Deployment pipeline for databases @EdPiairo, #WinOps
- 28. DEVOPS AND DATABASES Deploymentpipeline for databases • DevOps way • Increase flow visibility • Increase feedback • Increase knowledge base @EdPiairo, #WinOps
- 29. READING MATERIAL Deployment pipelinefor databases @EdPiairo, #WinOps
- 30. Q&A Deployment pipeline fordatabases @EdPiairo, #WinOps @EdPiairo https://pt.linkedin.com/in/jesuspiairo eduardopiairo@gmail.com http://www.eduardopiairo.com/