Continuous Deployment and Testing Workshop from Better Software West
•
4 likes•5,692 views
In this workshop from the 2015 SQE Better Software West conference, Cory Foy details the Continuous Paradigm companies are embracing - including Continuous Integration, Continuous Deployment, and Continuous Testing. This presentation was co-created by Jared Richardson.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Continuous Deployment and Testing Workshop from Better Software West
Similar to Continuous Deployment and Testing Workshop from Better Software West (20)
More from Cory Foy
More from Cory Foy (20)
Recently uploaded
Recently uploaded (20)
Continuous Deployment and Testing Workshop from Better Software West
- 1. Continuous Testing C o r y F o y C o r y F o y , L L C @ C o r y _ f o y
- 2. Who am I?
- 3. 3 Cofounder of GROWS Methodology Author Ship It! and Career 2.0 Screencast editor PragProg.com 2nd public signatory of the Agile Manifesto Started AgileRTP in 2007! Coach AgileArtisans.com Jared Richardson
- 4. 4 CTO of Pretty Kool Apps, Founder of Cory Foy, LLC Helped write the Software Craftsmanship Manifesto Former Microsoft PFE Development Clients include MIT, Beats By Dre Global Agile + Lean Coach Former Assistant Fire Chief blog.coryfoy.com Cory Foy
- 5. Who are you?
- 6. Who’s A User? Already using continuous integration? Continuous deployment? Which tools?
- 7. What would you say you do here? Roles? Responsibilities? Why are you here? What are your tests for this session?
- 8. Objectives Understand Continuous Feedback in context of SDLC Understand the Continuous Paradigm Understand the basics of Jenkins Understand an end-to-end Continuous workflow Miscellaneous practical tips and tricks
- 9. Outline SDLC Continuous paradigm Continuous Integration (benefits & workflow) Introduction to Jenkins Continuous Testing (benefits & workflow) Jenkins as a continuous deployment/testing tool Miscellaneous tips & tricks
- 10. Breaks Half-way (90 minutes)? Each hour ?
- 11. SDLC Feedback
- 12. Requirements Write Code The Traditional Approach Demo Rewrite “Discussion” The architects generate a document and hand it off An isolated event, primarily worked by the customer proxy Arch Code like mad! We’re starting late! Not what we meant! Wrong arch Ignored my docs etc so on
- 13. Demo Write Code Requirements The Agile Approach Rewrite Before significant time and $$ is invested Discuss Include the Golden Triad Dev QA Customer
- 14. Demo Write Code Architecture Proof of Concept Requirements Arch
- 15. Technical Vision StatementDefineYourGoals DB Services Front End Design
- 16. System Vision StatementDefineYourGoals Team1 Team2 Team3 Feat A Feat B Feat C Technical Vision Business Vision
- 17. Technical Product OwnerTestandExperimentContinuously Team1 Team2 Team3 Feat A Feat B Feat C Technical Vision Business Vision
- 18. Experimentation Learn about software by writing software Can’t study your way into experience Like riding a bike 3+ experiments Create feedback loops flickr.com/photos/schwar/6801765768
- 19. Exercise - Dot Game Groups of 7 Roles: BA, PM, Developers, Tester 5 Minute Rounds
- 20. Requirements Rewrite Discuss Development Developers disagree on which Javascript toolkit is best Node.js Bootstrap Angular.js Pick one SOA Monolithic Peer to peer Pick one Developers disagree on which architecture is best Demo Revise Rewrite Adjust Frequent demos discover communication failures early Continue until you can demo
- 22. Decide! Learn Learn Decide! Two Paths
- 23. Expect Well Less Well Change What we wanted to happen What went well What didn’t go so well What we want to try
- 26. Feedback Loops
- 27. Feedback Loops Discover What We Need Discover How to Build It Build It
- 28. What Is Agile?
- 30. 30 AgileManifesto.org Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan
- 31. Feedback Loops
- 32. flickr.com/photos/bobowen/4501875907 Product or system flickr.com/photos/30691679@N07/3808395213 Module/ Sub System flickr.com/photos/kevino/1438502858 Class
- 34. Pairing Test First Demos ??? Feedback Loops Inside Feedback Loops ???
- 35. Systems are closed Change is slow Interdependencies are low Certainty is high Variability is low Newtonian Management Methods Work: Facilitating Organizational Change: Lessons from Complexity Science
- 36. System Agents Emergent Patterns ComplexAdaptiveSystem Facilitating Organizational Change: Lessons from Complexity Science
- 37. Agile Is... Tighter Feedback Loops
- 39. 39 Initiative Themes Epics Features Stories Days Iterations Months Quarters Years Optional Optional
- 42. Minimize Dark Times Code Change Validation http://flickr.com/photos/bogenfreund/556656621/
- 44. Exercise Create a Value Stream Map Start with where work comes in to your org Continue until it is in a customer’s hands Each step gets a box Map Time Map Anchors
- 45. OneVision OneVoice One Team Outcomes over Output Velocity over Capacity Throughput over Utilization Leadership over Management 286.5 / 1592.5 7 weeks of work 40 weeks to do the 7 weeks
- 46. Different Levels Manual acceptance tests Unit tests Continuous Testing
- 47. Continuous Feedback Continuous Integration Continuous Delivery Continuous Testing
- 48. Continuous deployment is controversial. Most people ... think I’m advocating low-quality code or an undisciplined cowboy-coding development process. ERIC RIES radar.oreilly.com/2009/03/continuous-deployment-5-eas.html
- 49. Language is a Tool Use it
- 51. Continuous Integration Watch Code Build product Run tests Publish results
- 52. Pros Fast feedback Known state Easily consumed history Shines a light 52
- 53. Cons Slows you down Nags you after every code change Exposes problems Shares issues Forces you to deal with problems Smoke alarm 53flickr.com/photos/117168856@N06/12486837493
- 54. 54 Work Time Perception of Problem Accumulation
- 58. Feedback Loops
- 59. Sidebar: How We Learn Dreyfus Model of Skills Acquisition 59
- 62. Key Points Skills don’t map 62dilbert.com/strip/1990-09-13
- 63. Key Points Beginners need steps 63
- 64. Steps Use source code management (SCM) Automate the build (script) Acquire a build box (isolated) Install a build environment (dev tools) 64 Skunkworkable
- 67. Jenkins Open source Established Split from Hudson Java application Any application server Self contained 67
- 68. Example Publish results javac (Oracle & IBM) message broker etc ws ejb deploy message broker tools sshexec (to scripts) JUnit HP's UFT Selenium Web page RSS Email
- 70. Dependent Builds Data Layer Data Services Rich Client Common Libs Web Portal Biz Services
- 71. Chained Continuous Integration Team 1 Team 2 Team 3 Integration build
- 72. Platform Testing Team 1 Team 3Team 2 Team 4 Team 5 Integration Build Platform1 Plat 3Plat 2 Plat 4 Plat 5
- 73. See Jenkins Sample project Add to Jenkins Explore the GUI 73 Travis CI RSpec / Guard
- 75. Continuous Integration Watch Code Build product Run tests Publish results
- 77. Continuous Testing CI CT Compile & unit test Deploy & integration test
- 78. Continuous Testing Build in CI (compile & unit tests) Deploy to dev (staging) Run integration tests
- 79. What does this tell us? If it works
- 80. What's this look like?
- 81. Continuous Testing CI CT Compile & unit test Deploy & integration test
- 82. Multiplatform Deploys CI CD Win7 CD Linux CD OS X
- 83. Exercise Remember your SDLC bottlenecks? What could continuous integration solve? What could continuous testing solve? Regroup with your team and discuss Bring your top 3 solutions 83 Cut Anchors
- 84. As We Explore a Continuous World... 84
- 86. Not Just Code Databases Servers Hardware 86 A Continuous Paradigm affects all portions of our ecosystem
- 87. Nuke and Pave Reset (completely) Start over Completely Scripted 87
- 89. Data Nuke & Pave Delete schema Drop tables Recreate Restock Rails Liquibase 89 flickr.com/photos/x-ray_delta_one/4152356464
- 90. Operating System Nuke & Pave Virtualize Recreate 90 flickr.com/photos/x-ray_delta_one/4152356464
- 91. Databases Data Schema Business Logic (Stored Procs) 91
- 92. Data Updates ETL Processes Data Mapping Migrating Data 92 How can we apply continuous paradigms here? Script Changes Script Deploy Write Tests
- 93. Schema / Stored Procs Table Structure Indexes Triggers Stored Procs 93 How can we apply continuous paradigms here? Script Changes Script Deploy Write Tests
- 94. Raw SQL CREATE TABLE products ( id int(11) NOT NULL auto_increment, name varchar(255), PRIMARY KEY (id) ); 94
- 95. SQL Server Data Tools 95 SQL Server Data Tools http://www.infoq.com/articles/tdd-dbpro-Foy
- 96. Rails ActiveRecord change_table :card_deck do |table| table.remove :description, :name table.string :first_name table.index :part_number table.rename :list_name, :last_name end 96
- 97. Rails ActiveRecord rake db:migrate Determines the best way to migrate Preserves the data Is reversible (rake db:rollback) 97
- 98. ActiveRecord rake db:reset Drops schema Recreates schema 98
- 99. Steps for a New OS Install VirtualBox Install Vagrant vagrant init hashicorp/precise32 vagrant up 99
- 100. Steps for a New OS 100
- 101. Benefits Scriptable Reproducible environment Solid results Fast results Repeatable results
- 102. Immutable Infrastructure “IT operations teams realized that it is far more expensive to debug and fix a faulty virtual server than to replace it with a new server” Hidden Jobs One Off Processes Production Hacks
- 103. When? The best time is day one The second best time is today
- 104. “If you don’t do it on Day One, you probably won’t” Andy Hunt 104andy.pragprog.com
- 105. Easy? No Difficult Necessary Use agility in your approach!
- 106. Costs Move to Zero Once scripted… What changes?
- 107. How do We Improve Our Feedback Loops?
- 108. Developers Devs write code normally SCM Code is shared via a source code management tool Continuous Testing Providing immediate feedback and a shared environment for a QA “First Look” Triggered Deploy to QA QA team members trigger this deploy Manual Testing A stable environment for manual and exploratory testing
- 109. SCMDevelopers Watch Build Unit Tests Deploy to Dev Integration Tests First Look Continuous Testing On Demand Deploy to QA Manual Testing Rapid feedback Pair Dev & QA
- 110. First Look • QA can see what’s been coded immediately • Differences in opinions can be discussed quickly • Fewer problems during the larger testing cycles • Keeps QA & Dev working together as partners • Minimizes feedback for the previous iteration • Faster feedback for QA
- 111. Continuous Testing • Includes QA in the continuous feedback cycle • Retains a traditional QA stable testing environment • Dev & QA should both review all tests (unit & int.) • QA requests trigger the QA env. deployment
- 112. Write Code Requirements The Traditional Approach Demo Discuss Rewrite Typically a confrontation & argument The demo forces a discussion of the requirements An isolated event, primarily worked by the customer proxy
- 113. Demo Write Code Requirements The Agile Approach Rewrite Discuss before significant time is invested Include the Golden Triad Discuss
- 114. Alternatives
- 117. IN Summary...
- 118. Culture Change Fundamental change in development
- 119. Steps Automate builds Continuous Integration Add unit tests Automate deployments Continuous Delivery Add integration tests flickr.com/photos/untitlism/2547423465
- 120. Your move