A webinar I did with Sauce Labs on the intersection of QA and DevOps. Many QA teams think of DevOps in terms of that infrastructure thing that IT does. But DevOps the movement is a tool for QA/QE to increase their presence across the entire development environment.

1. © Sauce Labs, Inc.
What is DevOps &
What Does it Mean for QA?
Presented by Chris Riley ( @HoardingInfo ), DevOps AnalystJuly 14, 2015

2. © Sauce Labs, Inc.© Sauce Labs, Inc.
Presenter
Chris Riley – technologist, research
analyst, O’Reilly author and subject
matter expert on DevOps. @hoardinginfo

3. © Sauce Labs, Inc.
Outline
• Introduction
• Definitions
• Nope … not really new
• New Challenges
• The Intersection of DevOps & QA
• A QA Strategy for DevOps
• Future of _______

4. © Sauce Labs, Inc.
The Two Faces
The Movement: People, Process, Tools
The Function: Infrastructure automation and
oversight

5. © Sauce Labs, Inc.
Data?

6. © Sauce Labs, Inc.
Why the movement?

7. © Sauce Labs, Inc.
A moving Target
• Confusion! “DevOps”
Function
“DevOps”
Movement
“DevOps”
“DevOps”
“DevOps”
“DevOps”
Developer
QA
IT Ops
“DevOps”
Vendor
Executive
Observer /
SI

8. © Sauce Labs, Inc.
Enterprise SMB Startup
Developer Eh.. But LOB? Cool Done!
QA No Time Need the $$ What QA
Executive Nah. I want to keep my job Do that thing I’ll script it
IT Ops Done it for years, leave me alone My budget, My thing What’s IT?
Vendor They are doing it They are doing it Did it
Observer/SI $ You got this -

9. © Sauce Labs, Inc.
False Comparison

10. © Sauce Labs, Inc.
So Basically No One Knows
Trough of disillusionment

11. © Sauce Labs, Inc.
What we do know:
• People then Process then Tools
• The processes are concrete
• Plan
• Dev
• Integrate
• QA
• System Test
• Release
• Monitor
• Measure
• “Culture” != Debug Ninja | Rockstar | Slide in the Lobby
• It is evolving

12. © Sauce Labs, Inc.
But Really It Is Very Easy
Faster releases at a higher quality

13. © Sauce Labs, Inc.
Faster releases at a higher quality

14. © Sauce Labs, Inc.

15. © Sauce Labs, Inc.
Uh oh - Problem
Current and Looming Challenges of DevOps
• We went too fast, crashed - sustainability
• We release a whole bunch, but no clue what is going on
• The more bugs, the more bugs, the more bugs, the more
• Chef is so three years ago – change
• Oh yeah the person who did that, they left
• Heartbleed v2.0

16. © Sauce Labs, Inc.
Why Should QA Care?

17. © Sauce Labs, Inc.
Who Cares?
• Get a budget
• Play with new and cool tools
• Be Prepared for Change
• Greater Opportunity

18. © Sauce Labs, Inc.
Happen to it, don’t let it happen to you
What can QA do?
• Deliver wins
• Deliver data
• Find your spot
• Continuous Documentation
• Make your developers champions
• Suggest improvements to the pipeline
• Realize and leverage your unique position
• Automate something, then automate something else

19. © Sauce Labs, Inc.
Real-world
• Acorns
• WellsFargo
• Constant Contact

20. © Sauce Labs, Inc.
The Future of ______
Where is it going?
• A mobile focus
• Containers not code
• Developers are more accountable
• User driven test case development
• QA -> QE: Test Strategy, Quality Evangelist

21. © Sauce Labs, Inc.
QA
Resources
• Test Automation KPIs - http://sauceio.com/index.php/2015/06/test-automation-
kpis/
• It Worked on My Machine - http://sauceio.com/index.php/2015/07/it-worked-
on-my-machine-communication-trap/
• Sign up for a free trial of Sauce
https://saucelabs.com/signup/trial