Where Testers and QA Fit in the Story of DevOps Continuous delivery. CI. GitHub. Scrum. CD. Jenkins. Continuous testing. Continuous integration. These are just some terms that are supposed to describe the word soup that is DevOps. Chances are that you have heard some or all of these words being passed around at your daily stand ups or company meetings. However, where does QA and testing fit into the story of DevOps? Some would say that developers and operations teams are all you need for a successful DevOps pipeline, while others show that Dev, Test and Ops need to be included to ensure quality at every step in your pipeline. In this webinar, Ryan Yackel, QASymphony's Director of Product Marketing, and Sunil Sehgal, Managing Partner at TechArcis, will share their experiences as they navigate you through the DevTestOps waters. In this webinar you will learn: Overview of the State of DevOps Common misconceptions of DevOps and QA How testers must adapt to the DevOps process The tools testers need for continuous testing Can't make the webinar? Sign up and we will send you the recording.

1. #DevOpsTesting
Where Testers & QA Fit
in the Story of DevOps
February 22nd, 2017
The audio for this webinar is delivered through your computer. There is no dial-in
number. Make sure your speakers are turned up or use a pair of headphones.

2. HOW TO WATCH THIS WEBINAR
• Audio for this webinar is delivered through your computer. Make
sure your speakers are turned up or use a set of headphones.
• If your audio quality is choppy, it could be your internet connection.
• You can customize your webinar viewing experience by increasing,
decreasing or minimizing the size of the widgets on your screen.
• If you have questions, enter them in the widget on the left.
#DevOpsTesting

3. MAXIMIZING THE PRESENTATION
#RiskBasedTesting
Click the icon in the
top right of the
presentation to
make the slides full
screen.
#DevOpsTesting

4. • This webinar will be recorded and available on-demand
tomorrow. You will get an email when it is available.
• Join the conversation on Twitter using the hashtag
#DevOpsTesting
• Use the Q&A widgets to ask questions during the webinar.
• At the end of the webinar, you will be asked to take a short
survey.
HOUSEKEEPING
#RiskBasedTesting
#DevOpsTesting

5. NEED TO LEAVE EARLY?
#RiskBasedTesting
#DevOpsTesting

6. NEXT WEBINAR
#RiskBasedTesting
WHAT?
Learn about our new
continuous testing solution
for teams practicing DevOps.
WHY?
CONTINUOUS DELIVERY, DEMANDS
CONTINUOUS QUALITY
WHEN?
March 1st, 2 – 3:00 PM
EST

7. UPCOMING: PAUL MERRILL
#RiskBasedTesting
WHAT?
Best practices and steps
to get started with test
automation.
WHY?
Test automation is integral for reduced
test maintenance and a faster time to
market.
WHEN?
March 8th, 2 – 3:00 PM
EST

8. April 18-19, 2017 | QualityJam.com
Email marketing@qasymphony.com to be entered to win a free ticket.
MARK YOUR CALENDARS!
#RiskBasedTesting#TestAutomation
WIN A FREE TICKET!

9. OUR PRESENTERS
Ryan Yackel
Product Marketing
QASymphony
@RyanYackAttack
Sunil Sehgal
Managing Partner
TechArcis
@TechArcis
Sunil brings over 20 years of experience
in business leadership, technology
management and strategic initiatives and
is an expert in Quality Assurance and
Testing Solutions
With a deep interest in the emerging
trends of testing needs, Ryan is
dedicated to being the customer
voice for all QASymphony products.

10. AGENDA
DevOps Movement
Is QA Dead?
How to enable Testing in DevOps
Practical Tips to Get Started
Q & A

11. “Software is eating the
world.”
“It’s an application economy.”
Marc Andreessen
“Every business will be in
software business.”Satya Nadella, CEO
“Speed is the new currency of IT and
businesses.”
Marc Benioff, CEO

12. DEVELOPMENT HAS ACCELERATED…
Waterfall
1970
Agile
2000
DevOps
2010
“If you don’t like change,
you will like irrelevance even
less.“
- General Eric Shineki,
Chief of Staff, U.S. Army

13. AGILE IS MAINSTREAM
The percentage of respondents’
organizations that practice agile
2 0 1595%
H O W MANY?
&
Percentage of Teams Using
Agile
Only 4% of respondents work
in a completely traditional / non-
agile development organization.
Contrast this with the 2009 report, in which (31%)
of the respondents worked where there were two
teams or less practicing agile!
53%
Less than ½ of our
teams are agile
34%
More than ½of
our teams are
agile
9%
All of our
teams are agile
4 %
None of our
teams are
agile
TO P 3 B E N E F I T S
87%
Ability to manage
changing priorities
85%
Increased team
productivity
8 4 %
Improved project
visibility
*State of Agile, 2016 Report, VersionOne

14. SECOPS
MICROSERVICES
GITLAB
DEVOPS
MICROSERVICES
SCM
PERFORCE
GITSCRUM
LEAN
CONTINUOUSDELIVERY
NEXUS
CONTINUOUS DEPLOYMENT CONTINUOUS IMPROVEMENT
VM
CONTINUOUSDELIVERY
JENKINS
TEST AUTOMATION
SCRUM
BLAZE METER
XP
CONTINOUS INTEGRATION
NEW
RELIC
GIT
STOP THE LINE
DevOps Word Soup
*Cloud Bees, Jenkins World 2016

15. Design Code
Design
Test Deploy
Code Test Deploy Design Code Test Deploy
Waterfall
Agile
DevOps
Incremental, Fast Deployments
3 to 9 months
2 to 6 Weeks
Hours to Days

16. DevOps is a set of practices
intended to reduce the time
between committing a
change to a system and the
change being placed into
production, while ensuring
high quality.
*DevOps: A Software Architect's Perspective, Bass Zhu

17. WHERE IS THE TESTING?
#DevOpsTesting

18. WHERE IS THE TESTING?
#DevOpsTesting

19. WHY THE PUSH BACK?
#DevOpsTesting
“Testers slow
us down”
“You don’t
use my
dev tools.”
“Testers can’t work in a true CI/CD
environment.”“Developers can just be
testers…” “If it’s not automated, it’s not real DevOps…

20. TESTING IN ALIVE IN AGILE / DEVOPS
#DevOpsTesting
*Forrester, The 2015 State Of Agile Development

21. THREE FACTORS AT PLAY
CONTIUOUS
QUALITYDISRUPTION
DEMAND FOR
AUTOMATION

22. #DevOpsTesting
THRIVING IN DISRUPTION
Quality and Convenience Drives “Customer Success”
Product Innovation and Development is
Changing
Software Development is also changing and
embracing Automation
Agile and DevOps is the new norm
But, how to drive “Continuous” Quality at Speed
in this Disruption?

23. PUTTING “TEST” IN “DEVOPS” =
“DEVTESTOPS”
#DevOpsTesting
DevTest
Enabling “Continuous Quality”
Ops

24. #DevOpsTesting
UNDERSTANDING “CONTINUOUS”
TERMINOLOGY
Process of delivering software updates to users on
a nearly constant basis.
Code can be rapidly and safely deployed to production by delivering every change to
a production-like environment
Continuous Integration Continuous Integration means the constant integration of changes to an application
at all stages of the delivery chain.
Continuous deployment is the next step of continuous delivery

25. HOW ARE WE ENABLING
DEVTESTOPS?
#DevOpsTesting
Achieve Continuous Quality with Speed
LOW
LOW
QUALITY
HIGH
HIGH
SPEED
1
2
3
Automation at
Speed of Dev
Clear Focus on
DevTestOps
Right Test
Infrastructure for
Dev and Test Teams

26. #DevOpsTesting
FOCUS TIPS FOR TESTERS
AMAZON TWO
PIZZA RULE
THINK SMALL, REAL SMALLAUTOMATION FIRST
APPROACH
GET SMART
PAIR UP

27. TEST AUTOMATION AT SPEED OF
DEV
User creates
story
Defines
acceptance criteria
Dev
Test
Dev team codes the
User Story
Apply action and validation steps
in automation components
Story available for test
Mapping script with code
Run test
FAIL
Report to dev. team
Code Check-in
PASS
Add to sprint suite
Trigger CI
Update result in
JIRA
Discuss Requirements,
Application flow, Test
Points
#DevOpsTesting
Example In-Sprint Workflow
1
Day-Zero Test automation for
in-Sprint User stories is the
only way Agile Testing can be
scaled 2
3
Test automation consistency
and maintenance is hard to
achieve in real world Always tie test automation
to source code branch that
is being developed.

28. INFRASTRUCTURE FOR DEVTESTOPS
#DevOpsTesting
Build
Plan
Code
Test

29. #DevOpsTesting
GETTING PRACTICAL

30. PROACTIVITY VOLUNTEER
#DevOpsTesting
“I
VOLUNTEER!”
“We are going to
start a pilot
DevOps project
with…”

31. ATTEND CONFERENCES
#DevOpsTesting

32. LISTEN AND LEARN TEST
AUTOMATION
#DevOpsTesting

33. TAKEAWAYS FOR THE
TESTERS
#DevOpsTesting
• Testing and QA is not Dead.
• Testing certainly is changing and Testing professionals
have to step up and embrace the change (DevTestOps).
• Learn to do basic coding and embrace automation.
• Staying with manual testing is not going to be fun.
– Learn TDD/BDD Frameworks like Gauge and
Cucumber
• Distributed teams with QA embedded in the sprint teams is
the new normal.
• So called independent QA teams are fading away. QA
Managers have to become hands on and enable
DevTestOps

34. #DevOpsTesting
Questions?

35. #DevOpsTesting
Thank You

36. TRUE AGILE AND
DEVTESTOPS
EXPERIENCE
#DevOpsTesting