Testing comes into its own
in DevOps
Development and Operations get their names in lights, but Testing is the Magic!
LinkedIn.com/in/jackmaherpmp
Testing has been the Rodney Dangerfield of the
technology space for the last time:
LinkedIn.com/in/jackmaherpmp
DevOps is a cultural and professional
movement that stresses communication,
collaboration and integration between
software developers and IT operations
professionals.
The resulting improved workflow provides
businesses the flexibility to change, and
change quickly, without sacrificing the
quality and reliability of their IT-based business services.
DevOps provides companies a competitive advantage
by delivering better software, faster and by enabling sustained innovation.
DevOps
clipped compound of "development" and "operations"
Graphic credit: By Kharnagy - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=51215412
LinkedIn.com/in/jackmaherpmp
• DevOps is frequently associated with automating technology development
practices, such as Continuous Integration and Continuous Delivery,
and the tools needed to do these things
• But it is a lot more than that, and goes much deeper, with the foundation of
The Three Ways:
1 - Systems Thinking
2 - Shorten & Amplify Feedback Loops
3 - Culture of Experimentation & Learning
DevOps & Testing
LinkedIn.com/in/jackmaherpmp
You might not guess it from the name
but testing rules DevOps
• Largely misunderstood as a way of reducing testing costs,
automated testing is now a demand, as companies realize
the need and benefit of 100% testing coverage.
•Automated testing is the key that unlocks our ability to
deliver solutions faster, cheaper, safer, and better!
LinkedIn.com/in/jackmaherpmp
You might not guess it from the name
but testing rules DevOps
Image copyright DevOps Institute®
used with permission
LinkedIn.com/in/jackmaherpmp
Lean
– never knowingly pass a defect downstream
“Just as long as the brakes work 99% of the time…”
- Noone Ever
• Automated testing brings breakthrough capabilities
with step change improvements to performance, cost,
and flexibility
• Testing coverage and types – logistical implications
LinkedIn.com/in/jackmaherpmp
Current state thinking is based on flow
In current state architecture and technology implementation practices
testing becomes center stage, because without automated testing and
its attendant logistics, the flow of value is disrupted.
Does that sound like a bad thing?
Yes, the disruption of the flow of value incurs, or is a symptom of,
waste.
LinkedIn.com/in/jackmaherpmp
Theory of
Constraints
There is always
one constraint
that limits the
performance
of a system.
LinkedIn.com/in/jackmaherpmp
-- The truest feedback loop --
Understanding the Value Stream
Flow
Flow
-- automate the flow --
Understanding the Value Stream
“Only brush and floss
the teeth you want to keep.”
- Dr. Heidi Munz, DDS
“Which half do you want to test?” - the last QA manager
• The fundamentals of test design become even more important
– Efficiency without effectiveness
becomes a faster way to waste
resources
• Long term re-usability
– as in Continuous Testing
• Built in telemetry
continuous monitoring for performance
boundary testing and negative testing
• No more manual testers?
– Not as many,
Much more strategic
Testing & Test Design
Allistair Scott –
https://watirmelon.blog/2016/05/18/ama-the-eye-above-my-testing-pyramid/LinkedIn.com/in/jackmaherpmp
Old Skills & New Skills
• Traditional Testing skills
• Test design
• Domain knowledge
• Process understanding
• Automated Testing skills
• Test automation concepts & practices
• Telemetry and real-time monitoring
• Machine Learning and data analysis
LinkedIn.com/in/jackmaherpmp
Resources – We need more people!
• Need MORE skills and people
Recruiting the displaced, leveraging experience
• Keeping it up
Charlie & The Chocolate Factory meets Groundhog Day
• Matching business technology investments
Risk (cost) vs. Value
LinkedIn.com/in/jackmaherpmp
Extra Credit: Personas
Personas
– they’re not just for marketing & UX/UI
• Shared Libraries – synthesized insights
• Re-use with evolutionary attributes
• Provide depth and context
LinkedIn.com/in/jackmaherpmp
Testing is the real magic!
Jack Maher, MSIS, PMP, DOL, CAL
jackmaherllc@gmail.com
Connect with me on LinkedIn at
https://LinkedIn.com/in/jackmaherpmp
https://StandingOnShoulders.us
Standing On Shoulders:
A Leader’s Guide to Digital Transformation
Testing Comes into its Own in DevOps by Jack Maher

Testing Comes into its Own in DevOps by Jack Maher

  • 1.
    Testing comes intoits own in DevOps Development and Operations get their names in lights, but Testing is the Magic! LinkedIn.com/in/jackmaherpmp
  • 2.
    Testing has beenthe Rodney Dangerfield of the technology space for the last time: LinkedIn.com/in/jackmaherpmp
  • 3.
    DevOps is acultural and professional movement that stresses communication, collaboration and integration between software developers and IT operations professionals. The resulting improved workflow provides businesses the flexibility to change, and change quickly, without sacrificing the quality and reliability of their IT-based business services. DevOps provides companies a competitive advantage by delivering better software, faster and by enabling sustained innovation. DevOps clipped compound of "development" and "operations" Graphic credit: By Kharnagy - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=51215412 LinkedIn.com/in/jackmaherpmp
  • 4.
    • DevOps isfrequently associated with automating technology development practices, such as Continuous Integration and Continuous Delivery, and the tools needed to do these things • But it is a lot more than that, and goes much deeper, with the foundation of The Three Ways: 1 - Systems Thinking 2 - Shorten & Amplify Feedback Loops 3 - Culture of Experimentation & Learning DevOps & Testing LinkedIn.com/in/jackmaherpmp
  • 5.
    You might notguess it from the name but testing rules DevOps • Largely misunderstood as a way of reducing testing costs, automated testing is now a demand, as companies realize the need and benefit of 100% testing coverage. •Automated testing is the key that unlocks our ability to deliver solutions faster, cheaper, safer, and better! LinkedIn.com/in/jackmaherpmp
  • 6.
    You might notguess it from the name but testing rules DevOps Image copyright DevOps Institute® used with permission LinkedIn.com/in/jackmaherpmp
  • 7.
    Lean – never knowinglypass a defect downstream “Just as long as the brakes work 99% of the time…” - Noone Ever • Automated testing brings breakthrough capabilities with step change improvements to performance, cost, and flexibility • Testing coverage and types – logistical implications LinkedIn.com/in/jackmaherpmp
  • 8.
    Current state thinkingis based on flow In current state architecture and technology implementation practices testing becomes center stage, because without automated testing and its attendant logistics, the flow of value is disrupted. Does that sound like a bad thing? Yes, the disruption of the flow of value incurs, or is a symptom of, waste. LinkedIn.com/in/jackmaherpmp
  • 9.
    Theory of Constraints There isalways one constraint that limits the performance of a system. LinkedIn.com/in/jackmaherpmp
  • 10.
    -- The truestfeedback loop -- Understanding the Value Stream Flow Flow
  • 11.
    -- automate theflow -- Understanding the Value Stream
  • 12.
    “Only brush andfloss the teeth you want to keep.” - Dr. Heidi Munz, DDS “Which half do you want to test?” - the last QA manager
  • 13.
    • The fundamentalsof test design become even more important – Efficiency without effectiveness becomes a faster way to waste resources • Long term re-usability – as in Continuous Testing • Built in telemetry continuous monitoring for performance boundary testing and negative testing • No more manual testers? – Not as many, Much more strategic Testing & Test Design Allistair Scott – https://watirmelon.blog/2016/05/18/ama-the-eye-above-my-testing-pyramid/LinkedIn.com/in/jackmaherpmp
  • 14.
    Old Skills &New Skills • Traditional Testing skills • Test design • Domain knowledge • Process understanding • Automated Testing skills • Test automation concepts & practices • Telemetry and real-time monitoring • Machine Learning and data analysis LinkedIn.com/in/jackmaherpmp
  • 15.
    Resources – Weneed more people! • Need MORE skills and people Recruiting the displaced, leveraging experience • Keeping it up Charlie & The Chocolate Factory meets Groundhog Day • Matching business technology investments Risk (cost) vs. Value LinkedIn.com/in/jackmaherpmp
  • 16.
    Extra Credit: Personas Personas –they’re not just for marketing & UX/UI • Shared Libraries – synthesized insights • Re-use with evolutionary attributes • Provide depth and context LinkedIn.com/in/jackmaherpmp
  • 17.
    Testing is thereal magic! Jack Maher, MSIS, PMP, DOL, CAL jackmaherllc@gmail.com Connect with me on LinkedIn at https://LinkedIn.com/in/jackmaherpmp https://StandingOnShoulders.us Standing On Shoulders: A Leader’s Guide to Digital Transformation