The document discusses shifting testing left and right to better align with DevOps practices. Shifting left involves including more testing earlier in the development process like unit and integration testing. Shifting right means adding more testing during deployment like monitoring and testing in production environments. The goal is to improve quality, reduce risks, and better support continuous delivery of software.

1. © All rights reserved, H.S PractiTest 2022
Align Testing With The Business
By Shifting Left & Right
Joel Montvelisky
PractiTest Co-Founder & Chief Solution Architect

2. © All rights reserved, H.S PractiTest 2022
About Me!
QA / Testing
(last 24 years)
● Tester
● QA Manager
● Blogger / Podcaster
● Speaker
● Consultant
● Solution Architect
PractiTest
● Co-Founder
● Chief Solution Architect
Other Stuff
● AST Board Member
● State of Testing™
● Online Test Conference
Joel Montvelisky
Follow: @joelmonte

3. © All rights reserved, H.S PractiTest 2022
About
Increase Visibility & Communication
Streamline Processes
Enhance Efficiency
Lower Cost and Improve ROI
Reduce Time to Market
Integrate manual and automated testing in one central platform
Trusted by global brands across all industries

4. © All rights reserved, H.S PractiTest 2022

5. © All rights reserved, H.S PractiTest 2022

6. © All rights reserved, H.S PractiTest 2022
The Cloud / DevOps Disruption

7. © All rights reserved, H.S PractiTest 2022
How did we get to DevOps?

8. © All rights reserved, H.S PractiTest 2022
✓ No more shipping CDs / posting download links
✓ Full control of the server infrastructure
✓ Deploy as frequently as needed
✓ Instrumentation ⇒ No more flying blind!
The Cloud / DevOps Disruption

9. © All rights reserved, H.S PractiTest 2022
It’s now more cost-effective
to “find” some bugs in production
The Cloud / DevOps Disruption

10. © All rights reserved, H.S PractiTest 2022
A different set of rules, speed and constraints
The Cloud / DevOps Disruption

11. © All rights reserved, H.S PractiTest 2022
Before we start “shifting”
…
some important adaptations

12. © All rights reserved, H.S PractiTest 2022
More Than Before - It’s About Risk Management
☯ Pre-Deployment vs. In-Production testing
☯ Speed vs. Required stability
☯ Proactivity vs. Reactivity

13. © All rights reserved, H.S PractiTest 2022
It’s Critical To Model Your System & Environments
✎ Evaluate changes and risks
✎ Have predefined responses for issues
✎ Facilitate communication between scattered teams

14. © All rights reserved, H.S PractiTest 2022
Check Out The Holistic Testing Approach
By Janet Gregory
https://janetgregory.ca/testing-from-a-holistic-point-of-view/

15. © All rights reserved, H.S PractiTest 2022
Let’s Go Ahead
and Shift Left

16. © All rights reserved, H.S PractiTest 2022
User Story Formatting & Planning
● Test Scenarios / Acceptance Criteria
● Important quality factors
● Required instrumentation
● Deployment considerations:
Feature Flags, Partial Updates, Migrations, etc.

17. © All rights reserved, H.S PractiTest 2022
User Story Value Hypothesis (USVH)
1. Clear understanding of the value seeked
2. Define metrics & benchmarks
3. Ensure instrumentation
4. Coordinate as part of the Dev and Ops tasks

18. © All rights reserved, H.S PractiTest 2022
Test Planning
✓ Application and Environment modeling
✓ What to test before deployment?
What in production?
✓ Analyse required deployment tests (if/when needed)

19. © All rights reserved, H.S PractiTest 2022
Shift-Left Testing
⇽ Include Unit & Integration Tests into traceability
⇽ Test coaching and enablement for non-testers
⇽ Pair testing/feedback sessions during development

20. © All rights reserved, H.S PractiTest 2022
Let’s Push Forward
And Shift Right

21. © All rights reserved, H.S PractiTest 2022
Deployment Operations
🛫 Deployment / Rollback testing
🛫 1 min / 5 min / 30 min monitoring
🛫 Dark Launching / Feature Flags
🛫 Blue Green Deployment / Canary Release

22. © All rights reserved, H.S PractiTest 2022
Automation In Production (?)
☸ Short sanity as part of 5 min monitoring
☸ Continuous Functional & API testing on prod environment
☸ Live dashboards

23. © All rights reserved, H.S PractiTest 2022
Monitor & Analytics
📊 Exception and Alert monitoring
📊 User behaviour analytics ❗❗
📊 USHV dashboards
📊 Feedback sessions with real users

24. © All rights reserved, H.S PractiTest 2022
It’s An On-Going
Improvement Project

25. © All rights reserved, H.S PractiTest 2022
Do, Fail, Learn, Change, Evolve
↻ Try things, you need to fail on your road to success
↻ Listen to feedback from your team
↻ Learn from the community
↻ Embrace change

26. © All rights reserved, H.S PractiTest 2022
It’s Not About Testing.
It’s Not About Quality.
It’s About The Business!
Finally…

27. © All rights reserved, H.S PractiTest 2022
Thank you!
joel@practitest.com
@joelmonte
https://www.practitest.com/