Looking to accelerate your testing strategy without missing a turn? There’s no need to stop and ask for directions. In this webinar we’ll show you how to solve the most common test delivery issues and close the gaps in your DevOps strategy using Helix ALM. You’ll see how easy it is to speed up test delivery by setting up coverage for both manual and automated testing teams. Join Nico Krüger to see how Helix ALM can help you simplify test management. You'll learn how to: -Cover both shift left and shift right testing. -Track testing progress, handle bugs and manage re-testing efforts. -Ensure complete test coverage for every part of your product.

1. Turn by Turn: A Practical Guide to Test Management
NICO KRÜGER, CTO, HELIX ALM — PERFORCE SOFTWARE

2. 2 | A Practical Guide to Test Management in Helix ALM perforce.com
Presenter
Nico Krüger
Chief Technical Officer, Helix ALM
Perforce Software

3. 3 | A Practical Guide to Test Management in Helix ALM perforce.com
What We’ll Cover
1
2
3
What shift left and shift right testing cover.
How to track testing progress, handle bugs, and manage re-testing efforts.
Why Helix ALM is the best way to ensure complete test coverage.

4. 4 | A Practical Guide to Test Management in Helix ALM perforce.com
What Shift Left and Shift Right Testing Cover
Shift Left Shift Right
of New Code of Every Build of Every Deployment In Production

5. 5 | A Practical Guide to Test Management in Helix ALM perforce.com
Why Shift Left?
• Deliver more software at a faster
rate.
• Shift left: start testing earlier in the
process.
• Focus on problem prevention.
AttentiontoQuality
Plan and
Design
Develop
and Build
Test Deploy and
Release
Monitor
and Analyze
Shift Left
Model Traditional
Quality
Model

6. 6 | A Practical Guide to Test Management in Helix ALM perforce.com
Why Shift Right?
• Building quality in itself is not enough in today’s
competitive market.
• Using continuous feedback from users is equally
important in the testing process.
• Ensuring that what was created works in
practice for real users — not just matches the
design or user needs.

7. 7 | A Practical Guide to Test Management in Helix ALM perforce.com
Benefits of Shifting Left and Shifting Right
• Find bugs earlier.
• Save time later on.
• Improve test coverage and quality.
• Foster teamwork between
developers and testers.
• Improve software delivery cycles.
• Reduce costs over time.
• Reduce technical debt.
Illustration from “Continuous testing in DevOps” (Dan Ashby)

8. 8 | A Practical Guide to Test Management in Helix ALM perforce.com
Things to Think About
Change
How do you handle design changes
based on customer feedback?
Visibility
Can you capture all these testing results
effectively? And prioritize and act on
them?
Risk
How can this help you reduce risk and lower
time to market?

9. A Practical Guide to Test Management with Helix ALM
Track testing progress, handle bugs, and manage re-testing efforts

10. 10 | A Practical Guide to Test Management in Helix ALM perforce.com
Common Test Activities For Each Release
Risk analysis
Effort estimates
Test strategy
Project plan
Requirements review
Test design
Test data creation
Test automation
Automated testing
Manual test execution
Performance testing
Test results
Defect reports
Metrics analysis
Actuals vs. planned
Planning Preparation Execution Outcome

11. 11 | A Practical Guide to Test Management in Helix ALM perforce.com
Planning Activities
• What are we building?
• High risk items
• Release and sprint breakdown
• Test plan and strategy
Requirement / user story
Test cases, test suites, estimations
Commit work to sprint / release
Classification, risk score

12. 12 | A Practical Guide to Test Management in Helix ALM perforce.com
1. What Are We Building?
• Requirement / user story in Helix ALM:

13. 13 | A Practical Guide to Test Management in Helix ALM perforce.com
2. High Risk Items
• Classification and risk score in Helix ALM:

14. 14 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Release and Sprint Breakdown
• Commit work to sprint / release in Helix ALM:

15. 15 | A Practical Guide to Test Management in Helix ALM perforce.com
4. Test Plan and Strategy
• Test cases and test suites in Helix ALM:

16. 16 | A Practical Guide to Test Management in Helix ALM perforce.com
Preparation Activities
• Requirements reviewed
• Test coverage
• Test design
• Manual vs. automated
Review process, approvals
Traceability
Test cases
Manual vs. automated inputs

17. 17 | A Practical Guide to Test Management in Helix ALM perforce.com
1. Requirements Reviewed
• Review process and approvals in Helix ALM:

18. 18 | A Practical Guide to Test Management in Helix ALM perforce.com
2. Test Coverage
• Traceability in Helix ALM:

19. 19 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Test Design
• Manual test cases in Helix ALM:

20. 20 | A Practical Guide to Test Management in Helix ALM perforce.com
4. Manual vs. Automated
• Capture results in Helix ALM:
REST API
< />
Helix ALM
Server
Define and manage test
cases in Helix ALM.
Use {ANY} test automation
framework to create and
execute tests in.
1. Create automation scripts.
2. Create test case in Helix
ALM for each automated
test.
3. Use Helix ALM’s REST API
to generate test runs and
record test results.
Endpoint:
…/helix-
alm/api/v0/testruns/generate/
POST:
{
testCaseIDs : [50,89],
events : []
}

21. 21 | A Practical Guide to Test Management in Helix ALM perforce.com
Execution Activities
• Execution
• Results
Pass, fail actions
Track results

22. 22 | A Practical Guide to Test Management in Helix ALM perforce.com
1. Execution
• Pass or fail actions in Helix ALM:

23. 23 | A Practical Guide to Test Management in Helix ALM perforce.com
2. Execution
• Track results in Helix ALM:

24. 24 | A Practical Guide to Test Management in Helix ALM perforce.com
Outcome Activities
• Production monitoring and feedback
• How to track and manage results and
feedback
• Incorporate into future testing
Capture feedback
Capture feedback
Improve test coverage

25. 25 | A Practical Guide to Test Management in Helix ALM perforce.com
• Capture feedback in Helix ALM:
1. Production Monitoring and Feedback

26. 26 | A Practical Guide to Test Management in Helix ALM perforce.com
2. How to Track and Manage Results and Feedback
• Capture feedback in Helix ALM:
SoloSubmit
REST API
Web or Desktop Client

27. 27 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Incorporate into Future Testing
• Improve test coverage in Helix ALM:

28. The Results
End-to-end traceability
Higher quality
Faster time to deployment

29. Q & A