Risk-Based Test Techniques
•
1 like•114 views
This document discusses risk-based testing techniques that can help address why testing fails on agile projects. It provides an overview of risk-based testing activities like risk identification, assessment, and mitigation. Specific risk analysis techniques are also summarized, including hazard analysis, cost of exposure analysis, failure mode and effect analysis, fault tree analysis, and quality function deployment. The document aims to demonstrate how applying a risk-based approach to testing can help with test estimation, scope, prioritization, and determining release readiness for agile projects.
Recommended
More Related Content
Similar to Risk-Based Test Techniques
Similar to Risk-Based Test Techniques (20)
More from GlobalLogic Ukraine
More from GlobalLogic Ukraine (20)
Recently uploaded
Recently uploaded (20)
Risk-Based Test Techniques
- 1. Risk-based test techniques on Agile projects Anton Muzhailo, GlobalLogic Ukraine
- 2. About me • ISTQB Certified Test Manager • Provide ISTQB Certified Trainings in CodeSpace • 300+ full course attendees during 4 years /in/muzhailo Anton Muzhailo Lead Automation Engineer, GlobalLogic In other words I’m basically doing: • Test Automation • Performance Testing • Test Management • Consulting in domains above • Teaching & Mentoring
- 3. Why testing fails on agile projects? Priority changes 1 Scope changes 2 Unclear requirements 3 And one more thing… 4 You are not Agile enough
- 4. Risk-based testing will help! Risk s Test estimation Release readiness Test scope Testing depth Test reduction Test prioritization
- 5. Quick reminder Risk characteristics Impact Likelihood Risk Level = Likelihood * Impact Technical stakeholders Determine Business stakeholders Determine
- 6. Risk-based vs Req-based Feature Acceptance Criteria 1 Feature Acceptance Criteria 2 Test case 1 Test case 2 Test case 3 Test case 1 Test case 2 Test case 3 Risk1 Risk2 Risk3
- 7. Risk-based testing activities Risk identification Risk assessment Risk mitigation Risk management
- 8. Risk Identification Techniques Independent assessments Project retrospectives Brainstorming Checklists Calling on past experience
- 9. Risk Assessment Determining the likelihood and impact for each risk Evaluating or assigning other properties of each risk, such as risk owner Cutting down the risks we don’t care about
- 10. Risk Mitigation Testing: Static and Dynamic Risk Contingency Accepting the risk
- 11. Risk Management Techniques Systematic Software Testing Pragmatic Risk Analysis and Management Product RISk MAnagement Hazard Analysis Cost of exposure Failure Mode and Effect Analysis Quality Function Deployment Fault Tree Analysis Process Decision Program Chart Event Tree Analysis
- 12. Systematic Software Testing Forming a Brainstorming Team Compile a list of features Determine the likelihood Determine the Impact Assign numeric values (RL) Compute the risk priority Review/modify the values Prioritize the features Determine the cut line Consider mitigation 1 2 3 4 5 6 7 8 9 10
- 13. Movie subscription system Likelihood Impact Risk LevelFeatures Attributes Change resolution 0.9 0.9 0.81 To be tested Play the movie 0.5 1 0.5 Performance 0.25 0.9 0.225 Security 0.25 0.25 0.125 Buy subscription 0.1 1 0.1 See recommendations 0.9 0.25 0.225 Accepted Create account 0.1 1 0.1 Not to be tested (or less) Recover account 0.1 0.9 0.09 Usability 0.25 0.25 0.625
- 14. Hazard Analysis Causes Hazard Consequences Risk Reduction Strategies Mitigation actions Safety Requirements Hazard Analysis Risk Reduction Hazard analysis techniques include: • Function Failure Analysis • Event Tree Analysis • Failure Modes and Effects Analysis • Fault Tree Analysis • Cause-consequence Diagrams • Hazard and Operability Studies.
- 15. Cost of exposure. Risk exposure Risk exposure (RE) = 2% * 80K = 1600 Risk Probability of occurring Total loss if it occurs Risk exposure Product recall situation 2% 80K 1600 Significant product rejection 0.1% 100K 1000 Competitive strike 10% 25K 2500 Most serious risk
- 16. Cost of exposure. Risk Reduction Leverage Risk Probability of occurring Total loss if it occurs Risk exposure Competitive strike 10% 25K 2500 Countermeasure Total cost New risk probability New total loss New Risk exposure RRL Advertising campaign 40K 3% 5K 150 0.059 Price promotions 30K 5% 10K 500 0.067 Simultaneous launch 10K 8% 15K 1200 0.13 Risk Reduction Leverage (RRL) = (2500 – 150) / 40000 = 0.059 Most cost-effective contermeasure
- 18. Failure Mode and Effect Analysis Function or Process Step Failure type Potential Impact Seve rity Potential Causes Occur rence Detection Mode Detecta bility RPN Temperature sensor. Measures the environment temperature Sensor failure Overheating or constant cooling 10 Wrong usage environment, old sensor, poor sensor quality 2 Subjective temperature measurement, thermometer 4 80 Recommend ed Actions Responsibili ty Target Date Action taken Severity Occure nce Detecta bility RPN Add extra sensor as duplicated Engineering ASAP If difference between sensors – shut down the system 3 2 1 6
- 19. Quality Function Deployment How to satisfy customer wants Relationships Matrix What the customer wants Target values Technical evaluation Competitive assessment Correlation MatrixCustomer Importance ratings Weighted rating • Customer focused • Allows Competitor Analysis • Development priorities oriented on end-user needs • Formal Validation • Shows design flaws and dependencies
- 20. Correlations: Strong Positive Positive Strong Negative Negative + + _ _ Relationships: Strongest= 10 Strong= 7 Fair= 4 Weak= 1 ●● ● • https://youtu.be/u9bvzE5Qhjk
- 21. Fault Tree Analysis • Displays all possible causes that leads to fault • A fault can be replaced by risk • If we know all possible causes of the risk – we can remove or prevent them
- 22. Car hits an object AND Driver doesn’t see the object Car fails to break OR OR Driver drunk Object is not visible from car Driver asleep Car going too fast Weak brakes https://www.smartdraw.com/fault-tree/examples/fault-tree-example-vehicle-collision/
- 23. Wanna know more? • Pragmatic Risk Analysis and Management – https://rbcs-us.com/site/assets/files/1159/a-case-study-in-risk-based-testing. pdf • Product Risk Management: – http://www.erikvanveenendaal.nl/NL/files/e-book%20PRISMA.pdf • Fault Tree Analysis / Event Tree Analysis – https://www.amazon.com/Fault-Analysis-Primer-Clifton-Ericson/dp/1466446 102 – https://www.amazon.com/Risk-Assessment-Tools-Techniques-Applications/d p/047089203X
- 24. Q & A