SlideShare a Scribd company logo
Risk-based Testing: Not for the
Fainthearted
George Wilkinson
Grove Consultants
george@grove.co.uk
www.grove.co.uk
Risk…a definition
Definition: ISO 31000: (2009)
Risk Management standard
definition, defines risk as:
“the effect of uncertainty
on objectives whether
positive or negative”

A more common project
definition of ‘risk’ is:
“the probability of an event,
hazard, threat or situation
occurring resulting in
undesirable consequences”
Testing…the challenges
risks are present due to:
a) Time pressures
b) System sophistication
c) Budget restrictions
d) Changing requirements
e) Resource challenges
…and on…and on…and on…

Test: a definition
“a particular process or method for
trying or assessing”
Our objectives:
• Find defects
• Raise confidence
• Have conformance to regulation
• Combinations of the above

In the act of
„testing‟ we need
FOCUS!!!
The TiNA project

London Civil and
Military Airspace
System
Existing FDP
system

Replacement FDP
system
Why is your system important?
flight numbers are
continually growing
world-wide
in 2010:
over the entire UK 2.1
million flights were
handled in controlled
airspace
over 200 million
passengers flew

“The safety of the
passengers rely upon
this system”

do you have a reason why
your system is important?
…if not find one!
Risk Exposure =
Probability * Consequence

Understanding Risk
Probability

Risk 1
100% 5

Risk Exposure = 2*2 = 4

75% 4

Risk 2
Risk Exposure = 4*2 = 8

50% 3

Risk 3

25% 2
1%

Risk Exposure = 2*4 = 8

Risk

Risk 4

1
1

2

3

4

5

Risk Exposure = 4*4 = 16
Consequence
Risk Management

risk
identification

•
•
•
•
•

risk workshops
expert interviews
heuristics
lessons learned
checklists
 Investig




risk
analysis
risk
mitigation
(control)

Try to…calculate
Risk Exposure



Risk
monitoring

ENGAGE THE STAKEHOLDERS!

ate
Ignore
Project
Mitigatio
n
Test
Conting
ency
plan
Risk-based Testing…points to note
can be hard to commit to…
can help answer:
how much testing is enough

is a risky business in itself
does not mean test all known risks

The main initiative being…
to provide detailed information to help „management‟
make a decision on whether a system is ready for
release
Is it them or is it us…?
Number

Software Risk item Frequency

Frequency

1

Misunderstanding of requirements

5

1

Lack of top management support

5

3

Lack of adequate user involvement

4

4

Failure to gain user commitment

3

5

Failure to manage end user expectations

3

6

Changes to requirements

3

7

Lack of an effective project management methodology

3

Project Management is project focussed
Test Management is product focussed
Source: Top Ten Lists of Software Project Risks: Evidence from Literature Survey by
Tharwon Arnuphaptrairong
Behaviours in Risk Based Testing #1

build the relationship with Project Management
test need to work close with Project Management
appreciate Project Management objectives
push Project Management for risk based decisions

learn to use „risk language‟
when verbalising risks
when writing risks
Behaviours in Risk Based Testing #2
all „risk management‟ activities should be efficient
act boldly, time is limited
ensure risk workshops are facilitated well
learn the lessons from past mistakes

retain the „risk based approach‟
in strategy and planning
in execution
on the next release
….when you are tired

Chance
of failure
Test
and report

Risk
Management
Plan
For Test
Risk-based reporting
start

today

end date

residual
risks of
releasing
TODAY
all risks
„open‟ at
the start

Progress through the test plan
Source: Risk Based E-Business Testing – Paul Gerrard & Neil Thompson
Defect data provides a message…choose well
defect density
70
60
50
40

defect density analysis

30
20
10

0

140
120
100

defects found versus fixed

80

Found

60

Fixed

40
20
0
Day Day Day Day Day Day Day Day Day Day
1
2
3
4
5
6
7
8
9
10
Summary
risks in modern systems are prevalent and testing
requires focus
risk based testing requires:
a good relationship with project management
an efficient risk management approach
good communication and reporting
discipline

success comes with taking
risks

More Related Content

What's hot

Terry Johns: Uncertainty - understanding the impact and the importance of rec...
Terry Johns: Uncertainty - understanding the impact and the importance of rec...Terry Johns: Uncertainty - understanding the impact and the importance of rec...
Terry Johns: Uncertainty - understanding the impact and the importance of rec...
Association for Project Management
 
Proactive vs. Reactive Approaches to Software Security Strategy
Proactive vs. Reactive Approaches to Software Security StrategyProactive vs. Reactive Approaches to Software Security Strategy
Proactive vs. Reactive Approaches to Software Security StrategyLindsey Landolfi
 
Software Engineering Risk Management Software Application
Software Engineering Risk Management   Software ApplicationSoftware Engineering Risk Management   Software Application
Software Engineering Risk Management Software Applicationguestfea9c55
 
Risk Management Maturity Model (RMMM)
Risk Management Maturity Model (RMMM)Risk Management Maturity Model (RMMM)
Risk Management Maturity Model (RMMM)
Adnan Naseem
 
Risk management
Risk managementRisk management
Risk management
Usman Mukhtar
 
Strayer cis 517 week 9 assignment 6 voip part 4
Strayer cis 517 week 9 assignment 6 voip part 4Strayer cis 517 week 9 assignment 6 voip part 4
Strayer cis 517 week 9 assignment 6 voip part 4
aagnaa
 
Risk analysis
Risk analysis  Risk analysis
Risk analysis
Arvind Kumar
 
Project risk analysis
Project risk analysisProject risk analysis
Project risk analysis
Nur E Alam Siddike
 
Strayer cis 517 week 9 assignment 6 voip part 4
Strayer cis 517 week 9 assignment 6 voip part 4Strayer cis 517 week 9 assignment 6 voip part 4
Strayer cis 517 week 9 assignment 6 voip part 4
aaronabrahhaam
 
Susan Parente Presents: Busting Barriers to Risk Management: PM Reston Lunche...
Susan Parente Presents: Busting Barriers to Risk Management: PM Reston Lunche...Susan Parente Presents: Busting Barriers to Risk Management: PM Reston Lunche...
Susan Parente Presents: Busting Barriers to Risk Management: PM Reston Lunche...
Liana Underwood
 
Risk Mitigation, Monitoring and Management Plan (RMMM)
Risk Mitigation, Monitoring and Management Plan (RMMM)Risk Mitigation, Monitoring and Management Plan (RMMM)
Risk Mitigation, Monitoring and Management Plan (RMMM)
Navjyotsinh Jadeja
 
Risk analysis
Risk analysisRisk analysis
Risk analysis
Indu Sharma Bhardwaj
 
Risk Management by Roger Pressman
Risk Management by Roger PressmanRisk Management by Roger Pressman
Risk Management by Roger Pressman
Rogerio P C do Nascimento
 
A Risk Analysis and Management in Software Engineering
A Risk Analysis and Management in Software Engineering A Risk Analysis and Management in Software Engineering
A Risk Analysis and Management in Software Engineering
MuhammadTalha436
 
Risk Management Lifecycle PowerPoint Presentation Slides
Risk Management Lifecycle PowerPoint Presentation Slides Risk Management Lifecycle PowerPoint Presentation Slides
Risk Management Lifecycle PowerPoint Presentation Slides
SlideTeam
 

What's hot (16)

Terry Johns: Uncertainty - understanding the impact and the importance of rec...
Terry Johns: Uncertainty - understanding the impact and the importance of rec...Terry Johns: Uncertainty - understanding the impact and the importance of rec...
Terry Johns: Uncertainty - understanding the impact and the importance of rec...
 
Proactive vs. Reactive Approaches to Software Security Strategy
Proactive vs. Reactive Approaches to Software Security StrategyProactive vs. Reactive Approaches to Software Security Strategy
Proactive vs. Reactive Approaches to Software Security Strategy
 
Software Engineering Risk Management Software Application
Software Engineering Risk Management   Software ApplicationSoftware Engineering Risk Management   Software Application
Software Engineering Risk Management Software Application
 
Risk Management Maturity Model (RMMM)
Risk Management Maturity Model (RMMM)Risk Management Maturity Model (RMMM)
Risk Management Maturity Model (RMMM)
 
Risk management
Risk managementRisk management
Risk management
 
Strayer cis 517 week 9 assignment 6 voip part 4
Strayer cis 517 week 9 assignment 6 voip part 4Strayer cis 517 week 9 assignment 6 voip part 4
Strayer cis 517 week 9 assignment 6 voip part 4
 
Risk analysis
Risk analysis  Risk analysis
Risk analysis
 
Project risk analysis
Project risk analysisProject risk analysis
Project risk analysis
 
Strayer cis 517 week 9 assignment 6 voip part 4
Strayer cis 517 week 9 assignment 6 voip part 4Strayer cis 517 week 9 assignment 6 voip part 4
Strayer cis 517 week 9 assignment 6 voip part 4
 
Susan Parente Presents: Busting Barriers to Risk Management: PM Reston Lunche...
Susan Parente Presents: Busting Barriers to Risk Management: PM Reston Lunche...Susan Parente Presents: Busting Barriers to Risk Management: PM Reston Lunche...
Susan Parente Presents: Busting Barriers to Risk Management: PM Reston Lunche...
 
Risk Mitigation, Monitoring and Management Plan (RMMM)
Risk Mitigation, Monitoring and Management Plan (RMMM)Risk Mitigation, Monitoring and Management Plan (RMMM)
Risk Mitigation, Monitoring and Management Plan (RMMM)
 
Risk analysis
Risk analysisRisk analysis
Risk analysis
 
Risk Management by Roger Pressman
Risk Management by Roger PressmanRisk Management by Roger Pressman
Risk Management by Roger Pressman
 
A Risk Analysis and Management in Software Engineering
A Risk Analysis and Management in Software Engineering A Risk Analysis and Management in Software Engineering
A Risk Analysis and Management in Software Engineering
 
Risk Analysis
Risk AnalysisRisk Analysis
Risk Analysis
 
Risk Management Lifecycle PowerPoint Presentation Slides
Risk Management Lifecycle PowerPoint Presentation Slides Risk Management Lifecycle PowerPoint Presentation Slides
Risk Management Lifecycle PowerPoint Presentation Slides
 

Viewers also liked

Test Automation for Packaged Systems: Yes, You Can!
Test Automation for Packaged Systems: Yes, You Can!Test Automation for Packaged Systems: Yes, You Can!
Test Automation for Packaged Systems: Yes, You Can!
TechWell
 
Building Successful Test Teams
Building Successful Test TeamsBuilding Successful Test Teams
Building Successful Test Teams
TechWell
 
Creating Great User Experiences: Tips and Techniques
Creating Great User Experiences: Tips and TechniquesCreating Great User Experiences: Tips and Techniques
Creating Great User Experiences: Tips and Techniques
TechWell
 
Dealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentDealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and Commitment
TechWell
 
Agile at Scale with Scrum: The Good, the Bad, and the Ugly
Agile at Scale with Scrum: The Good, the Bad, and the UglyAgile at Scale with Scrum: The Good, the Bad, and the Ugly
Agile at Scale with Scrum: The Good, the Bad, and the Ugly
TechWell
 
Six Free Ideas to Improve Agile Success
Six Free Ideas to Improve Agile SuccessSix Free Ideas to Improve Agile Success
Six Free Ideas to Improve Agile Success
TechWell
 
Data Collection and Analysis for Better Requirements
Data Collection and Analysis for Better RequirementsData Collection and Analysis for Better Requirements
Data Collection and Analysis for Better Requirements
TechWell
 
Adaptive Leadership: Accelerating Enterprise Agility
Adaptive Leadership: Accelerating Enterprise AgilityAdaptive Leadership: Accelerating Enterprise Agility
Adaptive Leadership: Accelerating Enterprise Agility
TechWell
 
Management Issues in Test Automation
Management Issues in Test AutomationManagement Issues in Test Automation
Management Issues in Test Automation
TechWell
 
Make the Cloud Less Cloudy: A Perspective for Software Development Teams
Make the Cloud Less Cloudy: A Perspective for Software Development TeamsMake the Cloud Less Cloudy: A Perspective for Software Development Teams
Make the Cloud Less Cloudy: A Perspective for Software Development Teams
TechWell
 
Build Your Mobile Testing Knowledge
Build Your Mobile Testing KnowledgeBuild Your Mobile Testing Knowledge
Build Your Mobile Testing Knowledge
TechWell
 
Measurement and Metrics for Test Managers
Measurement and Metrics for Test ManagersMeasurement and Metrics for Test Managers
Measurement and Metrics for Test Managers
TechWell
 
Collaboration without Chaos
Collaboration without ChaosCollaboration without Chaos
Collaboration without Chaos
TechWell
 
Cause-Effect Graphing: Rigorous Test Case Design
Cause-Effect Graphing: Rigorous Test Case DesignCause-Effect Graphing: Rigorous Test Case Design
Cause-Effect Graphing: Rigorous Test Case Design
TechWell
 
Designing Self-maintaining UI Tests for Web Applications
Designing Self-maintaining UI Tests for Web ApplicationsDesigning Self-maintaining UI Tests for Web Applications
Designing Self-maintaining UI Tests for Web Applications
TechWell
 
Connecting with Customers
Connecting with CustomersConnecting with Customers
Connecting with Customers
TechWell
 
Test Management for Cloud-based Applications
Test Management for Cloud-based ApplicationsTest Management for Cloud-based Applications
Test Management for Cloud-based Applications
TechWell
 
It’s All Fun and Games: Using Play to Improve Tester Creativity
It’s All Fun and Games: Using Play to Improve Tester CreativityIt’s All Fun and Games: Using Play to Improve Tester Creativity
It’s All Fun and Games: Using Play to Improve Tester Creativity
TechWell
 

Viewers also liked (18)

Test Automation for Packaged Systems: Yes, You Can!
Test Automation for Packaged Systems: Yes, You Can!Test Automation for Packaged Systems: Yes, You Can!
Test Automation for Packaged Systems: Yes, You Can!
 
Building Successful Test Teams
Building Successful Test TeamsBuilding Successful Test Teams
Building Successful Test Teams
 
Creating Great User Experiences: Tips and Techniques
Creating Great User Experiences: Tips and TechniquesCreating Great User Experiences: Tips and Techniques
Creating Great User Experiences: Tips and Techniques
 
Dealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and CommitmentDealing with Estimation, Uncertainty, Risk, and Commitment
Dealing with Estimation, Uncertainty, Risk, and Commitment
 
Agile at Scale with Scrum: The Good, the Bad, and the Ugly
Agile at Scale with Scrum: The Good, the Bad, and the UglyAgile at Scale with Scrum: The Good, the Bad, and the Ugly
Agile at Scale with Scrum: The Good, the Bad, and the Ugly
 
Six Free Ideas to Improve Agile Success
Six Free Ideas to Improve Agile SuccessSix Free Ideas to Improve Agile Success
Six Free Ideas to Improve Agile Success
 
Data Collection and Analysis for Better Requirements
Data Collection and Analysis for Better RequirementsData Collection and Analysis for Better Requirements
Data Collection and Analysis for Better Requirements
 
Adaptive Leadership: Accelerating Enterprise Agility
Adaptive Leadership: Accelerating Enterprise AgilityAdaptive Leadership: Accelerating Enterprise Agility
Adaptive Leadership: Accelerating Enterprise Agility
 
Management Issues in Test Automation
Management Issues in Test AutomationManagement Issues in Test Automation
Management Issues in Test Automation
 
Make the Cloud Less Cloudy: A Perspective for Software Development Teams
Make the Cloud Less Cloudy: A Perspective for Software Development TeamsMake the Cloud Less Cloudy: A Perspective for Software Development Teams
Make the Cloud Less Cloudy: A Perspective for Software Development Teams
 
Build Your Mobile Testing Knowledge
Build Your Mobile Testing KnowledgeBuild Your Mobile Testing Knowledge
Build Your Mobile Testing Knowledge
 
Measurement and Metrics for Test Managers
Measurement and Metrics for Test ManagersMeasurement and Metrics for Test Managers
Measurement and Metrics for Test Managers
 
Collaboration without Chaos
Collaboration without ChaosCollaboration without Chaos
Collaboration without Chaos
 
Cause-Effect Graphing: Rigorous Test Case Design
Cause-Effect Graphing: Rigorous Test Case DesignCause-Effect Graphing: Rigorous Test Case Design
Cause-Effect Graphing: Rigorous Test Case Design
 
Designing Self-maintaining UI Tests for Web Applications
Designing Self-maintaining UI Tests for Web ApplicationsDesigning Self-maintaining UI Tests for Web Applications
Designing Self-maintaining UI Tests for Web Applications
 
Connecting with Customers
Connecting with CustomersConnecting with Customers
Connecting with Customers
 
Test Management for Cloud-based Applications
Test Management for Cloud-based ApplicationsTest Management for Cloud-based Applications
Test Management for Cloud-based Applications
 
It’s All Fun and Games: Using Play to Improve Tester Creativity
It’s All Fun and Games: Using Play to Improve Tester CreativityIt’s All Fun and Games: Using Play to Improve Tester Creativity
It’s All Fun and Games: Using Play to Improve Tester Creativity
 

Similar to Risk-based Testing: Not for the Fainthearted

Project/Program Risk management
Project/Program Risk managementProject/Program Risk management
Project/Program Risk management
Shan Sokhanvar (CISM, AWS-SAP, PMP, MCTS)
 
Risk.pdf
Risk.pdfRisk.pdf
Risk.pdf
hasan752746
 
Risk and Procurement ManagementDr Paul BaguleyClass Slides.docx
Risk and Procurement ManagementDr Paul BaguleyClass Slides.docxRisk and Procurement ManagementDr Paul BaguleyClass Slides.docx
Risk and Procurement ManagementDr Paul BaguleyClass Slides.docx
lillie234567
 
Project Controls Expo 18th Nov 2014 - "Practical Applications of a Risk Manag...
Project Controls Expo 18th Nov 2014 - "Practical Applications of a Risk Manag...Project Controls Expo 18th Nov 2014 - "Practical Applications of a Risk Manag...
Project Controls Expo 18th Nov 2014 - "Practical Applications of a Risk Manag...
Project Controls Expo
 
Risk strategies presentation
Risk strategies presentationRisk strategies presentation
Risk strategies presentation
Raven Morgan
 
ECC_Black_Swan_2008_4
ECC_Black_Swan_2008_4ECC_Black_Swan_2008_4
ECC_Black_Swan_2008_4Dean Wenner
 
Risk Management Presentation.pptx
Risk Management Presentation.pptxRisk Management Presentation.pptx
Risk Management Presentation.pptx
PMIUKChapter
 
Free-ebook-rex-black advanced-software-testing
Free-ebook-rex-black advanced-software-testingFree-ebook-rex-black advanced-software-testing
Free-ebook-rex-black advanced-software-testing
Qualister
 
Software IT risk-management
Software IT risk-managementSoftware IT risk-management
Software IT risk-management
gufranresearcher
 
Risk Based Software Planning
Risk Based Software PlanningRisk Based Software Planning
Risk Based Software Planning
Muhammad Alhalaby
 
Webinar - Building Team Efficiency and Effectiveness
Webinar - Building Team Efficiency and EffectivenessWebinar - Building Team Efficiency and Effectiveness
Webinar - Building Team Efficiency and Effectiveness
Invensis Learning
 
Risk Management
Risk ManagementRisk Management
Risk Management
Hinal Lunagariya
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
RajeevRanjan338430
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
HinaAsghar16
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
AyidAlmgati
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
AayushSharma261
 
project managment.ppt
project managment.pptproject managment.ppt
project managment.ppt
HinaAsghar16
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
HemaLatha208756
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
HinaAsghar16
 

Similar to Risk-based Testing: Not for the Fainthearted (20)

Project/Program Risk management
Project/Program Risk managementProject/Program Risk management
Project/Program Risk management
 
Risk.pdf
Risk.pdfRisk.pdf
Risk.pdf
 
Risk and Procurement ManagementDr Paul BaguleyClass Slides.docx
Risk and Procurement ManagementDr Paul BaguleyClass Slides.docxRisk and Procurement ManagementDr Paul BaguleyClass Slides.docx
Risk and Procurement ManagementDr Paul BaguleyClass Slides.docx
 
Project Controls Expo 18th Nov 2014 - "Practical Applications of a Risk Manag...
Project Controls Expo 18th Nov 2014 - "Practical Applications of a Risk Manag...Project Controls Expo 18th Nov 2014 - "Practical Applications of a Risk Manag...
Project Controls Expo 18th Nov 2014 - "Practical Applications of a Risk Manag...
 
Risk strategies presentation
Risk strategies presentationRisk strategies presentation
Risk strategies presentation
 
ECC_Black_Swan_2008_4
ECC_Black_Swan_2008_4ECC_Black_Swan_2008_4
ECC_Black_Swan_2008_4
 
Risk Management Presentation.pptx
Risk Management Presentation.pptxRisk Management Presentation.pptx
Risk Management Presentation.pptx
 
Free-ebook-rex-black advanced-software-testing
Free-ebook-rex-black advanced-software-testingFree-ebook-rex-black advanced-software-testing
Free-ebook-rex-black advanced-software-testing
 
Software IT risk-management
Software IT risk-managementSoftware IT risk-management
Software IT risk-management
 
Risk Based Software Planning
Risk Based Software PlanningRisk Based Software Planning
Risk Based Software Planning
 
Webinar - Building Team Efficiency and Effectiveness
Webinar - Building Team Efficiency and EffectivenessWebinar - Building Team Efficiency and Effectiveness
Webinar - Building Team Efficiency and Effectiveness
 
Risk Management
Risk ManagementRisk Management
Risk Management
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
 
project managment.ppt
project managment.pptproject managment.ppt
project managment.ppt
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
 
9. Risk.ppt
9. Risk.ppt9. Risk.ppt
9. Risk.ppt
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
Ma 15Ma 15
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
TechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
TechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Recently uploaded

Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
Welocme to ViralQR, your best QR code generator.
Welocme to ViralQR, your best QR code generator.Welocme to ViralQR, your best QR code generator.
Welocme to ViralQR, your best QR code generator.
ViralQR
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 

Recently uploaded (20)

Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
Welocme to ViralQR, your best QR code generator.
Welocme to ViralQR, your best QR code generator.Welocme to ViralQR, your best QR code generator.
Welocme to ViralQR, your best QR code generator.
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 

Risk-based Testing: Not for the Fainthearted

  • 1. Risk-based Testing: Not for the Fainthearted George Wilkinson Grove Consultants george@grove.co.uk www.grove.co.uk
  • 2. Risk…a definition Definition: ISO 31000: (2009) Risk Management standard definition, defines risk as: “the effect of uncertainty on objectives whether positive or negative” A more common project definition of ‘risk’ is: “the probability of an event, hazard, threat or situation occurring resulting in undesirable consequences”
  • 3. Testing…the challenges risks are present due to: a) Time pressures b) System sophistication c) Budget restrictions d) Changing requirements e) Resource challenges …and on…and on…and on… Test: a definition “a particular process or method for trying or assessing” Our objectives: • Find defects • Raise confidence • Have conformance to regulation • Combinations of the above In the act of „testing‟ we need FOCUS!!!
  • 4. The TiNA project London Civil and Military Airspace System Existing FDP system Replacement FDP system
  • 5. Why is your system important? flight numbers are continually growing world-wide in 2010: over the entire UK 2.1 million flights were handled in controlled airspace over 200 million passengers flew “The safety of the passengers rely upon this system” do you have a reason why your system is important? …if not find one!
  • 6. Risk Exposure = Probability * Consequence Understanding Risk Probability Risk 1 100% 5 Risk Exposure = 2*2 = 4 75% 4 Risk 2 Risk Exposure = 4*2 = 8 50% 3 Risk 3 25% 2 1% Risk Exposure = 2*4 = 8 Risk Risk 4 1 1 2 3 4 5 Risk Exposure = 4*4 = 16 Consequence
  • 7. Risk Management risk identification • • • • • risk workshops expert interviews heuristics lessons learned checklists  Investig   risk analysis risk mitigation (control) Try to…calculate Risk Exposure   Risk monitoring ENGAGE THE STAKEHOLDERS! ate Ignore Project Mitigatio n Test Conting ency plan
  • 8. Risk-based Testing…points to note can be hard to commit to… can help answer: how much testing is enough is a risky business in itself does not mean test all known risks The main initiative being… to provide detailed information to help „management‟ make a decision on whether a system is ready for release
  • 9. Is it them or is it us…? Number Software Risk item Frequency Frequency 1 Misunderstanding of requirements 5 1 Lack of top management support 5 3 Lack of adequate user involvement 4 4 Failure to gain user commitment 3 5 Failure to manage end user expectations 3 6 Changes to requirements 3 7 Lack of an effective project management methodology 3 Project Management is project focussed Test Management is product focussed Source: Top Ten Lists of Software Project Risks: Evidence from Literature Survey by Tharwon Arnuphaptrairong
  • 10. Behaviours in Risk Based Testing #1 build the relationship with Project Management test need to work close with Project Management appreciate Project Management objectives push Project Management for risk based decisions learn to use „risk language‟ when verbalising risks when writing risks
  • 11. Behaviours in Risk Based Testing #2 all „risk management‟ activities should be efficient act boldly, time is limited ensure risk workshops are facilitated well learn the lessons from past mistakes retain the „risk based approach‟ in strategy and planning in execution on the next release ….when you are tired Chance of failure Test and report Risk Management Plan For Test
  • 12. Risk-based reporting start today end date residual risks of releasing TODAY all risks „open‟ at the start Progress through the test plan Source: Risk Based E-Business Testing – Paul Gerrard & Neil Thompson
  • 13. Defect data provides a message…choose well defect density 70 60 50 40 defect density analysis 30 20 10 0 140 120 100 defects found versus fixed 80 Found 60 Fixed 40 20 0 Day Day Day Day Day Day Day Day Day Day 1 2 3 4 5 6 7 8 9 10
  • 14. Summary risks in modern systems are prevalent and testing requires focus risk based testing requires: a good relationship with project management an efficient risk management approach good communication and reporting discipline success comes with taking risks