Let's Test Context-Driven Software
Testing Conference Stockholm Sweden

A European conference
on context-driven testing
 – for testers by testers.
Why Let's Test?


Context-driven conference
Famous speakers
The venue
Tutorials – May 7, 2012



Keynote from Michael Bolton:
"If It's Not Context-Driven, You
   Can't Do It Here"
To test is to compose, edit, narrate, and justify
                THREE stories.
A story about the status of the PRODUCT…
…about how it failed, and how it might fail...
…in ways that matter to your various clients.
A story about HOW YOU TESTED it…
…how you configured, operated and observed it…
…about what you haven’t tested, yet…
…and won’t test, at all…
A story about how GOOD that testing was…
…what the risks and costs of testing are…
…what made testing harder or slower…
…how testable (or not) the product is…
…what you need and what you recommend.
Tutorials – May 7, 2012

Tutorial/workshop from Rob Sabourin:
“Just-In-Time Testing”
Tutorials – May 7, 2012

“ALAP” activities           -    “ASAP” activities       -
do as late as possible, as       do now.
close to the actual testing as
possible.

                                 Find test ideas
Test plans preparing
                                 Prioritize test ideas
Test cases scripting
Test data preparing
...etc.
Testing Ideas
Collect all testing ideas you can find!

How to find them?
  Does system do what it is suppose to do?
  Does the system do things it is not supposed to?
  How can the system break?
  How does the system react to it’s environment?
  What characteristics must the system have?
  Why have similar systems failed?
  How have previous projects failed?
Test Idea Sources
Capabilities
Failure Modes
Quality Factors
Usage Scenarios
Creative Ideas
States
Data
Environments
White Box
Conference Day 1 - May 8, 2012

Keynote from Rob Sabourin:
"Applied Testing Lessons from Delivery
 Room Labor Triage"


Philosophy: “Bug are not good or bad,
  bugs have priority and severity and it is a
  business decision how to prioritize.”
Conference Day 1 - May 8, 2012
Anders Dinsen
"Testing In The Black Swan
  Domain"


Black Swan Idea/philosophy:
   The term black swan derives
  from a Latin expression - In
  English "a rare bird in the
  lands, very much like a black
  swan". When the phrase was
  coined, the black swan was
  presumed not to exist.
Conference Day 1 - May 8, 2012

Rikard Edgren
“Curing Our Binary Disease”


Philosophy: Software testing is a
  lot about computers. Most
  software is made for people...
Conference Day 1 - May 8, 2012

Pass/Fail addiction
You feel good when starting a test with “Verify that…” and
  ending with Pass or Fail

Pass/Fail rehab:
Look at some more places than what is stated in the Expected
  Results field
Write the occasional test idea using the word "investigate"
You can ask richer questions than: Is this correct or not?
Conference Day 1 - May 8, 2012

Coverage obsession
A coverage model is useful to get ideas
Not useful as a metric of completion

A model can help you find important things, but a
  percentage number might not include things that are
  important


Information about the system is more important than
   information about the model of the system (Emilsson)
Conference Day 1 - May 8, 2012

Louise Perold – “Tales from the financial testing trenches”
Conference Day 1 - May 8, 2012

Anne-Marie Charrett – “Coaching Testers”
Conference Day 2 - May 9, 2012
Keynote from Scott Barber:
“Testing Missions in Context From Checking to
  Assessment”
Conference Day 2 - May 9, 2012

Fiona Charles - "Strategies for a Successful Systems
  Integration Test"
Conference Day 2 - May 9, 2012

Huib Schoots - "So You Think You Can Test?"


Becoming a better tester:
1. Adapt to the context
2. Collaborate
3. Learn & practice
Conference Day 2 - May 9, 2012

Keynote from Julian Harty:
  "Open Sourcing Testing"
Yoda



C:UsersVeronickaDesktopwork_folderLets_testyAmR9cwF.mp4
Thank You!
Q&A
Comments

Let's test

  • 1.
    Let's Test Context-DrivenSoftware Testing Conference Stockholm Sweden A European conference on context-driven testing – for testers by testers.
  • 2.
    Why Let's Test? Context-drivenconference Famous speakers The venue
  • 3.
    Tutorials – May7, 2012 Keynote from Michael Bolton: "If It's Not Context-Driven, You Can't Do It Here"
  • 4.
    To test isto compose, edit, narrate, and justify THREE stories. A story about the status of the PRODUCT… …about how it failed, and how it might fail... …in ways that matter to your various clients. A story about HOW YOU TESTED it… …how you configured, operated and observed it… …about what you haven’t tested, yet… …and won’t test, at all… A story about how GOOD that testing was… …what the risks and costs of testing are… …what made testing harder or slower… …how testable (or not) the product is… …what you need and what you recommend.
  • 5.
    Tutorials – May7, 2012 Tutorial/workshop from Rob Sabourin: “Just-In-Time Testing”
  • 6.
    Tutorials – May7, 2012 “ALAP” activities - “ASAP” activities - do as late as possible, as do now. close to the actual testing as possible. Find test ideas Test plans preparing Prioritize test ideas Test cases scripting Test data preparing ...etc.
  • 7.
    Testing Ideas Collect alltesting ideas you can find! How to find them? Does system do what it is suppose to do? Does the system do things it is not supposed to? How can the system break? How does the system react to it’s environment? What characteristics must the system have? Why have similar systems failed? How have previous projects failed?
  • 8.
    Test Idea Sources Capabilities FailureModes Quality Factors Usage Scenarios Creative Ideas States Data Environments White Box
  • 9.
    Conference Day 1- May 8, 2012 Keynote from Rob Sabourin: "Applied Testing Lessons from Delivery Room Labor Triage" Philosophy: “Bug are not good or bad, bugs have priority and severity and it is a business decision how to prioritize.”
  • 10.
    Conference Day 1- May 8, 2012 Anders Dinsen "Testing In The Black Swan Domain" Black Swan Idea/philosophy: The term black swan derives from a Latin expression - In English "a rare bird in the lands, very much like a black swan". When the phrase was coined, the black swan was presumed not to exist.
  • 11.
    Conference Day 1- May 8, 2012 Rikard Edgren “Curing Our Binary Disease” Philosophy: Software testing is a lot about computers. Most software is made for people...
  • 12.
    Conference Day 1- May 8, 2012 Pass/Fail addiction You feel good when starting a test with “Verify that…” and ending with Pass or Fail Pass/Fail rehab: Look at some more places than what is stated in the Expected Results field Write the occasional test idea using the word "investigate" You can ask richer questions than: Is this correct or not?
  • 13.
    Conference Day 1- May 8, 2012 Coverage obsession A coverage model is useful to get ideas Not useful as a metric of completion A model can help you find important things, but a percentage number might not include things that are important Information about the system is more important than information about the model of the system (Emilsson)
  • 14.
    Conference Day 1- May 8, 2012 Louise Perold – “Tales from the financial testing trenches”
  • 15.
    Conference Day 1- May 8, 2012 Anne-Marie Charrett – “Coaching Testers”
  • 16.
    Conference Day 2- May 9, 2012 Keynote from Scott Barber: “Testing Missions in Context From Checking to Assessment”
  • 17.
    Conference Day 2- May 9, 2012 Fiona Charles - "Strategies for a Successful Systems Integration Test"
  • 18.
    Conference Day 2- May 9, 2012 Huib Schoots - "So You Think You Can Test?" Becoming a better tester: 1. Adapt to the context 2. Collaborate 3. Learn & practice
  • 19.
    Conference Day 2- May 9, 2012 Keynote from Julian Harty: "Open Sourcing Testing"
  • 20.
  • 21.