Successfully reported this slideshow.
Your SlideShare is downloading. ×

TestIstanbul 2017 Keynote: "Characteristics Of A Modern Test Process" by Jan Jaap Cannegieter

Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Upcoming SlideShare
MSR2017-Challenge
MSR2017-Challenge
Loading in …3
×

Check these out next

1 of 42 Ad

TestIstanbul 2017 Keynote: "Characteristics Of A Modern Test Process" by Jan Jaap Cannegieter

Download to read offline

When most of the well-known test methods where originated the world looked different. Back than making comprehensive strategies and plans was important, (test) engineering was focussed on doing things thoroughly and following (international) standards was important for organizations. Now other values are considered more important, like speed, craftsmanship, flexibility, goal orientation and pragmatism. In this keynote Jan Jaap will consider the changes testers and test organizations face today and explore the consequences of these changes for the test process and the individual tester.

When most of the well-known test methods where originated the world looked different. Back than making comprehensive strategies and plans was important, (test) engineering was focussed on doing things thoroughly and following (international) standards was important for organizations. Now other values are considered more important, like speed, craftsmanship, flexibility, goal orientation and pragmatism. In this keynote Jan Jaap will consider the changes testers and test organizations face today and explore the consequences of these changes for the test process and the individual tester.

Advertisement
Advertisement

More Related Content

Advertisement
Advertisement

TestIstanbul 2017 Keynote: "Characteristics Of A Modern Test Process" by Jan Jaap Cannegieter

  1. 1. Characteristics of a modern test process Jan Jaap Cannegieter
  2. 2. 2 Agenda R.I.P. 1983– 2017
  3. 3. 3
  4. 4. SDM Stages DOCUMENTATION FIXED REQUIREMENTS Contract TESTPLAN PLANNING PROCESS ADHERENCE QUALITY GATES Process DESIGN Monitoringandcontrol Quality accurance Method based Certification W a t e r f a l l Specifications Projectmanagement PLANNING BIG BANG STABILITY predictableHANDBOOK O R G A N I Z A T I O N A L P O L I C Y Tools
  5. 5. 5
  6. 6. AGILE SCRUM DevOps User stories TOOLING SECURITY PRAGMATIC CUSTOMER SATISFACTION PEOPLE SKILLS FLEXIBILITY FAST CULTURE OUTSOURCING PERFORMANCE CRAFTMANSHIP PASSION C O N T I N U O U S D E L I V E R Y BUSINESSVALUE AUTONOMOUS P R O J E C T TEAM PLANNING ITERATIONS CHANGE vision VALUEBASED MULTIFUNCTIONALTEAM C O L L A B O R A T I O N
  7. 7. Changes Planned Flexible 7
  8. 8. Changes Planned Flexible Method Craftsmanship 8
  9. 9. Changes Planned Flexible Method Craftsmanship 9
  10. 10. Changes Planned Flexible Method Craftsmanship Process focus Goal oriented 10
  11. 11. Changes Planned Flexible Method Craftsmanship Process focus Goal oriented Thoroughly Fast 11
  12. 12. Changes Planned Flexible Method Craftsmanship Process focus Goal oriented Thoroughly Fast Standard Pragmatic 12
  13. 13. Changes Planned Flexible Method Craftsmanship Process focus Goal oriented Thoroughly Fast Standard Pragmatic 13
  14. 14. The classical way of testing… Test management ClosureDesign & Specification Execution Strategy & planning …is not (always) applicable anymore 14
  15. 15. FastGoal oriented Flexible 15
  16. 16. Characteristic 1: Goal orientation
  17. 17. Some testers in their project 17
  18. 18. 18
  19. 19. From: ‘Start with why’ by Simon Sinek 19
  20. 20. Goal oriented Goals testing Risk based = Which risks are (not) covered Risk Value based = Which value is delivered By the product/iteration Value Confirmation based = Is the system in line with the regulations and requirements Check Inspired by testing vs checking and testing vs checking revised by Michael Bolton and James Bach: http://www.developsense.com/blog/2009/08/testing-vs-checking/ and http://www.satisfice.com/blog/archives/856 as well as ‘Reinventing software qualtiy by Goyko Adzic, Agile testing days 2012: https://www.youtube.com/watch?v=8To_Nh68QPk
  21. 21. Characteristic 2: Flexibility 15.57
  22. 22. 23 Flexibility in testing Scripted testing Exploratory testing Testing
  23. 23. 24 Different ways of testing Based on‘Telling your exploratory story’ by Jon Bach, Agile 2010 conference Scripted testing Exploratory testing Detailed scripting Global scripting Session based testing Bug hunts Test tours Freestyle exploratory testing
  24. 24. Different ways of testing Scripted testing Exploratory testing Detailed scripting Global scripting Session based testing Bug hunts Test tours Freestyle exploratory testing Focussed on action Flexible Pragmatic Rely on the tester Focussed on test execution Focussed on preparation Focussed on planning Rely on the method Confidence in the process Focussed on documentation Based on‘Telling your exploratory story’ by Jon Bach, Agile 2010 conference 25
  25. 25. Characteristic 3: Fast 16.10
  26. 26. 28 Fast Scripted testing Exploratory testing Detailed scripting Global scripting Session based testing Bug hunts Test tours Freestyle exploratory testing Automation Documentation
  27. 27. 29 Automation = checking
  28. 28. Based on ‘Implication of emphasis on automation in CI’ - Martin Jansson http://thetesteye.com/blog/2017/03/implication-of-emphasis-on-automation-in-ci/ Infinite amount of tests Valuable tests Tests that you want to do more than once Tests that you want to do once Tests that you want to automate Tests you can automate Tests you have automated What can we automate?
  29. 29. 31 Automation and costs Manual Automated Analysis outcome Regression test Non-functional test Functional testing
  30. 30. You can test more You can test more often You can test faster You can test different things Maybe it is even more expensive 32
  31. 31. 33 Documentation
  32. 32. TESTERS ALL COUNTRIES, DEINSTALL WORD R.I.P. 1983 – 2017 34
  33. 33. Recap 16.20
  34. 34. FastGoal oriented Flexible Scripted testing Exploratory testing Detailed scripting Globale scripting Session based testing Bug hunts Test tours Freestyle exploratory testing Risk Value Check Automation Documentation 36
  35. 35. • Go to www.menti.com • Code: 137910 • Choose three skills you want to improve: – Goal orientation – Checking skills – Risk based testing – Value based testing – Detailed scripting and global scripting – Session based testing and bug hunting – Test tours and free style exploratory testing – Automation – Creative documentation 37 What about the state of testing in Turkey? Link
  36. 36. … determines the goal of his/her testing … is able to apply check, risk based and value based testing … masters different ways of scripted testing … masters different ways of exploratory testing … knows when to apply which way of testing … masters different ways of documentation … masters test automation … has a community to discuss his/her situation … and never stops learning 38 So a modern tester…
  37. 37. Keep learning
  38. 38. Questions

Editor's Notes

  • https://www.google.nl/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=&url=http%3A%2F%2Fwww.dedijk.nl%2Findex.php%3Farchiefid%3D17%26menu%3Dpara&bvm=bv.136811127,d.d2s&psig=AFQjCNEgrSTg0e2VEchYEWyvbt6whU22uQ&ust=1477644949941270
  • Why should I do this test?
  • Look for the value!
  • Geef hier een korte beschrijving van scripted en non scripted testen in situatiebeschrijving:
    In het geval van scripted testen gaan we op basis van goede requirements vooraf scripts opstellen die we, zodra het te testen product beschikbaar komt, gaan uitvoeren conform het opgestelde script.
    Bij non-scripted testen, wat vooral gebaseerd is op het exploratory testen van Jon en James Bach, wordt de enige echt toegevoegde waarde gezien van de tester als deze achter de knoppen zit. Dus op basis van zijn kennis en kunde gaat een exploratory tester aan de slag en constateert van alles, wat hij met korte communicatielijnen terug moet kunnen koppelen naar de opdrachtgever om te constateren of het de moeite waard is verder op dit onderwerp in te zoomen. Zo niet, dan wordt doorgegaan naar een volgend geconstateerd aandachtspunt.

    Het betreft hier twee extremen, waarvan wij vanuit situationeel testen constateren: twee extremen op een continue schaal.
  • To improve and broaden your skills
  • Differs per system how big the brackets are (Price calculations vs webshop)

×