Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

TestIstanbul 2017 Keynote: "Characteristics Of A Modern Test Process" by Jan Jaap Cannegieter

130 views

Published on

When most of the well-known test methods where originated the world looked different. Back than making comprehensive strategies and plans was important, (test) engineering was focussed on doing things thoroughly and following (international) standards was important for organizations. Now other values are considered more important, like speed, craftsmanship, flexibility, goal orientation and pragmatism. In this keynote Jan Jaap will consider the changes testers and test organizations face today and explore the consequences of these changes for the test process and the individual tester.

Published in: Software
  • Be the first to comment

  • Be the first to like this

TestIstanbul 2017 Keynote: "Characteristics Of A Modern Test Process" by Jan Jaap Cannegieter

  1. 1. Characteristics of a modern test process Jan Jaap Cannegieter
  2. 2. 2 Agenda R.I.P. 1983– 2017
  3. 3. 3
  4. 4. SDM Stages DOCUMENTATION FIXED REQUIREMENTS Contract TESTPLAN PLANNING PROCESS ADHERENCE QUALITY GATES Process DESIGN Monitoringandcontrol Quality accurance Method based Certification W a t e r f a l l Specifications Projectmanagement PLANNING BIG BANG STABILITY predictableHANDBOOK O R G A N I Z A T I O N A L P O L I C Y Tools
  5. 5. 5
  6. 6. AGILE SCRUM DevOps User stories TOOLING SECURITY PRAGMATIC CUSTOMER SATISFACTION PEOPLE SKILLS FLEXIBILITY FAST CULTURE OUTSOURCING PERFORMANCE CRAFTMANSHIP PASSION C O N T I N U O U S D E L I V E R Y BUSINESSVALUE AUTONOMOUS P R O J E C T TEAM PLANNING ITERATIONS CHANGE vision VALUEBASED MULTIFUNCTIONALTEAM C O L L A B O R A T I O N
  7. 7. Changes Planned Flexible 7
  8. 8. Changes Planned Flexible Method Craftsmanship 8
  9. 9. Changes Planned Flexible Method Craftsmanship 9
  10. 10. Changes Planned Flexible Method Craftsmanship Process focus Goal oriented 10
  11. 11. Changes Planned Flexible Method Craftsmanship Process focus Goal oriented Thoroughly Fast 11
  12. 12. Changes Planned Flexible Method Craftsmanship Process focus Goal oriented Thoroughly Fast Standard Pragmatic 12
  13. 13. Changes Planned Flexible Method Craftsmanship Process focus Goal oriented Thoroughly Fast Standard Pragmatic 13
  14. 14. The classical way of testing… Test management ClosureDesign & Specification Execution Strategy & planning …is not (always) applicable anymore 14
  15. 15. FastGoal oriented Flexible 15
  16. 16. Characteristic 1: Goal orientation
  17. 17. Some testers in their project 17
  18. 18. 18
  19. 19. From: ‘Start with why’ by Simon Sinek 19
  20. 20. Goal oriented Goals testing Risk based = Which risks are (not) covered Risk Value based = Which value is delivered By the product/iteration Value Confirmation based = Is the system in line with the regulations and requirements Check Inspired by testing vs checking and testing vs checking revised by Michael Bolton and James Bach: http://www.developsense.com/blog/2009/08/testing-vs-checking/ and http://www.satisfice.com/blog/archives/856 as well as ‘Reinventing software qualtiy by Goyko Adzic, Agile testing days 2012: https://www.youtube.com/watch?v=8To_Nh68QPk
  21. 21. Characteristic 2: Flexibility 15.57
  22. 22. 23 Flexibility in testing Scripted testing Exploratory testing Testing
  23. 23. 24 Different ways of testing Based on‘Telling your exploratory story’ by Jon Bach, Agile 2010 conference Scripted testing Exploratory testing Detailed scripting Global scripting Session based testing Bug hunts Test tours Freestyle exploratory testing
  24. 24. Different ways of testing Scripted testing Exploratory testing Detailed scripting Global scripting Session based testing Bug hunts Test tours Freestyle exploratory testing Focussed on action Flexible Pragmatic Rely on the tester Focussed on test execution Focussed on preparation Focussed on planning Rely on the method Confidence in the process Focussed on documentation Based on‘Telling your exploratory story’ by Jon Bach, Agile 2010 conference 25
  25. 25. Characteristic 3: Fast 16.10
  26. 26. 28 Fast Scripted testing Exploratory testing Detailed scripting Global scripting Session based testing Bug hunts Test tours Freestyle exploratory testing Automation Documentation
  27. 27. 29 Automation = checking
  28. 28. Based on ‘Implication of emphasis on automation in CI’ - Martin Jansson http://thetesteye.com/blog/2017/03/implication-of-emphasis-on-automation-in-ci/ Infinite amount of tests Valuable tests Tests that you want to do more than once Tests that you want to do once Tests that you want to automate Tests you can automate Tests you have automated What can we automate?
  29. 29. 31 Automation and costs Manual Automated Analysis outcome Regression test Non-functional test Functional testing
  30. 30. You can test more You can test more often You can test faster You can test different things Maybe it is even more expensive 32
  31. 31. 33 Documentation
  32. 32. TESTERS ALL COUNTRIES, DEINSTALL WORD R.I.P. 1983 – 2017 34
  33. 33. Recap 16.20
  34. 34. FastGoal oriented Flexible Scripted testing Exploratory testing Detailed scripting Globale scripting Session based testing Bug hunts Test tours Freestyle exploratory testing Risk Value Check Automation Documentation 36
  35. 35. • Go to www.menti.com • Code: 137910 • Choose three skills you want to improve: – Goal orientation – Checking skills – Risk based testing – Value based testing – Detailed scripting and global scripting – Session based testing and bug hunting – Test tours and free style exploratory testing – Automation – Creative documentation 37 What about the state of testing in Turkey? Link
  36. 36. … determines the goal of his/her testing … is able to apply check, risk based and value based testing … masters different ways of scripted testing … masters different ways of exploratory testing … knows when to apply which way of testing … masters different ways of documentation … masters test automation … has a community to discuss his/her situation … and never stops learning 38 So a modern tester…
  37. 37. Keep learning
  38. 38. Questions

×