Belgium Testing Days: Shift your testing mindset

  • 513 views
Uploaded on

Change your mindset from finding bugs to preventing them, and to helping the customer build quality in to the product.

Change your mindset from finding bugs to preventing them, and to helping the customer build quality in to the product.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
513
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
8
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Lisa  Crispin   Co-­‐Author  with  Janet  Gregory,  Agile  Tes)ng:  A  Prac)cal  Guide  for   Testers  and  Agile  Teams,  and  the  upcoming  More  Agile  Tes)ng     Copyright  2014,  Lisa  Crispin   and  Janet  Gregory  
  • 2. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Some  slides  and  story-­‐telling   • Learning  through  exercises  and  discussions    
  • 3. Copyright  2014   Lisa  Crispin  and  Janet   Gregory  
  • 4. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • IteraBon  (sprint)   • Feature  (epic,  theme  or  capability)   • Story   • Done  (story  done,  feature  done,  release  done)   • Feedback   5  
  • 5. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • more  than  “just”  tesBng  code   • an  acBvity;  not  a  phase   6  
  • 6. What  challenges  do  you  see  for  tes2ng  in  agile?   7  
  • 7. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   Instead  of     ◦ We’re  here  to  find  bugs  …  or  ensure   requirements  are  met  …  or  break  the   soWware  …   Think   – How  do  we  “bake  quality  in”   &  help  company  succeed?   9  
  • 8. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   Can  you  think  of  some  ways  that  you  cross   boundaries  in  how  you  work?   10   Also  DevOps,  UX   designers,  others  
  • 9. 11   • Simplicity   • Feedback   • Respond  to  change  
  • 10. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   Analytical Relentlessly Curious Observant Skeptical Empiricist Critical Thinker Investigator hCp://www.slideshare.net/ehendrickson   12  
  • 11. 13   What  does  this  phrase  mean  to  you?  What  skills   does  tesBng  require?  Discuss!    
  • 12. Breadth of Skills DepthofSkills T-­‐shaped  Skill-­‐set  
  • 13. 15  
  • 14. 16   play,  experiment,  learn   keeps  us  vital  and  alive  Play,  experiment,  learn!  
  • 15. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   •  Gives  us  an  enthusiasm  for  life  that  is   irreplaceable.  Without  it,  life  just  doesn’t  taste   good  -­‐  Lucia  Capocchione   •  You  can  discover  more  about  a  person  in  an  hour   of  play  than  in  a  year  of  conversaBon.  -­‐  Plato   •  Play  is  our  brain’s  favourite  way  of  learning  –   Dianne  Ackerman            PorBa  Tung  (see  references)   17  
  • 16. Copyright  2014   Lisa  Crispin  and  Janet   Gregory     Instead  of  saying  NO,     or  being  the  gatekeeper     Be  the  informaBon  provider  so   business  can  make  the  decisions        Ques2ons  about  the  thinking  tester?   18  
  • 17. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • CommunicaBon  means  ...    sharing   ◦ Ideas,  goals,  informaBon,  decisions,  soluBons     • CollaboraBon  means  ...   ◦ Working  together  to  set  goals,  experiment,  find   soluBons   ◦ The  whole  team    …..   20  
  • 18. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Power  of  Three   • Three  Amigos   • Pairing   • ConBnuous  feedback   21  
  • 19. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   •   On  an  index  card,  each  person  draw  what  your   “word”  means  to  you  personally    4  minutes   • Now,  collaborate  –  remember  what  is  important   to  you  …   • Draw  one  picture  (large  paper)  that  everyone   can  ‘live  with’.          7-­‐8  minutes   22  
  • 20. Picture  by  Augusto  EvangelisB,  based  on  diagram  from  Elisabeth  Hendrickson  
  • 21. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   User   Story   Expand   Tests   High   level   AT   Auto-­‐   mate   tests   Code   &   Execute   tests   Explore     Exploratory   TesBng   Accept   Story   Fix   defects   Explore   examples   24  
  • 22. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   Shoppers  can  easily  and  securely  save  billing  info   to  re-­‐use  for  each  purchase,  so  that  repeat   business  increases  by  X  %.   25   Desired  behavior  (BDD)   Given  I  am  a  shopper  checking  out,   When  I  enter  my  billing  informaBon,   I’m  prompted  to  save  it  securely  for  future   convenience      
  • 23. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   Shoppers  can  easily  and  securely  save  billing  info   to  re-­‐use  for  each  purchase,  so  that  repeat   business  increases  by  X  %.   26   Given…   When…   Then…  
  • 24. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Examples  provide  common  language   • Shared  common  understanding   • Coding  and  tesBng  concurrently   • Involves  whole  team   • Shared  definiBon  of  DONE   • Prevents  defects   27  
  • 25. 28   • QuesBon   • Elicit  examples   • Uncover  hidden   assumpBons  
  • 26. Copyright  2014   Lisa  Crispin  and  Janet   Gregory     Instead  of  saying  NO,     or  being  the  gatekeeper     Be  the  informaBon  provider  so   business  can  make  the  decisions        Ques2ons  about  the  collabora2on?   29  
  • 27. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Checking:  Does  the  system  do   what  it's  supposed  to  do?   • Exploring:  Are  there  any  other   risks  or  vulnerabiliBes  that  we   haven't  thought  about  yet?   • TesBng  ==  checking  +  exploring   **Elisabeth  Hendrickson,  “The  Two  Sides  of  SoWware  TesBng”,  Agile  ConnecBon     GUI   API   Unit  Tests   31  
  • 28. 32  
  • 29. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   From  Mas   Barcomb  
  • 30. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   It’s  not  just  about  code  !!!   ◦ Test  business  value   ◦ Test  assumpBons   ◦ Uncover  hidden  assumpBons   The  goal:     ◦ Shared  common  understanding  of  the  story   ◦ PrevenBng  defects  (eliminate  waste)   34  
  • 31. • Why  are  we  doing  this?   • Who  can  help?  Hinder?  Who  is  impacted?   • How  can  they  help  or  hinder?  Impacts   • What  can  we  do  to  support  impacts?              Deliverables     35  
  • 32. 36   Stakeholders  /   personas   Impacts   Possible  deliverables   Possible  deliverables  
  • 33. Copyright  2014   Lisa  Crispin  and  Janet   Gregory       AcBviBes  by  Bme   Child  Stories   From  Janet  Gregory  &  MaC  Barcomb   Jeff  Pason:  hsp:// www.agileproductdesign.com/ blog/the_new_backlog.html  
  • 34. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   From  Janet   Gregory  &   MaC   Barcomb   Story   Mapping  
  • 35. 39  
  • 36. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Understand  the   business  needs   • What  level  are  at?   • Collaborate   appropriately   Release  level   IteraBon  level   Story  test  level   Task  level   System  level   40  
  • 37. 41  
  • 38. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Know  your   customers   • Make  them  real   • Plan  your   exploratory  tesBng   using  them   •  Picture  –  from  Jeff  Pason’s   PragmaBc  Personas  weekly  column   on  SBcky  Minds  (1/25/2010)   42
  • 39. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   Template:   •  Explore  (target)   •  With  (resources)   •  To  discover  (informa)on)     Where:   •  Target:  Where  are  you  exploring   •  Resources:  What  resources  will  you  bring  with  you   •  Informa2on:  What  kind  of  informaBon  are  you  hoping  to   find?   •  Explore  It!  by  Elisabeth  Hendrickson   43
  • 40. Copyright  2014   Lisa  Crispin  and  Janet   Gregory     Explore  ediBng  profiles     With  real  user  names     To  discover  if  there  are  instances  where  username   constraints  are  not  enforced     A  tool  to  guide  explora)on.  Keep  it  simple.   44
  • 41. Copyright  2014   Lisa  Crispin  and  Janet   Gregory     Story  backlog  for  feature  “Remember  Me”   New  shoppers  are  encouraged  to  create  a  login  account   with  username,  password,  and  security  features  so  that   signups  increase  by  X  %.   Think  of  some  personas  to  use  for  tesBng,  and  write  some   charters  to  guide  your  exploratory  tesBng   45  
  • 42. Copyright  2014   Lisa  Crispin  and  Janet   Gregory     Instead  of  saying  NO,     or  being  the  gatekeeper     Be  the  informaBon  provider  so   business  can  make  the  decisions        Ques2ons?   46  
  • 43. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Know  your  context   • Have  a  tool  box  full   • Simple  is  oWen  best   • Use  your  imaginaBon   Let’s  look  at  some  examples   48  
  • 44. Taken  from   Ready  to  use   Graphic   Organizers    for   primary    grade   teachers  
  • 45. Day  1     A  new  user   wants  to   create  her   account   Day  1     The  new  user   wants  to  log   into  the   system     Day  2     An  exisBng   user  wants  to   change  her   password   Day  2     An  exisBng   user  forgets   her  password   Day  2     The  new  user   wants  to  log   into  the   system     Day  30     The  system   asks  user  to   change  her   password   Day  ??           …….     Day  60     The  user   wants  to   delete  her   account   Day  ??           …….     Day  ??           …….    
  • 46. Words  /  Phrases   •  I  wonder  ….   •  What  caught  your   asenBon?   •  Could  you  show  me?   •  What  makes  you  think   there  is  more?   Ques2ons  /  Predic2ons   •  What  might  happen   next?   •  Why  would  that  be?   •  What  is  the  worst  thing   that  could  happen?     •  ….  or  the  best?   •  What  assumpBons  do   you  have?  
  • 47. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   Block   account   User   enters   wrong   password     Wrong   password  a   2nd  Bme;   Issue   warning   User  can’t   log  in   They  are  in   the   database   The   credenBals   meet   req’ts   They   entered   their   credenBals   correctly     Their   password   expired  ….   Wrong   password  a   third  Bme   Prevent   user  from   logging  in   again;   Display   msg   52  
  • 48. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • PracBce  anBcipaBng  what  will  happen   • Define  your  tests   • Check  –  running  tests  or  collaborate  with   customers  and  programmers  before  coding   • Be  prepared  to  change  your  tests  if  your   predicBons  are  wrong   • Learn  by  reviewing  –  what  quesBons  could   you  have  asked  first.   53  
  • 49. Sub  topic   Sub  topic   Sub  topic   MAIN   TOPIC   Sub  topic   Sub  topic   first  2me   change   new  account   password   rules   encryp2on       save   user  name   rules   Login  :  User  name  &  password  
  • 50. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   55  
  • 51. Copyright  2014   Lisa  Crispin  and  Janet   Gregory     Story  backlog  for  “Remember  Me”  capability   Shoppers  can  easily  and  securely  save  billing  info  to  re-­‐use   for  each  purchase,  so  that  repeat  business  increases  by  X   %.   56  
  • 52. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Think  simple   • Have  a  variety  of  tools   • Adapt  to  your  needs   • Look  in  places  you  may  not  have  considered   57  
  • 53. Copyright  2014   Lisa  Crispin  and  Janet   Gregory     Instead  of  saying  NO,     or  being  the  gatekeeper     Be  the  informaBon  provider  so   business  can  make  the  decisions        Ques2ons  about  the  tools?   58  
  • 54. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   • Curiosity   • Ability  to  observe   • Ability  to  challenge   • Ability  to  adapt   • To  recognize  contexts     • Ability  to  THINK  !   60  
  • 55. 61   Challenge   Yourself  !   What   experiments  will   you  try  back  at   work?  
  • 56. Copyright  2014   Lisa  Crispin  and  Janet   Gregory   Agile  Tes)ng:  A  Prac)cal  Guide  for   Testers  and  Agile  Teams   Coming  soon:  More  Agile  Tes)ng  !   By  Lisa  Crispin  and  Janet  Gregory     www.agiletester.ca   Contact  info   www.lisacrispin.com   Email:  lisa@lisacrispin.com   Twiser:  lisacrispin   62  
  • 57. •  Elisabeth  Hendrickson   –  CAST  keynote  hsp://www.slideshare.net/ehendrickson   –  Explore  It!  –  new  book  on  PragmaBc  Programmers   –  hsp://www.agileconnecBon.com/arBcle/two-­‐sides-­‐soWware-­‐tesBng-­‐checking-­‐ and-­‐exploring   •  Ben  Kelly,  hsp://lets-­‐test.com/wp-­‐content/uploads/2012/05/LetsTest2012-­‐ BenKelly-­‐TheTesBngDead.pdf   •  Markus  Gartner,  hsp://www.shino.de/2012/07/16/cast-­‐2012-­‐the-­‐tesBng-­‐dead/,   plus  his  book  ATDD  By  Example   •  Paul  Carvalho,  hsp://www.agilejournal.com/arBcles/columns/column-­‐arBcles/ 6515-­‐low-­‐tech-­‐tools-­‐for-­‐the-­‐thinking-­‐tester   •  Ready  to  Use  Graphic  Organizers   •  Alister  Scos,  tesBng  ice  cream  cone  anB-­‐pasern,  hsp://waBrmelon.com/ 2012/01/31/introducing-­‐the-­‐soWware-­‐tesBng-­‐ice-­‐cream-­‐cone/   •  Sharon  Robson,  Test  AutomaBon  Pyramid  Expanded,  hsp://blog.soWed.com/ 2013/08/26/1883/  
  • 58. •  hsp://www.exampler.com  -­‐  Brian  Marick’s  web  site   •  Gojko  Adzic,  Bridging  the  Communica)on  Gap,  2009;  Specifica)on  by   Example,  2011,  Impact  Mapping,  2013   •  www.sBckyminds.com/    PragmaBc  Personas  -­‐  Jeff  Pason’s  weekly  column   1/25/2010   •  Jean  Tabaka,  Collabora)on  Explained,  2006  Addison-­‐Wesley   •  hsp://www.uie.com/arBcles/indispensable_skills   •  PorBa  Tung  –  Power  of  Play    hsp://www.selfishprogramming.com/ category/playmaking/   •  Esther  Derby  and  Diana  Larsen,  Agile  Retrospec)ves   •  Linda  Rising,  Small  Experiments,   hsp://web.lindarising.info/uploads/Small_Experiments.pdf   •  Liz  Keogh,  “a  simple  way  to  esBmate  complexity”,  hsp://lizkeogh.com/ 2013/07/21/esBmaBng-­‐complexity/  (and  see  her  related  blog  posts)    
  • 59. •  Tastycupcakes.org,  games  for  learning   •  Gamestorming  retreat  hsp://www.co-­‐learning.be/#agenda/ GamestormingRetreat/06092014   •  Chaos  Monkey  &  Ne{lix  hsp://techblog.ne{lix.com/2012/07/chaos-­‐ monkey-­‐released-­‐into-­‐wild.html   •  Weekend  TesBng:  www.weekendtesBng.org   •  Michael  Feathers,  Working  EffecBvely  with  Legacy  Code,  hsp:// www.amazon.com/Working-­‐EffecBvely-­‐Legacy-­‐Michael-­‐Feathers/dp/ 0131177052   •  Strangler  pasern  for  rewriBng  legacy  code:      hsp:// marBnfowler.com/bliki/StranglerApplicaBon.html    
  • 60. Copyright  2014   Lisa  Crispin  and  Janet   Gregory     Instead  of  saying  NO,     or  being  the  gatekeeper     Be  the  informaBon  provider  so   business  can  make  the  decisions        Any  unanswered  ques2ons  /  concerns?   66