Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The Speed to Cool: Agile Testing & Building Quality In

1,144 views

Published on

Published in: Technology
  • Be the first to comment

The Speed to Cool: Agile Testing & Building Quality In

  1. 1. Speed to Cool: Agile Testing & Building Quality InCraig Smith
  2. 2. Welcome… Image: © Gracie Films / 20thCentury Fox Television http://www.paleodietrecipes.org.uk/paleo-images/content/homer-confession.jpg
  3. 3. Image: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/ The speed to cool…
  4. 4. Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355 Thumbs up… Cool!
  5. 5. Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg Choke…
  6. 6. How Management See Testing Image: http://www.craigsfire.com/wp-content/uploads/2010/02/pool.jpg
  7. 7. How Management Would Like To See Testing Image: http://us.123rf.com/400wm/400/400/dotshock/dotshock1012/dotshock101200006/8437158-internet-network-server-room-with-computers-racks-and-digital-receiver-for-digital-tv.jpg
  8. 8. Image: http://scitascienda.files.wordpress.com/2013/04/barney-stinson-quote-when-i-get-sad-i-stop-being-sad-and-be-awesome-instead-true-story.jpg?w=500&h=353
  9. 9. Image: http://rnstechnologies.com/content_images/small_image_2.jpg/ So, What is a Tester?
  10. 10. Look left… Look right…
  11. 11. Image: http://3.bp.blogspot.com/_RdF7S0TNAHY/TOqn8MLYajI/AAAAAAAAAJI/QDBFdixiq0E/s1600/2006-06-17%252520Falling-piano.gif Look up…
  12. 12. Image: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg CSI: Software
  13. 13. Image: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG Agile & Testing
  14. 14. To Do Analysis Develop Test Done We reflect work like this…
  15. 15. To Do Analysis Develop Test Done Which is really working like this…
  16. 16. Image: Craig Smith Remind you of something?
  17. 17. Let’s ponder the Agile Manifesto Responding tochange over following a plan
  18. 18. Image: © Sony Computer Entertainment Europe http://www.ultimateps3.fr/images/jeux/buzz-quiz-tv/buzz-quiz-tv_1216759203.jpg Time to play the “Agile Manifesto Tester’s Challenge”
  19. 19. Image: © Bright/Kauffman/Crane Productions http://miacannedy.files.wordpress.com/2012/11/friends-couch.jpg Individuals and interactions over processes and tools Challenge #1
  20. 20. Image: http://blog.agafonov.net.ua/image.axd?picture=2011%2F5%2FvNext+Visual+Studio+2011.jpg Working software overcomprehensive documentation Challenge #2
  21. 21. Challenge #3 Image: © Touchstone Pictures http://cdn.mymovies.ge/backdrops/ce6/4bc922b5017a3c57fe00dce6/metro-original.jpg Customer collaboration overcontract negotiation
  22. 22. Image: http://resources3.news.com.au/images/2014/04/01/1226870/743135-26b0c3f6-b92a-11e3-9942-d7dbb3111cd3.jpg Responding to change overfollowing a plan Challenge #4
  23. 23. Analyst / Customer Developer Tester Automation Elaboration / Specification Acceptance Criteria High Performing AGILE Project Manager Testers in an agile team
  24. 24. Developer Tester Analyst More Technical Less Technical Code Design Unit Test AutomatedFunctional / Specialist Tests ManualTest ExploratoryTest Requirements Customer Collab. Developers need more testing involvement Testers need more technical involvement Analysts need more testing involvement Testers in an agile team
  25. 25. (noun) the standard of something as measured against other things of a similar kind; the degree of excellence of something oxforddictionaries.com Image: http://www.naccho.org/topics/infrastructure/accreditation/images/Quality-Definition.jpg / Definition of Quality…
  26. 26. Image: http://upload.wikimedia.org/wikipedia/commons/b/b9/Steve_Jobs_Headshot_2010-CROP.jpg Quality means different things
  27. 27. Image: http://s3.amazonaws.com/integral-life-home/iceberg.jpg Implicit / Explicit Quality
  28. 28. Testing ≠ Quality
  29. 29. Image: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg Building Quality In
  30. 30. Quality is everyone’s responsibility Image: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg
  31. 31. Everyone likes to be seen to value quality Image: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg
  32. 32. Image: © United Feature Syndicate http://s458.photobucket.com/albums/qq310/mrbigjohnson/Murals/?action=view&current=NovemberPics115.jpg&newest=1 Quality from kickoff
  33. 33. 1 2 3 4 Cost Scope Quality Time X X X X Fixed Flexible Success sliders
  34. 34. 1 2 3 4 Cost Scope Quality Time X X X X Fixed Flexible Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg
  35. 35. 1 2 3 4 Cost Scope Quality Time X X X X Fixed Flexible Quality almost always at #3
  36. 36. Correctness
  37. 37. Reliability Robustness Availability Integrity Flexibility Usability Interoperability Efficiency Testability Maintainability Reusability Portability Reliability + + + + - + + Robustness + + + - Availability + + Integrity - - - - - Flexibility + - - + + + Usability + - - Interoperability - + - + Efficiency - - - - - - - - Testability + + + + - + Maintainability + + + - + Reusability - - + + - + + + Portability + - + - + - + Trade Offs
  38. 38. Quality Advocates What does quality mean to the different roles in the team? Quality Taxonomy What are quality attributes? Quality Prioritisation How do we know what quality attributes to include? Quality TradeoffRisks What are risks with the quality attributes we are trading off? Quality Measurement How do we test and measure quality? Success Sliders How does quality relate to the sliders? Quality Definition What does quality mean? Next Steps How do we apply quality to our work 1 2 3 4 5 6 7 8 Defining Quality
  39. 39. Quality Definition
  40. 40. Image: © 2008 Melissa McKenneyhttp://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg Shared understanding of quality
  41. 41. Image: http://www.thechildmindingshop.co.uk/ekmps/shops/thecs/images/table-chalkboard-and-white-board-in-one-%5B2%5D-5540-p.jpg Strategy & Plan
  42. 42. Simple test strategy & plans
  43. 43. Simple test strategy
  44. 44. Image: © Sesame Workshop http://images.wikia.com/muppet/images/9/95/Sesame-english-do-you-like-it-apple_count.jpg Reporting & Metrics
  45. 45. Understand Development, Quality & Release Metrics
  46. 46. Report on how testing is going
  47. 47. Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg #1
  48. 48. HEALTH PROJECT DEVELOPMENT TESTING USER 0 1 2 3 4 5 0 1 2 3 4 5 6 7 1 2 3 4 5 6 7 8 New Risks & Issues Raised Number of Risks & Issues Iteration TESTCOVERAGE 0 5 10 15 20 25 0 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 Number of Tests Number of Defects Iteration MAINTAINABILITY PERFORMANCE 0 200 400 600 800 1000 1200 1400 1600 1800 4700 4800 4900 5000 5100 5200 5300 5400 5500 5600 5700 1 2 3 4 5 6 7 8 Lines of Test Code Lines of Code Iteration OVERALL $- $5 $10 $15 $20 $25 $30 0 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 Business Value Number of Features Iteration BVC
  49. 49. Image: http://artegami.com/wp-content/uploads/2007/08/toysrus_karate_kid.jpg Agile Testing Practices
  50. 50. Software is a Series of Loops Image: http://2.bp.blogspot.com/_4G2ptSlZZn0/R9nRjimkLII/AAAAAAAAAqA/tzYJjRyhLkk/s400/brekky05011049.jpg
  51. 51.  End to end automated tests and cover 10 conditions per test, manual covers 1 condition per test  Automated tests cover all high priority business flows, manual tests mostly cover lower priority flows  Metrics need context! % Regression test cases automated Automated Manual How Much Automated Testing Is Enough?
  52. 52. Testing is more than a series of merely repeatable actions Image: http://cdn.themis-media.com/media/global/images/library/deriv/71/71335.jpg
  53. 53. Image: © The Curiosity Company / 20thCentury Fox Television http://images2.fanpop.com/images/photos/3200000/fry-bender-futurama-3295254-1024-768.jpg Low value vs high value
  54. 54. Testing Craftsmanship Image: © Wild Dancer Productions / Touchstone Television http://www.tvacres.com/images/props_tool_time_binford.jpg
  55. 55. Red Green Refactor Red Green Refactor ATDD ATDD TDD
  56. 56. Traditionally Test via the UI Image: http://stovallorganizing.com/wp-content/uploads/2013/04/Turtleing.jpg
  57. 57. Manual Exploratory Collaboratively built around system behaviour Developer built optimisedfor fast feedback Confidence Speed / Feedback Exercises components and systems Investment Profile
  58. 58. Image: http://concordion.org/image/example/online-shop/AcceptanceTest.png Specification by Example
  59. 59. Image: © Gracie Films / 20thCentury Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg Quality Maturity
  60. 60. Agile Quality Practices
  61. 61. Team Self Assessment
  62. 62. Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg
  63. 63. No agreed approach to testing Tests are not considered a valuable asset An agreed approach to testing that is aligned to a definition of quality Tests are considered a valuable asset that can be reused as features are progressively implemented Test strategy is agreed and understood by the team and includes targets (coverage, defects, …) Test strategy is documented and visible as a BVC used by the team Non-functional requirements are agreed and included in the test strategy Test planning is based on risk (technical complexity and business impact) Test artifacts are treated with the same importance as code and are properly maintained and refactored The relevant ____ilityand security tests form part of the test strategy -1 1 2 3 4 Test Planning
  64. 64. Image: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE O F LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH Empowering Testing
  65. 65. Automation: I work with developers to automate tests that provide business value and identify system risks Collaboration: I work with analysts and SMEsto ensure that testable acceptance criteria are created for all stories Strategy & Planning: I am involved in the project at all stages to ensure that testing provides the greatest value and quality objectives are achieved Tools & Techniques: I use both manual and automated techniques using the preferred testing tools based on the situation Architecture: I have an understanding of the system architecture and can create tests that verify individual components and the system as a whole Development: I take an interest in development practices and monitor code quality metrics Estimating: I am involved in developing estimates for projects at a story level, for tools and infrastructure and also for deployment/release activities Reporting: I provide metrics that give insight into project health and system quality Agile: I understand Agile project delivery and the differences between testing in the different phases of an phase Qualifications & Training: I have recognised qualifications in testing and continually update and maintain my skills Recruitment & Development: I am attracted to the organisation because testing is a cool career path that offers heaps of opportunities and a way of continually developing my skills Community & Teams: I am part of a community of testers that are embedded within teams but share common values Future Tester
  66. 66. Image: http://houndbound.com/dogblog/wp-content/uploads/2009/09/pug_graduate1.jpg Testing Skills
  67. 67. Agile Testing Command Line Interface Continuous Integration Version Control Build Tools Capture Replay (Selenium) HTML Test Maintenance & Data Specification By Example / ATDD / BDD Concordion/ Cucumber SQL Web Services Test Automation Course
  68. 68. New Software Test Engineer Role New Graduates, Recruits, Consultants & Partners BA SME Other Up Skill Assessment Current Test Analysts Capable + Current Skills + Desire Capable + Desire Not Capable + No Desire Not Capable + Desire **Assessment = Technical Test + Interview** Assist & Assess
  69. 69. Image: http://eventstrategysolutions.com/wp-content/uploads/2010/10/early-bird.jpg Get Involved Early
  70. 70. Image: http://blogs.jcvi.org/wp-content/uploads/2009/11/emperor-queue.jpg Queue to Join
  71. 71. Image: http://1.bp.blogspot.com/-pKB3xu6zOc8/TWU1W_4OEqI/AAAAAAAAAzk/ygEOBNumv-Q/s400/nespresso-clooney.jpg Speed to Cool
  72. 72. Continuous Integration Watch Code Build / Compile Run Tests / Analysis Publish Results Stop The Line! Failure?
  73. 73. Continuous Delivery Image: http://www.thoughtworks.com/imgs/drawing-cd-header.png
  74. 74. #notesting Image: http://3.bp.blogspot.com/-jy4Sc0m-oTA/UU9qrGJw56I/AAAAAAAAAC8/zSlPJS9Ed7c/s200/No+testing.JPG
  75. 75. Image: http://www.hackerchick.com/wp-content/uploads/2012/01/2012-01-Kanban-is-the-new-Scrum.jpg http://media.tumblr.com/8b6564487c4ee9bc0698fa880d183fe9/tumblr_inline_moky6riBro1qz4rgp.jpg Iterative was only the beginning! Next ???
  76. 76. Wrap Up Image: © Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg
  77. 77. Do you have a testing skillset (or are you just doing testing?) Image: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Photos-csi-miami-8507515-1999-1315.jpg
  78. 78. Does everybody understand their role in quality? Image: http://www.swotti.com/tmp/swotti/cacheDMLSBGFNZSBWZW9WBGU=/imgVILLAGE%20PEOPLE1.jpg
  79. 79. Are you building quality in from the start? Image: © HiTEntertainment / Hot Animation http://1.bp.blogspot.com/-iLEyvBHn-W0/TglUWW5Or0I/AAAAAAAAAds/HXtPDGPLghA/s1600/bob+the+builder.jpg
  80. 80. Are you measuring testing & assessing quality? Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423
  81. 81. Are you hunting down best practices? Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg
  82. 82. Are you or your testers empowered? Image: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg
  83. 83. The world around us is getting faster (A… is just the start) Image: https://drawception.com/pub/panels/2012/5-13/ATX2Tj5p9f-12.png
  84. 84. Image: © Miller-MilkisProductions http://imagetime.co.gp/key/henry%20winkler%20ron%20howard# Testing is cool…
  85. 85. Image: © Universal Television http://30.media.tumblr.com/tumblr_l6g4d631K31qzp4mwo1_r1_500.jpg …but I love it when delivery and quality come together!
  86. 86. Craig SmithQuestions? http://www.craigsmith.id.au craig@craigsmith.id.au @smithcdau

×