Successfully reported this slideshow.
Your SlideShare is downloading. ×

The Speed to Cool: Agile Testing & Building Quality In

Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Loading in …3
×

Check these out next

1 of 77 Ad

The Speed to Cool: Agile Testing & Building Quality In

Download to read offline

Presentation delivered at Agile 2011 in Salt Lake City by Craig Smith and Adrian Smith. Ensuring that the approach to testing and quality is understood and appropriately valued in an agile world can be a struggle for many organisations, especially when resources are limited and our customers are expecting business value in a timely manner. In this session we will define what quality means and share a number of tools for measuring it, discuss approaches to improving the skills, empowerment and role of testing in the organisation and share why testing is the coolest role on the team and why it is everyones responsibility.

Presentation delivered at Agile 2011 in Salt Lake City by Craig Smith and Adrian Smith. Ensuring that the approach to testing and quality is understood and appropriately valued in an agile world can be a struggle for many organisations, especially when resources are limited and our customers are expecting business value in a timely manner. In this session we will define what quality means and share a number of tools for measuring it, discuss approaches to improving the skills, empowerment and role of testing in the organisation and share why testing is the coolest role on the team and why it is everyones responsibility.

Advertisement
Advertisement

More Related Content

Similar to The Speed to Cool: Agile Testing & Building Quality In (20)

Advertisement

More from Craig Smith (20)

Recently uploaded (20)

Advertisement

The Speed to Cool: Agile Testing & Building Quality In

  1. 1. The Speed to Cool: Agile Testing Craig Smith & Building Adrian Smith Quality In
  2. 2. Welcome… “Eyyy!” Image: © Fuzzy Door Productions / 20th Century Fox Television C A
  3. 3. Welcome… Not Related… Image: © Universal Pictures http://cf1.imgobject.com/backdrops/8af/4bc92693017a3c57fe00f8af/twins-original.jpg C
  4. 4. Not Australian for Beer! Image:http://techfreep.com/images/fosters.jpg C
  5. 5. The speed to cool… Image: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/ C
  6. 6. Thumbs up… Cool! Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355 C
  7. 7. Choke... Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg C
  8. 8. So, What is a Tester? Image: http://rnstechnologies.com/content_images/small_image_2.jpg/ A
  9. 9. Look left… Look right… A
  10. 10. Look up… Image: http://3.bp.blogspot.com/_RdF7S0TNAHY/TOqn8MLYajI/AAAAAAAAAJI/QDBFdixiq0E/s1600/2006-06-17%252520Falling-piano.gif A
  11. 11. CSI: Software Image: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg C
  12. 12. Agile & Testing Image: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG C
  13. 13. To Do Analysis Develop Test Done We reflect work like this... C
  14. 14. To Do Analysis Develop Test Done Which is really working like this... C
  15. 15. Remind you of something? Image: Craig Smith C
  16. 16. Testers in an Analyst / agile team Customer Project Elaboration / Specification Acceptance Criteria Manager High Performing AGILE Developer Automation Tester C
  17. 17. Testers in an agile team Analysts need more testing involvement Analyst Testers need more technical involvement Tester Developer Developers need more testing involvement More Less Requirements Functional / Exploratory Technical Technical Automated Customer Specialist Unit Test Manual Design Collab. Code Tests Test Test C
  18. 18. Definition of Quality… (noun) the standard of something as measured against other things of a similar kind; the degree of excellence of something oxforddictionaries.com Image: http://www.naccho.org/topics/infrastructure/accreditation/images/Quality-Definition.jpg / A
  19. 19. Quality means different things Image: http://upload.wikimedia.org/wikipedia/commons/b/b9/Steve_Jobs_Headshot_2010-CROP.jpg A
  20. 20. Implicit / Explicit Quality Image: http://s3.amazonaws.com/integral-life-home/iceberg.jpg A
  21. 21. Testing ≠ Quality A
  22. 22. Building Quality In Image: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg C
  23. 23. Quality is everyone’s responsibility Image: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg C
  24. 24. Everyone likes to be seen to value quality Image: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg C
  25. 25. Quality from kickoff Image: © United Feature Syndicate http://s458.photobucket.com/albums/qq310/mrbigjohnson/Murals/?action=view&current=NovemberPics115.jpg&newest=1 C
  26. 26. Success sliders Cost Scope Quality Time Fixed 1 X 2 X 3 X Flexible 4 X C
  27. 27. Cost Scope Quality Time Your Fixed 1 X Turn! 2 X 3 X Flexible 4 X Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A
  28. 28. Quality almost always at number 3 Cost Scope Quality Time Fixed 1 X 2 X 3 X Flexible 4 X A
  29. 29. Correctness A
  30. 30. Quality Interoperability Maintainability Robustness Trade- Reusability Availability Testability Portability Efficiency Reliability Flexibility Usability Integrity offs Reliability + + + + - + + Robustness + + + - Availability + + Integrity - - - - - Flexibility + - - + + + Usability + - - Interoperability - + - + Efficiency - - - - - - - - Testability + + + + - + Maintainability + + + - + Reusability - - + + - + + + Portability + - + - + - + A
  31. 31. What does quality mean Defining 1 Quality Advocates to the different roles in the team? Quality 2 Quality Taxonomy What are quality attributes? Quality How do we know what 3 Prioritisation quality attributes to include? What are risks with the 4 Quality Tradeoff Risks quality attributes we are trading off? 5 Quality Measurement How do we test and measure quality? 6 Success Sliders How does quality relate to the sliders? 7 Quality Definition What does quality mean? 8 Next Steps How do we apply quality to our work C
  32. 32. Quality Definition C
  33. 33. Shared understanding of quality Image: © 2008 Melissa McKenney http://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg C
  34. 34. Strategy & Plan Image: http://www.thechildmindingshop.co.uk/ekmps/shops/thecs/images/table-chalkboard-and-white-board-in-one-%5B2%5D-5540-p.jpg A
  35. 35. Simple test strategy & plans A
  36. 36. Simple test strategy A
  37. 37. Reporting & Metrics Image: © Sesame Workshop http://images.wikia.com/muppet/images/9/95/Sesame-english-do-you-like-it-apple_count.jpg C
  38. 38. Understand continuous integration Image: http://confluence.atlassian.com/download/attachments/229837908/bamboo-dashboard.png?version=2&modificationDate=1297756308930 C
  39. 39. Understand code metrics Image: http://docs.codehaus.org/download/attachments/111706381/dashboard.png?version=2&modificationDate=1267794480088 C
  40. 40. Report how testing is going Image: http://1.bp.blogspot.com/-46_MdfmjelA/TVa-kb3lTJI/AAAAAAAAABU/JU38qkUXf2c/s1600/half-full-glass.jpg C
  41. 41. Your Turn! #1 Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A
  42. 42. BVC PROJECT TESTING 9 25 7 5 8 New Risks & Issues Raised Number of Risks & Issues 6 7 20 Number of Defects 4 Number of Tests 5 6 15 3 5 4 4 3 10 2 3 2 2 5 1 1 1 0 0 0 0 1 2 3 4 5 6 7 8 HEALTH 1 2 3 4 5 6 7 8 TEST Iteration Iteration COVERAGE OVERALL DEVELOPMENT USER 5700 1800 9 $30 5600 1600 8 5500 $25 1400 7 Number of Features Lines of Test Code 5400 Business Value Lines of Code 1200 6 $20 5300 1000 5 5200 $15 800 4 5100 600 3 $10 5000 4900 400 2 $5 4800 200 1 4700 0 0 $- MAINTAINABILITY 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 PERFORMANCE Iteration Iteration A
  43. 43. Agile Testing Practices Image: http://artegami.com/wp-content/uploads/2007/08/toysrus_karate_kid.jpg C
  44. 44. Low Value vs High Value Image: © The Curiosity Company / 20th Century Fox Television http://images2.fanpop.com/images/photos/3200000/fry-bender-futurama-3295254-1024-768.jpg C
  45. 45. Good: Basic Automation Image: http://seleniumhq.org/projects/ide/ C
  46. 46. Better: ATDD / BDD Plain text test Step definition Production code Image: http://cukes.info/ C
  47. 47. Best: Specification by example Image: http://www.concordion.org/ C
  48. 48. Quality Maturity Image: © Gracie Films / 20th Century Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg A
  49. 49. Agile Quality Practices A
  50. 50. Team Self- Assessment A
  51. 51. Quality Requirements A
  52. 52. Quality Development A
  53. 53. Quality Testing A
  54. 54. Quality Team Image: http://concordion.org/image/example/online-shop/AcceptanceTest.png A
  55. 55. Your Turn! Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg C A
  56. 56.  Test artifacts are treated with the same importance as code and are 4 properly maintained and refactored  The relevant ____ility and security tests form part of the test strategy  Non-functional requirements are agreed and included in the test strategy 3  Test planning is based on risk (technical complexity and business impact)  Test strategy is agreed and understood by the team and includes 2 targets (coverage, defects, …)  Test strategy is documented and visible as a BVC used by the team  An agreed approach to testing that is aligned to a definition of quality 1  Tests are considered a valuable asset that can be reused as features are progressively implemented  No agreed approach to testing Test -1  Tests are not considered a valuable asset Planning C A
  57. 57. ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF Empowering RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE O F LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH Testing Image: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg C
  58. 58. Collaboration: Estimating: Recruitment & Development: I work with analysts and SMEs to I am involved in developing I am attracted to the organisation ensure that testable acceptance estimates for projects at a story because testing is a cool career path criteria are created for all stories level, for tools and infrastructure that offers heaps of opportunities and a and also for deployment/release way of continually developing my skills activities Automation: I work with developers to automate tests that provide Reporting: business value and identify I provide metrics that give system risks insight into project health and system quality Strategy & Planning: I am involved in the project at all Agile: stages to ensure that testing I understand Agile project delivery provides the greatest value and and the differences between testing quality objectives are achieved in the different phases of an phase Qualifications & Training: Tools & Techniques: I have recognised qualifications in I use both manual and testing and continually update and automated techniques using the maintain my skills preferred testing tools based on the situation Architecture: I have an understanding of the system architecture and can create tests that Community & Teams: verify individual components and the I am part of a community of Development: system as a whole testers that are embedded I take an interest in within teams but share development practices and common values monitor code quality metrics Future tester C A
  59. 59. Testing Skills Image: http://houndbound.com/dogblog/wp-content/uploads/2009/09/pug_graduate1.jpg A
  60. 60. Architecture Skills Image: http://www.invermodels.co.uk/portfolios/sheriff.jpg C
  61. 61. Technical Skills Image: http://www.logicalnetworking.net/wp-content/uploads/2010/02/TuxInSchoolComputerLab.jpg A
  62. 62. Share with community Image: http://www.linkline.org.uk/poster/images/Banner.png C
  63. 63. Tools & Automation Image: Martha (Picasa) http://lh3.ggpht.com/_9kYHVyqm3zs/S70g1BiNILI/AAAAAAAADho/A4vuRNMTs50/IMG_7956.JPG A
  64. 64. Get Involved Early Image: http://eventstrategysolutions.com/wp-content/uploads/2010/10/early-bird.jpg C
  65. 65. Queue To Join Image: http://blogs.jcvi.org/wp-content/uploads/2009/11/emperor-queue.jpg C
  66. 66. Wrap Up Image: © Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg C
  67. 67. Do you have a testing skillset (or are you just doing testing)? C Image: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Phot
  68. 68. Does everybody understand their role in quality? Image: http://www.swotti.com/tmp/swotti/cacheDMLSBGFNZSBWZW9WBGU=/imgVILLAGE%20PEOPLE1.jpg A
  69. 69. Are you building quality in from the start? Image: © HiT Entertainment / Hot Animation http://1.bp.blogspot.com/-iLEyvBHn-W0/TglUWW5Or0I/AAAAAAAAAds/HXtPDGPLghA/s1600/bob+the+builder.jpg A
  70. 70. Are you measuring testing and assessing quality? Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423 C
  71. 71. Are you hunting down best practices? Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg A
  72. 72. Are you testers empowered? Image: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg A
  73. 73. Don’t forget to use (or improve) our quality templates C
  74. 74. Testing is cool… Image: © Miller-Milkis Productions http://imagetime.co.gp/key/henry%20winkler%20ron%20howard# C
  75. 75. ...but I love it when quality comes together Image: © Universal Television http://30.media.tumblr.com/tumblr_l6g4d631K31qzp4mwo1_r1_500.jpg C
  76. 76. Craig Smith http://www.suncorp.com.au Questions http://www.agileacademy.com.au http://www.craigsmith.id.au ??? craig.smith@suncorp.com.au @smithcdau Dr. Adrian Smith http://www.ennova.com.au http://www.agileengineeringdesign.com adrian.smith@ennova.com.au @adrianlsmith
  77. 77. Suncorp is one of Australia and New Zealand's largest diversified financial services providers, supplying banking, insurance and wealth management products to around 9 million customers through well-established and recognised brands such as AAMI, Australian Pensioners Insurance Agency, Shannons, Vero, Asteron and Tyndall, as well as Suncorp and GIO. Today, Suncorp is Australia's fifth largest bank and second largest domestic general insurance group, with over 16,000 staff. Suncorp has representation in 450 offices, branches and agencies throughout Australia and New Zealand. (http://www.suncorp.com.au) Ennova is a software development company that specialises in helping businesses optimise their use of technology. We are passionate about what we do and have embedded Agile and Lean thinking into our approach to everything. This enables us to rapidly deliver high quality software solutions that provide long term business value. Our Agile and Lean consulting services draw on an diverse experience base that spans the engineering, manufacturing, construction and financial services industries. Additionally, Ennova is active in the development of software products and therefore has first hand practical experience in the application of Agile and Lean methods. (http://www.ennova.com.au) The Agile Academy is the next wave in Agile learning and collaboration. Designed for IT professionals, the Agile Academy is a knowledge hub that promotes Agile related learning, knowledge sharing and capability development across the IT industry. We offer an integrated curriculum of leading edge courses across the entire solution development life cycle, covering all roles at varying levels. (http://www.agileacademy.com.au)

×