The Speed to Cool: Agile Testing & Building Quality In

1. TheSpeed to Cool:Agile Testing Craig Smith& Building Adrian SmithQuality In

2. Welcome… “Eyyy!”Image: © Fuzzy Door Productions / 20th Century Fox Television C A

3. Welcome… Not Related…Image: © Universal Pictures http://cf1.imgobject.com/backdrops/8af/4bc92693017a3c57fe00f8af/twins-original.jpg C

4. Not Australian for Beer!Image:http://techfreep.com/images/fosters.jpg C

5. The speed to cool…Image: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/ C

6. Thumbs up… Cool!Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355 C

7. Choke...Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg C

8. So, What is a Tester?Image: http://rnstechnologies.com/content_images/small_image_2.jpg/ A

9. Look left… Lookright… A

10. Look up…Image: http://3.bp.blogspot.com/_RdF7S0TNAHY/TOqn8MLYajI/AAAAAAAAAJI/QDBFdixiq0E/s1600/2006-06-17%252520Falling-piano.gif A

11. CSI: SoftwareImage: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg C

12. Agile & TestingImage: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG C

13. To Do Analysis Develop Test Done We reflect work like this... C

14. To Do Analysis Develop Test Done Which is really workinglike this... C

15. Remind you of something?Image: Craig Smith C

16. Testers in an Analyst / agile team Customer Project Elaboration / Specification Acceptance Criteria Manager High Performing AGILE Developer Automation Tester C

17. Testers in an agile team Analysts need more testing involvement AnalystTesters need moretechnical involvement Tester Developer Developers need more testing involvementMore Less Requirements Functional / ExploratoryTechnical Technical Automated Customer Specialist Unit Test Manual Design Collab. Code Tests Test Test C

18. Definition of Quality… (noun) the standard of something as measured against other things of a similar kind; the degree of excellence of something oxforddictionaries.comImage: http://www.naccho.org/topics/infrastructure/accreditation/images/Quality-Definition.jpg / A

19. Quality means different thingsImage: http://upload.wikimedia.org/wikipedia/commons/b/b9/Steve_Jobs_Headshot_2010-CROP.jpg A

20. Implicit / Explicit QualityImage: http://s3.amazonaws.com/integral-life-home/iceberg.jpg A

21. Testing ≠Quality A

22. Building Quality InImage: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg C

23. Quality is everyone’s responsibilityImage: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg C

24. Everyone likes to be seen to value qualityImage: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg C

25. Quality from kickoffImage: © United Feature Syndicate http://s458.photobucket.com/albums/qq310/mrbigjohnson/Murals/?action=view&current=NovemberPics115.jpg&newest=1 C

26. Success sliders Cost Scope Quality Time Fixed 1 X 2 X 3 XFlexible 4 X C

27. Cost Scope Quality Time Your Fixed 1 X Turn! 2 X 3 X Flexible 4 XImage: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A

28. Quality almost always at number 3 Cost Scope Quality Time Fixed 1 X 2 X 3 XFlexible 4 X A

29. Correctness A

30. Quality Interoperability Maintainability RobustnessTrade- Reusability Availability Testability Portability Efficiency Reliability Flexibility Usability Integrity offsReliability + + + + - + +Robustness + + + -Availability + +Integrity - - - - -Flexibility + - - + + +Usability + - -Interoperability - + - +Efficiency - - - - - - - -Testability + + + + - +Maintainability + + + - +Reusability - - + + - + + +Portability + - + - + - + A

31. What does quality meanDefining 1 Quality Advocates to the different roles in the team?Quality 2 Quality Taxonomy What are quality attributes? Quality How do we know what 3 Prioritisation quality attributes to include? What are risks with the 4 Quality Tradeoff Risks quality attributes we are trading off? 5 Quality Measurement How do we test and measure quality? 6 Success Sliders How does quality relate to the sliders? 7 Quality Definition What does quality mean? 8 Next Steps How do we apply quality to our work C

32. QualityDefinition C

34. Strategy & PlanImage: http://www.thechildmindingshop.co.uk/ekmps/shops/thecs/images/table-chalkboard-and-white-board-in-one-%5B2%5D-5540-p.jpg A

35. Simple teststrategy& plans A

36. Simple teststrategy A

37. Reporting & MetricsImage: © Sesame Workshop http://images.wikia.com/muppet/images/9/95/Sesame-english-do-you-like-it-apple_count.jpg C

38. Understand continuous integrationImage: http://confluence.atlassian.com/download/attachments/229837908/bamboo-dashboard.png?version=2&modificationDate=1297756308930 C

39. Understand code metricsImage: http://docs.codehaus.org/download/attachments/111706381/dashboard.png?version=2&modificationDate=1267794480088 C

40. Report how testing is goingImage: http://1.bp.blogspot.com/-46_MdfmjelA/TVa-kb3lTJI/AAAAAAAAABU/JU38qkUXf2c/s1600/half-full-glass.jpg C

41. Your Turn! #1Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A

42. BVC PROJECT TESTING 9 25 7 5 8 New Risks & Issues Raised Number of Risks & Issues 6 7 20 Number of Defects 4 Number of Tests 5 6 15 3 5 4 4 3 10 2 3 2 2 5 1 1 1 0 0 0 0 1 2 3 4 5 6 7 8 HEALTH 1 2 3 4 5 6 7 8 TEST Iteration Iteration COVERAGE OVERALL DEVELOPMENT USER 5700 1800 9 $30 5600 1600 8 5500 $25 1400 7 Number of Features Lines of Test Code 5400 Business Value Lines of Code 1200 6 $20 5300 1000 5 5200 $15 800 4 5100 600 3 $10 5000 4900 400 2 $5 4800 200 1 4700 0 0 $-MAINTAINABILITY 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 PERFORMANCE Iteration Iteration A

43. Agile Testing PracticesImage: http://artegami.com/wp-content/uploads/2007/08/toysrus_karate_kid.jpg C

44. Low Value vs High ValueImage: © The Curiosity Company / 20th Century Fox Television http://images2.fanpop.com/images/photos/3200000/fry-bender-futurama-3295254-1024-768.jpg C

45. Good: Basic AutomationImage: http://seleniumhq.org/projects/ide/ C

46. Better: ATDD / BDD Plain text test Step definition Production codeImage: http://cukes.info/ C

47. Best: Specification by exampleImage: http://www.concordion.org/ C

48. Quality MaturityImage: © Gracie Films / 20th Century Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg A

49. Agile QualityPractices A

50. Team Self-Assessment A

51. QualityRequirements A

52. QualityDevelopment A

53. QualityTesting A

54. Quality TeamImage: http://concordion.org/image/example/online-shop/AcceptanceTest.png A

55. Your Turn!Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg C A

56.  Test artifacts are treated with the same importance as code and are4 properly maintained and refactored  The relevant ____ility and security tests form part of the test strategy  Non-functional requirements are agreed and included in the test strategy3  Test planning is based on risk (technical complexity and business impact)  Test strategy is agreed and understood by the team and includes2 targets (coverage, defects, …)  Test strategy is documented and visible as a BVC used by the team  An agreed approach to testing that is aligned to a definition of quality1  Tests are considered a valuable asset that can be reused as features are progressively implemented  No agreed approach to testing Test-1  Tests are not considered a valuable asset Planning C A

57. ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF EmpoweringRCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH TestingImage: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg C

58. Collaboration: Estimating: Recruitment & Development: I work with analysts and SMEs to I am involved in developing I am attracted to the organisation ensure that testable acceptance estimates for projects at a story because testing is a cool career path criteria are created for all stories level, for tools and infrastructure that offers heaps of opportunities and a and also for deployment/release way of continually developing my skills activitiesAutomation:I work with developers toautomate tests that provide Reporting:business value and identify I provide metrics that givesystem risks insight into project health and system qualityStrategy & Planning:I am involved in the project at all Agile:stages to ensure that testing I understand Agile project deliveryprovides the greatest value and and the differences between testingquality objectives are achieved in the different phases of an phase Qualifications & Training:Tools & Techniques: I have recognised qualifications inI use both manual and testing and continually update andautomated techniques using the maintain my skillspreferred testing tools based onthe situation Architecture: I have an understanding of the system architecture and can create tests that Community & Teams: verify individual components and the I am part of a community of Development: system as a whole testers that are embedded I take an interest in within teams but share development practices and common values monitor code quality metrics Future tester C A

59. Testing SkillsImage: http://houndbound.com/dogblog/wp-content/uploads/2009/09/pug_graduate1.jpg A

60. Architecture SkillsImage: http://www.invermodels.co.uk/portfolios/sheriff.jpg C

61. Technical SkillsImage: http://www.logicalnetworking.net/wp-content/uploads/2010/02/TuxInSchoolComputerLab.jpg A

62. Share with communityImage: http://www.linkline.org.uk/poster/images/Banner.png C

63. Tools & AutomationImage: Martha (Picasa) http://lh3.ggpht.com/_9kYHVyqm3zs/S70g1BiNILI/AAAAAAAADho/A4vuRNMTs50/IMG_7956.JPG A

64. Get Involved EarlyImage: http://eventstrategysolutions.com/wp-content/uploads/2010/10/early-bird.jpg C

65. Queue To JoinImage: http://blogs.jcvi.org/wp-content/uploads/2009/11/emperor-queue.jpg C

67. Do you have a testing skillset (or are you just doing testing)? CImage: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Phot

68. Does everybody understand their role in quality?Image: http://www.swotti.com/tmp/swotti/cacheDMLSBGFNZSBWZW9WBGU=/imgVILLAGE%20PEOPLE1.jpg A

69. Are you building quality in from the start?Image: © HiT Entertainment / Hot Animation http://1.bp.blogspot.com/-iLEyvBHn-W0/TglUWW5Or0I/AAAAAAAAAds/HXtPDGPLghA/s1600/bob+the+builder.jpg A

70. Are you measuring testing and assessing quality?Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423 C

71. Are you hunting down best practices?Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg A

73. Don’t forget to use(or improve) our quality templates C

75. ...but I love it when quality comes togetherImage: © Universal Television http://30.media.tumblr.com/tumblr_l6g4d631K31qzp4mwo1_r1_500.jpg C

76. Craig Smithhttp://www.suncorp.com.au Questionshttp://www.agileacademy.com.auhttp://www.craigsmith.id.au ???craig.smith@suncorp.com.au@smithcdau Dr. Adrian Smith http://www.ennova.com.au http://www.agileengineeringdesign.com adrian.smith@ennova.com.au @adrianlsmith

77. Suncorp is one of Australia and New Zealands largest diversified financial servicesproviders, supplying banking, insurance and wealth management products to around9 million customers through well-established and recognised brands such as AAMI,Australian Pensioners Insurance Agency, Shannons, Vero, Asteron and Tyndall, aswell as Suncorp and GIO. Today, Suncorp is Australias fifth largest bank and secondlargest domestic general insurance group, with over 16,000 staff. Suncorp hasrepresentation in 450 offices, branches and agencies throughout Australia and NewZealand. (http://www.suncorp.com.au)Ennova is a software development company that specialises in helping businessesoptimise their use of technology. We are passionate about what we do and haveembedded Agile and Lean thinking into our approach to everything. This enables usto rapidly deliver high quality software solutions that provide long term businessvalue. Our Agile and Lean consulting services draw on an diverse experience basethat spans the engineering, manufacturing, construction and financial servicesindustries. Additionally, Ennova is active in the development of software productsand therefore has first hand practical experience in the application of Agile and Leanmethods.(http://www.ennova.com.au)The Agile Academy is the next wave in Agile learning and collaboration. Designed forIT professionals, the Agile Academy is a knowledge hub that promotes Agile relatedlearning, knowledge sharing and capability development across the IT industry. Weoffer an integrated curriculum of leading edge courses across the entire solutiondevelopment life cycle, covering all roles at varying levels.(http://www.agileacademy.com.au)