The Future Tester at Suncorp - A Journey of Building Quality In Through Agile
Upcoming SlideShare
Loading in...5
×
 

The Future Tester at Suncorp - A Journey of Building Quality In Through Agile

on

  • 3,268 views

Presentation delivered by Craig Smith, Adrian Smith with Dallas Thorneycroft at STANZ 2011 in Melbourne, Australia. ...

Presentation delivered by Craig Smith, Adrian Smith with Dallas Thorneycroft at STANZ 2011 in Melbourne, Australia.

When Suncorp started down the path of rolling out its agile program over four years ago, it was viewed by many internally and the industry with much scepticism and angst, yet now it is approaching mainstream adoption in the industry. One of the key challenges of becoming agile was improving our approach to testing and quality. In this talk we will talk about why we had to change, why we had to improve the “speed to cool” in relation to testing, our challenges and approach and our blueprint for the “future tester” at Suncorp. Like our agile journey, our vision for testing has been regarded an ambitious, so join us to hear why we believe raising the profile, empowerment and skillset of testing is critical to our (and your) future success.

Statistics

Views

Total Views
3,268
Views on SlideShare
2,526
Embed Views
742

Actions

Likes
1
Downloads
30
Comments
0

6 Embeds 742

http://craigsmith.id.au 415
http://cds43.wordpress.com 249
http://www.agileengineeringdesign.com 57
http://twitter.com 16
https://twitter.com 3
http://webcache.googleusercontent.com 2

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

The Future Tester at Suncorp - A Journey of Building Quality In Through Agile The Future Tester at Suncorp - A Journey of Building Quality In Through Agile Presentation Transcript

  • The FutureTester atSuncorp: Craig Smith Adrian SmithA Journey of withBuilding Quality Dallas ThorneycroftIn Through Agile
  • Welcome…Image: © Walt Disney Pictures / Pixar http://st-listas.20minutos.es/images/2008-07/26818/342659_640px.jpg?1216524692 C A
  • Welcome… Not Related…Image: © Universal Pictures http://cf1.imgobject.com/backdrops/8af/4bc92693017a3c57fe00f8af/twins-original.jpg C
  • First, let’s go back in timeImage: © Universal Pictures http://www.picalls.com/redimensionador/1920x1440/1920x1440.php?src=/1920x1440/./data/media/4/Back_to_the_Future.jpg&w=1024&h=768&zc=0 C
  • Waterfall …1970Image: http://images.jbrains.ca/theory_of_bdd/royce_diagram.jpg C
  • Read past page 2!Image: http://blogs.kcls.org/librarytalk/vintage%20boy%20reading.jpg C
  • 1980’s… 1990’s…Image: http://spaghettitesting.files.wordpress.com/2009/04/fad.png?w=396&h=296 C
  • One TPS report too many…Image: http://spaghettitesting.files.wordpress.com/2009/04/fad.png?w=396&h=296 C
  • 2001XP C
  • XP: Extreme ProgrammingImage: Beck, Kent – Extreme Programming Explained: Embrace Change C
  • Scrum XP: Extreme ProgrammingImage: http://upload.wikimedia.org/wikipedia/commons/b/bd/Scrum-1.JPG A
  • ScrumImage: http://www.mountaingoatsoftware.com/system/asset/file/17/ScrumLargeLabelled.png A
  • Agile: An Umbrella TermImage: http://www.flickr.com/photos/trektrack/2389559700 A
  • Then… in Suncorp landImage: David Jackmanson on Flickr http://www.flickr.com/photos/djackmanson/350383099/sizes/z/in/photostream/ A
  • A leader with a visionImage: © SlatteryIT C
  • Speed to coolImage: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/ C
  • Thumbs up… Cool!Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355 C
  • Choke...Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg C
  • CSI: SoftwareImage: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg C
  • Agile & TestingImage: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG C
  • To Do Analysis Develop Test Done We reflect work like this... C
  • To Do Analysis Develop Test Done Which is really workinglike this... C
  • Remind you of something?Image: Craig Smith C
  • Testers in an Analyst / agile team Customer Project Elaboration / Specification Acceptance Criteria Manager High Performing AGILE Developer Automation Tester C
  • Testers in an agile team Analysts need more testing involvement AnalystTesters need moretechnical involvement Tester Developer Developers need more testing involvementMore Less Requirements Functional / ExploratoryTechnical Technical Automated Customer Specialist Unit Test Manual Design Collab. Code Tests Test Test C
  • Everyone likes to be seen to value qualityImage: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg C
  • Quality is everyone’s responsibilityImage: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg C
  • The JourneyImage: http://www.handheldgpsinformation.com/wp-content/uploads/2010/06/iStock_000001211274XSmall.jpg C
  • Number 1 ProblemImage: http://www.mintvinyl1972.cc.cc/img/product/2009/200912/20091204/279589_0_Journey_Greatest_Hits_Lp_Cbs_4.jpg C
  • Slow ExpensiveImage: http://s1.hubimg.com/u/781000_f520.jpg
  • Fighting Fires CImage: http://rpmedia.ask.com/ts?u=/wikipedia/commons/thumb/b/b2/US_Navy_080730-N-5277R-003_A_Commander%2C_Naval_Forces_Japan_firefighter_douses_a_fire_on_a_dummy_aircraft_during
  • Problem &Proposed Solution A
  • Building Quality InImage: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg A
  • Training & Processes & Roles & Tools & Comms & Coaching Practices Responsibility Infrastructure ChangeAgile Create central Define minimum Preferred tools Testerassessment tool repository for skill set vs technology Surveyfor software QA artefacts matrixquality and Create software Invigoratetesting maturity Create central / QA hiring guide Investigate testing agreed QA opportunities to communityUp-skill existing strategy Define skills for simplify testAgile coaches in Agile team data and Internal /testing practices Create standard members in environments External templates relation to QA CommsUpdate courses Create ready-to- Strategyand training Create glossary Review position go test toolguides descriptions and packages Create BVC career roadmap template for testing rolesCreate Agile Create workingquality/testing example ofchampions Create Agile Define skills for acceptance software QA speciality testing driven one-pagers rolesAssist in-flight developmentprojects Streams... C A
  • Processes & PracticesImage: http://artegami.com/wp-content/uploads/2007/08/toysrus_karate_kid.jpg A
  • Success sliders Cost Scope Quality Time Fixed 1 X 2 X 3 XFlexible 4 X A
  • Cost Scope Quality Time Your Fixed 1 X Turn! 2 X 3 X Flexible 4 XImage: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A
  • Quality almost always at number 3 Cost Scope Quality Time Fixed 1 X 2 X 3 XFlexible 4 X A
  • What does quality meanDefining 1 Quality Advocates to the different roles in the team?Quality 2 Quality Taxonomy What are quality attributes? Quality How do we know what 3 Prioritisation quality attributes to include? What are risks with the 4 Quality Tradeoff Risks quality attributes we are trading off? 5 Quality Measurement How do we test and measure quality? 6 Success Sliders How does quality relate to the sliders? 7 Quality Definition What does quality mean? 8 Next Steps How do we apply quality to our work C
  • QualityDefinition C
  • Shared understanding of qualityImage: © 2008 Melissa McKenney http://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg C
  • Simple QA TestStrategy& Plans A
  • Reporting PROJECT TESTING 9 25 7 5 8 New Risks & Issues Raised Number of Risks & Issues 6 7 20 Number of Defects 4 Number of Tests 5 6 15 3 5 4 4 3 10 2 3 2 2 5 1 1 1 0 0 0 0 1 2 3 4 5 6 7 8 HEALTH 1 2 3 4 5 6 7 8 TEST Iteration Iteration COVERAGE OVERALL DEVELOPMENT USER 5700 1800 9 $30 5600 1600 8 5500 $25 1400 7 Number of Features Lines of Test Code 5400 Business Value Lines of Code 1200 6 $20 5300 1000 5 5200 $15 800 4 5100 600 3 $10 5000 4900 400 2 $5 4800 200 1 4700 0 0 $-MAINTAINABILITY 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 PERFORMANCE Iteration Iteration A
  • Tools & InfrastructureImage: http://www.datenform.de/blog/uploaded_images/tools-709754.jpg A
  • ATDD /Specification ATDD Lifecycle by example Feature Discuss Discuss feature requirements Identify SME BA Test Dev Identify new features BA Test Dev or requirements Refactor Distill Distill into stories Stories TDD with acceptance Cycle criteria Demo Green Red Demonstrate feature and verify using exploratory testing Software Develop SME BA Test Dev Develop the code and instrument tests Test Dev A
  • ATDD /Specification Living Documentation by example C
  • Preferred Tools Best (Specification by Example) Better (ATDD / BDD) Good (Automation) Traditional / Isolated (Manual Tester Focussed) C
  • Training & CoachingImage: http://www.travelsmartsunshinecoast.com.au/image/image_gallery?uuid=cb59e826-c472-427d-bc6c-e6186ef30a5e&groupId=849750&t=1296775495173 C
  • Training C
  • Testing ChampionsImage: http://niche-desktop-testing.s3.amazonaws.com/wp-content/uploads/2010/11/WINNER-Secondary-Live-Action.jpg C
  • In-flight Project AssistanceImage: © Little Britain Productions / BBC Productions http://www.latimes.com/media/photo/2011-06/62506401.jpg C
  • Quality MaturityImage: © Gracie Films / 20th Century Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg A
  • Agile QualityPractices A
  • Team Self-Assessment A
  • QualityRequirements A
  • QualityDevelopment A
  • QualityTesting A
  • Quality TeamImage: http://concordion.org/image/example/online-shop/AcceptanceTest.png A
  • Your Turn!Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg C A
  •  Test artifacts are treated with the same importance as code and are4 properly maintained and refactored  The relevant ____ility and security tests form part of the test strategy  Non-functional requirements are agreed and included in the test strategy3  Test planning is based on risk (technical complexity and business impact)  Test strategy is agreed and understood by the team and includes2 targets (coverage, defects, …)  Test strategy is documented and visible as a BVC used by the team  An agreed approach to testing that is aligned to a definition of quality1  Tests are considered a valuable asset that can be reused as features are progressively implemented  No agreed approach to testing Test-1  Tests are not considered a valuable asset Planning C A
  • ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF Roles &RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH ResponsibilitiesImage: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg C
  • Collaboration: Estimating: Recruitment & Development: I work with analysts and SMEs to I am involved in developing I am attracted to the organisation ensure that testable acceptance estimates for projects at a story because testing is a cool career path criteria are created for all stories level, for tools and infrastructure that offers heaps of opportunities and a and also for deployment/release way of continually developing my skills activitiesAutomation:I work with developers toautomate tests that provide Reporting:business value and identify I provide metrics that givesystem risks insight into project health and system qualityStrategy & Planning:I am involved in the project at all Agile:stages to ensure that testing I understand Agile project deliveryprovides the greatest value and and the differences between testingquality objectives are achieved in the different phases of an phase Qualifications & Training:Tools & Techniques: I have recognised qualifications inI use both manual and testing and continually update andautomated techniques using the maintain my skillspreferred testing tools based onthe situation Architecture: I have an understanding of the system architecture and can create tests that Community & Teams: verify individual components and the I am part of a community of Development: system as a whole testers that are embedded I take an interest in within teams but share development practices and common values monitor code quality metrics Future tester C A
  • Transition Plan New Graduates,Recruits, Consultants & PartnersCurrent Test Analysts New Software Test Assessment Engineer Role Capable + Current Skills + Desire Up Capable + Desire Skill Not Capable + Desire BA Not Capable + No Desire SME Other **Assessment = Technical Test + Interview** C A
  • Communications & ChangeImage: http://dallasmorningviewsblog.dallasnews.com/megaphone-kid-cropped.jpg C
  • Internal / External Communications StrategyImage: C
  • Invigorate Testing CommunityImage: http://2.bp.blogspot.com/_rtqJH_Y4QDw/TTYsl0ieGbI/AAAAAAAABDQ/cMRXApOgV9U/s1600/brent_judd-791018.JPG C
  • Case Study
  • RegroupImage: http://www.philparkertraining.com/data/uploads/team%20discussion.jpg
  • MAF
  • Story + Acceptance Test Criteria Scenarios Test Case Capture MAF for Selenium MainFrame for WebAutomation Executable ContinuousProcess - TAF Specification Integration
  • Wrap UpImage: © Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg C
  • Agile testing is a journeyImage: http://goldeneaglesofamerica.com/wp-content/uploads/2011/04/yellow-brick-2.jpg A
  • Measure, Improve and keep improving your approachImage: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423 C
  • Testing skills are still really, really, important CImage: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Phot
  • Are you hunting down best practices?Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg A
  • Testers need to be viewed as super heroesImage: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg A
  • Don’t forget to use(or improve) our quality templates C
  • Testing needs to be coolImage: © Miller-Milkis Productions http://imagetime.co.gp/key/henry%20winkler%20ron%20howard# C
  • Craig Smithhttp://www.suncorp.com.au Questionshttp://www.agileacademy.com.auhttp://www.craigsmith.id.au ???craig.smith@suncorp.com.au@smithcdau Dr. Adrian Smith http://www.ennova.com.au http://www.agileengineeringdesign.com adrian.smith@ennova.com.au @adrianlsmith
  • Suncorp is one of Australia and New Zealands largest diversified financial servicesproviders, supplying banking, insurance and wealth management products to around9 million customers through well-established and recognised brands such as AAMI,Australian Pensioners Insurance Agency, Shannons, Vero, Asteron and Tyndall, aswell as Suncorp and GIO. Today, Suncorp is Australias fifth largest bank and secondlargest domestic general insurance group, with over 16,000 staff. Suncorp hasrepresentation in 450 offices, branches and agencies throughout Australia and NewZealand. (http://www.suncorp.com.au)Ennova is an technology company that has focused on providing the engineering andconstruction industries with innovative products and services that improve projectexecution and operational efficiency. Ennova base their the project delivery approachon combination of Lean and Agile principles and practices. This provides clients witha high level of transparency and real value for money. Consulting engagements areundertaken using a pragmatic and common sense approach that is aimed atincreasing the clients internal capability and building business agility.(http://www.ennova.com.au)The Agile Academy is the next wave in Agile learning and collaboration. Designed forIT professionals, the Agile Academy is a knowledge hub that promotes Agile relatedlearning, knowledge sharing and capability development across the IT industry. Weoffer an integrated curriculum of leading edge courses across the entire solutiondevelopment life cycle, covering all roles at varying levels.(http://www.agileacademy.com.au)