'Acceptance Testing in Agile - what does it mean to you?' by Fran O'Hara


Published on

View webinar: http://www.eurostarconferences.com/community/member/webinar-archive/webinar-66-acceptance-testing-in-agile---what-does-it-mean-to-you

With sequential lifecycles like the V-model, the main interpretation of 'Acceptance' is usually User Acceptance Testing. In the more iterative/incremental approach of Agile, the word 'acceptance' has a different meaning. It typically relates to customer or user story based testing. However, many agile teams struggle to ensure they have an effective test strategy because of a lack of clarity in the scope of acceptance testing. This can lead to significant product risks being omitted in testing. This presentation will clarify the many forms of Acceptance testing and the roles involved. It will provide key lessons learnt and practical advice to help ensure your approach is as effective as possible in your context.

Published in: Technology, Education
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

'Acceptance Testing in Agile - what does it mean to you?' by Fran O'Hara

  1. 1. Today’s webinar is presented by Fran O’Hara and he willdiscuss Acceptance Testing in Agile - what does it mean toyou?Welcome to the EuroSTAR MayWebinar Serieswww.eurostarconferences.comThis webinar is due to start at 2pm. Make sure you stick around at the end for theQ&A session and continue the conversation with the speaker on Twitter after theshow!@esconfs#esconfs
  2. 2. Acceptance Testing in Agile – whatdoes it mean to you?Fran O’Hara, Inspire Quality Services, IrelandFran OHara is Director and Principal Consultant of Inspire Quality Services. With over 28 yearsexperience in the software industry, he specialises in pragmatic approaches to lean/agile, softwareprocess improvement, quality/testing, and associated practices. For the last 5 years, his mainfocus has been providing agile/lean coaching, training and support to organisations transitioningto agile/lean particularly with Scrum/XP and Kanban. Fran is a regular speaker at agile, processimprovement and quality/testing conferences. He is a certified ScrumMaster, an ISTQB testingtutor at advanced level, a CMMI lead assessor, a fellow of the Irish Computer Society, a director ofthe TMMi Foundation, a trained TMMi Assessor and co-founder of the Irish SIG in SoftwareTesting - SoftTest.www.eurostarconferences.com@esconfs#esconfs
  3. 3. How can I get the slides?www.eurostarconferences.comSlides and all materials will be posted on the EuroSTAR blog aswell as emailed to you.@esconfs#esconfs
  4. 4. Join the conversation on Twitter#esconfs@esconfswww.eurostarconferences.comContinue the conversation with the speaker on Twitter after the show!
  5. 5. We provide Agile, Quality and Process Improvement Services such as Consulting/Coaching:– Strategic advice and hands-on Coaching/mentoring in areas such as agile/lean(Scrum, XP, Kanban), testing, process improvement, etc. Training public/inhouse:– Lean/Agile: Getting Lean through Kanban, Succeeding with Agile/Scrum, PMI’s Agile CertifiedPractitioner, Agile Testing, Product Owner training, etc.– Testing (ISTQB Foundation and Advanced Test Manager/Analyst, Risk-based testing, Test designtechniques, Testing for developers, TMap®, Peer Reviews, UAT, etc.)– Requirements/Business analysis– Software project management Assessments– Agile practices– Industry standards and models such as CMMI®, TPI®, TMMi®, etc.5www.inspireqs.iefran.ohara@inspireqs.ie
  6. 6. Agenda• Acceptance testing in traditional plan-driven lifecycles• V-model• Acceptance testing in agile• Agile – a few relevant concepts• Agile test strategy• Quadrant thinking and automation pyramid• Conclusions6
  7. 7. 7V-ModelRequirementsFunctional Spec.Hi level design(User)Acceptance testLo level designCodeSystem testIntegration testUnit testReviewsStatic AnalysisStatic Testing Dynamic TestingEarly test design
  8. 8. UseracceptancetestingOperational(acceptance)testingContract andregulationacceptancetestingAlpha andbeta (orfield) testing8Typical forms of Acceptance TestingISTQB : (user) acceptance testing: Formal testing with respect to userneeds, requirements, and business processes conducted to determinewhether or not a system satisfies the acceptance criteria and to enablethe user, customers or other authorized entity to determine whether ornot to accept the system. [After IEEE 610]
  9. 9. Agenda• Acceptance testing in traditional plan-driven lifecycles• V-model• Acceptance testing in agile• Agile – a few relevant concepts• Agile test strategy• Quadrant thinking and automation pyramid• ConclusionsCopyright © 2013 Inspire QS 9
  10. 10. Resources ScheduleScope/RequirementsPlan DrivenFIXEDESTIMATEDResources ScheduleScope/RequirementsValue DrivenQualityQualityFlipping the Iron TriangleCopyright © 2013 Inspire QS 10
  11. 11. Waterfall .vs. AgileCopyright © 2013 Inspire QS 11
  12. 12. Agile Phases? – but beware• Planning phase steps– Product backlog prioritized and ready?• At least for first sprint or two!– Architecture defined?• Versus emergent!?.... ‘architectural vision’– Release & Test Planning• Development iterations– Build quality software/documentation• Implement phase steps (‘End Game’)– System integration testing• But integrate early as much as possible– Final performance testing– UAT/Beta….Most focusWaterfall Agile12
  13. 13. Agenda• Acceptance testing in traditional plan-driven lifecycles• V-model• Acceptance testing in agile• Agile – a few relevant concepts• Agile test strategy• Quadrant thinking and automation pyramid• ConclusionsCopyright © 2013 Inspire QS 13
  14. 14. Evolving from sequential to iterative/incremental!Code CodeCode &Bug FixTestSprint 1 Sprint 2CodeTestSprint 1 Sprint 2Code &Bug FixCodeTestCode &Bug FixCode & Bug FixTestSprint 1 Sprint 2Code & Bug FixTestABC14
  15. 15. Copyright © 2013 Inspire QS 15An acceptance test is a formal description of the behaviour of a softwareproduct, generally expressed as an example or a usage scenario. ..- in many cases the aim is that it should be possible to automate the executionof such tests by a software tool, either ad-hoc to the development team or offthe shelf.- Similarly to a unit test, an acceptance tests is generally understood to have abinary result, pass or fail;- For many Agile teams acceptance tests are the main form of functionalspecification; sometimes the only formal expression of businessrequirements. ..Also known as• The terms "functional test", "acceptance test" and "customer test" are usedmore or less interchangeably.• A more specific term "story test", referring to user stories is also used, as inthe phrase "story test driven development".- Agile Alliance‘Acceptance’ Testing in Agile
  16. 16. Agile Testing Quadrants16
  17. 17. Sample interpretation ofTest QuadrantsQ1Q2 Q3Q4Business FacingTechnology FacingSupportingtheTeamCritiquetheProductStatic TestsUnit TestsLow level Integration TestsAcceptance TestsUsability TestsExploratory TestsPerformance TestsTechnical Security Tests‘ility’ TestsAutomatedAcceptanceTestFrameworkAutomatedDevelopmentFrameworkManualandAutomatedTools
  18. 18. 18‘Some people use the term ‘acceptance tests’ todescribe Q2 tests, but we believe that acceptance testsencompass a broader range of tests that include Q3and Q4.Acceptance tests verify that all aspects of thesystem, including qualities such as usability andperformance, meet customer expectations. ‘– from ‘Agile Testing’, Crispin/GregoryMore interpretations….
  19. 19. The Automation PyramidUnit/Component layerDeveloper Testse.g. JUnitAPI/Service layer‘Acceptance Tests’e.g. Fitnesse, CucumberGUI layere.g. SeleniumManual Testse.g. exploratoryAutomate atfeature/workflow levelAutomate atstory levelAutomate atdesign levelBased on Mike Cohn19
  20. 20. From: Lisa Crispin, 2011 20
  21. 21. Maintaining ContextPRIORITYGRANULARITY21
  22. 22. Sprints and Testing StrategySprint 1Dev + Test*Sprint 2Dev + Test*Sprint 3Dev + Test*Additional testing Additional Testing*Sprint test = Automated Unit & Acceptance, Manual ExploratoryWithin a Sprint may need to perform additional testing as part of a defined but adaptive risk-basedtesting strategy e.g.:– Feature/’epic’ or workflow level testing– Combination/feature interaction testing– Business cycle & end-to-end scenario testing – exercising multiple stories, end of monthprocessing, etc.– Performance testing– Usability testing– Security testing– System integration testing Note: Ideally any testing needed should be included within the Sprint rather than being deferred….Evolve to fully Working Software!!Additional testing…22Copyright © 2013 Inspire QS
  23. 23. 23 From: Janet Gregory 2011
  24. 24. Agenda• Acceptance testing in traditional plan-driven lifecycles• V-model• Acceptance testing in agile• Agile – a few relevant concepts• Agile test strategy• Quadrant thinking and automation pyramid• ConclusionsCopyright © 2013 Inspire QS 24
  25. 25. • Adapt test strategy (and therefore ‘acceptancetesting’) to your context e.g.– Lifecycle• Sequential• Iterative/incremental e.g. Agile/lean– Organisational• IT• Product development• Outsourcing– Domain area• Regulated - Safety critical, Financial Services, …• Web, embedded, …– Product risks• Based on above, agree (local) definition of termsand disseminate!Conclusions25
  26. 26. EuroSTAR Webinar ArchiveAccess almost 50 on-demand software testing webinars by the worlds leadingtesting experts. Topics include….www.eurostarconferences.comAgile, Automation, Test Management, Process Improvements, Risk-based Testing, PerformanceTesting, Test Documentation, Cloud Testing, Session-based Testing, Weekend TestersVisit the archive!http://www.eurostarconferences.com/community/member/webinar-archive@esconfs#esconfs
  27. 27. The EuroSTAR Community.Are you a member?Did you know we have an online resource area with almost …www.eurostarconferences.com600 software testing presentations, 50 topicalwebinars, over 40 videos and podcasts and 20 experteBooksDo you know that membership is completely free and you can access thesepremium testing resources anytime?Join today!http://www.eurostarconferences.com/community/member@esconfs#esconfs
  28. 28. www.eurostarconferences.comAre you coming to Gothenburg?Join us in the Swedish Exhibition& CongressCentre, Gothenburg, Swedenfrom the 04-07 November forthe 21st annual EuroSTARConference.Visitwww.eurostarconferences.comfor more information on whatyou can expect to see at Europe’slargest software testing event!@esconfs#esconfs