EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test Automation© Christian Nørlyng and Prett...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWho am I?Test Automation Lead...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationAgenda• Mission and Bugs• Goa...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationMost Important Mission"Increa...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationAutomation and bugsTest Autom...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationSetting realistic goals• Rule...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationGetting the Context”Features”...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationPicking the first features”Wa...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationGood Automation Candidates• S...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationPoor Automation CandidatesPoo...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationAnalysing the ”User Action”Pa...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationDesigning Good Test Cases• Te...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWhat is ”Structural Test Patt...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationThe Principle in short• By th...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationThink AutomationHow and whatt...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationKeyWord ClassificationNavigat...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWork Process DescriptionRequi...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationProducts of Module Based Test...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationKW 7KW 6KW 3KW 2.1KW 1KW 7KW ...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWhy does this work?• During t...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationSummary of test design• Coope...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWhere to go from here!• Data ...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test Automation5.262.1 2.32.375.25.16 432.2 ...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationRemove the abstraction• Model...
EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationQuestions and CommentsPlease ...
Upcoming SlideShare
Loading in …5
×

'Raising the Quality Bar In Agile Teams By Means Of “Early” Test Automation' by Christian Nørlyng

324 views
261 views

Published on

When testing in agile projects, testers are required to deliver the best service possible to the developers. To be able to deliver this highly needed service to developers, the team needs already “done” features to keep on working, avoid known defects to resurface (reappear) as well as avoid builds to crash.



I will present successfully applied methods and techniques used in agile software development projects. The focus on this approach for test automation is to let it become this needed “early” service to both developers and manual testers. By following these methods and techniques, testers will be able to impact the quality (positively) by contributing to test automation and test improvement via better design of test cases for test automation. It is a fundamental matter for high quality products that developers are able to continue keeping the high quality alongside new functionality is added. For this to be a success, test automation needs to be “pushed back” to as close as possible to the developers.



In order to keep up with the pace of the developers and to avoid the “Death by Maintenance” syndrome, a proper approach to “early” test automation is required. I will introduce examples of a proper approach as well as some handy test techniques for easing the scripting of tests.



The presentation is about how to incorporate successful test automation into an agile project. It is about the processes used daily by developers as well as incorporating our tests to the build processes and hence improving the quality of our products. I will also emphasize the importance of cooperation with the developers and their tool smiths, by pragmatic approaches.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
324
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

'Raising the Quality Bar In Agile Teams By Means Of “Early” Test Automation' by Christian Nørlyng

  1. 1. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test Automation© Christian Nørlyng and PrettyGoodTesting®By Christian NørlyngRaising The Quality Bar In Agile TeamsBy means Of Early Test Automation1
  2. 2. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWho am I?Test Automation Lead at PrettyGoodTestingISTQB certified Test Analyst (adv. level)9+ years of test experience from• Small & Large Teams• Agile & Waterfall Projects• Medical – Directory – Telecom – Defense – Maritime2
  3. 3. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationAgenda• Mission and Bugs• Goals, Context and Features for automation• Structural Test Patterns• Thinking Automation• Modeling for Data and more3
  4. 4. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationMost Important Mission"Increase managementconfidence in the product."4
  5. 5. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationAutomation and bugsTest Automation is looking forDefects found during regression testing5
  6. 6. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationSetting realistic goals• Rules of thumb are difficult to apply• Conduct a small pilot project• Less than a month in duration• After creating “just enough” infrastructure,track time to automate each feature• Compare time to manual testing• Use these data for subsequent test projects• Continue to update data• Automation will become more efficientafter the first few projects6
  7. 7. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationGetting the Context”Features””Trade off’s””Possibilities””Context”Starting with theintersection!7
  8. 8. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationPicking the first features”Wants””Seems Quick””Musts Haves””Planned/ImplementedFeatures”Starting with theintersection!8
  9. 9. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationGood Automation Candidates• Short or simple transactions• Many data combinations• Expected results are stableor easy to generate at runtime• Tests that are executed regularly• Tasks that are difficult to do manually• Highest priority features9
  10. 10. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationPoor Automation CandidatesPoor Automation Candidates• Long or complex transactions• One-offs• Unstable or difficult to predict results• Tests that works across multiple applications10
  11. 11. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationAnalysing the ”User Action”Patterns Under Test• Breaking down the test cases andsystem under test into keywords• Each keyword should representa ”unique” set of actions to the system11
  12. 12. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationDesigning Good Test Cases• Test cases should have a single objective• Test cases should result in one of twodispositions: PASS or FAIL• Test cases should be independent• No test case should rely onthe successful completion of another test• Test cases must start and stopat a known state12
  13. 13. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWhat is ”Structural Test Patterns”?• A break down method both for supporting• KeyWords, ActionWords or Primitives• Can be used for manualand automated testing• Can relate manualand automated testing• Can ease maintenance of manualand automated testware13
  14. 14. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationThe Principle in short• By thinking from the bottom up the supportfor automation is enabled from the testdesign.• By breaking down the users behaviour intopatterns, the test procedures be simplified.14
  15. 15. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationThink AutomationHow and whatto automateAnalyzedGUI/MMIActionWordsStructuringTest ConditionsDomainknowlegdeTest DesignStructureRequirementsModular mindset, duringanalyzis and Test designTest Conditions suitable for automationTraceableidentification15
  16. 16. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationKeyWord ClassificationNavigationGo from A to B (Start to adjust Time)ActionInput to system (Set Time)VerificationThe object of the test (Vary Time set)16
  17. 17. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWork Process DescriptionRequirementsTest DesignTests using KeywordsAutomatedManualModular mindsetduring test designReviewReview17
  18. 18. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationProducts of Module Based Test DesignTraditionalSequentialTestCasesA pseudo test case broken down into ActionWords,each KeyWord is unique to the SUT (Software Under Test)KW 6KW 5KW 4KW 3KW 2KW 1 KW = KeyWord18
  19. 19. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationKW 7KW 6KW 3KW 2.1KW 1KW 7KW 5.1KW 4KW 3KW 2.2KW 1KW 7KW 5.2KW 4KW 3KW 2.3KW 112.1 2.2 2.336 45.17Saving above 50% of work in just this example.5.2KW = KeyWordAn Advantage19
  20. 20. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWhy does this work?• During test analysis, try to break down eachTestCase into unique and identifiable useraction sequences• A unique sequence, is not to exist elsewhere• (stick to this…)• The sequences are to be reused and combinedin any order, representing complete user actions• Everything implemented is the rightcontext of the automation project20
  21. 21. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationSummary of test design• Cooperation between Test Designer, Manual TestTeam and Automation Test Team reduces effort, by:- Thinking Automation First- Reusing Test Documentation/KeyWords• KeyWords (aka ActionWords, Modules etc.):- Promotes flexible & easy maintainable Test Suites• Exploratory Testing and Model Based Testing...still to be carried out (not a stand-alone thing)!21
  22. 22. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationWhere to go from here!• Data Drive the TestUse:Parameters for the KeywordsKeywords as DataUse Test Techniques and TestGeneration Tools for modelling!Ex. Decision Tables,Classification Trees or State Machine Graphing22
  23. 23. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test Automation5.262.1 2.32.375.25.16 432.2 2.32.1112.1 2.2 2.336 45.175.2Simplified Example23
  24. 24. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationRemove the abstraction• Models can even bemadein a spread sheet!• MS Excel (e.g.) canoftenbe used as a data source• Designing test can nowbedone from outside thetest automation tool!!KeyWordParameterSetTest 1KW1 KW1_P1KW2.2 KW2_P1KW3 KW3_P1KW4 KW4_P1KW5.1 KW5_P1KW7 KW7_P1Test 2KW1 KW1_P1KW2.2 KW2_P2KW3 KW3_P1KW4 KW4_P1KW5.1 KW5_P1KW7 KW7_P1Test 3KW1 KW1_P1KW2.2 KW2_P3KW3 KW3_P1KW4 KW4_P1KW5.1 KW5_P1KW7 KW7_P124
  25. 25. EuroSTAR 2011 : T6 : Raising The Quality Bar In Agile Teams By Means Of Early Test AutomationQuestions and CommentsPlease feel free to contact me!Christian NørlyngTest Automation LeadMob: (+45) 3163 0203CHNO@PrettyGoodTesting.comhttp://www.PrettyGoodTesting.com© Christian Nørlyng and PrettyGoodTesting®25

×