Your SlideShare is downloading. ×
0
Test Automation andKeyword-driven testing     Brian Nielsen,     bnielsen@cs.aau.dk
Testing as a process                              g      prequirements               Planning&                            ...
Test Automationrequirements               Planning&                            Control                ologi               ...
1 Manual Testing1.        + easy & cheap to start        + flexible testing        - expensive every execution        - no...
2 Capture Replay Testing    2. Capture-Replay+ flexible testingexpensive first execution+ auto regression testing- fragile...
3 Script Based Testing3. Script-Based          +/- test impl. = programming          + automatic execution          + auto...
4 Keyword Driven Testing     4. Keyword-Driven+ abstract tests+ automatic execution+ auto regression testing- robust tests...
5 Model-Based     5. Model Based         Testing               g+ abstract tests+ automatic execution+ auto regression tes...
Script-based       Script based TestingTest inputs and observations (verdictassignment) programmed in scripts in    g     ...
Keyword Driven Testing      y                  g• Script based automation where test case  design is  d i i separated f   ...
Keyword Driven Testing       y                  g+ Concise, flexible, maintainable,+ Read-/writeable by non-programmers÷ E...
Keyword Driven Test                 yEg. Sequence      Object          Keyword         Value      LoginDialog     Login   ...
KWD ProcessTest Expert                            Automation Expert              http://www.softwaretestinghelp.com/wp-con...
Automation Fixture                    Keywod Script                                        Open(Scripts)                  ...
Tools•   SAFS, open source•   EMOS Framework, open source•   FIT/FitNesse,    FIT/FitNesse open source•   Certify, Worksof...
Examplehttp://localhost:8080/FitBookExamples.Chapter4TestingActions.Fig6TestChatServer
http://fit.c2.com/wiki.cgi?FitBookhttp://my.safaribooksonline.com/0321269349
Comparison                           pCriteria                            Manual Script KWD   Model-BasedCost         Deve...
References• http://en.wikipedia.org/wiki/Keyword-driven_testing• http://www.cs.waikato.ac.nz/~marku/mbt/• http://www.onest...
Upcoming SlideShare
Loading in...5
×

Test Automation and Keyword-driven testing af Brian Nielsen, CISS/AAU

2,241

Published on

Oplægget blev holdt ved et seminar i InfinIT-interessegruppen Softwaretest den 28. september 2010.
Læs mere om interessegruppen på http://www.infinit.dk/dk/interessegrupper/softwaretest/softwaretest.htm

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
2,241
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Test Automation and Keyword-driven testing af Brian Nielsen, CISS/AAU"

  1. 1. Test Automation andKeyword-driven testing Brian Nielsen, bnielsen@cs.aau.dk
  2. 2. Testing as a process g prequirements Planning& Control ologi preparationspecification test plan tekno (abstract) abstract/logical Test test casesspecification generation tionst concrete/ Test executablel implemen- tation test cases ormat Test verdict/logsimplementation executionInfo Completion quality report CISS
  3. 3. Test Automationrequirements Planning& Control ologi preparationspecification test plan tekno (abstract) abstract/logical Test test casesspecification generation tionst concrete/ Test executablel implemen- tation test cases ormat Test verdict/logsimplementation executionInfo Completion quality report CISS
  4. 4. 1 Manual Testing1. + easy & cheap to start + flexible testing - expensive every execution - no auto regression testing i i - ad-hoc coverage - no coverage measurement M. Utting ”Practical Model Based Testing”
  5. 5. 2 Capture Replay Testing 2. Capture-Replay+ flexible testingexpensive first execution+ auto regression testing- fragile tests break easily- ad-hoc coverage- no coverage measurement
  6. 6. 3 Script Based Testing3. Script-Based +/- test impl. = programming + automatic execution + auto regression testing fragile tests break easily? (depends on abstraction) - ad-hoc coverage - no coverage measurement
  7. 7. 4 Keyword Driven Testing 4. Keyword-Driven+ abstract tests+ automatic execution+ auto regression testing- robust tests- ad-hoc coverage ad hoc- no coverage measurement
  8. 8. 5 Model-Based 5. Model Based Testing g+ abstract tests+ automatic execution+ auto regression testing+ auto design of tests+ systematic coverage+ measure coverage of modeland requirements- modelling overhead
  9. 9. Script-based Script based TestingTest inputs and observations (verdictassignment) programmed in scripts in g )p g pdedicated or general-purpose languages. + Repeatable (for regression testing) + Data driven testing: Fixed scripts, each parameterized with different data d e e da a – Mixes test harness and logical test cases – Must be updated when specs (or impl) change – Very lengthy – Good programmers may write well-structured well structured reusable test code but ”it is just test code”
  10. 10. Keyword Driven Testing y g• Script based automation where test case design is d i i separated f t d from automation t ti – Focus on actions user/environment can do on objects in SUT (at different abstraction levels) • ”Actions” appear in scripts, pp p • ”Action-code” implements the action• aka “Action-word” testing (or table driven Action-word (or, testing), < 1994• Black-box, subsystem, accept tests• Automated execution using a “framework”. framework .
  11. 11. Keyword Driven Testing y g+ Concise, flexible, maintainable,+ Read-/writeable by non-programmers÷ Expressiveness of a scripting language – C t l structures and complex computations Control t t d l t ti – (Branching in test cases, complex data, matching of expected results)
  12. 12. Keyword Driven Test yEg. Sequence Object Keyword Value LoginDialog Login ”badUserId”, ”GoodPass” VerifyLogin ”Login failed” Login failed LoginDialog Login ”goodUserId”, ”badPass” VerifyLogin ”Login failed” LoginDialog Login ”goodUserId”, ”GoodPass” VerifyLogin ”welcome” WelcomeDialog W l Di l changeLogin h L i ”newUserName”,”newpwd” ” U N ”” d” confirm ”goodUserId”, ”newpwd” confirmChange ”Change Failed”
  13. 13. KWD ProcessTest Expert Automation Expert http://www.softwaretestinghelp.com/wp-content/qa/uploads/2010/01/keyword-driven-testing.pdf
  14. 14. Automation Fixture Keywod Script Open(Scripts) While(!EOF){ Engine/driver Keyword, data=readFile();Generic Libs Case(keyword){ (fixtures) Login: id t > b it(d t ) L i widget->submit(data); verifyLogin: … Application Libs } (keyword functions) Close() SUT }
  15. 15. Tools• SAFS, open source• EMOS Framework, open source• FIT/FitNesse, FIT/FitNesse open source• Certify, Worksoft• Unified TestPro, SDT• TestFrame, TestFrame LogicaCMG• TestArchitect, LogiGear• Tools with built-in keyword support: – TestQuest Pro Pro, – QuickTest Professional
  16. 16. Examplehttp://localhost:8080/FitBookExamples.Chapter4TestingActions.Fig6TestChatServer
  17. 17. http://fit.c2.com/wiki.cgi?FitBookhttp://my.safaribooksonline.com/0321269349
  18. 18. Comparison pCriteria Manual Script KWD Model-BasedCost Development L M M L Maintenance H? H L Tools/equip q p L M M HTime Time to first test L M M M-H Re-execution H L L L Maintenance L H H LLearn- Skills L H M* H*ability Maturity L M M-H H Readability L L M H* Interest / Ch ll I t t Challenging i L M M HEffective- Bug detection H L L Hness Tracability L L M H Coverage L L M H
  19. 19. References• http://en.wikipedia.org/wiki/Keyword-driven_testing• http://www.cs.waikato.ac.nz/~marku/mbt/• http://www.onestoptesting.com/automation- framework/keyword-driven-testing/• http://www.softwaretestinghelp.com/wp- content/qa/uploads/2010/01/keyword-driven-testing.pdf• http://www.musala.com/press/PR_2008_03_17/pr/Keyw ord-driven%20Testing.pdf ddi %20T ti df• Mark Fewster and Dorothy Graham, Software Test Automation, Automation 1999 (Chapter 22)• M. Utting Practical Model-based testing
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×