Alexander Andelkovic, Spotifyalex@spotify.com                                   STARWEST 2012
IntroductionBackgroundRapid Test AutomationExampleSummaryFully Automated TestingQuestions                          1/21
Lives in Stockholm, Sweden15+ years testing experienceTest lead at SpotifyPassionate about advanced test techniques       ...
Our reality:- Tougher business competition- Rapid releases needed to stay competitive- Shorter release cycles (Year > Mont...
Test automation(TA) done by test developer and manual tester     Activity       Traditional TA       Agile TA          Rap...
Test automation(TA) done by test developer and manual tester     Activity       Traditional TA       Agile TA          Rap...
Test automation(TA) done by test developer and manual tester     Activity       Traditional TA       Agile TA          Rap...
Test automation(TA) done by test developer and manual tester     Activity       Traditional TA       Agile TA          Rap...
Model-Based Testing used for auto generation of test procedures/vectors using models of system requirementsAgile TA       ...
- Simple scripts(Python) developed in Sikuli test framework tobuild test automation- Manual tester writes own test automat...
- Exploratory testing done while modeling and coding- Stress testing can be done immediately or overnight- Manual tester g...
Features of Spotify desktop client rewritten into HTML 5End user shall have same experience of the new rewritten HTML 5fea...
Browse What’sNew view   Main view                9/21
Play Top track                 10/21
Search Track,Artist, Album                11/21
Write Message                11/21
Send track andmessage                 11/21
12/21
InitLoopEnd       13/21
14/21
- Manual tester not dependant on test developer- Test automation can be developed immediately when needed- Valuable test f...
Fully Test Automation   the next TEST frontier?                             16/21
- GUITAR is a model-based system for automated GUI testing- Developed by Atif Memon, associate professor in theDept. of Co...
- Automated event/screen ripping with crawling of anentire application- Overlaying of test cases onto screenshots(node and...
- WebTestingExplorer is an Automated test case generator forweb front-ends- Developed by Scott McMaster former student of ...
E-mail: alex@spotify.comGraphwalker: http://graphwalker.org/yED: http://www.yworks.com/en/products_yed_about.htmlSikuli: h...
21/21
Upcoming SlideShare
Loading in …5
×

Starwest 2012 Making The Most Of Test Automation In An Agile Project

758 views
671 views

Published on

Introduction of Rapid Test Automation, enabling manual tester to do valuable agile test automation.

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
758
On SlideShare
0
From Embeds
0
Number of Embeds
28
Actions
Shares
0
Downloads
9
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Starwest 2012 Making The Most Of Test Automation In An Agile Project

  1. 1. Alexander Andelkovic, Spotifyalex@spotify.com STARWEST 2012
  2. 2. IntroductionBackgroundRapid Test AutomationExampleSummaryFully Automated TestingQuestions 1/21
  3. 3. Lives in Stockholm, Sweden15+ years testing experienceTest lead at SpotifyPassionate about advanced test techniques 2/21
  4. 4. Our reality:- Tougher business competition- Rapid releases needed to stay competitive- Shorter release cycles (Year > Month > Week > Day)Problem:Difficult to keep-up with test automation of newfunctionality as stories accumulates after each sprintSolution:Use Rapid Test Automation for faster test feedback loops 3/21
  5. 5. Test automation(TA) done by test developer and manual tester Activity Traditional TA Agile TA Rapid TA Modeling Test developer Manual tester Manual tester Test developer Test developer Coding Test developer Test developer Manual tester Test developer Testing feedback Month(s) Week(s) Day(s) 4/21
  6. 6. Test automation(TA) done by test developer and manual tester Activity Traditional TA Agile TA Rapid TA Modeling Test developer Manual tester Manual tester Test developer Test developer Coding Test developer Test developer Manual tester Test developer Testing feedback Month(s) Week(s) Day(s) 4/21
  7. 7. Test automation(TA) done by test developer and manual tester Activity Traditional TA Agile TA Rapid TA Modeling Test developer Manual tester Manual tester Test developer Test developer Coding Test developer Test developer Manual tester Test developer Testing feedback Month(s) Week(s) Day(s) 4/21
  8. 8. Test automation(TA) done by test developer and manual tester Activity Traditional TA Agile TA Rapid TA Modeling Test developer Manual tester Manual tester Test developer Test developer Coding Test developer Test developer Manual tester Test developer Testing feedback Month(s) Week(s) Day(s) 4/21
  9. 9. Model-Based Testing used for auto generation of test procedures/vectors using models of system requirementsAgile TA Rapid TAFinite State Machine(FSM) Extended Finite State Machine(EFSM) y-Ed used to create models Graphwalker (Model Based testing tool) used to traverse models 5/21
  10. 10. - Simple scripts(Python) developed in Sikuli test framework tobuild test automation- Manual tester writes own test automation code- No need to make test automation stable only keep usable code 6/21
  11. 11. - Exploratory testing done while modeling and coding- Stress testing can be done immediately or overnight- Manual tester give early/instant feedback to test developer of testcases suited for robust regression testing 7/21
  12. 12. Features of Spotify desktop client rewritten into HTML 5End user shall have same experience of the new rewritten HTML 5features(What’s New, Top List, Profile) in the Spotify desktop client 8/21
  13. 13. Browse What’sNew view Main view 9/21
  14. 14. Play Top track 10/21
  15. 15. Search Track,Artist, Album 11/21
  16. 16. Write Message 11/21
  17. 17. Send track andmessage 11/21
  18. 18. 12/21
  19. 19. InitLoopEnd 13/21
  20. 20. 14/21
  21. 21. - Manual tester not dependant on test developer- Test automation can be developed immediately when needed- Valuable test feedback can be given within hour(s)- Instant regression, performance and stress testing can be done- Developers shows greather interest in testing 15/21
  22. 22. Fully Test Automation the next TEST frontier? 16/21
  23. 23. - GUITAR is a model-based system for automated GUI testing- Developed by Atif Memon, associate professor in theDept. of Computer Science at the University of Maryland- Automated GUI-based test case generation- Automated test case execution- Automated visualization of test case execution Atif Memon 17/21
  24. 24. - Automated event/screen ripping with crawling of anentire application- Overlaying of test cases onto screenshots(node andedge drawing)- Recording of manual test cases through SeleniumIDE and execution with GUITAR Replayer- Support for Web, iPhone, Android, Java apps 18/21
  25. 25. - WebTestingExplorer is an Automated test case generator forweb front-ends- Developed by Scott McMaster former student of Atif Memon- Generates and replay test cases, looking for differences instate- Detects unexpected HTTP status codes and Javascript errorsduring exploration Scott McMaster 19/21
  26. 26. E-mail: alex@spotify.comGraphwalker: http://graphwalker.org/yED: http://www.yworks.com/en/products_yed_about.htmlSikuli: http://sikuli.org/Web Guitar:http://sourceforge.net/apps/mediawiki/guitar/index.php?title=WebGuitarWeb Testing Explorer: 20/21
  27. 27. 21/21

×