Applied Testing Heuristics in the Context of eBay

2,382 views
2,336 views

Published on

This presentation demonstrates eBay’s exciting new world of test engineering. We will tell you all our secrets.

0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,382
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide
  • Manhörtgerne mal Tester sichdarüberzubeklagen, dass die Requirements nicht gut sindUnsist das egalWirnehmen, was vorhandenist und Informationen, welchewirbenötigen, bekommenwirdadurch, dasswirmiteinanderreden
  • Applied Testing Heuristics in the Context of eBay

    1. 1. Applied Testing Heuristicsin the Context of eBayDominik Dary & Ilari Henrik AegertereBay International AGMarch 13, 2013
    2. 2. WHO ARE WE? WHAT DO WE DO? Dominik Dary Staff Software Engineer in Test Mobile Test Automation Enthusiast E-mail: ddary@ebay.com Twitter: @dominikdary Ilari Henrik Aegerter Manager Quality Engineering Europe Testing of all EU relevant features on 12 eBay sites E-mail: iaegerter@ebay.com Twitter: @ilarihenrik Applied Testing Heuristics in the Context of eBay 2
    3. 3. CONTENT•Intro•Misconceptions•Test Process•Using Tours•Regression Testing/Using Tools•Continuous Improvement Applied Testing Heuristics in the Context of eBay 3
    4. 4. INTRO
    5. 5. MOBILE FACTSMobile Facts Mobile Fun Facts100,000,000 downloads Every 30 seconds, a woman’s handbag isof eBay Inc’s apps purchased on eBay Mobile.Mobile transaction volume Every 2 minutes, a tablet is bought throughhas grown in 2012 to 13 billion USD eBay Mobile.3,3 million items Every week, more than 10,000 cars andare listed with using mobile apps every week 500,000 car parts are sold through eBay’s mobile apps. Source: http://www.ebayinc.com/assets/pdf/fact_sheet/eBay_Mobile_Collateral_Fact_Sheet_2_08_13.pdf Applied Testing Heuristics in the Context of eBay 5
    6. 6. EBAY INC. FACTSFounded in 1995Based in San Jose, California~28’000 Employees worldwide Applied Testing Heuristics in the Context of eBay 6
    7. 7. WHAT DOES THIS TITLE MEAN?Applied – What/Why?Testing – Well, yes?Heuristics – Huh? What?Context – Ahem? More please?eBay – What’s special? Applied Testing Heuristics in the Context of eBay 7
    8. 8. WHAT DOES THISTITLE MEAN?‘Applied’ Image credit: http://www.flickr.com/photos/americanartmuseum/3463141656/sizes/o/in/photostream/ Applied Testing Heuristics in the Context of eBay 8
    9. 9. WHAT DOES THISTITLE MEAN?‘Testing’ Image credit: http://www.flickr.com/photos/kevlar/4198943649/sizes/o/in/photostream/ Applied Testing Heuristics in the Context of eBay 9
    10. 10. WHAT DOES THISTITLE MEAN?‘Heuristics’ Applied Testing Heuristics in the Context of eBay 10
    11. 11. WHAT DOES THIS TITLE MEAN?‘Context’ Image credit: http://www.flickr.com/photos/timdrivas/6973202868/sizes/h/in/photostream/ Applied Testing Heuristics in the Context of eBay 11
    12. 12. WHAT DOES THIS TITLE MEAN?‘eBay’ Applied Testing Heuristics in the Context of eBay 12
    13. 13. MISCONCEPTIONS
    14. 14. MISCONCEPTIONSAutomation vs.Manual Applied Testing Heuristics in the Context of eBay 14
    15. 15. MISCONCEPTIONSYou need aheavy paper trail Image credit: http://www.flickr.com/photos/fredr/262344284/sizes/l/in/photostream/ Applied Testing Heuristics in the Context of eBay 15
    16. 16. TEST STRATEGY
    17. 17. TEST STRATEGYPrimary Information Objective:Shall we ship? Image credit: http://www.flickr.com/photos/liwnik/4141632990/sizes/z/in/photostream/ Applied Testing Heuristics in the Context of eBay 17
    18. 18. TEST STRATEGYDistribution Manual/AutomatedImage credit: http://www.flickr.com/photos/61091655@N00/6831352744/sizes/l/in/photostream/ Image credit: http://www.flickr.com/photos/r80o/39304743/sizes/l/in/photostream/ Applied Testing Heuristics in the Context of eBay 18
    19. 19. TEST STRATEGYManual Image credit: http://www.flickr.com/photos/61091655@N00/6831352744/sizes/l/in/photostream/ Applied Testing Heuristics in the Context of eBay 19
    20. 20. TEST STRATEGYAutomated Image credit: http://www.flickr.com/photos/r80o/39304743/sizes/l/in/photostream/ Applied Testing Heuristics in the Context of eBay 20
    21. 21. PLANNING
    22. 22. PLANNINGDev:San Jose, USA Applied Testing Heuristics in the Context of eBay 22
    23. 23. PLANNINGTesting:San Jose &Zurich, Berlin,Paris, London Applied Testing Heuristics in the Context of eBay 23
    24. 24. PLANNING1. Request2. Self-organize Image credit: http://www.flickr.com/photos/davidaola/317048270/sizes/z/in/photostream/ Applied Testing Heuristics in the Context of eBay 24
    25. 25. PLANNINGNo written test plans Applied Testing Heuristics in the Context of eBay 25
    26. 26. ANALYSIS/MODELING/TEST DESIGN
    27. 27. ANALYSIS/MODELING/TEST DESIGNTest Oracle:Whatever isavailable Image credit: http://www.flickr.com/photos/amodiovalerioverde/270355045/sizes/z/in/photostream/ Applied Testing Heuristics in the Context of eBay 27
    28. 28. ANALYSIS/MODELING/TEST DESIGNNo test cases Applied Testing Heuristics in the Context of eBay 28
    29. 29. REPORTING
    30. 30. REPORTINGBug Reports Applied Testing Heuristics in the Context of eBay 30
    31. 31. REPORTINGTest Reports-General Summary-Perceived risks-Found issues-What did we do Applied Testing Heuristics in the Context of eBay 31
    32. 32. USING TOURS
    33. 33. FCC CUTS VIDSTHE MNEMONIC STANDS FOR THE FOLLOWING:•Feature tour •Variability tour•Complexity tour •Interopeability tour•Claims tour •Data tour •Structure tour•Configuration tour•User tour•Testability tour•Scenario tour Applied Testing Heuristics in the Context of eBay 33
    34. 34. REGRESSIONTESTING
    35. 35. TEST AUTOMATION•To get early and instant Feedback•We automate the regression tests•It is our safety net to save time & this is reinvested into manual testing Applied Testing Heuristics in the Context of eBay 35
    36. 36. PAGES AND BUSINESS CRITICAL FLOWS e-Commerce shopping site like eBay Select View Order Review Payment Category Summary Provider Search View View Update Item Category Orderlist View Delete Product View Item Shopping Cart Page Page Checkout Page Success Page Applied Testing Heuristics in the Context of eBay 36
    37. 37. ANDROID APP TEST CASE Tests Flow ObjectsObjects Page Applied Testing Heuristics in the Context of eBay 37
    38. 38. THE IMPORTANCE OF PARALLEL TEST EXECUTION •Multiple Products •12 European Sites •Different Technologies –The Web –Windows –Mobile Web –Mobile Apps •Android •iOSPicture Source: http://www.flickr.com/photos/ippei-janine/483345027/ Mobile Testing and Mobile Automation at eBay 38
    39. 39. TECHNICAL HIGH LEVEL OVERVIEW OFTHE TEST INFRASTRUCTURE Selenium Webdriver / Grid Automated Test Development via IDE QEEngineer Version Control System eBay web Tests can be front end started on Grid Clone Source Files End-to-End Grid Hub Tests + Start the Test Suite Build via via Brower Maven Test type? API Call eBay API Run test Agile via TestNG Team View the Test Session and the Continuous Integration Result in the System (Jenkins) Browser DB validation Database Our virtualized test infrastructure hosted on VMware vSphere Testing Environment Applied Testing Heuristics in the Context of eBay 39
    40. 40. USING TOOLS
    41. 41. TOOLS FOR TESTING SUPPORT Image credit: http://www.wenger.ch/stuff/contentmgr/files/0/0faeaa3c3c7c9e33468cf11a78cfb51e/image/evo_s54_sku_rev1.png Applied Testing Heuristics in the Context of eBay 41
    42. 42. CONTINUOUSIMPROVEMENT
    43. 43. CONTINUOUS LEARNING BY PRESCRIPTION? PRESENTATION TITLE GOES HERE 43
    44. 44. Thank You!Questions or Comments?Dominik Dary Ilari Henrik AegerterE-mail: ddary@ebay.com E-mail: iaegerter@ebay.comTwitter: @dominikdary Twitter: @ilarihenrik Mobile Testing and Mobile Automation at eBay 44

    ×