EBAY - A LOOK BEHIND THE SCENES

1,194 views

Published on

Guest Lecture about eBay at Fachhochschule Heilbronn, Wirtschaftsinformatik

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,194
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
14
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

EBAY - A LOOK BEHIND THE SCENES

  1. 1. EBAYA LOOK BEHIND THE SCENESMICHAEL PALOTAS – HEAD OF QUALITY ENGINEERING EUROPEJANUARY 8 2013
  2. 2. TOPICS TODAY• Overview about eBay• Our current challenges• How we see the future• How do we build and test software• A little bit of management talk• Q&A FH HEILBRONN /// EBAY INTERNATIONAL 2
  3. 3. WHO AM I?MICHAEL PALOTASHEAD OF QUALITY ENGINEERING EUROPEMPALOTAS@EBAY.COMMICHAEL.PALOTAS@GRIDFUSION.NET+41 79 6690708http://ch.linkedin.com/in/michaelpalotashttp://www.xing.com/profile/Michael_Palotas FH HEILBRONN /// EBAY INTERNATIONAL 3
  4. 4. THE COMPANY FH HEILBRONN /// EBAY INTERNATIONAL 4
  5. 5. EBAY INC. FH HEILBRONN /// EBAY INTERNATIONAL 5
  6. 6. LOCATIONS FH HEILBRONN /// EBAY INTERNATIONAL 6
  7. 7. EBAY FACTS• Founded in 1995 • >10 Petabytes of data in Hadoop and Teradata clusters• Based in San Jose, California • 2 billion page views every day• 28000 employees worldwide • 75 billion database calls every day• >100 million active buyers and sellers worldwide • >100 million downloads of eBay Inc’s mobile apps• Revenue: 11.6B USD • Mobile transaction volume will double in• 68 Billion USD transaction volume in 2011 2012 to 10 billion USD• 2000 USD transaction volume every • 1.7 million items listed via mobile apps second every week FH HEILBRONN /// EBAY INTERNATIONAL 7
  8. 8. EBAY FUN FACTS• Every 30 seconds, a woman’s handbag is purchased on eBay Mobile.• Every 2 minutes, a tablet is bought through eBay Mobile• Every week, more than 8,000 cars and 340,000 car parts are sold through eBay’s mobile apps.• 7,493 tablets sold weekly from April – June; enough to cover the surface of 3 Olympic-sized pools. FH HEILBRONN /// EBAY INTERNATIONAL 8
  9. 9. EBAY MARKETPLACES ORGANIZATION• Offices around the globe• 1000+ developers• 300+ test engineers• Main development center in San Jose• European Headquarter in Zürich• Waterfall … Agile… and everything in between FH HEILBRONN /// EBAY INTERNATIONAL 9
  10. 10. OUR CHALLENGES & OPPORTUNITIES• Scaling• Mobile• Cross Border Trade• Ever faster release cycles• Trust FH HEILBRONN /// EBAY INTERNATIONAL 10
  11. 11. WHAT’S IN THE FUTUREhttp://www.wahrsagen-online24.de/ FH HEILBRONN /// EBAY INTERNATIONAL 11
  12. 12. HOW WE WORK FH HEILBRONN /// EBAY INTERNATIONAL 12
  13. 13. LOCALIZATION FH HEILBRONN /// EBAY INTERNATIONAL 13
  14. 14. SETUP Mobile Global Portland Global Product USA Product San Jose Chennai USA India EU Quality Engineering (Zürich, London, Local Global Berlin, Paris) Product Product Shanghai Zürich, China London Adjacencies (i.e. Brands for Friends) FH HEILBRONN /// EBAY INTERNATIONAL 14
  15. 15. NOT ONLY THE WEB Windows Desktop Mobile FH HEILBRONN /// EBAY INTERNATIONAL 15
  16. 16. TESTING – OWNERSHIP OF QUALITY Manual Test CORE TESTING Consulting + MOBILE Coaching Automation INNOVATION FH HEILBRONN /// EBAY INTERNATIONAL 16
  17. 17. TEST AUTOMATION – WHY?• NOT to replace people• To save time and to reinvest that time into manual testing• To get early and instant feedback• Regression testing only• Safety net FH HEILBRONN /// EBAY INTERNATIONAL 17
  18. 18. AUTOMATION IS GOOD…BUT Manual•  Tools help, but tools don’t test•  Manual testing is equally important•  Manual (exploratory) and automated testing complement each other•  Most bugs are found during manual testing / while automating Automation FH HEILBRONN /// EBAY INTERNATIONAL 18
  19. 19. WHAT DO WE DO WITH SELENIUM? End to End functional test automation Manual Tests Selenium space E2E Test s Integration Tests Unit Tests FH HEILBRONN /// EBAY INTERNATIONAL 19
  20. 20. HIGH LEVEL INFRASTRUCTURE ESX vCenter Server Selenium ESX Web GRID HUB Frontend ESX ESX TestNG ESX API Test Type ESX DB FH HEILBRONN /// EBAY INTERNATIONAL 20
  21. 21. SELENIUM GRIDSequential Execution Parallel Execution Test Test Test Test Parallel ExecutionParallel Execution Test Test Test Test Test Test Test Test Test Test Test Test Test 1 2 3 … 4500 Execution Time Execution TimeExecution time: Execution time:7000 minutes (~116 hours = ~5 days) 60 minutes by using 150 Virtual Machines /-  4500 end-to-end regression test cases-  2-3 minutes execution time for each test Browsers using the Selenium GRID FH HEILBRONN /// EBAY INTERNATIONAL 21
  22. 22. BUG QUALITYBug Quality = accepted bugs / submitted bugs 100 Bug Quality in % (2008-2010) 95 90 Start of automation efforts 85 Bug Quality 2008-2010 80 75 Q1 08 Q2 08 Q3 08 Q4 08 Q1 09 Q2 09 Q3 09 Q4 09 Q1 10 Q2 10 Q3 10 Q4 10 FH HEILBRONN /// EBAY INTERNATIONAL 22
  23. 23. MOBILE
  24. 24. EBAY’S MOBILE PRODUCTS Mobile Web Android Native App iOS Native App FH HEILBRONN /// EBAY INTERNATIONAL 24
  25. 25. FIRST CHALLENGE: LOCALIZATION (L10N) FH HEILBRONN /// EBAY INTERNATIONAL 25
  26. 26. SECOND CHALLENGE: DEVICE DIVERSITY FH HEILBRONN /// EBAY INTERNATIONAL 26
  27. 27. DEVICES VS. EMULATORS FH HEILBRONN /// EBAY INTERNATIONAL 27
  28. 28. MANUAL MOBILE TESTING• Feature testing is manual• Concentrate on top 5 devices• Layout, User Experience, Localization (i.e. does the text fit on the button)• In depth EU specific domain knowledge FH HEILBRONN /// EBAY INTERNATIONAL 28
  29. 29. MOBILE TEST AUTOMATION REQUIREMENTS• Use load balancer features of Selenium GRID for parallel execution• Manage multiple applications / versions / languages• Native app should not need to be modified• Native app runtime inspection support FH HEILBRONN /// EBAY INTERNATIONAL 29
  30. 30. THE IMPORTANCE OF PARALLEL TEST EXECUTION•  Multiple Apps•  12 European Sites•  iOS Devices •  iPhone vs. iPad •  Version•  Android Devices •  Manufacturers •  Screen Sizes •  OS Modifications FH HEILBRONN /// EBAY INTERNATIONAL 30
  31. 31. CHECK IT OUT ON GITHUB• https://github.com/freynaud/ios-driver• http://calabash-driver.github.com FH HEILBRONN /// EBAY INTERNATIONAL 31
  32. 32. A LITTLEMANAGEMENT TALK
  33. 33. THE PERFECT EMPLOYEE Sackmesser.ch FH HEILBRONN /// EBAY INTERNATIONAL 33
  34. 34. WHO ARE WE LOOKING FOR? Sackmesser.ch FH HEILBRONN /// EBAY INTERNATIONAL 34
  35. 35. INNOVATION BY PRESCRIPTION FH HEILBRONN /// EBAY INTERNATIONAL 35
  36. 36. OFFSHORINGhttp://www.guardian.co.uk/business/2011/jan/06/viewpoint-bp FH HEILBRONN /// EBAY INTERNATIONAL 36
  37. 37. INNOVATE…AND TALK ABOUT IT Sydney, Australia, October 5th 2011 Selenium GRID has 1.5K downloads / day FH HEILBRONN /// EBAY INTERNATIONAL 37
  38. 38. THE LONG LEASH FH HEILBRONN /// EBAY INTERNATIONAL 38
  39. 39. HYGIENE FACTORShttp://betterafter50.com/wp/wp-content/uploads/2011/10/google-adsense-more-money-tips.jpg FH HEILBRONN /// EBAY INTERNATIONAL 39
  40. 40. THANK YOU!COMMENTS?
  41. 41. WE ARE HIRING!http://ebaycareers.com/Or contact me: mpalotas@ebay.com

×