Mobile Test Automation at eBay

Mobile Testing and MobileAutomation at eBayMichael Palotas & Dominik DaryQuality Engineering EuropeeBay International AGSeptember 2012

eBay Inc. Facts Founded in 1995 Based in San Jose, California 27770 Employees worldwide

Mobile FactsMobile Facts: Mobile Fun Facts: 100,000,000 downloads Every 30 seconds, a woman’s handbag is purchased on eBay of eBay Inc’s apps Mobile. Every 2 minutes, a tablet is Mobile transaction volume bought through eBay Mobile. will double in 2012 to 10 billion USD Every week, more than 8,000 cars and 340,000 car parts are 1,7 million items sold through eBay’s mobile apps. are listed with using mobile 7,493 tablets sold weekly from apps every week April – June; enough to cover the surface of 3 Olympic-sized pools.

Who we are Michael Palotas Head of Quality Engineering Europe E-mail: mpalotas@ebay.com Dominik Dary Staff Software Engineer in Test E-mail: ddary@ebay.com

Agenda1. Challenges in Mobile Testing2. Manual Mobile Testing3. Our Requirements for Mobile Test Automation4. Test Automation of the Mobile Web, Android Apps & iOS Apps5. Conclusion

First Challenge: Localization

Second Challenge: Device Diversity

Devices vs. Emulators

Manual Mobile Testing Feature testing is manual Concentrate on top 5 devices Functionality, Layout, User Experience and Localization In depth EU specific domain knowledge

The importance of parallel Test Execution • Multiple Apps • 12 European Sites • iOS Devices • iPhone vs. iPad • Version • Android Devices • Manufactures • Screen Sizes • OS ModificationsPicture Source: http://www.flickr.com/photos/ippei-janine/483345027/

Technical High Level Overview of the Web Tests

Mobile Test Automation Requirements• Use the Load Balancer Features of the Selenium Grid2 to execute the End-to-End Tests in parallel• Manage multiple applications / versions / languages• The Mobile App should not need to be modified (e.g. like adding a test server)• Mobile App Runtime Inspection Support

Testing of eBay‘s Mobile ProductsAndroid Mobile Web Android Native App iOS Native App

Test Automation of the Mobile Web We use Selenium and specifically the AndroidDriver and the iPhoneDriver Test Cases are written in Java and are similar to web tests Tests are only executed on Emulators http://code.google.com/p/selenium/wiki/IPhoneDriver http://code.google.com/p/selenium/wiki/AndroidDriver

Android Mobile Web Test Infrastructure TestNG Test Selenium Grid http http Jetty Server Hub Android Driver WebView Android Server QE Machine Backend Device

Page Tests Flow ObjectsObjects Mobile Web Test Case

Test Automation of the Android Apps We have created the Open Source project Calabash-Driver Calabash-Driver integrates Calabash-Android into the Selenium Grid Calabash-Driver offers a convenient Webdriver like Java API for writing tests http://calabash-driver.github.com

Test Automation of Android Apps Selenium Grid TestNG Hub Test http http Instrumentation http Backend Calabash Calabash Android Jetty Server Driver Connecto r eBay App ADB Connec- USB tion QE Machine Device Calabash Server Backend

Dialog Tests Flow ObjectsObjects Android App Test Case

Test Automation of the iOS Apps We have created the Open Source project iOS-Driver iOS-Driver integrates Apple’s official tool UI Automation into the Selenium Grid iOS-Driver offers a convenient Webdriver like Java API for writing tests https://github.com/freynaud/ios-driver

Test Automation of iOS Apps Selenium Grid TestNG Hub Test http http Instru- iOS eBay App Jetty Server ments Driver Manager Apple‘s UI Automa- tion QE Machine iOS Simulator iOS-Server Backend

Dialog Flow TestsObjects Objects iOS App Test Case

Advantages of Calabash-Driver & iOS-Driver Solutions are integrated into the Selenium Grid which enables us to scale The concept of automated testing the Web, Win32, mobile Web and native apps is the same Fast Rampup for the testers and quick return on investment Both Solutions are supporting the interaction with elements based on the L10n resource bundle key

Fork us at Github http://calabash-driver.github.com https://github.com/freynaud/ios-driver

Conclusion No single automation solution for mobile Web, Android and iOS apps – and that’s ok! Invest into Scalability by Virtualization Buy the top devices Open source is your best friend!Interested in our solutions? Contribute to our projects!

Thank You!Questions or Comments?

http://seleniumhq.wordpress.com	9862
http://feeds.feedburner.com	298
http://test-failed.blogspot.com	226
http://dary.de	73
http://www.dary.de	51
http://test-failed.blogspot.ru	38
http://localhost	28
http://www.newsblur.com	22
http://eventifier.co	16
https://twitter.com	8
http://translate.googleusercontent.com	5
http://test-failed.blogspot.de	4
http://nguyentantrieu.info	3
https://www.rebelmouse.com	2
http://tweetedtimes.com	2
http://twitter.com	1
http://xianguo.com	1
http://127.0.0.1	1
http://test-failed.blogspot.com.au	1
http://www.ustart.org	1

Mobile Test Automation at eBay

by Dominik Dary on Sep 25, 2012

Accessibility

Categories

Upload Details

Usage Rights

20 Embeds 10,643

Statistics

Mobile Test Automation at eBay Presentation Transcript