Mobile WebDriver
Selendroid

Dominik Dary
Productivity & Test Engineering Europe
2013-11-21 Software Test Usergroup Hamburg
AGENDA
1. Facts about eBay
2. Selenium
3. Mobile Automation Requirements
4. Selendroid
5. Borderless Test Automation

Mobile WebDriver Selendroid

2
FACTS ABOUT EBAY
EBAY INC. FACTS
•Founded in 1995

•Based in San Jose, California
•27770 Employees worldwide

Mobile WebDriver Selendroid

4
MOBILE FACTS

Mobile Facts

Mobile Fun Facts

162,000,000 downloads
of eBay Inc’s apps

Every 15 seconds, a pair of ladies shoes is purchased on
eBay Mobile in the UK.

Mobile transaction volume
2012: 13 billion USD – overall increase of 120 % from 2011!
2013: expectation is to transact 20 billion USD

4.2 million items
are listed with using mobile apps every week

500 USD
mobile transaction volume every second

Every week, more than 11,000 cars and 690,000 car parts
are sold through eBay’s mobile apps.

Source: http://www.ebayinc.com/system/download_links/eBay_MobileMomentum_Facts_052913_0.pdf?download=1

Mobile WebDriver Selendroid

5
WHO AM I?

Dominik Dary
Software Engineer
E-mail: ddary@ebay.com
Twitter: @dominikdary
Github: http://github.com/dominikdary

Mobile WebDriver Selendroid

6
DISCLAIMER
–Test Automation is Software Development
–End-to-End Tests are slow

–Perfect vs. Good Enough – A Context where
Time to Market Matters

Mobile WebDriver Selendroid

7
SELENIUM
WHAT IS SELENIUM?

Selenium automates browsers
that’s it

Mobile WebDriver Selendroid

9
WHAT DO WE DO WITH SELENIUM?

End to End functional test automation

Manual
Tests

Selenium space

E2
E
Test
s
Integration Tests

Unit Tests

Mobile WebDriver Selendroid

10
SELENIUM
JSON WIRE
PROTOCOL
Client
Server
Ruby
Python

Java
C#

i.e. Firefox driver

Mobile WebDriver Selendroid

11
CLIENT
•Is seen as „Selenium“ by the users
•Is called by the test framework or the CI server

•Generates HTTP requests which are received by the
server

•Supported languages:
Java, C#, Python, Ruby, PHP, JS

Mobile WebDriver Selendroid

12
SERVER
•Receives HTTP requests
•Start and teardown of browser

•Translates requests into browser specific commands
•Communicates back to the client

Mobile WebDriver Selendroid

13
SCALING USING SELENIUM GRID

Client

Client

CI

server

GRID Hub

server

server

Mobile WebDriver Selendroid

14
TECHNICAL HIGH LEVEL OVERVIEW OF
THE TEST INFRASTRUCTURE
Selenium Webdriver / Grid

Automated Test
Development
via IDE

QE
Engineer

Tests can be
started on Grid

eBay web
front end

Version Control System

Clone
Source Files
End-to-End
Tests

Start the Test Suite
via Brower

View the Test
Session and the
Result in the
Browser

+

Build via
Maven
Test type?

Agile
Team

Grid Hub

API Call

eBay API

Run test
via TestNG

Continuous Integration
System (Jenkins)
DB validation

Our virtualized test infrastructure hosted on VMware vSphere

Database

Testing Environment

Mobile WebDriver Selendroid

15
MOBILE AUTOMATION REQUIREMENTS
•Use the same approach and infrastructure as web
•Use the Load Balancer / Resource Management

Features of Selenium Grid
•Manage multiple applications / versions / languages
•No modification of mobile app
•Mobile App Runtime Inspection Support
Mobile WebDriver Selendroid

16
ANOTHER AUTOMATION TOOL?

Android

iOS

• Calabashandroid
• Robotium
• Appium
• UiAutomator
• Espresso

• Calabash-ios
• Frank
• UIAutomation
• Appium
• KeepItFunctional

Selendroid & ios-driver

Mobile WebDriver Selendroid

17
MOBILE WEBDRIVER
SELENDROID
SELENDROID
Open sourced on github:
– https://github.com/selendroid
Documentation:
• https://selendroid.io
Committers:
– eBay, Salesforce and Facebook
Getting help
– IRC : #selendroid on freenode

Mobile WebDriver Selendroid

19
SELENDROID FEATURES

•The only mobile WebDriver that supports native &
hybrid apps on Android versions (API 10 to 19)
•The app under test must not be modified
•Interacts simultaneously with multiple Android devices
•Supports hot plugging of hardware devices
•Selenium Grid Support for scaling
•Advanced Gestures are supported
•Build in Inspector to simplify test case development
•Full compatibility to the JSON Wire Protocol.
Mobile WebDriver Selendroid

20
CLIENT / SERVER ARCHITECTURE

MOBILE
BROWSER
CLIENT

JSON Wire Protocol

SERVER

selendroid
ios-driver
Mobile WebDriver Selendroid

21
TESTING NATIVE APPS
• Elements are found by locators
• Found element are used for different
interactions
• Example

Mobile WebDriver Selendroid

22
NATIVE DEMO
http://youtu.be/074BnGV0mS0

Mobile WebDriver Selendroid

23
TESTING HYBRID APPS
• Build in support for testing WebViews
with WebDriver
• Example:

Mobile WebDriver Selendroid

24
HYBRID DEMO
http://youtu.be/FGsKI6esKpw

Mobile WebDriver Selendroid

25
SELENDROID ARCHITECTURE

WebDriver
Client

HTTP

HTTP & WebDriver
JSON wire protocol

Selendroid
Standalone
Driver

Selendroid-standalone

Android SDK

USB

Mobile WebDriver Selendroid

26
SELENDROID ARCHITECTURE

Mobile WebDriver Selendroid

27
TEST: DEVICE VS. EMULATOR

•Hardware devices and Emulators can be used
•Hardware devices are much faster
•Android devices will be identified automatically
•Hot plugging of hardware devices is supported

Mobile WebDriver Selendroid

28
SELENDROID INSPECTOR
•View hierarchy
•View UI element properties
•UI screenshot with view locator
•Record the click actions
•Display the html of a web view
•XPath helper

Mobile WebDriver Selendroid

29
SELENDROID INSPECTOR IN ACTION

http://youtu.be/JKZeF3eHljo
Mobile WebDriver Selendroid

30
BORDERLESS TEST
AUTOMATION
BORDERLESS TEST AUTOMATION
•Our business is borderless  test automation needs
to be as well

•Use the same approach and infrastructure for web
and mobile

Mobile WebDriver Selendroid

32
SAME API FOR WEB AND MOBILE
A regular Web Test Case

An iPhone app test

An Android app test

Mobile WebDriver Selendroid

33
CROSS PLATFORM DEMO
Uses in one test scenario an iOS app, web page and an Android app.

Mobile WebDriver Selendroid

34
WE ARE LOOKING
FOR
CONTRIBUTORS

Mobile WebDriver Selendroid

35
Thank You!
Questions or Comments?

Dominik Dary

Fork us at Github:

Email: ddary@ebay.com
Twitter: @dominikdary

- http://selendroid.io
- http://github.com/ios-driver

Mobile WebDriver Selendroid

Mobile WebDriver Selendroid

  • 1.
    Mobile WebDriver Selendroid Dominik Dary Productivity& Test Engineering Europe 2013-11-21 Software Test Usergroup Hamburg
  • 2.
    AGENDA 1. Facts abouteBay 2. Selenium 3. Mobile Automation Requirements 4. Selendroid 5. Borderless Test Automation Mobile WebDriver Selendroid 2
  • 3.
  • 4.
    EBAY INC. FACTS •Foundedin 1995 •Based in San Jose, California •27770 Employees worldwide Mobile WebDriver Selendroid 4
  • 5.
    MOBILE FACTS Mobile Facts MobileFun Facts 162,000,000 downloads of eBay Inc’s apps Every 15 seconds, a pair of ladies shoes is purchased on eBay Mobile in the UK. Mobile transaction volume 2012: 13 billion USD – overall increase of 120 % from 2011! 2013: expectation is to transact 20 billion USD 4.2 million items are listed with using mobile apps every week 500 USD mobile transaction volume every second Every week, more than 11,000 cars and 690,000 car parts are sold through eBay’s mobile apps. Source: http://www.ebayinc.com/system/download_links/eBay_MobileMomentum_Facts_052913_0.pdf?download=1 Mobile WebDriver Selendroid 5
  • 6.
    WHO AM I? DominikDary Software Engineer E-mail: ddary@ebay.com Twitter: @dominikdary Github: http://github.com/dominikdary Mobile WebDriver Selendroid 6
  • 7.
    DISCLAIMER –Test Automation isSoftware Development –End-to-End Tests are slow –Perfect vs. Good Enough – A Context where Time to Market Matters Mobile WebDriver Selendroid 7
  • 8.
  • 9.
    WHAT IS SELENIUM? Seleniumautomates browsers that’s it Mobile WebDriver Selendroid 9
  • 10.
    WHAT DO WEDO WITH SELENIUM? End to End functional test automation Manual Tests Selenium space E2 E Test s Integration Tests Unit Tests Mobile WebDriver Selendroid 10
  • 11.
  • 12.
    CLIENT •Is seen as„Selenium“ by the users •Is called by the test framework or the CI server •Generates HTTP requests which are received by the server •Supported languages: Java, C#, Python, Ruby, PHP, JS Mobile WebDriver Selendroid 12
  • 13.
    SERVER •Receives HTTP requests •Startand teardown of browser •Translates requests into browser specific commands •Communicates back to the client Mobile WebDriver Selendroid 13
  • 14.
    SCALING USING SELENIUMGRID Client Client CI server GRID Hub server server Mobile WebDriver Selendroid 14
  • 15.
    TECHNICAL HIGH LEVELOVERVIEW OF THE TEST INFRASTRUCTURE Selenium Webdriver / Grid Automated Test Development via IDE QE Engineer Tests can be started on Grid eBay web front end Version Control System Clone Source Files End-to-End Tests Start the Test Suite via Brower View the Test Session and the Result in the Browser + Build via Maven Test type? Agile Team Grid Hub API Call eBay API Run test via TestNG Continuous Integration System (Jenkins) DB validation Our virtualized test infrastructure hosted on VMware vSphere Database Testing Environment Mobile WebDriver Selendroid 15
  • 16.
    MOBILE AUTOMATION REQUIREMENTS •Usethe same approach and infrastructure as web •Use the Load Balancer / Resource Management Features of Selenium Grid •Manage multiple applications / versions / languages •No modification of mobile app •Mobile App Runtime Inspection Support Mobile WebDriver Selendroid 16
  • 17.
    ANOTHER AUTOMATION TOOL? Android iOS •Calabashandroid • Robotium • Appium • UiAutomator • Espresso • Calabash-ios • Frank • UIAutomation • Appium • KeepItFunctional Selendroid & ios-driver Mobile WebDriver Selendroid 17
  • 18.
  • 19.
    SELENDROID Open sourced ongithub: – https://github.com/selendroid Documentation: • https://selendroid.io Committers: – eBay, Salesforce and Facebook Getting help – IRC : #selendroid on freenode Mobile WebDriver Selendroid 19
  • 20.
    SELENDROID FEATURES •The onlymobile WebDriver that supports native & hybrid apps on Android versions (API 10 to 19) •The app under test must not be modified •Interacts simultaneously with multiple Android devices •Supports hot plugging of hardware devices •Selenium Grid Support for scaling •Advanced Gestures are supported •Build in Inspector to simplify test case development •Full compatibility to the JSON Wire Protocol. Mobile WebDriver Selendroid 20
  • 21.
    CLIENT / SERVERARCHITECTURE MOBILE BROWSER CLIENT JSON Wire Protocol SERVER selendroid ios-driver Mobile WebDriver Selendroid 21
  • 22.
    TESTING NATIVE APPS •Elements are found by locators • Found element are used for different interactions • Example Mobile WebDriver Selendroid 22
  • 23.
  • 24.
    TESTING HYBRID APPS •Build in support for testing WebViews with WebDriver • Example: Mobile WebDriver Selendroid 24
  • 25.
  • 26.
    SELENDROID ARCHITECTURE WebDriver Client HTTP HTTP &WebDriver JSON wire protocol Selendroid Standalone Driver Selendroid-standalone Android SDK USB Mobile WebDriver Selendroid 26
  • 27.
  • 28.
    TEST: DEVICE VS.EMULATOR •Hardware devices and Emulators can be used •Hardware devices are much faster •Android devices will be identified automatically •Hot plugging of hardware devices is supported Mobile WebDriver Selendroid 28
  • 29.
    SELENDROID INSPECTOR •View hierarchy •ViewUI element properties •UI screenshot with view locator •Record the click actions •Display the html of a web view •XPath helper Mobile WebDriver Selendroid 29
  • 30.
    SELENDROID INSPECTOR INACTION http://youtu.be/JKZeF3eHljo Mobile WebDriver Selendroid 30
  • 31.
  • 32.
    BORDERLESS TEST AUTOMATION •Ourbusiness is borderless  test automation needs to be as well •Use the same approach and infrastructure for web and mobile Mobile WebDriver Selendroid 32
  • 33.
    SAME API FORWEB AND MOBILE A regular Web Test Case An iPhone app test An Android app test Mobile WebDriver Selendroid 33
  • 34.
    CROSS PLATFORM DEMO Usesin one test scenario an iOS app, web page and an Android app. Mobile WebDriver Selendroid 34
  • 35.
  • 36.
    Thank You! Questions orComments? Dominik Dary Fork us at Github: Email: ddary@ebay.com Twitter: @dominikdary - http://selendroid.io - http://github.com/ios-driver Mobile WebDriver Selendroid

Editor's Notes

  • #6 HiereinpaarFaktenzu eBay