The document details a webinar comparing Selenium and UFT for mobile testing strategies, exploring their capabilities, tool assessments, and integration features. It provides case studies highlighting their use in large banking and transportation corporations, showcasing automation benefits and increased efficiency in testing processes. Key differences between the two tools are presented, including programming language support, object identification methods, and execution capabilities.

1. Feb 2015
Tech Mahindra & Experitest Co-webinar:
Selenium vs UFT:
Which is Better for Your Mobile Testing Strategy?

2. Speakers
Guy Arieli
CTO
Experitest
Mahendra Singh
Project Manager (MATE)
Tech Mahindra

3. Demo
Seleinum vs UFT for Mobile -Which
one is right for your testing team?
Case studies
Agenda
What is UFT?
UFT for Mobile
What is Selenium?
Selenium for mobile
1
2
3
4
5
6
7

4. UFT and Selenium - Tool Assessment

5. What is UFT, QTP?
Runs on VB script
A UI based automation tool.
Focus on Web and desktop technologies
UFT is the HP solution (previously called QTP) for Test Automation
..

6. UFT for Mobile
Experitest Mobile Add on for UFT
Mobile Menu – Devices & Applications Managing
Full & complete integration into HP UFT software
Record a test, edit it, run it, and view results (report)
Integration of object repository (mobile object properties)
Object Spy include Native & Web identification methods
Integration into HP’s Quality Center & Performance Center

7. Competitive Landscape- Plug in for UFT
Mobility
Capabilities
Enterprise
readiness
Support all OS.
Support all
Mobile devices
Support all app
types
Integration to all CI
stability
scalability
Remote capabilities
End to End solution
HP
Experitest
Mobile
Add on
for UFT

8. What is Selenium ?
Selenium is an open source test automation framework that
support cross browser test automation
Selenium 2 also known as WebDriver
Selenium supports perl, php, python, objective-c, java,
Microsoft.net, ruby, and more.
It is not a tool with a UI – it uses a programming language to
use it specifically
This project gain extremely high popularity and support due
to HP pricing and luck of support for SMBs

9. Selenium for Mobile
Experitest provide enterprise grade solution based on WebDriver API called
MobilWebDriver
Providers interface to interact with Mobile Application
All function of Seetest Automation Tool can be executed in Java Selenium environment
using MobilWebDriver
Experitest Mobile Plug in for Selenium

10. Competitive Landscape- Plug in for Selenium
Support all OS.
Support all
Mobile devices
Support all app
types
Integration to all CI
stability
scalability
Remote capabilities
End to End solution
Experitest
plug in for
selenium
Mobility
Capabilities
Enterprise
readiness
Selenium

11. UFT Vs Selenium –
Which is better for your testing team

12. UFT vs Selenium – Which is better for Mobile Strategy?
Experitest Mobile Plugin for
Selenium
Mobile Add on for UFT
JAVAVB ScriptSupported language

13. Language Supported
Java
Using IDEs like Eclipse made writing Java
easier then working with any other
scripting language.
Every student that graduate BSC in
computer science knows Java.
Java is Object Oriented, it can be very
important in large automation projects.
Easy to integrate with your
enviourment backend
Microsoft VbScript
Scripting Language.
Lack full features of a programming
language.
Interpreted
Considered to be easier to learn
Vbscript cannot run on MAC.

14. UFT vs Selenium – Which is better for Mobile Strategy?
Experitest Mobile Plugin for
Selenium
Mobile Add on for UFT
JAVAVB ScriptSupported language
√√Object Identification
√√
Descriptive
Programing

15. Object Repository vs. Descriptive programming
UFT uses Object Repository (by default). ***
Selenium uses 'descriptive programming' (by default).
With Experitest Mobile plugin for Selenium you can use object repository or descriptive
programming in your WebDriver project.
Object Repository- cons
Hard to source control.
Hard to merge.
Can reduce the test visibility.
Can cause inconsistency in behavior.
Object Repository- Pros
When identification of an object changed,
the update is done in a single place.
Support internal tools like 'Object Spy'.

16. UFT vs Selenium – Which is better for Mobile Strategy?
Experitest Mobile Plugin for
Selenium
Mobile Add on for UFT
JAVAVB ScriptSupported language
√√Object Identification
√√Descriptive Programing
√√
Test Recording
capabilities
√√Xpath
√√Object Spy

17. Programing skills? Yes / NO
To build a successful automation project you
will need to have programing capabilities
No coding, approach is very limited
and in many cases will fail
Recording capabilities can ease the
tool learning curve
Many testing team has programing
knowledge in Vbscript
Most of the computer science graduates has
good Java knowledge
<!!!>

18. UFT vs Selenium – Which is better for Mobile Strategy?
Experitest Mobile Plugin for SeleniumMobile Add on for UFT
JAVAVB ScriptSupported language
√√Object Identification
√√Descriptive Programing
√√Test Recording capabilities
√√Xpath
√√Object Spy
√xParallel Execution

19. Parallel Execution
UFT can only perform
one test per machine.
Selenium can perform multiple &
simultaneous tests

20. Demo

21. End-to-End Product Suite - Manual, Automation, Monitoring, Load, Network Virtualization, Manager
• Manual testing tool
• Mini-recorder for automating short,
repetitive, manual scenarios
• Report with screenshots of each step
• Manual to Automation Script Convertor
• Device Lab located onsite (in the customer VPN)
• Devices can be reserved and accessed by any remote user
• Used in conjunction with SeeTestAutomation/Manual for testing of remote devices
SeeTestManual
SeeTestCloud
• Automation tool
• Same test runs on different devices
• Plugs into all testing & CI environments:
SeeTestAutomation
SeeTestNetworkVirtualization
• Device performance under varying network conditions
• Simulating mobile network bandwidth latency and reception while on the move
SeeTestLoad
• Real device generated mobile load
• Full integration to LoadRunner, Jmeter, etc.
Mobile Add-On for UFT
• Full & complete integration into HP UFT:
• Record a test, edit it, run it, and view results
• Integration of object repository and more…
SeeTestManager
Free
Tool!
N
L
G
U

22. Case Study
Banking

23. Headquartered in UK
Spans over 50 countries across Europe,
America, Africa & Asia
~150,000 employees
Mobile applications in tens of languages
Ranked in top 10 largest banks worldwide
Revenue of ~$30 Bn.
Customer Profile:
Multinational banking and financial services company
Major global financial services provider engaged in personal
banking, credit cards, corporate and investment banking and
wealth and investment management.
The bank’s personal and business
account management apps
What needed to be tested?

24. Implementation
Years working with the tool: 1
Over 25 SeeTestAutomation stations
Number of Automation engineers working on the project: 25
2 geographical locations around the world (US, Europe, Africa and China)
Number of tests before: 0
Number of tests today: ~2,000
Number of executed tests: ~200,000 (each test can run on more than one device)
Build single test that can run on Chrome / IE / Firefox and Safari for Desktop
And Chrome / Safari / IE for mobile (iOS, Android and WP8.1).

25. Coverage
 Total coverage: ~90%.
 Number of executions of the full cycle: Once a day
 Full app test coverage for all OS-Cross platform testing of
Android
iOS
WindowsPhone8
 Full end-to-end coverage of test scenario
 Support for multiple languages (including English, Spanish, French)

26. What if we did it manually?
A single QA engineer: 56 man years to finish the cycle (lifetime).
For one day we would need 20,000 trained manual QA engineers.
Another Advantage
The R&D engineers can work faster and take more risks
According to the bank R&D managers the development speed is
ROI
3-4 times faster!

27. Case Study
Transportation

28. Customer Profile: Major National Railroad
Passenger Corporation
5
Headquartered in Washington DC, USA
More than 20,000 employees
Revenue: ~3 Bn
US national rail operator operating over 300 trains
and an average of 85,000 passengers a day in USA &
Canada. Last year served more than 30 million
people.

29. The needs
Amtrak mobile website
Amtrak mobile native application
Many user flows such as
Book one-way and round-trip tickets
Search for station information
Check train status, board using eTicket
And more
Save tickets to your phone calendar
Integration with Apple Passbook™
or Samsung Wallet™
Testing User’s Applications Testing Integration with 3rd Parties

30. The Requirements
Test the Android, iOS and WindowsPhone8 mobile application
Have a full testing environment deployed onsite for end-to-end system
testing including the integration with Apple Passbook™ or Samsung Wallet™
Monitoring capabilities (such as memory and CPU usage) of the Android/iOS devices
to ensure large quantities of data do not hamper the app’s functionality

31. SeeTestAutomation Deployment - Description
Within 3 Months of Project Kick-Off
~10 floating licenses SeeTest Automation+
Experitest Mobile Add on for UFT
Over 20 test machines running on iOS ,
Android and WindowsPhone8
Onsite deployment with integration to the
existing UFT/QC test environment
Parallel execution of tests
Onsite mobile lab using SeeTestCloud
80% Automation; 20% manual
On Premise Mobile Device Lab located in USA
Implementation Coverage
Coverage of customer’s app & website
including the integration with Apple
Passbook™ or Samsung Wallet™
Support for multiple languages
(including English, Spanish)

32. Thank you 