SeeTestAutomation (Experitest) vs. PerfectoMobile Express - Competitive analysis
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

SeeTestAutomation (Experitest) vs. PerfectoMobile Express - Competitive analysis

on

  • 971 views

Competitive analysis - SeeTestAutomation (Experitest) vs. PerfectoMobile Express. ...

Competitive analysis - SeeTestAutomation (Experitest) vs. PerfectoMobile Express.
In the Mobile Automation Testing field, some of the main capabilities are the Native/Web identification methods including Xpath, ability to run parallel testing, Security and the ability to gain clear ROI in your mobile application testing project.

Statistics

Views

Total Views
971
Views on SlideShare
971
Embed Views
0

Actions

Likes
0
Downloads
48
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

SeeTestAutomation (Experitest) vs. PerfectoMobile Express - Competitive analysis Presentation Transcript

  • 1. Competitive Analysis SeeTest vs. Perfecto MobileCloud Express
  • 2. 2 Executive Summary MobileCloud ExpressSeeTestAutomation 1. Maturity of Native and Web Identification Perfecto has partial native identification – only 1 of 30 native properties is supported 2. Test Creation Method & Coverage Perfecto requires manual tests creation (no real recorder) – more time & training, covers less functions 3. Hardware/Software Only (affects complexity of installation/upgrade path) Perfecto’s deployment & upgrade requires shipping & purchasing of hardware – lengthy and heavy duty process; also dependant on availability of Perfecto field engineers for HW support 4. Scalability Perfecto can only have two devices connected to the MobileCloud Express 5. Integration Into Test Environments Perfecto does not enable you to leverage many of the test environments such as Perl, Python, Ruby, and provides only very partial integration into others such as Visual Studio and RFT (cannot edit there tests, just execute the tests)
  • 3. Both companies provide 2 types of products: Automation testing tool Manual testing tool These two product types can be accessed in various ways: This comparison focuses on the Automation testing tool 3 Tool Type  Local connectivity (tethered to tester machine)  Onsite private Cloud  No Public Cloud  Local connectivity (tethered to tester machine)  Private Cloud (not onsite)  Public Cloud
  • 4. 4 Maturity of Native and Web Identification Objects identification capabilities using Native/Web properties  Full support for Native identification ‒ Over 30 classes supported: ID, Name, Text, Class, Accessibility label, Content description, Hint (android), Placeholder, etc.  Full support for Web properties ‒ ID, Name, Text, Class, CSS  Full Object Spy support – Full properties of each object – Hierarchy of the objects  Ability to use XPath for Native & Web apps – Multi-property object identification  Support for all mobile OS – Android, iOS, WindowsPhone and Blackberry  No support for 90% of Native properties – Only support one class: ID  Full support for Web properties ‒ ID, Name, Text, Class, CSS  Very partial object spy – No support for Native apps – No property view for Web apps  No XPath support for Native apps  No Native support for Blackberry and WindowsPhone8 Implications: immaturity of the Perfecto Native identification compared to SeeTest implies… – Poor maintainability of tests , due to dependency on Image and Text that makes tests sensitive to UI changes in the app – No portability of tests (on native apps) across different mobile OS , as Image/Text identification varies across devices – No native support for Blackberry and WindowsPhone8 support
  • 5. 5 Test Creation Method & Coverage Ability to record & create tests easily, quickly & comprehensively  Real recording ‒ Records tester’s actions ‒ Extracts objects automatically (with Native/Web properties) ‒ Performed on the visualization of the device ‒ No code writing required  Support for all functions & gestures ‒ Ability to interact with objects that are not visible on the screen  Support for all OS ‒ iOS ‒ Android ‒ WindowsPhone8 ‒ BlackBerry  No real recording – Write/Build the tests codes manually – Selecting steps manually (one by one) from a list of actions – Extracting objects manually  Partial coverage of functions & gestures – Cannot interact with invisible objects (for example clicking on an item in a list that is not fully visible)  No Support for WindowsPhone8 Implications: Perfecto test creation method compared to SeeTest implies… – Long time to create a full project due to – Lack of recording feature that makes it a lot easier for the tester to create tests and extracts objects automatically – Lack of functional coverage – No coverage for WindowsPhone8 applications
  • 6. 6 Software/Hardware (installation/upgrade simplicity) Solution type and implications for future updates/upgrades  Software solution only – downloadable  Update/Upgrade or fix requirements ‒ Download a new version  Simple connectivity to the tester’s PC – USB – Wi-Fi – Internal cloud  Hardware solution  Update/Upgrade or fix requirements – May require shipment of hardware equipment  Connectivity through a proprietary hardware  Maximum of 2 devices connected to tester machine Implications: Perfecto solution type compared to SeeTest implies… – Long time to upgrade when needed due to the need for purchasing new hardware – Dependency on 3rd party each time you want to fix, maintain, upgrade or change your project – Hardware limitations and requirements when need to connect a device
  • 7. 7 Scalable Architecture Ability to Scale your project when necessary  Connect 16 devices per tester’s PC  Any tester can see the full list of all devices connected to the SeeTestCloud and use any one of them  Connect 2 devices per tester’s PC  Tester can only see the devices connected to his local machine; cannot see or use devices that are located elsewhere in the organization Implications: Perfecto system architecture compared to SeeTest implies… – Poor productivity of you testing team (poor ROI), due to the limitations mentioned – 2 devices connected per tester’s PC – No sharing devices across the organization
  • 8. 8 Integration Into Test & CI Environments Ability to create, edit, run your tests and view results from within a testing and CI environments  Full support for creating, editing, running and viewing results in all the following: ‒ UFT(QTP) ‒ Visual Studio ‒ RFT ‒ Eclipse ‒ Python ‒ Perl ‒ Ruby  Support for the following CI environments ‒ QC ‒ TFS ‒ Jenkins ‒ TeamCity ‒ Hudson  No support for creating/editing your tests in Visual Studio, RFT  No support at all for Python, Perl, Ruby  No support for most CI environments such as Jenkins, TeamCity, Hudson Implications: Perfecto integration to testing and CI environments compared to SeeTest implies… – Disability to leverage your existing ALM assets – Very long training or even new testing team recruitment in case you are using Visual Studio/RFT/Python/Perl/Ruby – Very long training or even new testing team recruitment in case you are using Jenkins/TeamCity/Hudson
  • 9. 9 Comparison Between Mobile Testing Tools Criteria SeeTestAutomation Perfecto MobileCloud Express Native and Web Identification Full Partial OS available for Native identification iOS Android WindowsPhone8 Blackberry iOS Android Cross platform testing abilities High Poor Testing environments UFT(QTP) Visual Studio RFT Eclipse Python Perl Ruby UFT(QTP) Eclipse RFT (only run tests; no create/edit test) Visual Studio (only run tests; no create/edit test) Recorder Yes No real recorder record button but no actual recording of object properties solution type Implication on Upgrade path Software Only Downloadable Hardware Requires purchasing & shipping of hardware