This document discusses how Appium and Perfecto can work together to improve mobile application testing. It summarizes Appium as an open-source tool for automating mobile tests but notes its limitations in enterprise settings due to lack of support and controls. Perfecto is introduced as a cloud-based platform that provides the infrastructure and capabilities needed for robust enterprise mobile testing at scale. The document argues that combining Appium's test automation with Perfecto's device lab, controls, and reporting removes Appium's limitations and allows for complete automated testing of mobile applications under real user conditions.

1. Appium & Perfecto: A Perfect Match
Max Skybin, Director of Sales Engineering
Nick Sanjines, Senior Sales Engineer

2. AGENDA
• Digital transformation context
• Key enablers of digital quality
• What is Appium?
• Appium’s strengths and limitations
• Who is Perfecto and how we work with Appium
• How we improve and build on Appium’s core strengths
• Benefits of using Perfecto & Appium together
• Demo
© 2016, Perfecto Mobile Ltd. All Rights Reserved.

3. 11/30/2016 3© 2015,Perfecto Mobile Ltd. All Rights Reserved.
3
- Physical experience and interaction gives way to Digital
- Digital is an Omni-Channel strategy
- Mobile is the first screen among connected consumers
Mobile
Social
Enterprise End User
Web
Internet of Things
The Digital Transformation

4. DIGITAL PLATFORMS ARE ALL MERGING INTO ONE EXPERIENCE
11/30/2016 4© 2015, Perfecto Mobile Ltd. All Rights Reserved.
One User Experience Across All Digital Platforms
Source: Google

5. Network Quality
Cellular, Wi-Fi
Interacting with sensors
Peak time -
Millions of transactions Multiple devices
Specific profiles
USERS DEMAND EXCEPTIONAL DIGITAL EXPERIENCE
REGARDLESS OF CONDITIONS
Varied Device Conditions
Background Apps Location

6. Immediate, reliable, secure
24/7 access to mobile devices
and web-browsers across all
required platforms
Unattended parallel
automation covering full
scope of functional and non-
functional requirements
Real-time on-demand
reporting with high-level view
of full digital quality as well as
detailed drill-down into
specific test results
KEY ENABLERS FOR EXCEPTIONAL DIGITAL QUALITY
© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Enterprise-Grade
Device Lab
Robust
Automation
Comprehensive
Reporting
Reduce device management spend
and enable high levels of
automated testing
Avoid manual testing spend
without compromising quality
Quickly identify quality issues
earlier in SDLC, prioritise, triage and
fix defects across web and mobile

7. WHAT IS APPIUM?
Appium is a tool for
automating testing of
applications on mobile
devices. It was created as an
open-source alternative to
existing commercial tools.
11/30/2016 7© 2016, Perfecto Mobile Ltd. All Rights Reserved.

8. APPIUM’S BENEFITS
• Cross-platform
• Write tests against multiple platforms (iOS, Android, Windows), using the same API
• Non-intrusive
• Doesn’t require the app to be modified or recompiled
• Doesn’t require access to application’s source code
• Test what you ship to end-users
• Open
• Automate using any language/framework
• Based on industry-standard Selenium Web Driver
• Open source project supported by community
11/30/2016 8© 2016, Perfecto Mobile Ltd. All Rights Reserved.

9. APPIUM’S LIMITATIONS
• Open Source Support Model
• No official support when something goes wrong
• Tends to take 1-2 months to support a new iOS version after GA release
• No OS-level or environmental controls
• Testing outside the application context is impossible, which prevents automation of
full digital experience (2 factor authentication, widgets, interaction with other apps)
• No environment controls are available to change GPS, network conditions, etc.
• Object-level recognition only, no ability to visually validate user experience
• Unreliable automation
• Defects in Appium/Selenium cause test failures
• Parallel execution difficult to configure and sustain
• Negative productivity impact
• No reporting capabilities – you have to build your own reporting
• Lack of IDE plug-ins slows down script creation
11/30/2016 9© 2016, Perfecto Mobile Ltd. All Rights Reserved.

10. IMPACT: APPIUM DOESN’T ADDRESS THE FUNDAMENTAL PROBLEM OF
PROVIDING AN ENTERPRISE-GRADE LAB
10
Real end user conditions
Complex
hardware &
software
setup
Secure environments
On-demand
access to
mobile devices,
browsers &
wearables
24x7
continuous
support

11. iOS 10 Beta
6/13
iOS G.A.
9/13
10/11 - Appium
support for iOS 10
120 days without iOS 10 support!
54% user adoption of iOS 10 during
Appium support gap
IMPACT: LACK OF TIMELY OS SUPPORT IN APPIUM LEADS TO RISK OF RELEASING
UNTESTED APPLICATIONS DURING WIDE OS ADOPTION

12. AppiumCannotTestAppiumCanTest IMPACT: LACK OF OS-LEVEL CONTROLS AND VISUAL VALIDATIONS LIMITS THE AMOUNT
OF AUTOMATION COVERAGE
11/30/2016 12© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Verify the user is able to enter only valid
postal code
• Verify the user is able to enter only valid post code
by checking input exists in DOM
• Verify the continue button is visible so the user can
proceed to the next screen
• Verify the screen renders within acceptable time
under WiFi, LTE and 3G connectivity
• Validate that when invalid postal code is entered,
error message is colored red

13. IMPACT: POOR REPORTING MAKES TEST RESULT ANALYSIS AND DEFECT ISOLATION
A PAINFUL EXERCISE
11/30/2016 13© 2016, Perfecto Mobile Ltd. All Rights Reserved.

14. WHO IS PERFECTO?
A Cloud Based Continuous Quality
Lab enabling application testing and
monitoring on real devices in real
end user conditions, for enterprises
adopting digital transformation and
agile delivery processes

15. INDUSTRY LEADERSHIP

16. PERFECTO OFFERS THE TESTING PLATFORM FOR COMPLETE
DIGITAL COVERAGE
Digital Test Suite Reporting for Agile
Teams
One Script
For All Digital Platforms
One Lab – Web & Mobile
One Secure Cloud
Manual & Automated Testing

17. GLOBAL, ENTERPRISE-GRADE DIGITAL LAB
11/30/2016 17© 2015, Perfecto Mobile Ltd. All Rights Reserved.

18. OPEN AND INTEGRATED
18
Open &
Integrated
Xcode
Selenium

19. HOW PERFECTO EXTENDS APPIUM
ACHIEVE HIGH %
OF AUTOMATION
SYSTEM LEVEL
CONTROL
IMAGE
INJECTION
OCR & IMAGE
OBJECT
RECOGNITION
RICH REPORTS
MIMIC REAL USER
ENVIRONMENT
GPS INJECTION
NETWORK
VIRTUALIZATION
PERSONA-
BASED TESTING
HYBRID CLOUD
GLOBAL
COVERAGE
GET ENTERPRISE
GRADE
ENTERPRISE
SECURITY
24X7 SUPPORT
SCALE &
FLEXIBLE
ROLES &
PERMISSIONS
MAKING
OPEN-SOURCE
ENTERPRISE
READY
OPEN SOURCE
IOS &
ANDROID
NATIVE/DOM
OBJECT
RECOGNITION
CI SUPPORT

20. BENEFITS OF USING APPIUM WITH PERFECTO
• Reliable unattended parallel automation
• Reuse the same Appium scripts and skill-set
• Fixed Appium/Selenium defects that cause failed executions fixed
• Unlimited parallel execution, no setup required
• OS-level and environmental controls
• You can interact with anything on the screen testing real-user interactions
• Test pop-ups, incoming calls, SMS, interruptions, etc
• Full ability to test a variety of real user conditions
• Accelerate tester and developer productivity
• Integrated reporting engine provides screenshots, videos, script and device
analytics, and more accelerating defect triage and giving executive visibility
• IDE plug-ins for popular IDEs accelerate script development and debugging
• Enterprise Support Model
• 24x7 support, global, secure, audited environments
• OS Beta support. Same-day support for GA versions.
11/30/2016 20© 2016, Perfecto Mobile Ltd. All Rights Reserved.

21. AppiumwithPerfectoAppiumOnly IMPACT: ACHIEVE COMPLETE TESTING COVERAGE WITH VISUAL ANALYSIS, OS-LEVEL
TESTING, AND REAL END-USER CONDITIONS
11/30/2016 21© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Verify the user is able to enter only valid
postal code
• Verify the user is able to enter only valid post code
by checking input exists in DOM
• Verify the continue button is visible so the user can
proceed to the next screen
• Verify the screen renders within acceptable time
under WiFi, LTE and 3G connectivity
• Validate that when invalid postal code is entered,
error message is colored red

22. IMPACT: UNDERSTAND THE IMPACT OF REAL-WORLD CONDITIONS ON
APPLICATION PERFORMANCE WITH PERSONA-BASED TESTING
22
Marketing / Business
 Business-Engineering alignment
 Automated lab configuration
 Communicate Risk in business terms
((( )))
Name: Sara
Location: London
Age: 25
Device: New
Sensitivity to UX: High
Behavior: Fashion magazine designer
Engineering
Name: Sara
Location: New York
Age: 25
Device: New
Sensitivity to UX: High
Behavior: Fashion magazine designer
Data
?
Test Cases
Name: Sara
Location: New York
Device: iPhone 7, iOS 10
Carrier: BT
Network: 3G
Background Apps: Instagram

23. IMPACT: UNDERSTAND HIGH-LEVEL DIGITAL QUALITY TRENDS AND QUICKLY
NARROW DOWN PROBLEMATIC AREAS
11/30/2016 23© 2016, Perfecto Mobile Ltd. All Rights Reserved.

24. IMPACT: ACCELERATE DEFECT RESOLUTION BY ZOOMING INTO DETAILS OF EACH FAILED TEST
EXECUTION WITH DEVICE VITALS, SCREENSHOTS AND VIDEOS
11/30/2016 24© 2016, Perfecto Mobile Ltd. All Rights Reserved.

25. PERFECTO PLATFORM
IN-HOUSE OR
3RD PARTY LAB
APPIUM & SELENIUM
PERFECTO ENTERPRISE
EXTENSIONS
AUTOMATION FRAMEWORK
AUTOMATION SCRIPTS
CONTINUOUS INTEGRATION
< 50% AUTOMATION90%+ AUTOMATION
ACHIEVE HIGH BUSINESS
VALUE WITH PERFECTO
& APPIUM

26. 11/30/2016 26© 2016, Perfecto Mobile Ltd. All Rights Reserved.
DEMO