The document discusses recommendations for building a solid test automation suite. It outlines some common challenges with test automation such as executing tests across platforms and maintaining test scripts over time. It then discusses strategies for defining appropriate digital test coverage, including determining which devices, OS versions, and platforms to test. The presentation recommends starting with a small set of tests and growing automation over time. It also emphasizes debugging tests across different platforms and environments. The last part of the document demonstrates automated testing using Perfecto's tools and discusses maintaining robust automation.

1. 5/13/2016 1© 2016, Perfecto Mobile Ltd. All Rights Reserved.
7 key recommendations for building
a solid test automation suite
May 2016
Eran Kinsbruner
Director, Tech. Evangelist
Perfecto
Uzi Eilon
Technology Director
Perfecto
Daniel Knott
Mobile Senior Test Engineer
Xing AG

2. Some housekeeping before we start
5/13/2016 2© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Submit questions
using the Q&A panel.
Participate in the
polls.
Watch your email for
a copy of the
recording and slides.
Complete the survey
following the
presentation.

3. Webinar Agenda
5/13/2016 3© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Mobile Test Automation Challenges
Strategy for defining the right digital test coverage
Practices For Robust Test Automation
The 7 Keys for Unattended Mobile Test Automation
Live Demo!
Q & A

4. 5/13/2016 4© 2015, Perfecto Mobile Ltd. All Rights Reserved.
I SAID
I WAS FINE.
I LIED.

5. Poll – Mobile Test Automation Challenges
5/13/2016 5© 2016, Perfecto Mobile Ltd. All Rights Reserved.

6. Code / Test – Common Challenges
1) Execution of One script across platforms
2) Automating build/deploy and acceptance testing during CI
3) Test results analysis
4) Object id Identification
5) Does it work over time ?
6) Maintenance of scripts and Objects
7) Matching Dev/Testers skill set

7. DevOps – challenges
Tools
Reports
Flows
TimeStability
False
negatives
Collaboration

8. The Test Coverage Conversation – What To
Answer?
 Which Devices?
 Which OS Versions?
 How Many platforms are Enough?
 When Should I refresh my test lab?
 Who is in charge of coverage?
5/13/2016 8© 2016, Perfecto Mobile Ltd. All Rights Reserved.

9. Mobile Test Coverage Method

10. Recommended OS – Usage & Quality
Rationale
Usage &
Quality
Issues
Wi-Fi Issues
Battery Drain
Latest REF
Android OS

11. WHY AUTOMATE?

12. UI
Integration
Unit Testing
Performance Security
Digital Transformation Requires Changes
Around Test Automation
Target
Devices
Target
Env.OS
OS versions
Form factors
CPU & Memory
Manufacturers
Wearables
IOT
Networks
Orientation
Location
Notifications
Events
Device events

13. Object Identification Is Key For Robust Automation
5/13/2016 13© 2016, Perfecto Mobile Ltd. All Rights Reserved.
• Selenium
• Appium
• XCTest
• UIAutomation
• Perfecto
• Abby OCR
• Applitools
• Perfecto

14. Device/System Level Control is Critical
14

15. Assure Proper Error Handling
15
System level control
Application control
Device control

16. 3 Layers Involved In Test Automation Optimization
5/13/2016 16© 2016, Perfecto Mobile Ltd. All Rights Reserved.
App
• Info.Plist (iOS)
• Manifest.MF
(Android)
Test Cases
• Define Desired Capabilities
Device
• Supports
Feature
• Doesn’t Support

17. Facebook App Testing Diversity
5/13/2016 17© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Test Scenario iPhone 6/iPhone 5S iPhone 6S/6S Plus iPad Tablets
Login
YES YES YES
Write Post (FB UI)
YES YES YES
Write Post
(FB Force Touch)
NO YES NO
Upload Photo/Video
(FB UI)
YES YES YES
Upload Photo/Video
(FB Force Touch)
NO YES NO
Take Photo/Video
(FB UI)
YES YES YES
Take Photo/Video
(FB Force Touch)
NO YES NO

18. More Examples: Android Doze & Multi Window
5/13/2016 18© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Android 6 and Above
Android N and Above

19. Validate Feature Compliance & Test Accordingly
5/13/2016 19© 2016, Perfecto Mobile Ltd. All Rights Reserved.
IOS Developer Library
INFO.PLIST

20. 7 Keys for Successful Unattended Automation and CI
5/13/2016 20© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Start small & Grow
Accept that not every test
enters CI
Debug & Debug Again
across few platforms
Make your script reusable
Validate within and between the
tests
Plan for unexpected events
Keep channel between Engineering,
Ops and Biz opened

21. Zero Effort Automation
Demo

22. More Example
5/13/2016 22© 2016, Perfecto Mobile Ltd. All Rights Reserved.

23. Smart Monkey Automation
5/13/2016 23© 2016, Perfecto Mobile Ltd. All Rights Reserved.

24. Smart Monkey Automation
5/13/2016 24© 2016, Perfecto Mobile Ltd. All Rights Reserved.

25. Webinar Agenda
5/13/2016 25© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Mobile Test Automation Challenges
Strategy for defining the right digital test coverage
Practices For Robust Test Automation
The 7 Keys for Unattended Mobile Test Automation
Live Demo!
Q & A

26. Q & A
5/13/2016 26© 2016, Perfecto Mobile Ltd. All Rights Reserved.

27. Special Offers to Webinar Attendees
5/13/2016 27© 2015, Perfecto Mobile Ltd. All Rights Reserved.
New Whitepaper – Early Release!
The Ultimate Digital Test Coverage Guide
Contact Eran  ERANK@PERFECTOMOBILE.COM to get your free copy!

28. Thank You