Every day we rely on mobile apps to pay bills, book an Uber, listen to music, share photos on Facebook, or buy coffee. But not all users are alike and not all user experiences are the same. Join this webinar and watch Sveta Kostinsky, Perfecto’s Director of Field Engineering, “bring users into the lab” to test for different conditions and personas. She’ll explain why it’s dangerous to rely on functional testing alone and cover how to: -Automate the testing of real user conditions -Leverage user personas as a guide for testing scenarios and requirements -Get Marketing and QA to collaborate about user personas -Deliver apps that withstand spotty networks, incoming calls and app conflicts

1. Prevent App Failures
Test Real User Conditions

2. 2
Sveta Kostinsky
Dir. Field Engineering

3. Meet your Users!
6/16/2016 3© 2015,Perfecto Mobile Ltd. All Rights Reserved.
Georgia PeterSara SamRoss

4. Quality reality

5. Mobile Calendar 2016
6/16/2016 5© 2016, Perfecto Mobile Ltd. All Rights Reserved.

6. Mobile application release frequency
• Most successful apps release 1-4 updates a month
• Release should balance between bug fixes and feature updates
• Updates is a great marketing tool for developers to leverage
• Developers can speak with their user base via release notes or
comment in the reviews
6/16/2016 6© 2016, Perfecto Mobile Ltd. All Rights Reserved.
2017
36 per year
App releases per year
*The IDC predicts that by 2017, most app releases will occur 36 times per year

7. Problem
6/16/2016 7© 2015,Perfecto Mobile Ltd. All Rights Reserved.
The Digital Reality
Users expect apps to work in the
mobile moment
(regardless of conditions)
Failure to satisfy is costly

8. Problem
6/16/2016 8© 2015,Perfecto Mobile Ltd. All Rights Reserved.
The Mobile Experience
Quality Challenge
1) Build common user environment
condition profiles into test suites
2) Assemble multiple solutions to
execute tests across profiles
3) Integrate user condition testing
within Continuous integration
pipelines
4) Analyze app performance blind
spots

9. True user centric testing
Optimize your LAB environment, LAB
configuration and the choice of user flows
to reflect your users.
6/16/2016 9© 2016, Perfecto Mobile Ltd. All Rights Reserved.

10. 6/16/2016 10© 2015,Perfecto Mobile Ltd. All Rights Reserved.
Georgia PeterSara SamRoss

11. 6/16/2016 11© 2016, Perfecto Mobile Ltd. All Rights Reserved.
End user conditions in your lab
Name: Sara
Location: London
Device: iPhone 6, iOS 9.2
Carrier: BT
Network condition: 3G
Background apps:
Instagram, Facebook,
Uber
Align coverage planning
to business priorities
Automate lab configuration
to end user conditions
Multiple devices
Mobile | Tablet |
Desktop
End user conditions

12. Quality in the digital era needs to align to the
business
12
© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Marketing /
Business
 Business-Engineering alignment
 Automated lab configuration
 Communicate Risk in business terms
Name: Sara
Location: London
Age: 25
Device: New
Sensitivity to UX: High
Behavior: Fashion magazine
designer
Engineering
Name: Sara
Location: London
Age: 25
Device: New
Sensitivity to UX: High
Behavior: Fashion magazine designer
Name: Sara
Location: London
Device: iPhone6, iOS 9.2
Carrier: BT
Network: 3G
Background Apps: Instagram,
Facebook

13. 6/16/2016 13© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Name: Sara
Location: London
Device: iPhone6, iOS 9.2
Carrier: BT
Network: 3G
Background Apps: Instagram
Persona dimension in the coverage matrix

14. Real user condition - Network
• vs. corporate firewall
• LTE to WiFi seamless transition
• WiFi assist on iOS9
• Offline mode testing
14

15. Real user condition - Network
• Weak network signal – will I be charged twice??
• Changing network conditions flows – 3G/LTE
• Have to test the end to end flow on IPV6
• Always helps to test on real carrier network – SIP
• Apple Network link conditioner vs. external emulation
TCP layer acknowledgements timing
15

16. Real user condition - Working with 3rd party
applications
• Sharing the device Camera application
• Notifications, incoming calls, incoming text messages
• Posting to third party application
• Performing sign in via a 3rd party application
• Context switching between the apps
16

17. Real user condition - Memory and
CPU
• iPhone photos application
• Low memory conditions on the device
• Hybrid apps and low memory
• Thermal throttling of CPU – LTE connection
17

18. Real user condition - Rotation state and
language
• Testing different orientation
• The need for visual analysis
6/16/2016 18© 2016, Perfecto Mobile Ltd. All Rights Reserved.

19. User Centric Quality - Lab
with Real end user environment conditions
Simple Functional Testing Is Not Enough

20. Perfecto Wind Tunnel - Lab Environment
Easily bring your end user experience into the lab
Offer a test environment that expands coverage to real world
user conditions
So that,
1. User experience blind spots are exposed
2. Mobile-user expectations are met
3. Business outcomes are assured
6/16/2016 21© 2015,Perfecto Mobile Ltd. All Rights Reserved.

21. Demo time
6/16/2016 22© 2016, Perfecto Mobile Ltd. All Rights Reserved.

22. Lab Configuration
Is your LAB up-to-date?
No, really up-to-date?
Set up an agile lab, responsive to
adoption trends.
6/16/2016 25© 2016, Perfecto Mobile Ltd. All Rights Reserved.

23. Optimize your lab
6/16/2016 26© 2016, Perfecto Mobile Ltd. All Rights Reserved.

24. User flow
BI and flow analysis as part of Persona
27
Where should I spend most of my time?

25. 6/16/2016 28© 2016, Perfecto Mobile Ltd. All Rights Reserved.

26. Next Webinar June 30: Why Apps Succeed
• Panel Discussion of New Survey Results
Register today:
http://info.perfectomobile.com/Why-Apps-Succeed-
Registration.html
6/16/2016 29© 2016, Perfecto Mobile Ltd. All Rights Reserved.

27. Please complete the survey!
svetak@perfectomobile.com
+1-339-927-4343
Sveta Kostinsky