Testing Mobile Apps Under Real User
Conditions
Introducing the Wind TunnelTM
© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Amir Rozenberg
Uzi Eilon
2/1/2016 2© 2015,Perfecto Mobile Ltd. All Rights Reserved.
2
- Physical experience and interaction gives way to Digital
- Digital is an Omni-Channel strategy
- Mobile is the first screen among connected consumers
Mobile
Social
Enterprise End User
Web
Internet of Things
The Digital Transformation
Problem
2/1/2016 3© 2015,Perfecto Mobile Ltd. All Rights Reserved.
The Mobile Experience
Quality Challenge
1) Building common user
environment condition profiles
into test suites
2) Assembling multiple solutions to
execute tests across profiles
3) Seamlessly integrating user
condition testing within
Continuous integration pipelines
4) Analyzing app performance blind
spots
Rethink Functional Testing for Digital
Experience
Introducing the Wind TunnelTM
Easily bring your end user conditions to the lab
Offer a test environment that expands coverage to real world
user conditions
So that,
1. Application flaws are exposed
2. Mobile-user expectations are met
3. Business outcomes are assured
2/1/2016 5© 2015,Perfecto Mobile Ltd. All Rights Reserved.
The Wind TunnelTM User Flow
Wind Tunnel
Profile Selector
Usage Patterns
1. Login
2. Search
3. Select
4. Add to cart
5. Payment
6. Shipping
7. Checkout
Unchanged Test Flows
User Journey
Existing Flows
Analyze &
Optimize
• Lives in NY
• iPhone 6S
• Verizon Customer
• Constant WhatsApp msg
Georgia
1
2
3 4
Coverage extended with User
Personas
2/1/2016 7© 2015,Perfecto Mobile Ltd. All Rights Reserved.
Persona: Meet Georgia
8
• Georgia
• 47 year old high income, corporate road warrior
living in Manhattan traveling to San Fran & London
• Traits
• Network: Constantly connected, frequent
network switches across various WiFi and cellular
networks
• Brands of choice: Apple & Verizon
• Device(s): iPhone 6S, Smartwatch & iPad Pro
• App loyalty: Intense social user, WhatsApp, Mobile
Banking and PO & Expense Report approvals
Network
Form
Factors
Apps
Location
Persona: Meet Ross
9
• Ross
• 20 year old college student, based in Miami
(travels home to San Fran)
• Traits
• Uses older phones – iPhone 4, 2-year-old Android
• More Wi-Fi based app activity than cellular
because travel is limited
• Social, eLearning, entertainment, music,
multimedia apps
• Lots of web searching and browser activity for
school work
• Frequent concerns over low battery
Location
Network
Form
Factors
Apps
2/1/2016 10© 2015,Perfecto Mobile Ltd. All Rights Reserved.
Create your own!
Can Alon navigate to the nearest Starbucks
store?
2/1/2016 11© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Can Alon navigate to the nearest Starbucks
store?
2/1/2016 12© 2015, Perfecto Mobile Ltd. All Rights Reserved.
2/1/2016 14© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Thank You
© 2015,Perfecto Mobile Ltd. All Rights Reserved.

Testing Mobile Apps under Real User Conditions

  • 1.
    Testing Mobile AppsUnder Real User Conditions Introducing the Wind TunnelTM © 2015, Perfecto Mobile Ltd. All Rights Reserved. Amir Rozenberg Uzi Eilon
  • 2.
    2/1/2016 2© 2015,PerfectoMobile Ltd. All Rights Reserved. 2 - Physical experience and interaction gives way to Digital - Digital is an Omni-Channel strategy - Mobile is the first screen among connected consumers Mobile Social Enterprise End User Web Internet of Things The Digital Transformation
  • 3.
    Problem 2/1/2016 3© 2015,PerfectoMobile Ltd. All Rights Reserved. The Mobile Experience Quality Challenge 1) Building common user environment condition profiles into test suites 2) Assembling multiple solutions to execute tests across profiles 3) Seamlessly integrating user condition testing within Continuous integration pipelines 4) Analyzing app performance blind spots
  • 4.
    Rethink Functional Testingfor Digital Experience
  • 5.
    Introducing the WindTunnelTM Easily bring your end user conditions to the lab Offer a test environment that expands coverage to real world user conditions So that, 1. Application flaws are exposed 2. Mobile-user expectations are met 3. Business outcomes are assured 2/1/2016 5© 2015,Perfecto Mobile Ltd. All Rights Reserved.
  • 6.
    The Wind TunnelTMUser Flow Wind Tunnel Profile Selector Usage Patterns 1. Login 2. Search 3. Select 4. Add to cart 5. Payment 6. Shipping 7. Checkout Unchanged Test Flows User Journey Existing Flows Analyze & Optimize • Lives in NY • iPhone 6S • Verizon Customer • Constant WhatsApp msg Georgia 1 2 3 4
  • 7.
    Coverage extended withUser Personas 2/1/2016 7© 2015,Perfecto Mobile Ltd. All Rights Reserved.
  • 8.
    Persona: Meet Georgia 8 •Georgia • 47 year old high income, corporate road warrior living in Manhattan traveling to San Fran & London • Traits • Network: Constantly connected, frequent network switches across various WiFi and cellular networks • Brands of choice: Apple & Verizon • Device(s): iPhone 6S, Smartwatch & iPad Pro • App loyalty: Intense social user, WhatsApp, Mobile Banking and PO & Expense Report approvals Network Form Factors Apps Location
  • 9.
    Persona: Meet Ross 9 •Ross • 20 year old college student, based in Miami (travels home to San Fran) • Traits • Uses older phones – iPhone 4, 2-year-old Android • More Wi-Fi based app activity than cellular because travel is limited • Social, eLearning, entertainment, music, multimedia apps • Lots of web searching and browser activity for school work • Frequent concerns over low battery Location Network Form Factors Apps
  • 10.
    2/1/2016 10© 2015,PerfectoMobile Ltd. All Rights Reserved. Create your own!
  • 11.
    Can Alon navigateto the nearest Starbucks store? 2/1/2016 11© 2015, Perfecto Mobile Ltd. All Rights Reserved.
  • 12.
    Can Alon navigateto the nearest Starbucks store? 2/1/2016 12© 2015, Perfecto Mobile Ltd. All Rights Reserved.
  • 13.
    2/1/2016 14© 2015,Perfecto Mobile Ltd. All Rights Reserved.
  • 14.
    Thank You © 2015,PerfectoMobile Ltd. All Rights Reserved.

Editor's Notes

  • #7 Validate- functional tester All 3- performance tester