©2019 Infostretch. All rights reserved. 1
Testing Solutions for
Hyper-Connected Apps
Don’t let peripherals play havoc
Sivakumar Anna
(sanna@infostretch.com)
©2019 Infostretch. All rights reserved. 2
Your speaker
Sivakumar Anna
VP - QE Services, Infostretch
(sanna@infostretch.com)
25 years of experience
in Fortune 1000 companies.
Instrumental in leading
strategic engagements at
InfoStretch which has resulted
in significant value for
our clients.
Responsible for managing
engagements in enterprise
segments ranging from QA,
Strategy engagements
Enable QA organizations become
more efficient in Test Automation
using innovative ideas
©2019 Infostretch. All rights reserved. 5
Agenda
1. Digital Platform Today & Digital Innovations
2. Mobile Test Approaches – Device Interfaces
1. Requirements
2. Challenges & Potential Solutions
3. Mobile Testing Techniques
4. Take Away
5. Q & A
©2019 Infostretch. All rights reserved. 6
The Digital Ecosystem is Rapidly Evolving
Push
Notification
Location
Services
Check Scan Biometrics
New unique
mobile capabilities
More complex
mobile applications
Exploding number
of device fragmentation
©2019 Infostretch. All rights reserved. 7©2018 Infostretch. All rights reserved. 7
Apps using Location Services
Simulate particular location
Simulation of location with different
GPS signal accuracy
Simulation of driving scenario
on different routes
Simulate GPS signal drop during
driving scenario
Simulate Location Services
©2019 Infostretch. All rights reserved. 8
Apps using Camera
Simulate Camera
Simulate image captured from Camera
Use cases:
• Check scanning
• Barcode / QR Code scanning
• Document Scanner Apps
©2019 Infostretch. All rights reserved. 9©2018 Infostretch. All rights reserved. 9
Apps interacting with
Peripherals through BLE
Simulate Bluetooth states (On/Off)
and peripheral advertising
Simulate connectivity scenarios such as pairing
success, failure, timeout, etc.
Simulate multiple peripheral device
with different Name, Serial number, signal
strength, etc.
Simulate Data transfer scenarios varying
parameters like interval, data type, sensor
readings, etc.
Connecting with BLE peripherals
©2019 Infostretch. All rights reserved. 10
BLE with Beacons
Beacon Placement &
Tuning
Correct Range
Detection
Detection of
Appropriate Beacon
Detection and
Response
Range
Battery
Drainage
Connectivity
Beacon
Placement
Testing
Focus
Test
Parameters
©2019 Infostretch. All rights reserved. 11
Apps using Fingerprint based
Authentication
Simulate Fingerprint for Authentication
Simulate success/failure scenarios for
fingerprint authentication
Scenarios allowing new fingerprints to be
enrolled or existing fingerprints to be removed
Scenarios involving no fingerprint sensor
available on device, no fingerprint enrolled
©2019 Infostretch. All rights reserved. 13
Digital Test Strategy in Today’s World
Device Hardware Interfaces
©2019 Infostretch. All rights reserved. 14
Multiple Failure Modes Drive Multiple Test Methodologies
Device Limits /
Non-Functional
Device
UI Test
Device
Functional
Application Functional
Test business function
Business rules validation
Data flows
Business requirements
Test mobile
device functions
Check capture
Location Services
Push notifications
Video Interactions
Test device UI
Label positioning
Error messages
Image rendering
Landscape/portrait
Test Device Limits
High memory usage
High processor usage
Interruption test
Test
Methodologies
Description:
Test
Approach
Digital unique
NO YES YES YES
Digital
Unique?
• Simulators
and Automation
• Using
Real Devices
• Using Hardware
& Software
Simulation
• Devices and
Selective
Automation
• Using
Real Devices
©2019 Infostretch. All rights reserved. 15
Simulator-based Solution for Digital
Hardware Interfaces & System
Interfaces
©2019 Infostretch. All rights reserved. 16
Digital App Automation Library – Portal Interface
©2019 Infostretch. All rights reserved. 17
Digital App Automation Library - Overview
Hardware returns
current location
Operating System
provides location update
to app
Application
Mobile
Automation
Library
App Requests Current
Location
Operating
System
Operating System
sends command to
Hardware
Hardware
(GPS)
Sends
command to
Library
Automation
Script
©2019 Infostretch. All rights reserved. 18
Mobile Automation Library
Automation Features
Touch ID Apple Pay
Camera GPS
Date Time BLE
Accelerometer Gyroscope
Command Handling
& Processing
Mobile Automation
Library Interface
REST Web Services
Web Socket Listener
©2019 Infostretch. All rights reserved. 19
Critical Use Case – Successfully Increased Test Automation Coverage
Bar code scanning for retail,
banking, healthcare apps
Simulate System Date / Time including
time zone to test application behavior –
verify promotions in retail, banking apps
Fitness applications – Bluetooth
connectivity scenarios, verify app behavior
in case of abnormal Heart Rate /
Temperature values etc.
Location based scenarios – feature is
available when user reaches specific
location
Check Deposit for mobile banking -
Customer logs in, Selects Account, Scans
Check, Confirms Deposit, Logs out
Biometrics used for authentication in
banking & wallet apps
Route functionality – field service personal
travels to customer location, starts job,
uploads picture, adds comment &
completes job
Payment functionality in apps using Apple
Pay & Google Wallet
©2019 Infostretch. All rights reserved. 20
Demo #2 :
Camera Image Injection Use Case
Demo #1 :
Location Service Use Case
Demo(s)
1. Utility Company providing service
maintenances
2. Employees / Contractors on the road
3. Mobile app would allow agents to start
working on the jobs only if the agents are
at specific location proximity
4. Agents can pick up the job only after they
are at the EXACT location
1. Utility Company providing
service maintenances
2. While working on jobs, need to attach
the picture of the items to be worked
on using the app
Tools & Technologies – Appium, Java Language, Local Devices or Cloud Devices
©2019 Infostretch. All rights reserved. 21
Take Away
#1 Work with Mobile
Application Developers
• Mobile OS specific tools
• Application Hooks
• Invest in building utilities tools
#2 Leverage Service
Providers
• Readymade framework
• Implementation Knowledge
• Custom Solutions
#3 Consider Cloud
Infrastructure Providers
• Perfecto Mobile (Perforce)
• Headspin
• Sauce Labs
©2019 Infostretch. All rights reserved. 22
Thank You
Connect With Us
info@infostretch.com
+1-408-727-1100

Testing Solutions for Hyper Connected Apps by Sivakumar Anna

  • 1.
    ©2019 Infostretch. Allrights reserved. 1 Testing Solutions for Hyper-Connected Apps Don’t let peripherals play havoc Sivakumar Anna (sanna@infostretch.com)
  • 2.
    ©2019 Infostretch. Allrights reserved. 2 Your speaker Sivakumar Anna VP - QE Services, Infostretch (sanna@infostretch.com) 25 years of experience in Fortune 1000 companies. Instrumental in leading strategic engagements at InfoStretch which has resulted in significant value for our clients. Responsible for managing engagements in enterprise segments ranging from QA, Strategy engagements Enable QA organizations become more efficient in Test Automation using innovative ideas
  • 3.
    ©2019 Infostretch. Allrights reserved. 5 Agenda 1. Digital Platform Today & Digital Innovations 2. Mobile Test Approaches – Device Interfaces 1. Requirements 2. Challenges & Potential Solutions 3. Mobile Testing Techniques 4. Take Away 5. Q & A
  • 4.
    ©2019 Infostretch. Allrights reserved. 6 The Digital Ecosystem is Rapidly Evolving Push Notification Location Services Check Scan Biometrics New unique mobile capabilities More complex mobile applications Exploding number of device fragmentation
  • 5.
    ©2019 Infostretch. Allrights reserved. 7©2018 Infostretch. All rights reserved. 7 Apps using Location Services Simulate particular location Simulation of location with different GPS signal accuracy Simulation of driving scenario on different routes Simulate GPS signal drop during driving scenario Simulate Location Services
  • 6.
    ©2019 Infostretch. Allrights reserved. 8 Apps using Camera Simulate Camera Simulate image captured from Camera Use cases: • Check scanning • Barcode / QR Code scanning • Document Scanner Apps
  • 7.
    ©2019 Infostretch. Allrights reserved. 9©2018 Infostretch. All rights reserved. 9 Apps interacting with Peripherals through BLE Simulate Bluetooth states (On/Off) and peripheral advertising Simulate connectivity scenarios such as pairing success, failure, timeout, etc. Simulate multiple peripheral device with different Name, Serial number, signal strength, etc. Simulate Data transfer scenarios varying parameters like interval, data type, sensor readings, etc. Connecting with BLE peripherals
  • 8.
    ©2019 Infostretch. Allrights reserved. 10 BLE with Beacons Beacon Placement & Tuning Correct Range Detection Detection of Appropriate Beacon Detection and Response Range Battery Drainage Connectivity Beacon Placement Testing Focus Test Parameters
  • 9.
    ©2019 Infostretch. Allrights reserved. 11 Apps using Fingerprint based Authentication Simulate Fingerprint for Authentication Simulate success/failure scenarios for fingerprint authentication Scenarios allowing new fingerprints to be enrolled or existing fingerprints to be removed Scenarios involving no fingerprint sensor available on device, no fingerprint enrolled
  • 10.
    ©2019 Infostretch. Allrights reserved. 13 Digital Test Strategy in Today’s World Device Hardware Interfaces
  • 11.
    ©2019 Infostretch. Allrights reserved. 14 Multiple Failure Modes Drive Multiple Test Methodologies Device Limits / Non-Functional Device UI Test Device Functional Application Functional Test business function Business rules validation Data flows Business requirements Test mobile device functions Check capture Location Services Push notifications Video Interactions Test device UI Label positioning Error messages Image rendering Landscape/portrait Test Device Limits High memory usage High processor usage Interruption test Test Methodologies Description: Test Approach Digital unique NO YES YES YES Digital Unique? • Simulators and Automation • Using Real Devices • Using Hardware & Software Simulation • Devices and Selective Automation • Using Real Devices
  • 12.
    ©2019 Infostretch. Allrights reserved. 15 Simulator-based Solution for Digital Hardware Interfaces & System Interfaces
  • 13.
    ©2019 Infostretch. Allrights reserved. 16 Digital App Automation Library – Portal Interface
  • 14.
    ©2019 Infostretch. Allrights reserved. 17 Digital App Automation Library - Overview Hardware returns current location Operating System provides location update to app Application Mobile Automation Library App Requests Current Location Operating System Operating System sends command to Hardware Hardware (GPS) Sends command to Library Automation Script
  • 15.
    ©2019 Infostretch. Allrights reserved. 18 Mobile Automation Library Automation Features Touch ID Apple Pay Camera GPS Date Time BLE Accelerometer Gyroscope Command Handling & Processing Mobile Automation Library Interface REST Web Services Web Socket Listener
  • 16.
    ©2019 Infostretch. Allrights reserved. 19 Critical Use Case – Successfully Increased Test Automation Coverage Bar code scanning for retail, banking, healthcare apps Simulate System Date / Time including time zone to test application behavior – verify promotions in retail, banking apps Fitness applications – Bluetooth connectivity scenarios, verify app behavior in case of abnormal Heart Rate / Temperature values etc. Location based scenarios – feature is available when user reaches specific location Check Deposit for mobile banking - Customer logs in, Selects Account, Scans Check, Confirms Deposit, Logs out Biometrics used for authentication in banking & wallet apps Route functionality – field service personal travels to customer location, starts job, uploads picture, adds comment & completes job Payment functionality in apps using Apple Pay & Google Wallet
  • 17.
    ©2019 Infostretch. Allrights reserved. 20 Demo #2 : Camera Image Injection Use Case Demo #1 : Location Service Use Case Demo(s) 1. Utility Company providing service maintenances 2. Employees / Contractors on the road 3. Mobile app would allow agents to start working on the jobs only if the agents are at specific location proximity 4. Agents can pick up the job only after they are at the EXACT location 1. Utility Company providing service maintenances 2. While working on jobs, need to attach the picture of the items to be worked on using the app Tools & Technologies – Appium, Java Language, Local Devices or Cloud Devices
  • 18.
    ©2019 Infostretch. Allrights reserved. 21 Take Away #1 Work with Mobile Application Developers • Mobile OS specific tools • Application Hooks • Invest in building utilities tools #2 Leverage Service Providers • Readymade framework • Implementation Knowledge • Custom Solutions #3 Consider Cloud Infrastructure Providers • Perfecto Mobile (Perforce) • Headspin • Sauce Labs
  • 19.
    ©2019 Infostretch. Allrights reserved. 22 Thank You Connect With Us info@infostretch.com +1-408-727-1100