Shrinathacharya has given a session on Thick and Thin Lines in Choosing Mobile Test Cloud Environment in ATA Bangalore 13th Meetup. All copyright belongs to the author.

1. Thick and Thin Lines in Choosing
Mobile Test Cloud Environment
Author: Shrinathacharya L M
Agile Testing Alliance Bangalore 13th Meetup

2. Abstract
Modern software development demands ability to develop, test,
understand technology for mobile application, choose right automation tool,
and right test environment. It’s always challenge when
• 37% of world population are using smart phones (2.8 billion smart phone / 7.4 billion world population)
• 5 million mobile application are on mobile stores
• 2400+ smartphones are running on multiple OS versions
So, an advancement of mobile computing, ubiquity of wireless networking
in product/project development has created a revolution in testing the
mobile application. Selecting the test environment is a challenge due to
multiple mobile devices, multiple operating system for companies, which
leads to either use internal mobile test labs or use mobile test cloud
environment.
This paper talks about understanding the thick and thin lines while choosing
the right mobile test cloud environment.

3. How many of you don’t have smartphone?

4. Are we accounting for Mobile Screen Sizes?

5. Device Fragmentation

6. How many apps are in your smartphone?

7. Selection Criteria for Mobile Cloud Environment
 Is mobile app built for android, iOS, Windows, Blackberry or Cross
platform?
 Do we need to test your mobile website as well?
 Do we need to validate the data inputted from mobile app with your
desktop app or web app?
 Is your mobile app testing is short term?
 Does test cloud environments support for manual, automation and
performance testing?
 Is testing only on standard devices of android, iOS, Windows,
Blackberry?
 Does your app requires to interact with other cloud environments like
MS Azure and cost involved?

8. 7 Challenges in Selecting Mobile Test Environment

9. 4 Quadrant of mobile development

10. Multiple Mobile OS v/s Multiple versions
Mobile application running on multiple versions in iOS
(Data as on Feb 2017*)

11. Multiple Mobile OS v/s Multiple versions
Mobile application running on multiple versions in Android
• It means, does your app need to test on all OS vs versions?
• Understand the upcoming Mobile OS and features in beta
(Data as on Feb 2017*)

12. Need of mobile app testing with multiple devices

13. Mobile testing environments

14. In-house Mobile Device Lab + Automation Tool

15. Mobile Test Cloud Environment

16. Comparison Analysis of Environments
Parameters Device
(Eg: Ranorex)
Xamarin Mobile
Test Cloud
Perfecto Mobile
Test Cloud
Device Usage Manual,
Automation
Automation Manual, Automation
Integration with
Legacy
Application
Yes No No
Cross platform
Automation
Yes Yes Yes
Devices &
platform
availability
Need to
purchase the
devices
Available in cloud
environment
Available in cloud
environment
Maintenance Need to set lab
environment
Hosted Hosted

17. Comparison Analysis of Environment - Cost Price
Parameters Device
(Eg: Ranorex)
Xamarin Mobile
Test Cloud
Perfecto Mobile
Test Cloud
Price of iOS
devices
Standard devices
(3-4 devices) - On
average $500 to
$800 each devices
Can choose any device
and any OS version.
•$99 / Month, 1 device
hour per day (1
concurrent device)
•$379/ Month 5 device
hours per day (3
concurrent devices)
•$799 /Month 10 device
hours per day (5
concurrent devices)
Can choose any device
and any OS version
•$99 per month/user
for basic for 5 hours.
•$299 per month/user
for advance for 20
hours.
Price of Android
devices
Standard devices
(10 devices) - On
average $500 to
$700 each devices.
Same as above.
https://www.xamarin.com/
test-cloud#pricing.
Same as above..
https://www.perfectomo
bile.com/plans-pricing.

18. Case Studies

19. Hybrid – In-house + Mobile Test Cloud

20. Key Takeaways

21. Author Biography
Shrinathacharya L M
Principal Quality Engineer, Allscripts
shrinathacharya.lm@allscripts.com
• Developer by profession | Automation tester by heart
| .NET programmer | Innovator
• Specialist in automation framework development
• 15+ years of experience in development, automation
(Web, Windows, Mobile applications), Innovation
• Submitted 12 innovative ideas at Allscripts related to
healthcare, automation. 2 ideas are in discussion with
patent committee to USPTO
• Speaker for ATAGTR-2017
• Published white paper in STC-2015, STC-2016
• Blog https://dotnetengineer.blog

22. Question and Answers

23. Thank You!!!