Cloud based Testing Mobile Apps

8,413 views

Published on

Session Presented at 2nd IndicThreads.com Conference On Software Quality held on 25-26 March 2011 in Pune, India. WEB: http://Q11.IndicThreads.com

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
8,413
On SlideShare
0
From Embeds
0
Number of Embeds
45
Actions
Shares
0
Downloads
400
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Cloud based Testing Mobile Apps

  1. 1. Cloud based Testing for Mobile Apps Dada Mote XORIANT Solutions Pvt. Ltd.
  2. 2. Agenda <ul><ul><li>Testing Mobile Apps </li></ul></ul><ul><ul><li>Limitations </li></ul></ul><ul><ul><li>Emerging Trends </li></ul></ul><ul><ul><li>Cloud Based Testing for Mobile Apps </li></ul></ul><ul><ul><li>Clouds types for Mobile Apps Testing </li></ul></ul><ul><ul><li>Features of Cloud based Testing </li></ul></ul><ul><ul><li>Test Planning and Best Practices </li></ul></ul><ul><ul><li>Future Scope –Cloud Automation Engagement </li></ul></ul>
  3. 3. Mobile-Smart Phones Requests
  4. 4. Introduction <ul><ul><li>Growth of Mobile Platforms </li></ul></ul><ul><ul><li>Growth of Vendors </li></ul></ul><ul><ul><li>Types of Mobile Apps </li></ul></ul><ul><ul><li>Biggest challenge: </li></ul></ul><ul><ul><ul><li>‘ How to Test?’ </li></ul></ul></ul>
  5. 5. Testing Pre-Installed Mobile Apps <ul><ul><li>Core data activities </li></ul></ul><ul><ul><li>Functionality & Usability </li></ul></ul><ul><ul><li>Automatic upgrades </li></ul></ul><ul><ul><li>Cannot be Un-installed </li></ul></ul><ul><ul><li>Testing on ‘Prototype device’ </li></ul></ul>
  6. 6. Testing Installable Mobile Apps <ul><ul><li>Downloading & Upgrading </li></ul></ul><ul><ul><li>Download through Wired / Wireless Media </li></ul></ul><ul><ul><ul><li>AppStore, Online-URL, Transfer via USB, BlueTooth, InfraRed </li></ul></ul></ul><ul><ul><li>Installation and Un-Installation </li></ul></ul><ul><ul><li>Platform Specific </li></ul></ul>
  7. 7. Testing Browser Based Mobile Apps <ul><ul><li>Supported Mobile Browsers </li></ul></ul><ul><ul><ul><li>Opera, Skyfire, Teashark, bolt, Blazer </li></ul></ul></ul><ul><ul><li>Accessibility and security </li></ul></ul><ul><ul><li>Availability scenarios </li></ul></ul><ul><ul><li>Real Location </li></ul></ul>
  8. 8. Testing Performance/Functionality <ul><ul><li>Various Network Strengths </li></ul></ul><ul><ul><li>Various Network Speeds </li></ul></ul><ul><ul><li>Various Network Types </li></ul></ul><ul><ul><ul><ul><li>2G, 3G & Wi-Fi </li></ul></ul></ul></ul>
  9. 9. Testing Performance/Functionality <ul><ul><li>Availability of Free Memory </li></ul></ul><ul><ul><li>Memory Usage Pattern </li></ul></ul><ul><ul><ul><li>Launched, Run, Exit, Run for long time </li></ul></ul></ul><ul><ul><ul><li>Memory Consumption Pattern (RAM) </li></ul></ul></ul><ul><ul><li>Multi-applications run while AUT is Run </li></ul></ul>
  10. 10. Testing Performance/Functionality <ul><ul><li>Continually Upgrading Devices & Apps </li></ul></ul><ul><ul><li>Backward Compatibility </li></ul></ul><ul><ul><li>MSP and Vendor Impact </li></ul></ul><ul><ul><li>Battery Consumption Pattern </li></ul></ul><ul><ul><ul><li>Various Battery Strengths </li></ul></ul></ul>
  11. 11. Testing Compatibility/Functionality <ul><ul><li>Various Input Modes </li></ul></ul><ul><ul><li>Different screen sizes and Resolutions </li></ul></ul><ul><ul><li>Various Interruptions while AUT is </li></ul></ul><ul><ul><ul><li>Launched, Run, Exit, Installed, Upgraded </li></ul></ul></ul>
  12. 12. Traditional Apps Testing- Simulators <ul><ul><li>Advantages </li></ul></ul><ul><ul><ul><li>Finding issues in early stage, </li></ul></ul></ul><ul><ul><ul><li>Non-availability of device </li></ul></ul></ul><ul><ul><li>Disadvantages </li></ul></ul><ul><ul><ul><li>Resemblance of the device </li></ul></ul></ul><ul><ul><ul><li>Test environment & i/o related issues </li></ul></ul></ul><ul><ul><ul><li>Actual end user scenarios </li></ul></ul></ul><ul><ul><ul><li>Network, location related scenarios </li></ul></ul></ul>
  13. 13. Mobile Apps Testing - Challenges <ul><ul><li>Testing is not straight forward </li></ul></ul><ul><ul><li>Simulators are not Reliable </li></ul></ul><ul><ul><li>Real Test Bed </li></ul></ul><ul><ul><ul><li>Real Devices </li></ul></ul></ul><ul><ul><ul><ul><li>Availability, Devices w/ limited resources, Versions </li></ul></ul></ul></ul><ul><ul><ul><li>Real Network </li></ul></ul></ul><ul><ul><ul><ul><li>Operators, Infrastructure, Location </li></ul></ul></ul></ul>
  14. 14. Requirement of Ideal Testing Platform <ul><ul><li>Easy access & Full control to many phones </li></ul></ul><ul><ul><li>Enable all types of Testing </li></ul></ul><ul><ul><li>Integrate with existing MDLC/MDF </li></ul></ul><ul><ul><li>Generate Reports Easily </li></ul></ul><ul><ul><li>Enhance Collaboration among distributed teams </li></ul></ul>
  15. 15. Emerging Trends <ul><ul><li>Advanced Testing Process </li></ul></ul><ul><ul><li>Automation Testing </li></ul></ul><ul><ul><ul><li>Mobinium, Robotium, QTP w/ M-Eux </li></ul></ul></ul><ul><ul><li>Out-Sourcing to Real Test Bed </li></ul></ul><ul><ul><ul><li>Beta Testing, Crowd-Sourced Testing </li></ul></ul></ul><ul><ul><li>Remote Real Devices </li></ul></ul><ul><ul><li>Cloud based Testing Approach </li></ul></ul>
  16. 16. General Cloud based Services <ul><ul><li>Features </li></ul></ul><ul><ul><ul><li>Pay as you use </li></ul></ul></ul><ul><ul><ul><li>Any service any time </li></ul></ul></ul><ul><ul><ul><li>Use of Virtualization </li></ul></ul></ul><ul><ul><ul><li>Resources Availability </li></ul></ul></ul><ul><ul><ul><li>Scale-up and Scale-down </li></ul></ul></ul><ul><ul><ul><li>Adopt changing conditions </li></ul></ul></ul>
  17. 17. General Cloud based Services- Types <ul><ul><li>Cloud Services </li></ul></ul><ul><ul><ul><li>SaaS, PaaS, IaaS, Taas </li></ul></ul></ul><ul><ul><li>Cloud Types </li></ul></ul><ul><ul><ul><li>Private Cloud </li></ul></ul></ul><ul><ul><ul><ul><li>Owned, Hosted, Dedicated </li></ul></ul></ul></ul><ul><ul><ul><li>Public Cloud </li></ul></ul></ul><ul><ul><ul><ul><li>Hosted, Shared </li></ul></ul></ul></ul>
  18. 18. Why Cloud based Approach for Mobile? <ul><ul><li>Real Test Bed </li></ul></ul><ul><ul><li>Dynamic mobile landscape </li></ul></ul><ul><ul><li>Comprehensive Testing </li></ul></ul><ul><ul><li>Efficient Testing </li></ul></ul><ul><ul><li>Compatibility </li></ul></ul><ul><ul><li>Service Quality across devices </li></ul></ul>
  19. 19. Cloud based Testing for Mobile Apps <ul><ul><li>Web based secure access </li></ul></ul><ul><ul><li>Control to Many Real/Actual Devices </li></ul></ul><ul><ul><li>Testing in Live Networks </li></ul></ul><ul><ul><li>Different Geo-locations globally </li></ul></ul>
  20. 20. Cloud based Testing for Mobile Apps <ul><ul><li>Control on Testing process </li></ul></ul><ul><ul><li>Agile Enterprises can control the Cloud to keep the Apps and services up-to-date with Newest Handsets </li></ul></ul><ul><ul><li>Huge Revenue opportunities w/ gain in the market value </li></ul></ul>
  21. 21. Mobile Cloud Overview <ul><ul><li>100% Web based S-a-a-S Platform </li></ul></ul><ul><ul><li>Holding the handset </li></ul></ul><ul><ul><li>Install Application from PC to Device </li></ul></ul><ul><ul><li>Send numbers to the device using keyboard </li></ul></ul><ul><ul><li>Simulate handset events in single click </li></ul></ul><ul><ul><li>Capture screenshots and videos </li></ul></ul>
  22. 23. M-Cloud Infra Elements <ul><ul><li>Sync Engine </li></ul></ul><ul><ul><li>Web2.0 Portal </li></ul></ul><ul><ul><li>Device Management </li></ul></ul><ul><ul><li>Data Adapters </li></ul></ul><ul><ul><li>Push Notifications </li></ul></ul><ul><ul><li>Aggregation </li></ul></ul>
  23. 24. M-Cloud Infra Elements <ul><ul><li>Rapid Development </li></ul></ul><ul><ul><li>Conflict Resolution </li></ul></ul><ul><ul><li>Core Apps </li></ul></ul><ul><ul><li>Privacy and Access </li></ul></ul><ul><ul><li>Scalability </li></ul></ul>
  24. 25. M-Cloud Connectivity
  25. 26. Specific Types of M-Cloud <ul><ul><li>Private M-Cloud </li></ul></ul><ul><ul><ul><li>Owned, Dedicated, Hosted </li></ul></ul></ul><ul><ul><li>Public M-Cloud </li></ul></ul><ul><ul><ul><li>Hosted, Shared </li></ul></ul></ul><ul><ul><li>Single Platform Cloud </li></ul></ul><ul><ul><li>Full Mobile Cloud </li></ul></ul><ul><ul><ul><li>Devices from All platforms </li></ul></ul></ul>
  26. 27. M-Cloud -Public Shared Devices <ul><ul><li>Book time slot for Specific Devices </li></ul></ul><ul><ul><li>Specify Mobile Networks, Geo-locations </li></ul></ul><ul><ul><li>Keep Updated the Test Plan </li></ul></ul><ul><ul><li>Complete testing activity within time </li></ul></ul><ul><ul><li>Security and Performance testing is crucial </li></ul></ul>
  27. 28. M-Cloud -Private Dedicated Devices <ul><ul><li>Secured Devices </li></ul></ul><ul><ul><li>Change/upgrade of devices within cloud </li></ul></ul><ul><ul><li>Pool of Devices is part of Test strategy </li></ul></ul><ul><ul><li>Network should be part of test strategy </li></ul></ul><ul><ul><li>Choose betn hosted and on-premise devices </li></ul></ul>
  28. 29. Services by M-Cloud Owner <ul><ul><li>Lab with Versions of devices </li></ul></ul><ul><ul><li>Setup Frameworks </li></ul></ul><ul><ul><li>Mobile Cloud Switch </li></ul></ul><ul><ul><li>Connection Utilities </li></ul></ul><ul><ul><li>Generate the Reports </li></ul></ul>
  29. 30. Features of M-Cloud <ul><ul><li>Highest level of Reliability </li></ul></ul><ul><ul><li>Device with Active Mobile plans </li></ul></ul><ul><ul><ul><li>Call, SMS, install apps, browse facility </li></ul></ul></ul><ul><ul><li>Availability of Latest & upcoming Devices </li></ul></ul><ul><ul><li>24x7 applications and performance monitoring </li></ul></ul><ul><ul><li>Reserve Devices whenever you need </li></ul></ul>
  30. 31. M-Cloud Future Scope
  31. 32. Best Practices - Test Planning <ul><ul><ul><li>Setup the Test Bed </li></ul></ul></ul><ul><ul><ul><ul><li>Identify the Resources on M-Cloud </li></ul></ul></ul></ul><ul><ul><ul><li>Identify Test Cases for M-Cloud </li></ul></ul></ul><ul><ul><ul><li>Identify Test Data Regulations in advance </li></ul></ul></ul><ul><ul><ul><li>Simulate the End User Experience </li></ul></ul></ul><ul><ul><ul><li>Consider the Response Times </li></ul></ul></ul><ul><ul><ul><li>Follow International Requirements </li></ul></ul></ul><ul><ul><ul><li>Identify Risk based scenarios </li></ul></ul></ul>
  32. 33. Best Practices – Test Execution <ul><ul><li>Select proper/specific M-Cloud </li></ul></ul><ul><ul><ul><li>Location, platform, Device dependent </li></ul></ul></ul><ul><ul><li>Connect to Device on M-Cloud and </li></ul></ul><ul><ul><li>Port the Apps on the Device </li></ul></ul><ul><ul><li>Identify applicable Testing types </li></ul></ul><ul><ul><li>Test across Multiple devices </li></ul></ul><ul><ul><li>Testing skills for Test engineers </li></ul></ul><ul><ul><li>Execute specific Tests related to </li></ul></ul><ul><ul><ul><li>Performance, Security, Accessibility, Availability </li></ul></ul></ul>
  33. 34. M-Cloud Implementation Challenges <ul><ul><li>Firewall Exceptions & Remote configurations </li></ul></ul><ul><ul><li>Application Tuning </li></ul></ul><ul><ul><li>Storage and Bandwidth cost </li></ul></ul><ul><ul><li>Cross Cloud Alignment bottlenecks </li></ul></ul><ul><ul><li>Failover Testing for disaster recovery </li></ul></ul><ul><ul><li>Elasticity and scalability- False positives </li></ul></ul><ul><ul><li>Security and performance issues </li></ul></ul>
  34. 35. Xoriant Services For Mobile Apps <ul><ul><li>Multiplatform Mobile Apps Development </li></ul></ul><ul><ul><li>Testing Framework for various platforms w/ M-Cloud services </li></ul></ul><ul><ul><li>Trained M-Cloud Mobile Apps Test Experts </li></ul></ul><ul><ul><li>Continuous Testing Improvement in M-Cloud Services </li></ul></ul>
  35. 36. THANK YOU! DADA MOTE [email_address] www.xoriant.com VISIT www.xoriant.com/mobile-applications.html TO RECEIVE A PROMOTIONADVERTISING CREDIT

×