Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Cloud based Testing Mobile Apps

8,600 views

Published on

Session Presented at 2nd IndicThreads.com Conference On Software Quality held on 25-26 March 2011 in Pune, India. WEB: http://Q11.IndicThreads.com

Published in: Technology
  • Be the first to comment

Cloud based Testing Mobile Apps

  1. 1. Cloud based Testing for Mobile Apps Dada Mote XORIANT Solutions Pvt. Ltd.
  2. 2. Agenda <ul><ul><li>Testing Mobile Apps </li></ul></ul><ul><ul><li>Limitations </li></ul></ul><ul><ul><li>Emerging Trends </li></ul></ul><ul><ul><li>Cloud Based Testing for Mobile Apps </li></ul></ul><ul><ul><li>Clouds types for Mobile Apps Testing </li></ul></ul><ul><ul><li>Features of Cloud based Testing </li></ul></ul><ul><ul><li>Test Planning and Best Practices </li></ul></ul><ul><ul><li>Future Scope –Cloud Automation Engagement </li></ul></ul>
  3. 3. Mobile-Smart Phones Requests
  4. 4. Introduction <ul><ul><li>Growth of Mobile Platforms </li></ul></ul><ul><ul><li>Growth of Vendors </li></ul></ul><ul><ul><li>Types of Mobile Apps </li></ul></ul><ul><ul><li>Biggest challenge: </li></ul></ul><ul><ul><ul><li>‘ How to Test?’ </li></ul></ul></ul>
  5. 5. Testing Pre-Installed Mobile Apps <ul><ul><li>Core data activities </li></ul></ul><ul><ul><li>Functionality & Usability </li></ul></ul><ul><ul><li>Automatic upgrades </li></ul></ul><ul><ul><li>Cannot be Un-installed </li></ul></ul><ul><ul><li>Testing on ‘Prototype device’ </li></ul></ul>
  6. 6. Testing Installable Mobile Apps <ul><ul><li>Downloading & Upgrading </li></ul></ul><ul><ul><li>Download through Wired / Wireless Media </li></ul></ul><ul><ul><ul><li>AppStore, Online-URL, Transfer via USB, BlueTooth, InfraRed </li></ul></ul></ul><ul><ul><li>Installation and Un-Installation </li></ul></ul><ul><ul><li>Platform Specific </li></ul></ul>
  7. 7. Testing Browser Based Mobile Apps <ul><ul><li>Supported Mobile Browsers </li></ul></ul><ul><ul><ul><li>Opera, Skyfire, Teashark, bolt, Blazer </li></ul></ul></ul><ul><ul><li>Accessibility and security </li></ul></ul><ul><ul><li>Availability scenarios </li></ul></ul><ul><ul><li>Real Location </li></ul></ul>
  8. 8. Testing Performance/Functionality <ul><ul><li>Various Network Strengths </li></ul></ul><ul><ul><li>Various Network Speeds </li></ul></ul><ul><ul><li>Various Network Types </li></ul></ul><ul><ul><ul><ul><li>2G, 3G & Wi-Fi </li></ul></ul></ul></ul>
  9. 9. Testing Performance/Functionality <ul><ul><li>Availability of Free Memory </li></ul></ul><ul><ul><li>Memory Usage Pattern </li></ul></ul><ul><ul><ul><li>Launched, Run, Exit, Run for long time </li></ul></ul></ul><ul><ul><ul><li>Memory Consumption Pattern (RAM) </li></ul></ul></ul><ul><ul><li>Multi-applications run while AUT is Run </li></ul></ul>
  10. 10. Testing Performance/Functionality <ul><ul><li>Continually Upgrading Devices & Apps </li></ul></ul><ul><ul><li>Backward Compatibility </li></ul></ul><ul><ul><li>MSP and Vendor Impact </li></ul></ul><ul><ul><li>Battery Consumption Pattern </li></ul></ul><ul><ul><ul><li>Various Battery Strengths </li></ul></ul></ul>
  11. 11. Testing Compatibility/Functionality <ul><ul><li>Various Input Modes </li></ul></ul><ul><ul><li>Different screen sizes and Resolutions </li></ul></ul><ul><ul><li>Various Interruptions while AUT is </li></ul></ul><ul><ul><ul><li>Launched, Run, Exit, Installed, Upgraded </li></ul></ul></ul>
  12. 12. Traditional Apps Testing- Simulators <ul><ul><li>Advantages </li></ul></ul><ul><ul><ul><li>Finding issues in early stage, </li></ul></ul></ul><ul><ul><ul><li>Non-availability of device </li></ul></ul></ul><ul><ul><li>Disadvantages </li></ul></ul><ul><ul><ul><li>Resemblance of the device </li></ul></ul></ul><ul><ul><ul><li>Test environment & i/o related issues </li></ul></ul></ul><ul><ul><ul><li>Actual end user scenarios </li></ul></ul></ul><ul><ul><ul><li>Network, location related scenarios </li></ul></ul></ul>
  13. 13. Mobile Apps Testing - Challenges <ul><ul><li>Testing is not straight forward </li></ul></ul><ul><ul><li>Simulators are not Reliable </li></ul></ul><ul><ul><li>Real Test Bed </li></ul></ul><ul><ul><ul><li>Real Devices </li></ul></ul></ul><ul><ul><ul><ul><li>Availability, Devices w/ limited resources, Versions </li></ul></ul></ul></ul><ul><ul><ul><li>Real Network </li></ul></ul></ul><ul><ul><ul><ul><li>Operators, Infrastructure, Location </li></ul></ul></ul></ul>
  14. 14. Requirement of Ideal Testing Platform <ul><ul><li>Easy access & Full control to many phones </li></ul></ul><ul><ul><li>Enable all types of Testing </li></ul></ul><ul><ul><li>Integrate with existing MDLC/MDF </li></ul></ul><ul><ul><li>Generate Reports Easily </li></ul></ul><ul><ul><li>Enhance Collaboration among distributed teams </li></ul></ul>
  15. 15. Emerging Trends <ul><ul><li>Advanced Testing Process </li></ul></ul><ul><ul><li>Automation Testing </li></ul></ul><ul><ul><ul><li>Mobinium, Robotium, QTP w/ M-Eux </li></ul></ul></ul><ul><ul><li>Out-Sourcing to Real Test Bed </li></ul></ul><ul><ul><ul><li>Beta Testing, Crowd-Sourced Testing </li></ul></ul></ul><ul><ul><li>Remote Real Devices </li></ul></ul><ul><ul><li>Cloud based Testing Approach </li></ul></ul>
  16. 16. General Cloud based Services <ul><ul><li>Features </li></ul></ul><ul><ul><ul><li>Pay as you use </li></ul></ul></ul><ul><ul><ul><li>Any service any time </li></ul></ul></ul><ul><ul><ul><li>Use of Virtualization </li></ul></ul></ul><ul><ul><ul><li>Resources Availability </li></ul></ul></ul><ul><ul><ul><li>Scale-up and Scale-down </li></ul></ul></ul><ul><ul><ul><li>Adopt changing conditions </li></ul></ul></ul>
  17. 17. General Cloud based Services- Types <ul><ul><li>Cloud Services </li></ul></ul><ul><ul><ul><li>SaaS, PaaS, IaaS, Taas </li></ul></ul></ul><ul><ul><li>Cloud Types </li></ul></ul><ul><ul><ul><li>Private Cloud </li></ul></ul></ul><ul><ul><ul><ul><li>Owned, Hosted, Dedicated </li></ul></ul></ul></ul><ul><ul><ul><li>Public Cloud </li></ul></ul></ul><ul><ul><ul><ul><li>Hosted, Shared </li></ul></ul></ul></ul>
  18. 18. Why Cloud based Approach for Mobile? <ul><ul><li>Real Test Bed </li></ul></ul><ul><ul><li>Dynamic mobile landscape </li></ul></ul><ul><ul><li>Comprehensive Testing </li></ul></ul><ul><ul><li>Efficient Testing </li></ul></ul><ul><ul><li>Compatibility </li></ul></ul><ul><ul><li>Service Quality across devices </li></ul></ul>
  19. 19. Cloud based Testing for Mobile Apps <ul><ul><li>Web based secure access </li></ul></ul><ul><ul><li>Control to Many Real/Actual Devices </li></ul></ul><ul><ul><li>Testing in Live Networks </li></ul></ul><ul><ul><li>Different Geo-locations globally </li></ul></ul>
  20. 20. Cloud based Testing for Mobile Apps <ul><ul><li>Control on Testing process </li></ul></ul><ul><ul><li>Agile Enterprises can control the Cloud to keep the Apps and services up-to-date with Newest Handsets </li></ul></ul><ul><ul><li>Huge Revenue opportunities w/ gain in the market value </li></ul></ul>
  21. 21. Mobile Cloud Overview <ul><ul><li>100% Web based S-a-a-S Platform </li></ul></ul><ul><ul><li>Holding the handset </li></ul></ul><ul><ul><li>Install Application from PC to Device </li></ul></ul><ul><ul><li>Send numbers to the device using keyboard </li></ul></ul><ul><ul><li>Simulate handset events in single click </li></ul></ul><ul><ul><li>Capture screenshots and videos </li></ul></ul>
  22. 23. M-Cloud Infra Elements <ul><ul><li>Sync Engine </li></ul></ul><ul><ul><li>Web2.0 Portal </li></ul></ul><ul><ul><li>Device Management </li></ul></ul><ul><ul><li>Data Adapters </li></ul></ul><ul><ul><li>Push Notifications </li></ul></ul><ul><ul><li>Aggregation </li></ul></ul>
  23. 24. M-Cloud Infra Elements <ul><ul><li>Rapid Development </li></ul></ul><ul><ul><li>Conflict Resolution </li></ul></ul><ul><ul><li>Core Apps </li></ul></ul><ul><ul><li>Privacy and Access </li></ul></ul><ul><ul><li>Scalability </li></ul></ul>
  24. 25. M-Cloud Connectivity
  25. 26. Specific Types of M-Cloud <ul><ul><li>Private M-Cloud </li></ul></ul><ul><ul><ul><li>Owned, Dedicated, Hosted </li></ul></ul></ul><ul><ul><li>Public M-Cloud </li></ul></ul><ul><ul><ul><li>Hosted, Shared </li></ul></ul></ul><ul><ul><li>Single Platform Cloud </li></ul></ul><ul><ul><li>Full Mobile Cloud </li></ul></ul><ul><ul><ul><li>Devices from All platforms </li></ul></ul></ul>
  26. 27. M-Cloud -Public Shared Devices <ul><ul><li>Book time slot for Specific Devices </li></ul></ul><ul><ul><li>Specify Mobile Networks, Geo-locations </li></ul></ul><ul><ul><li>Keep Updated the Test Plan </li></ul></ul><ul><ul><li>Complete testing activity within time </li></ul></ul><ul><ul><li>Security and Performance testing is crucial </li></ul></ul>
  27. 28. M-Cloud -Private Dedicated Devices <ul><ul><li>Secured Devices </li></ul></ul><ul><ul><li>Change/upgrade of devices within cloud </li></ul></ul><ul><ul><li>Pool of Devices is part of Test strategy </li></ul></ul><ul><ul><li>Network should be part of test strategy </li></ul></ul><ul><ul><li>Choose betn hosted and on-premise devices </li></ul></ul>
  28. 29. Services by M-Cloud Owner <ul><ul><li>Lab with Versions of devices </li></ul></ul><ul><ul><li>Setup Frameworks </li></ul></ul><ul><ul><li>Mobile Cloud Switch </li></ul></ul><ul><ul><li>Connection Utilities </li></ul></ul><ul><ul><li>Generate the Reports </li></ul></ul>
  29. 30. Features of M-Cloud <ul><ul><li>Highest level of Reliability </li></ul></ul><ul><ul><li>Device with Active Mobile plans </li></ul></ul><ul><ul><ul><li>Call, SMS, install apps, browse facility </li></ul></ul></ul><ul><ul><li>Availability of Latest & upcoming Devices </li></ul></ul><ul><ul><li>24x7 applications and performance monitoring </li></ul></ul><ul><ul><li>Reserve Devices whenever you need </li></ul></ul>
  30. 31. M-Cloud Future Scope
  31. 32. Best Practices - Test Planning <ul><ul><ul><li>Setup the Test Bed </li></ul></ul></ul><ul><ul><ul><ul><li>Identify the Resources on M-Cloud </li></ul></ul></ul></ul><ul><ul><ul><li>Identify Test Cases for M-Cloud </li></ul></ul></ul><ul><ul><ul><li>Identify Test Data Regulations in advance </li></ul></ul></ul><ul><ul><ul><li>Simulate the End User Experience </li></ul></ul></ul><ul><ul><ul><li>Consider the Response Times </li></ul></ul></ul><ul><ul><ul><li>Follow International Requirements </li></ul></ul></ul><ul><ul><ul><li>Identify Risk based scenarios </li></ul></ul></ul>
  32. 33. Best Practices – Test Execution <ul><ul><li>Select proper/specific M-Cloud </li></ul></ul><ul><ul><ul><li>Location, platform, Device dependent </li></ul></ul></ul><ul><ul><li>Connect to Device on M-Cloud and </li></ul></ul><ul><ul><li>Port the Apps on the Device </li></ul></ul><ul><ul><li>Identify applicable Testing types </li></ul></ul><ul><ul><li>Test across Multiple devices </li></ul></ul><ul><ul><li>Testing skills for Test engineers </li></ul></ul><ul><ul><li>Execute specific Tests related to </li></ul></ul><ul><ul><ul><li>Performance, Security, Accessibility, Availability </li></ul></ul></ul>
  33. 34. M-Cloud Implementation Challenges <ul><ul><li>Firewall Exceptions & Remote configurations </li></ul></ul><ul><ul><li>Application Tuning </li></ul></ul><ul><ul><li>Storage and Bandwidth cost </li></ul></ul><ul><ul><li>Cross Cloud Alignment bottlenecks </li></ul></ul><ul><ul><li>Failover Testing for disaster recovery </li></ul></ul><ul><ul><li>Elasticity and scalability- False positives </li></ul></ul><ul><ul><li>Security and performance issues </li></ul></ul>
  34. 35. Xoriant Services For Mobile Apps <ul><ul><li>Multiplatform Mobile Apps Development </li></ul></ul><ul><ul><li>Testing Framework for various platforms w/ M-Cloud services </li></ul></ul><ul><ul><li>Trained M-Cloud Mobile Apps Test Experts </li></ul></ul><ul><ul><li>Continuous Testing Improvement in M-Cloud Services </li></ul></ul>
  35. 36. THANK YOU! DADA MOTE [email_address] www.xoriant.com VISIT www.xoriant.com/mobile-applications.html TO RECEIVE A PROMOTIONADVERTISING CREDIT

×