Challenges and solutions in mobile and cloud computing testing - ZANEC

Challenges and Solutions in Testing Modern Software Paradigms like Mobile and Cloud Computing Satya Kaliki Chief Technology Officer satya.kaliki@zanec.com

Who am I?  CTO and Co-founder of ZANEC Technologies  Interim CTO at an Insurance Company owned by Harvard Medical Institutions  Passionate about Mobile and Cloud Computing, Semantic Web, SOA  13 Years of industry experience 2

Agenda  Mobile Computing  Challenges  Factors to consider in your test strategy  Case Study – Search App for iPhone, Android, Windows Phone 7  Cloud Computing  Challenges  Factors to consider in your test strategy  Case study - Air Cargo Supply Chain  Q&A 3

CHALLENGES

Locations Carriers Test case complexity Devices Features 5

Mobile Apps vs. Traditional Apps vs. 6

Native Apps vs. Mobile Browser App Courtesy: Global Intelligence Alliance 7

Location and Localization 8

Field Testing – Signal strength variations 9

THINGS TO CONSIDER IN YOUR TEST STRATEGY

Adopt a Use Real crowdsourcing Devices in strategy the Field Use Real Devices in the Lab Use Emulators in the Lab App Maturity and Testing Progress 11

Lowest Common Denominator and choose based on market share 12

13 Usability

Navigation 14

Varied end user expectations 15

Background noise Field Testing 16

Field Testing - Multitasking 17

Android Emulator Commands  emulator – netdelay gprs [Emulates a GPRS, means min of 150 max of 550 ms]  emulator – netspeed gprs [Transfer rates of a gprs network]  emulator – netspeed 14.4 14.4 [Exact transfer rate for up and down] Use Emulators to simulate network variations 18

CASE STUDY Search App for iPhone, Android, Windows 7 Mobile

App Overview  The Search App provides secure, real-time access to documents, structured data and messages - all from a single click  Can connect to wide variety of sources including PC’s local hard drives, Popular social Networking sites, Internet Search engines, Internet Email Providers, MS SharePoint, MS Exchange Server  Can distinguish variety of file types including MS Office  Currently the App is targeting two broad categories of Users  Personal Use - Social Networking, SMS, Contacts, Media, Photos  Business Users - Email, Exchange, Contacts etc 20

Test Strategy  iPhone as first Platform and iOS Versions 4.1 (3G, 3GS and 4)  Extended to Android in Phase 2  Windows Phone 7 is Phase 3  Test Approach  Emulators in the Lab  Real Devices in the Lab  Real Devices in the Field  Customer’s priority focus is UK 21

Test Strategy  Scope of Testing  Usability  Navigation  Intuitiveness  User Personas  Varied demographics  Mobile Literacy not considered for this App  Performance  Multi-tasking  Varying signal and network parameters 22

Challenges in Cloud Computing Testing

Introduction  Cloud Computing presents significant benefits to organizations that adopt this paradigm:  Reduced Cost  Improved Flexibility  Significant Mobility  Increased Service Focus  Testing in a Cloud Computing environment must address key risks associated with migrating to Cloud  In the absence of a comprehensive Test Strategy realization of the promise remains a dream 24

Security Location Reliability Independence Cloud Governance Computing Manageability Risks Resilience & SLAs Self-healing Multi-tenancy 25

Test teams must understand these models Consumers Software Software as a Service (SaaS) Application Platforms Platform as a Service (PaaS) Operating Systems Virutalisation Infrastructure as a Service (IaaS) Physical Servers Networks & Firewalls Data Centers and Power

THINGS TO CONSIDER IN YOUR TEST STRATEGY

Choose a Test Environment On-Premise vs. On-Cloud vs. 28

Must include tests for each of the Cloud Computing risks Don’t forget to include the App Functional Testing! 29

Evaluate App specific Audit, Compliance security best practices and Governance Vulnerability Analysis Assess Data Security 30

Performance Testing 31

Multi-tenancy and data security 32

Test for Reliability 33

Test for Maintainability and Manageability 34

Estimate optimal Service Levels and test whether you are able to meet them 35

Checklist for assessing Go Live Readiness 36

CASE STUDY Air Cargo Supply Chain

App Overview  The App provides secure, real-time access to shipment documents and role based view of consignment location  One-Time Data Entry  End to end, role based visibility to all stakeholders (Ground handlers, General Sales Agents, Airlines, Customs and Freight Forwarders)  Offers great benefits to stakeholders  Increased reliability on consignment’s current status  Reduced costs  Improved Accuracy and Quality  Enormous Scalability 38

Test Strategy  Infrastructure as a Service model  On Cloud Test Environment  Security model best practices  Multi-tenant  Multi-tiered (Same document, different view based on organisation, role and level within)  Need to perform well at 1 million consignments being shipped concurrently 39

Test Strategy  Scope of Testing  Functional  Usability  Various levels of Security  Performance  Manageability  Recovery  Operational readiness 40

Questions?

Challenges and solutions in mobile and cloud computing testing - ZANEC

by Satya Kaliki

Accessibility

Categories

Upload Details

Usage Rights

Statistics

Challenges and solutions in mobile and cloud computing testing - ZANEC Presentation Transcript