Mobile Device Quality Management Pwpt 12 7 2011


Published on

A Overview and Framework for Quality and Governance

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • * Mobile Computing at Federal Agencies: Frequency, Functionality, & Security; A Candid Survey of Federal Executives and Employees (2011)
  • (*) This has been changed from “Mobile Device-Customer Relationship Management.” We’re still looking for the appropriate title for this full life cycle MDQM service / solution….
  • Performance testing will be utilized to measure mobile network connectivity with results to include but not be limited to, dropped calls, fastest data speeds, fastest text messaging service, or other areas which may reflect a disruption to the expected mobile device communication actions
  • * This area was previously titled “Mobile Device-Customer Service Management.” We’re still looking for the right tag for this full-life cycle MDQM service / solution.
  • * Above MDQMS stages are derived from June & July 2011 workshops held in conjunction with the Mobile Computing for Federal Agencies task force. Input in reference to the above stages was received from Verizon Wireless, AT&T Mobility Solutions, Motorola Mobility (all members of the task force), and from the public sector, representatives from Government Services Administration (GSA) * Above MDQMS Stages Derived From Government Services Administration (GSA), Verizon, & Motorola Workshops (June / July 2011)
  • Mobile Device Quality Management Pwpt 12 7 2011

    1. 1. Mobile Device Quality Management <ul><li>A OVERVIEW AND FRAMEWORK FOR QUALITY AND GOVERNANCE </li></ul><ul><ul><ul><ul><li>Bob Kustudik, Compuware </li></ul></ul></ul></ul><ul><ul><ul><ul><li>[email_address] </li></ul></ul></ul></ul>
    2. 2. Mobile Device Computing Explosion <ul><li>The mobile computing explosion of the past 4-5 years reveal some interesting statistics </li></ul><ul><li>Gartner industry findings (from December 2010) reflect that worldwide sales of mobile phone devices grew 35% from the third quarter of 2009, and smartphone sales grew 96 % from the third quarter of 2009 (and smartphones accounted for 20% of overall mobile phone sales in the third quarter of 2010) </li></ul><ul><li>Recent (May 2011) statistics provided by the Yankee Group indicate that by 2013, the estimated number of mobile device users will be at 160 million, the estimated number of mobile application downloads will be at 7 billion, and the projected revenue from mobile device application downloads will be $4.2 billion </li></ul><ul><li>Current industry trends indicate that mobile devices (more specifically, tablets) will soon overtake laptops as standard-issue for government agencies and many businesses </li></ul>
    3. 3. Mobile Device Computing Challenges <ul><li>Along with the rapid growth of mobile computing, and the fact that </li></ul><ul><li>mobile devices are often mission critical to an organization, there are </li></ul><ul><li>pressing challenges and concerns. Industry respondents to the Yankee </li></ul><ul><li>and Gartner Groups have identified some current challenges </li></ul><ul><li>(as specific to MDQM) as reflected below: </li></ul><ul><li>Lack of consistent standards in development and quality management / testing </li></ul><ul><li>Inconsistent customer focused “Full-Life Cycle Mobility Management (including ” from providers </li></ul><ul><li>Managing structure and protocol for different development and quality management mobile operating system environments </li></ul><ul><li>Quality management challenges presented by increasing trend of more and more organizations adopting BYOD (Bring Your Own Device) policies to their mobile computing initiatives </li></ul>
    4. 4. Mobile Device Statistics from Government Survey* <ul><li>A recent survey from the staff of Mobile Computing at Federal Agencies </li></ul><ul><li>reflected the following results. Nearly one-third of government respondents </li></ul><ul><li>indicated displeasure with their mobile devices and applications. The mobile </li></ul><ul><li>application frustrations within this government survey were further broken down </li></ul><ul><li>as follows: </li></ul>
    5. 5. Mobility Device Quality Management <ul><li>Despite the tremendous surge in the mobile computing arena, there is </li></ul><ul><li>no existing guide, framework or methodology on how best to test the </li></ul><ul><li>particular complexities of mobile applications and mobile devices. For </li></ul><ul><li>simplicity, we have divided mobile device testing quality management </li></ul><ul><li>into five main areas: </li></ul><ul><li>User Interface Testing </li></ul><ul><li>External Factor Testing </li></ul><ul><li>Stress and Performance Testing </li></ul><ul><li>Security Testing </li></ul><ul><li>Mobile Device Quality Management Solutions(*) </li></ul>
    6. 6. User Interface Testing <ul><li>Logically, the first area to address within the scope of the mobile device </li></ul><ul><li>testing initiative is the user interface capabilities. Some of the basic </li></ul><ul><li>areas addressed in this phase of the device testing are: </li></ul><ul><li>Screen Orientation / Resolution </li></ul><ul><li>Touchscreens </li></ul><ul><li>Trackballs, Trackwheels, and Touchpads </li></ul><ul><li>Soft Keyboards </li></ul><ul><li>Hard Keys </li></ul><ul><li>Device Shortcuts </li></ul>
    7. 7. External Factor Testing <ul><li>There are numerous factors that are external to the developed </li></ul><ul><li>mobile application itself that are inherent (and critical) to how the </li></ul><ul><li>mobile device actually performs. Quality management will assess </li></ul><ul><li>the how such factors influence the performance of the application, and </li></ul><ul><li>will include, but not be limited to: </li></ul><ul><li>Network Connections (including 4G LTE,4G, 3G, 2G, Wi-Fi connectivity protocol) </li></ul><ul><li>SD Card Interactions </li></ul><ul><li>Phone Calls and Other Interruptions </li></ul><ul><li>Device Options </li></ul>
    8. 8. Performance and Stress Testing <ul><li>Mobile applications and devices are expected to hold up and function </li></ul><ul><li>as designed, and as customers expect. Users of mobile devices will </li></ul><ul><li>expect applications to perform under high traffic conditions with a </li></ul><ul><li>multitude of applications running. </li></ul><ul><li>Accordingly, stress and performance testing is a necessity for quality </li></ul><ul><li>management to discover exceptions, hangs, and deadlocks that may </li></ul><ul><li>go unnoticed during functional and user interface testing initiatives. </li></ul><ul><li>There are a multitude of performance management and stress testing </li></ul><ul><li>tools that can be utilized to satisfy this important aspect of mobile </li></ul><ul><li>device quality management. Compuware’s Gomez is a highly </li></ul><ul><li>recognized solution for such testing. </li></ul>
    9. 9. Mobile Computing Trends <ul><li>Most mobile carriers now advertise their 4G networks (in </li></ul><ul><li>telecommunications, 4G is the fourth generation of cellular </li></ul><ul><li>wireless standards). As reflected in the graph below, 4G lines will </li></ul><ul><li>Exceed 500 million globally by 2015 (Yankee Group, July 2011) </li></ul>
    10. 10. Security Testing <ul><li>Corresponding with the business, consumer, and government </li></ul><ul><li>explosion in the mobile application – device environment; ongoing </li></ul><ul><li>security issues and threats need to be continually addressed. </li></ul><ul><li>Appropriate security testing will cover, but not be limited to: </li></ul><ul><li>Web Applications </li></ul><ul><li>Sensitive Applications </li></ul><ul><li>Application and Device Permissions </li></ul><ul><li>Application – Device Compatibility and Compliance </li></ul>
    11. 11. Mobile Device Quality Management Solutions* <ul><li>An important element in ensuring that the desired solution to the full- </li></ul><ul><li>life cycle quality management requirement is effectively carried out, is </li></ul><ul><li>the role of Mobile Device Quality Management Solutions (MDQMS) </li></ul><ul><li>representative. The MDQMS representative should be prepared to </li></ul><ul><li>work closely with the client and provide quality management expertise </li></ul><ul><li>to the entire mobile computing initiative from the design through the </li></ul><ul><li>deployment stages, and may also include: </li></ul><ul><li>MDQM Assessment </li></ul><ul><li>Recommendations for tool utilization, including device simulators, </li></ul><ul><li>emulators, and application performance – stress testing tools </li></ul>
    12. 12. MDQMS Stages * Mobile Computing Design Stage Mobile Computing Build Stage Mobile Computing Test Stage Mobile Computing Deployment Stage Mobile Computing Requirements Workshop Environment & Device Assessment Workshop Wireless Configuration Functional Testing (lab) User Interface (lab) Mobile Computing Product Migration Performance Gap Analysis Customized Mobile Computing Development Performance & Stress Testing (lab) Security Testing (lab) Device Testing (lab) Mobile Computing Technical Verification Mobile Computing Solution Design External Factors – Connectivity Testing (lab & field) Pilot Testing (field)
    13. 13. MDQM Summary <ul><li>In a brief summary, quality management should plan their testing </li></ul><ul><li>efforts of the mobile computing application / device in terms (and </li></ul><ul><li>scope) beyond the standard functional testing, as it is very important </li></ul><ul><li>to consider the previously addressed areas and how they differ from </li></ul><ul><li>desktop or regular web applications. </li></ul><ul><li>The test areas described in this overview reflect a baseline for </li></ul><ul><li>projected initiatives and provide a framework to build (and expand </li></ul><ul><li>upon) a robust and comprehensive mobile device quality management </li></ul><ul><li>program. </li></ul><ul><li>It’s important to remember that many government agencies and </li></ul><ul><li>businesses now follow the “A3”requirements when it comes to mobile </li></ul><ul><li>applications; it works “ anytime , anywhere , and on any device.” </li></ul><ul><li>Organizations operating within the mobile computing environment </li></ul><ul><li>should plan accordingly. </li></ul>
    14. 14. References <ul><li>Documentation utilized in preparing this presentation include: </li></ul><ul><li>Mobile Computing at Federal Agencies; A Report on Frequency, Functionality, & Security (2011) </li></ul><ul><li>National Institute of Standards and Technology, SP 800-124, Guidelines on Cell Phone and PDA Quality Management and Security </li></ul><ul><li>Verizon, AT&T, and Motorola Quality Management Solutions </li></ul><ul><li>The Yankee Group </li></ul><ul><li>BlackBerry and Android User Interface Guidelines </li></ul><ul><li>Gartner Business Communications </li></ul>
    15. 15. Questions or Comments <ul><li>Questions, comments, or for more information regarding this presentation should be directed to: </li></ul><ul><ul><ul><ul><ul><li>[email_address] </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>(630) 285-8560 </li></ul></ul></ul></ul></ul><ul><ul><li> or </li></ul></ul><ul><ul><ul><ul><li> [email_address] </li></ul></ul></ul></ul><ul><ul><ul><ul><li>(630) 285-8560 </li></ul></ul></ul></ul>