Uploaded byPerfecto by Perforce
Introducing Continuous Quality
Perfecto Mobile is a leader in mobile app quality, enabling companies to achieve continuous quality and rapid app releases without sacrificing quality. The shift towards faster mobile innovation drives the necessity for agile methods in software development, leading to increased app release frequencies and the implementation of continuous integration practices. Essential to this process is automation and a modern testing lab capable of supporting frequent updates while ensuring performance and consistency.
More Related Content
Similar to Introducing Continuous Quality
Introducing Continuous Quality
- 1.
- 2. THE LEADER INMOBILE APP QUALITY PERFECTO MOBILE AT A GLANCE SETTING THE BAR FOR MARKET SUCCESS DOMINANT LEADER & VISIONARY INDUSTRY STANDOUT AND RISING STAR Perfecto helps companies implement continuous quality by accelerating app release velocity without compromising quality. “Perfecto Mobile currently has the the strongest 3rd party position in the market” – Thomas Murphy Frost and Sullivan Customer Value Leadership Award – Mobile Application Testing, Global, 2013
- 3. Why Faster? Paceof Innovation Insatiable user demand Business Transformation
- 4. What Users Want… Flawless and Immediate Execution creates Engagement
- 5. Mobile Innovators areTransforming Enterprises Driving Customer Engagement Strengthening Brand Beat competition through innovation 53% of Business leaders expect mobile technologies and apps will drive business innovation over the next three years. Source: Harvard Business Review
- 6. Mobile Strategy atUnited Airlines Engagement Driven Innovation Execution Business Outcome Mobile Contributes $25M 2013 Investor Report 41 updates since 2011 introduction
- 7. Marriott is StrengtheningCustomer Engagement Engagement Driven Innovation Business Outcome $1.3B Mobile is 10% of total Marriott Revenue By identifying contextual moments that matter
- 8. Modern App Lifecycle= Frequent & Fast Releases “Traditional Development Practices Will Fail for Mobile Apps” April 2014 Accelerating app release cycles create fundamental challenges There is no more time to lose over escaped defects and technical debt Quality must be continuous Typical app releases per year 2010 4 per year 2015 36 per year
- 9. Time to Marketis Driving SDLC Transformation …. Right Now 93% of Enterprises have begun the shift to agile methods WORLD QUALITY REPORT 2014-2015 • Quality is shifting left • Iterative methods and Continuous integration are merging Dev and Test activities • Emulators are moving toward extinction • Performance testing is starting earlier • There is an emerging DevOps culture Automation is the fundamental enabler
- 10. Poll Question: RESULTS Which velocity blockers are you experiencing? (Indicate all 35% 28% 34% 44% 52% 0% 10% 20% 30% 40% 50% 60% Manual testing Lab readiness/availability Late in-cycle feedback Non-functional testing starts late Too many non-reproducible defects that apply)
- 11. Velocity and ReleaseFrequency Challenges Coverage - end user flows, devices, OS Stability and consistency of test environment between cycles Collaboration across teams / locations Fast Feedback
- 13. Key to Speed: Automating Development & Testing Processes Service Virtualization Automation that Works Component Library | Parallel Execution |App & System Level Control Build Sanity “Always Ready” Lab Device-as-a-Service | Real Devices Carrier Connected | Globally Distributed Non-Functional Test • Real world condition testing • Performance testing • Production readiness Continuous Integration
- 14. Achieving Continuous QualityRequires a Modern Lab 14 Enterprise Grade • Secure • Available • Consistent • Device SLA Global & Collaborative • In-market devices • Remote access • 12 Global Data Centers • Share devices with offshore Teams Hybrid • Devices on premise and in the Cloud Real End User Conditions • Real Devices • Real Networks • “Wind Tunnel” - Real World Device and App Conditions Open and Integrated • MobileCloud API • Selenium & Eclipse • Jenkins • Many others… Elastic • 100s of Devices On-Demand When Needed • Latest devices The Continuous Quality Lab
- 15. Ready to Pluginto YOUR Environment Existing remote web driver clients Device Cloud Visual DOM Device Grid Remote web driver server REST API remote web driver perfecto extensions Cloud Auto Remote Interactive access & Script Recorders
- 16. The Right Services Manual Test Test Automation App Monitoring Performance
- 17. Recap – Mobileis Driving Business innovation Faster Release Frequency Continuous Quality Imperative
- 18. Thank You Learnmore at perfectomobile.com/continuous-quality-lab
Editor's Notes
- #5 There’s a but, High user expectations. As complicated as the mobile content delivery chain complete with both back end and third party services / ad networks or the fact that the quality of user network conditions vary widely – users expect apps to work, and work flawlessly with near immediate responsiveness. Mobile has nearly eliminated any switching cost between apps. Users encountering a negative experience are highly likely shift their attention and engagement to a competitive offering. This also extends to vendors who fail to leverage the very latest mobile innovation including the internet of things trend. Keep up or risk being abandoned. DAUs/MAUs (ratio of daily active users to monthly active users) – What percentage of your users are visiting every day? You can also break this down and see what percentage of your users are visiting 8 times a month, 4 times a month, etc.Average visits per month – How often does each user open the app? Some app managers look at the inverse of this which is visit interval or what is the average time between visits. You can look at it either way. The insight is similar.Time in app – How long is the duration of each visit?Screen views – How many screens is each user visiting?Retention – What percent of new installs are visiting the next day, the day after that, the day after that, etc.? The most common metric for this is 30/60/90 day retention (how many users are still visiting 30, 60, and 90 days after the first install).
- #6 It’s clear, SOME enterprises are realizing material top line revenue growth driven by investing in quality mobile experiences. For example, numerous banks are already projecting when mobile will become the primary customer engagement point. Retailers Source: Harvard Business Review: Business Transformation and the CIO Role https://enterprisersproject.com/sites/default/files/Business%20Transformation%20and%20the%20CIO%20Role.pdf
- #8 Revenue data – source: Marriott, Security Analyst Meeting Transcript, September 8, 2014 Marriott seeks mobile contextual moments that matter (http://www.mobilecommercedaily.com/marriott-seeks-mobile-contextual-moments-that-matter) Marriot Mcommerce Conference May 2014 Marriott is analyzing target customers to understand how extend engagement with customers by analyzing which contextual moments can most effectively be address via. The commitment to become a mobile first company are driving top line outcomes – 10% of revenue is direwctly attributable to mobnile
- #12 This is our point of view of the challenges
- #14 Build #1 – Test automation pyramid, developed by Mike Cohn, 2009. Describes a test strategy that suggest the greatest investment should be in testing the smallest units of code. From there the next investment should be on system or integration testing. And the smallest investment made at the most brittle application layer the UI #2 – While this is an excellent investment strategy, the objective should be on building “automation that actually works.” Automation should be viewed and treated as code and not a second class citizen. Therefore, reuse should be planned for in day one with thoughts of building a framework or component library at the forefront of each automation team’s agenda. Recognizing the uniquely mobile aspects of apps, effective test automation will require control of both the system (or for iOS springboard) level control AND in-app control. Combined these will enable coverage. #3 The Always Ready Lab – automation alone is not good enough for mobile. Mobile app quality requires access to a test environment that is nearly a production replica without burdening devtest teams the burden of managing 20, 30, 5o devices in house or worse in numerous difference locations. #4 CI Nearly every app team is striving to accelerate and CI is emerging as a leading solution. Automation is cornerstone for these strategies to become effective – Automating the process and testing along with an always ready lab provides teams with fast feedback #5 Service virtualization is being rapidly adopted by team struggling due to lacking access to services provided by systems of record or third party providers. SV enables teams to execute testing while mimicking the behavior and data flows of these systems. #6 Fundamental to truly optimizing flows for faster delivery is recognizing that common out of cycle tests should coincide with earlier testing phases.