SlideShare a Scribd company logo
|November 2014 | Roy Solomon | VP & CO-FOUNDER |
rsolomon@applause.com
INCORPORATING
360 °APP QUALITY IN
MOBILE DEVELOPMENT
| 2
APPS ARE GATEWAY TO YOUR BRAND & BUSINESS
| 3
THEY MUST DO MORE THAN MERELY WORK…
3
| 4
THE NEW NECESSITY IS TO DELIGHT USERS
| 5
U S E R S A R E M O R E V O C A L T H A N E V E R
| 6
U S E R P E R C E P T I O N I S R E A L I T Y
Source: Compuware Mobile App Usage survey
| 7
5 REASONS THIS MATTERS MORE THAN EVER
| 8
1. THE APPS ECONOMY IS ULTRA -COMPETITIVE
| 9
2. SWITCHING COSTS ARE AT OR NEAR ZERO
| 10
W H A T I S T H I S N U M B E R ?
16%
% O F U S E R S T H A T W O U L D R E T R Y A N A P P A F T E R 2 F A I L U R E S
| 11OpenSignal Android Fragmentation Visualized (July 2013)
3. FRAGMENTATION (OF ALL KINDS) SPIKING
|
Personal Computers
(Desktop And Notebook)
Smartphones
Tablets
Smart TVs
Wearables
0
1,000
2,000
3,000
4,000
5,000
6,000
7,000
8,000
9,000
10,000
#OfDevices(InMillions)
Global Internet Device Installed Base Forecast
12Business Insider (Business Intelligence Estimates) 2013
4. IT’S NOT JUST MOBILE
| 13
5. THE SPEED OF DEVELOPMENT & TESTING
| 14
ARE YOU PREPARED TO SURVIVE – AND THRIVE?
|
USERS DON’T COMPARTMENTALIZE QUALITY
15
A H A ! M O M E N T
| 16
WINNING APPS & COMPANIES DON’T EITHER
|
360°APP QUALITY
QUALITY, DEFINED BY YOUR USERS
17
T H E N E W M E A S U R I N G S T I C K
|
The Challenge
•••
WHAT THIS MEANS
FOR YOU
|
Your Test Labs Are Here Your Users Are Here
Modern apps need real-world testing, where users live, work & play
19
T H E P R O B L E M W I T H T H E S T A T U S Q U O
|
C L O S E D L O O P O F T E S T & F E E D B A C K
20
Tester End UsersDeveloper
Build distribution1 In-app bug reporting2
Crash log reporting
4
In-app user feedback3
Product/Marketer
Sentiment Analysis5
Builds
User Feedback
Crash logs
BugsBugs & Crashes
Quality Dashboard
with Sentiment Analysis
|
O U T S I D E - I N A P P Q U A L I T Y S I G N A L S
• Inside-out POV valuable, but incomplete
– Regardless of dev & test methodologies
• 360
ₒ
app quality requires an outside-in worldview
– Comes in many forms
- Usability feedback
- User analytics
- L10N issues
- Bug reports
- Crash reports
- Security vulnerabilities
– And at many times
- Research
- Pre-launch
- Post-launch
User Perception Is Reality 21
|
WATERFALL
AGILE FORRESTER
LEAN
22
|
PRE-LAUNCH POST-LAUNCH
MEASURE USER
APPLAUSE
EARN USER
APPLAUSE
23
|
PRE-LAUNCH POST-LAUNCH
DESIGN &
DEVELOP
1
TEST &
DEPLOY
2
LISTEN &
LEARN
3
ANALYZE
& PLAN
4
360º
APPQUALITY
5
EG: IBM
EG: JIRA EG: FLURRY
EG: BAZAARVOICE
24
|
The Challenge
•••
DIVING DEEPER
| 26
3 6 0 ° A P P Q U A L I T Y D A S H B O A R D
| 27
I N - T H E - W I L D T E S T I N G S E R V I C E S
• Testing beyond the QA lab (in-
house or offshore)
• Test coverage where your
users work, live & play
• Across devices, OSes &
carriers
• Real testers, real devices, real-
world conditions
• Across the SDLC
|
A C T I O N A B L E D E F E C T R E P O R T S
FYI, THIS IS WHAT ACTIONABLE LOOKS LIKE
|
S D K - E N A B L E D C R A S H R E P O R T S
| 30
S D K - E N A B L E D S E S S I O N R E P O R T S
| 31
V A L I D A T E D L O C A L I Z A T I O N I S S U E S
| 32
M O B I L E B E T A P R O G R A M S
| 33
U S E R S E N T I M E N T A N A L Y T I C S
|
H E A R I N G W H A T U S E R S A R E S A Y I N G
ENORMOUS BLIND SPOT FOR COMPANIES
|
I F Y O U C A N C U T T H R O U G H T H E N O I S E
AND FIND THE SIGNALS 35
| 36
U S E R R E V I E W S E N T I M E N T
TURN DATA INTO ACTIONABLE INSIGHTS
| 37
C O M P E T I T I V E A N A L Y S I S
DETERMINE WHERE TO INVEST IN QUALITY
|
L I S T E N I N G T O U S E R S D R I V E S Q U A L I T Y
• Analytics = listen to your users
• End opinion-based debates
• Continual improvement
• Measure what matters
• Compare to competitors
• Measure before & after launch
IT’S POWERFUL IN CREATING WINNING APPS 38
|
• Modern apps have different recipe for success
– Infinitely more variables (devices, OSes, carriers, locations, use cases)
– Apps must go beyond merely “good enough” to delight users
– Traditional methods & playbooks won’t suffice
• Companies must play catch-up
– App quality no longer just a CIO & CTO problem; matters to brand & biz
– Move beyond lab to where users work, live & play
– Closed loop between user POV and your definition of quality
• 360°app quality isn’t just about dev ops or testing
– Requires modern tools and analytics that focus on users-centric quality
– Necessity due to outsized user expectations + voice
• A few mobile app war stories & examples (time permitting)
K E Y T A K E A W A Y S
39
|
The Challenge
•••
QUESTIONS?
ANSWERS.
Matt Johnston | CMO & CSO | mjohnston@applause.com

More Related Content

Viewers also liked

Exploring Usability Testing for Mobile and Web Technologies
Exploring Usability Testing for Mobile and Web TechnologiesExploring Usability Testing for Mobile and Web Technologies
Exploring Usability Testing for Mobile and Web Technologies
TechWell
 
Speed Up Testing with Monitoring Tools
Speed Up Testing with Monitoring ToolsSpeed Up Testing with Monitoring Tools
Speed Up Testing with Monitoring Tools
TechWell
 
The Unfortunate Triumph of Process over Purpose
The Unfortunate Triumph of Process over PurposeThe Unfortunate Triumph of Process over Purpose
The Unfortunate Triumph of Process over Purpose
TechWell
 
Testing Cloud Services
Testing Cloud ServicesTesting Cloud Services
Testing Cloud Services
TechWell
 
Transforming How We Deliver Value: Agility at Scale
Transforming How We Deliver Value: Agility at ScaleTransforming How We Deliver Value: Agility at Scale
Transforming How We Deliver Value: Agility at Scale
TechWell
 
Testing Lessons Learned from Sesame Street
Testing Lessons Learned from Sesame StreetTesting Lessons Learned from Sesame Street
Testing Lessons Learned from Sesame Street
TechWell
 
A Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing MaturityA Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing Maturity
TechWell
 
Testing Compliance with Accessibility Guidelines
Testing Compliance with Accessibility GuidelinesTesting Compliance with Accessibility Guidelines
Testing Compliance with Accessibility Guidelines
TechWell
 
Shifting Left: The Evolution of Test Automation
Shifting Left: The Evolution of Test AutomationShifting Left: The Evolution of Test Automation
Shifting Left: The Evolution of Test Automation
TechWell
 
You Said What? Becoming Aware of the Things We Say
You Said What? Becoming Aware of the Things We SayYou Said What? Becoming Aware of the Things We Say
You Said What? Becoming Aware of the Things We Say
TechWell
 

Viewers also liked (10)

Exploring Usability Testing for Mobile and Web Technologies
Exploring Usability Testing for Mobile and Web TechnologiesExploring Usability Testing for Mobile and Web Technologies
Exploring Usability Testing for Mobile and Web Technologies
 
Speed Up Testing with Monitoring Tools
Speed Up Testing with Monitoring ToolsSpeed Up Testing with Monitoring Tools
Speed Up Testing with Monitoring Tools
 
The Unfortunate Triumph of Process over Purpose
The Unfortunate Triumph of Process over PurposeThe Unfortunate Triumph of Process over Purpose
The Unfortunate Triumph of Process over Purpose
 
Testing Cloud Services
Testing Cloud ServicesTesting Cloud Services
Testing Cloud Services
 
Transforming How We Deliver Value: Agility at Scale
Transforming How We Deliver Value: Agility at ScaleTransforming How We Deliver Value: Agility at Scale
Transforming How We Deliver Value: Agility at Scale
 
Testing Lessons Learned from Sesame Street
Testing Lessons Learned from Sesame StreetTesting Lessons Learned from Sesame Street
Testing Lessons Learned from Sesame Street
 
A Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing MaturityA Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing Maturity
 
Testing Compliance with Accessibility Guidelines
Testing Compliance with Accessibility GuidelinesTesting Compliance with Accessibility Guidelines
Testing Compliance with Accessibility Guidelines
 
Shifting Left: The Evolution of Test Automation
Shifting Left: The Evolution of Test AutomationShifting Left: The Evolution of Test Automation
Shifting Left: The Evolution of Test Automation
 
You Said What? Becoming Aware of the Things We Say
You Said What? Becoming Aware of the Things We SayYou Said What? Becoming Aware of the Things We Say
You Said What? Becoming Aware of the Things We Say
 

Similar to Incorporating 360 Degree App Quality in Mobile Development

Launching great enterprise mobile apps that beat the competition
Launching great enterprise mobile apps that beat the competitionLaunching great enterprise mobile apps that beat the competition
Launching great enterprise mobile apps that beat the competition
ebuc
 
Applause crowd testing meetup march 2015
Applause crowd testing meetup   march 2015Applause crowd testing meetup   march 2015
Applause crowd testing meetup march 2015
QualiTest
 
How to improve Customer Engagement
How to improve Customer EngagementHow to improve Customer Engagement
How to improve Customer Engagement
Susanne B. Böck
 
American Marketing Association Presentation: Location-Based Mobile Advertising
American Marketing Association Presentation: Location-Based Mobile AdvertisingAmerican Marketing Association Presentation: Location-Based Mobile Advertising
American Marketing Association Presentation: Location-Based Mobile Advertising
Keith Layton
 
PAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur JainPAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur Jain
Neotys
 
Dev Ops or Not - Testing Has To Change - Richard Hunter
Dev Ops or Not - Testing Has To Change - Richard HunterDev Ops or Not - Testing Has To Change - Richard Hunter
Dev Ops or Not - Testing Has To Change - Richard Hunter
SpotQA
 
Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)
Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)
Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)
TelecomValley
 
Mobile App Development Trends
Mobile App Development TrendsMobile App Development Trends
Mobile App Development Trends
Susanne B. Böck
 
The Art of Data Consistency - Sample Blending For Your Tracker Studies
The Art of Data Consistency - Sample Blending For Your Tracker StudiesThe Art of Data Consistency - Sample Blending For Your Tracker Studies
The Art of Data Consistency - Sample Blending For Your Tracker Studies
EMI Research Solutions
 
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Rosenfeld Media
 
2016 Prototyping Tools
2016 Prototyping Tools2016 Prototyping Tools
2016 Prototyping Tools
Alexander Meinhardt
 
Fintech Belgium Summit 2017 - Societal Impact - Anais Digital by Reynald Le...
Fintech Belgium Summit 2017 -  Societal Impact - Anais Digital  by Reynald Le...Fintech Belgium Summit 2017 -  Societal Impact - Anais Digital  by Reynald Le...
Fintech Belgium Summit 2017 - Societal Impact - Anais Digital by Reynald Le...
FinTech Belgium
 
Alliance 2017 - How to Plan a Pain-Free Upgrade or Transition to the Cloud
Alliance 2017 - How to Plan a Pain-Free Upgrade or Transition to the CloudAlliance 2017 - How to Plan a Pain-Free Upgrade or Transition to the Cloud
Alliance 2017 - How to Plan a Pain-Free Upgrade or Transition to the Cloud
Sparkrock
 
Crowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest Group
Crowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest GroupCrowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest Group
Crowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest Group
Qualitest
 
Jen Ng | UX / UI Design Portfolio
Jen Ng  |  UX / UI Design PortfolioJen Ng  |  UX / UI Design Portfolio
Jen Ng | UX / UI Design Portfolio
Jen Ng
 
Making a business plan
Making a business planMaking a business plan
Making a business plan
Atul Puri
 
The Sample Landscape: Guide Book To the Sample Industry
The Sample Landscape: Guide Book To the Sample IndustryThe Sample Landscape: Guide Book To the Sample Industry
The Sample Landscape: Guide Book To the Sample Industry
EMI Research Solutions
 
Design for Startups
Design for StartupsDesign for Startups
Design for Startups
Pek Pongpaet
 
Stickman - V 3.1
Stickman - V 3.1Stickman - V 3.1
Stickman - V 3.1Sunder Iyer
 

Similar to Incorporating 360 Degree App Quality in Mobile Development (20)

Launching great enterprise mobile apps that beat the competition
Launching great enterprise mobile apps that beat the competitionLaunching great enterprise mobile apps that beat the competition
Launching great enterprise mobile apps that beat the competition
 
Applause crowd testing meetup march 2015
Applause crowd testing meetup   march 2015Applause crowd testing meetup   march 2015
Applause crowd testing meetup march 2015
 
How to improve Customer Engagement
How to improve Customer EngagementHow to improve Customer Engagement
How to improve Customer Engagement
 
Crowdsource Testing presented by uTest
Crowdsource Testing presented by uTestCrowdsource Testing presented by uTest
Crowdsource Testing presented by uTest
 
American Marketing Association Presentation: Location-Based Mobile Advertising
American Marketing Association Presentation: Location-Based Mobile AdvertisingAmerican Marketing Association Presentation: Location-Based Mobile Advertising
American Marketing Association Presentation: Location-Based Mobile Advertising
 
PAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur JainPAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur Jain
 
Dev Ops or Not - Testing Has To Change - Richard Hunter
Dev Ops or Not - Testing Has To Change - Richard HunterDev Ops or Not - Testing Has To Change - Richard Hunter
Dev Ops or Not - Testing Has To Change - Richard Hunter
 
Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)
Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)
Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)
 
Mobile App Development Trends
Mobile App Development TrendsMobile App Development Trends
Mobile App Development Trends
 
The Art of Data Consistency - Sample Blending For Your Tracker Studies
The Art of Data Consistency - Sample Blending For Your Tracker StudiesThe Art of Data Consistency - Sample Blending For Your Tracker Studies
The Art of Data Consistency - Sample Blending For Your Tracker Studies
 
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
 
2016 Prototyping Tools
2016 Prototyping Tools2016 Prototyping Tools
2016 Prototyping Tools
 
Fintech Belgium Summit 2017 - Societal Impact - Anais Digital by Reynald Le...
Fintech Belgium Summit 2017 -  Societal Impact - Anais Digital  by Reynald Le...Fintech Belgium Summit 2017 -  Societal Impact - Anais Digital  by Reynald Le...
Fintech Belgium Summit 2017 - Societal Impact - Anais Digital by Reynald Le...
 
Alliance 2017 - How to Plan a Pain-Free Upgrade or Transition to the Cloud
Alliance 2017 - How to Plan a Pain-Free Upgrade or Transition to the CloudAlliance 2017 - How to Plan a Pain-Free Upgrade or Transition to the Cloud
Alliance 2017 - How to Plan a Pain-Free Upgrade or Transition to the Cloud
 
Crowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest Group
Crowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest GroupCrowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest Group
Crowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest Group
 
Jen Ng | UX / UI Design Portfolio
Jen Ng  |  UX / UI Design PortfolioJen Ng  |  UX / UI Design Portfolio
Jen Ng | UX / UI Design Portfolio
 
Making a business plan
Making a business planMaking a business plan
Making a business plan
 
The Sample Landscape: Guide Book To the Sample Industry
The Sample Landscape: Guide Book To the Sample IndustryThe Sample Landscape: Guide Book To the Sample Industry
The Sample Landscape: Guide Book To the Sample Industry
 
Design for Startups
Design for StartupsDesign for Startups
Design for Startups
 
Stickman - V 3.1
Stickman - V 3.1Stickman - V 3.1
Stickman - V 3.1
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
TechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
TechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
TechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
TechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
TechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
TechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
TechWell
 
Ma 15
Ma 15Ma 15
Ma 15
TechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
TechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
TechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
TechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
TechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
TechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
TechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
TechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
TechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
TechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
TechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
TechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Recently uploaded

Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
Aftab Hussain
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
Globus
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
XfilesPro
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
abdulrafaychaudhry
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Globus
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
Google
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
Aftab Hussain
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
Adele Miller
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
Pro Unity Game Development with C-sharp Book
Pro Unity Game Development with C-sharp BookPro Unity Game Development with C-sharp Book
Pro Unity Game Development with C-sharp Book
abdulrafaychaudhry
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
Shane Coughlan
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Globus
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 

Recently uploaded (20)

Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
Pro Unity Game Development with C-sharp Book
Pro Unity Game Development with C-sharp BookPro Unity Game Development with C-sharp Book
Pro Unity Game Development with C-sharp Book
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 

Incorporating 360 Degree App Quality in Mobile Development

  • 1. |November 2014 | Roy Solomon | VP & CO-FOUNDER | rsolomon@applause.com INCORPORATING 360 °APP QUALITY IN MOBILE DEVELOPMENT
  • 2. | 2 APPS ARE GATEWAY TO YOUR BRAND & BUSINESS
  • 3. | 3 THEY MUST DO MORE THAN MERELY WORK… 3
  • 4. | 4 THE NEW NECESSITY IS TO DELIGHT USERS
  • 5. | 5 U S E R S A R E M O R E V O C A L T H A N E V E R
  • 6. | 6 U S E R P E R C E P T I O N I S R E A L I T Y Source: Compuware Mobile App Usage survey
  • 7. | 7 5 REASONS THIS MATTERS MORE THAN EVER
  • 8. | 8 1. THE APPS ECONOMY IS ULTRA -COMPETITIVE
  • 9. | 9 2. SWITCHING COSTS ARE AT OR NEAR ZERO
  • 10. | 10 W H A T I S T H I S N U M B E R ? 16% % O F U S E R S T H A T W O U L D R E T R Y A N A P P A F T E R 2 F A I L U R E S
  • 11. | 11OpenSignal Android Fragmentation Visualized (July 2013) 3. FRAGMENTATION (OF ALL KINDS) SPIKING
  • 12. | Personal Computers (Desktop And Notebook) Smartphones Tablets Smart TVs Wearables 0 1,000 2,000 3,000 4,000 5,000 6,000 7,000 8,000 9,000 10,000 #OfDevices(InMillions) Global Internet Device Installed Base Forecast 12Business Insider (Business Intelligence Estimates) 2013 4. IT’S NOT JUST MOBILE
  • 13. | 13 5. THE SPEED OF DEVELOPMENT & TESTING
  • 14. | 14 ARE YOU PREPARED TO SURVIVE – AND THRIVE?
  • 15. | USERS DON’T COMPARTMENTALIZE QUALITY 15 A H A ! M O M E N T
  • 16. | 16 WINNING APPS & COMPANIES DON’T EITHER
  • 17. | 360°APP QUALITY QUALITY, DEFINED BY YOUR USERS 17 T H E N E W M E A S U R I N G S T I C K
  • 19. | Your Test Labs Are Here Your Users Are Here Modern apps need real-world testing, where users live, work & play 19 T H E P R O B L E M W I T H T H E S T A T U S Q U O
  • 20. | C L O S E D L O O P O F T E S T & F E E D B A C K 20 Tester End UsersDeveloper Build distribution1 In-app bug reporting2 Crash log reporting 4 In-app user feedback3 Product/Marketer Sentiment Analysis5 Builds User Feedback Crash logs BugsBugs & Crashes Quality Dashboard with Sentiment Analysis
  • 21. | O U T S I D E - I N A P P Q U A L I T Y S I G N A L S • Inside-out POV valuable, but incomplete – Regardless of dev & test methodologies • 360 ₒ app quality requires an outside-in worldview – Comes in many forms - Usability feedback - User analytics - L10N issues - Bug reports - Crash reports - Security vulnerabilities – And at many times - Research - Pre-launch - Post-launch User Perception Is Reality 21
  • 24. | PRE-LAUNCH POST-LAUNCH DESIGN & DEVELOP 1 TEST & DEPLOY 2 LISTEN & LEARN 3 ANALYZE & PLAN 4 360º APPQUALITY 5 EG: IBM EG: JIRA EG: FLURRY EG: BAZAARVOICE 24
  • 26. | 26 3 6 0 ° A P P Q U A L I T Y D A S H B O A R D
  • 27. | 27 I N - T H E - W I L D T E S T I N G S E R V I C E S • Testing beyond the QA lab (in- house or offshore) • Test coverage where your users work, live & play • Across devices, OSes & carriers • Real testers, real devices, real- world conditions • Across the SDLC
  • 28. | A C T I O N A B L E D E F E C T R E P O R T S FYI, THIS IS WHAT ACTIONABLE LOOKS LIKE
  • 29. | S D K - E N A B L E D C R A S H R E P O R T S
  • 30. | 30 S D K - E N A B L E D S E S S I O N R E P O R T S
  • 31. | 31 V A L I D A T E D L O C A L I Z A T I O N I S S U E S
  • 32. | 32 M O B I L E B E T A P R O G R A M S
  • 33. | 33 U S E R S E N T I M E N T A N A L Y T I C S
  • 34. | H E A R I N G W H A T U S E R S A R E S A Y I N G ENORMOUS BLIND SPOT FOR COMPANIES
  • 35. | I F Y O U C A N C U T T H R O U G H T H E N O I S E AND FIND THE SIGNALS 35
  • 36. | 36 U S E R R E V I E W S E N T I M E N T TURN DATA INTO ACTIONABLE INSIGHTS
  • 37. | 37 C O M P E T I T I V E A N A L Y S I S DETERMINE WHERE TO INVEST IN QUALITY
  • 38. | L I S T E N I N G T O U S E R S D R I V E S Q U A L I T Y • Analytics = listen to your users • End opinion-based debates • Continual improvement • Measure what matters • Compare to competitors • Measure before & after launch IT’S POWERFUL IN CREATING WINNING APPS 38
  • 39. | • Modern apps have different recipe for success – Infinitely more variables (devices, OSes, carriers, locations, use cases) – Apps must go beyond merely “good enough” to delight users – Traditional methods & playbooks won’t suffice • Companies must play catch-up – App quality no longer just a CIO & CTO problem; matters to brand & biz – Move beyond lab to where users work, live & play – Closed loop between user POV and your definition of quality • 360°app quality isn’t just about dev ops or testing – Requires modern tools and analytics that focus on users-centric quality – Necessity due to outsized user expectations + voice • A few mobile app war stories & examples (time permitting) K E Y T A K E A W A Y S 39
  • 40. | The Challenge ••• QUESTIONS? ANSWERS. Matt Johnston | CMO & CSO | mjohnston@applause.com