SlideShare a Scribd company logo
1 of 17
Measurements and Metrics




MOBILE ANALYTICS
VALIDATED LEARNING LOOP

                                • Analytics and Metrics Process =
                                  Build + Measure + Learn
                                • Best summarized by Eric Ries’s
                                  Validated Learning Loop in Lean
                                  Startup methodology




                                        Not just code. Also alignment of
                                        measurement and business
                                        strategy



              REFERENCE: Lean Startup by Eric Ries
OUTCOMES

• Analytics don’t end with
  measurement
• Must translate data into desirable
  outcomes




 Test, measure, and take action




                           REFERENCE: Lean Startup by Eric Ries
BUSINESS REQUIREMENTS
• FUNDAMENTAL QUESTION: WHAT DEFINES
  SUCCESS?
• All analysis start with a question
• Understand what metrics and data are needed to make
  better decisions and perform better
• Analyze mobile app architecture
   – Any constraints that may inhibit measurements
   – How to leverage technology
PRODUCT USAGE METRICS


                               AARRR!
• What do you need to do to
  build your product and
  learn about your users?
• Dave McClure’s AARRR
  model provides 5 useful
  metrics to learning about
  your product and how it is
  used



          Reference: dave McClure, 500 startups. Picture courtesy of walt Disney pictures
THE AARRR MODEL




            Reference: dave McClure, 500 startups
FUNNEL ANALYSIS
• A funnel of steps that a user go through before meeting a
  goal, for example
   –   Steps leading to contacting the company
   –   Steps leading to purchasing the product
   –   Steps leading to purchasing in-app modules/features
   –   Steps leading to purchasing merchandise or tokens (for games(
• Funnel analysis = understanding conversions
• A step in a funnel = a page view (web) = a screen or action
  (mobile app)
WEB VS MOBILE

                 WEB                                 MOBILE APP

 Session tracking done primarily thru       Session tracking done primarily thru
        cookies and Javascript                             UDID

Human user interface is keyboard and        Human user interface is gestural and
          mouse based                                 touch-based
Web measurement model is centered
                                             Measurement model is less about
around page views, referrals, search,
                                                  referrals and search
            and visits
                                                Unique visitors are measured
Unique visitors are tied to individual or
                                            differently because of gateway IPs of
          server IP addresses
                                                           carriers
SOLUTIONS
• Flurry – http://flurry.com/
• Localytics – http://localytics.com/
• Webtrends –
  http://webtrends.com/products/analytics/mobile/
• AppClix – http://www.appclix.com/
• Kontagent – http://kontagent.com/
• Bango – http://bango.com/
• Apsalar – http://apsalar.com/
• Claritics – http://claritics.com/
• Others that we may have missed…
MOBILE METRICS CATEGORIES

•   Application
•   Content
•   User Behavior
•   People/Location
•   Technical
COMMON MOBILE METRICS 1

• Applications                • Content
  – #Downloads                  –   Screens
  – Conversions                 –   Visits, unique visits
    (Monetization)              –   In-app
  – Engagement/loyalty          –   Ads
    (over time)                 –   Links
  – User acquisition            –   Other events
  – User retention
  – Cohort analysis
    (retention, engagement,
     monetization)
COMMON MOBILE METRICS 2

• User Behavior                 • People/Location
  – Screen flow (useful for       –   Users
    navigation and usability)     –   Social identity
  – Exits (how users are          –   Countries/Regions
    exiting an app)               –   Languages
  – Sessions                      –   Marketplaces
    (length, frequency, type
    of users)                     –   Carriers
                                  –   Age
COMMON MOBILE METRICS 3

• Technical
  – Errors
  – Devices
  – Operating systems
  – App Versions
  – Connections
REPORT TERMINOLOGY

 • Common report terminology
 • Example: Breakdown of OS versions used to run the app
                                              FILTER: Time Duration
DIMENSION: OS Version




                                                         METRIC: Session


                          Reference: Localytics report
STRATEGIES
• Define a few funnels to understand how user
  usage drives towards a goal like
  registration, purchase
• If possible apply some of the advanced tracking
  and reporting features in the analytics tool to
  provide deeper insights
   – Filters (at the log and report levels)
   – Funnel analysis
   – Profiling
• Keep refining how metrics are tracked
EVENT TAGGING

• Data collection
• Mapping: Actions » Events » Metrics
• Need to define events to tag so that we can
  measure the metrics
• Example:
  – Start Time = Time when a player starts playing a
    game
  – End Time = Time when a player ends a game
  – Defines the names for both events
Questions?




                        Picture: Sean Dreilinger -
http://www.flickr.com/photos/seandreilinger/2326448445/in/photostream/

More Related Content

Viewers also liked

Прориси
ПрорисиПрориси
Прориси
belyavsky
 
Brand Management Pptsam1
Brand Management Pptsam1Brand Management Pptsam1
Brand Management Pptsam1
samarpankole
 
Siberian dream
Siberian dreamSiberian dream
Siberian dream
filipj2000
 
81765 karaagopyan
81765 karaagopyan81765 karaagopyan
81765 karaagopyan
filipj2000
 
Istanbul 100 years_ago
Istanbul 100 years_agoIstanbul 100 years_ago
Istanbul 100 years_ago
filipj2000
 

Viewers also liked (16)

Прориси
ПрорисиПрориси
Прориси
 
13강 기업교육론 20110603
13강 기업교육론 2011060313강 기업교육론 20110603
13강 기업교육론 20110603
 
Collective action under autocracies
Collective action under autocraciesCollective action under autocracies
Collective action under autocracies
 
Introduction to Steens Furniture
Introduction to Steens FurnitureIntroduction to Steens Furniture
Introduction to Steens Furniture
 
STEM Powers Jets
STEM Powers JetsSTEM Powers Jets
STEM Powers Jets
 
Mexico by john2
Mexico by john2  Mexico by john2
Mexico by john2
 
Creativity
CreativityCreativity
Creativity
 
Brand Management Pptsam1
Brand Management Pptsam1Brand Management Pptsam1
Brand Management Pptsam1
 
Shanxi china
Shanxi  chinaShanxi  china
Shanxi china
 
Summarizing ppoint
Summarizing ppointSummarizing ppoint
Summarizing ppoint
 
Brand Management Pptsam1
Brand Management Pptsam1Brand Management Pptsam1
Brand Management Pptsam1
 
Siberian dream
Siberian dreamSiberian dream
Siberian dream
 
National 2
National 2National 2
National 2
 
81765 karaagopyan
81765 karaagopyan81765 karaagopyan
81765 karaagopyan
 
Twitter for Business
Twitter for BusinessTwitter for Business
Twitter for Business
 
Istanbul 100 years_ago
Istanbul 100 years_agoIstanbul 100 years_ago
Istanbul 100 years_ago
 

Similar to Mobile Analytics

SoftWatch Overview_short (1)
SoftWatch Overview_short (1)SoftWatch Overview_short (1)
SoftWatch Overview_short (1)
Dror Leshem
 
SoftWatch Overview_short (1)
SoftWatch Overview_short (1)SoftWatch Overview_short (1)
SoftWatch Overview_short (1)
Moshe Kozlovski
 
Session 9-10 - UI/UX design for iOS 7 application
Session 9-10 - UI/UX design for iOS 7 applicationSession 9-10 - UI/UX design for iOS 7 application
Session 9-10 - UI/UX design for iOS 7 application
Vu Tran Lam
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
Paul Barsch
 

Similar to Mobile Analytics (20)

Understanding Mobile Apps for Events: From Strategy to Selection
Understanding Mobile Apps for Events: From Strategy to SelectionUnderstanding Mobile Apps for Events: From Strategy to Selection
Understanding Mobile Apps for Events: From Strategy to Selection
 
CIS13: How Enterprises Go Mobile: An Introduction to MobileIT
CIS13: How Enterprises Go Mobile: An Introduction to MobileITCIS13: How Enterprises Go Mobile: An Introduction to MobileIT
CIS13: How Enterprises Go Mobile: An Introduction to MobileIT
 
Using analytics in ux design my view
Using analytics in ux design   my viewUsing analytics in ux design   my view
Using analytics in ux design my view
 
Boost the ROI of your digital presence
Boost the ROI of your digital presenceBoost the ROI of your digital presence
Boost the ROI of your digital presence
 
The Human Customer: B2B's Great Migration to Customer Experience in Digital
The Human Customer: B2B's Great Migration to Customer Experience in DigitalThe Human Customer: B2B's Great Migration to Customer Experience in Digital
The Human Customer: B2B's Great Migration to Customer Experience in Digital
 
Supersede overview presentation
Supersede overview presentationSupersede overview presentation
Supersede overview presentation
 
SoftWatch Overview_short (1)
SoftWatch Overview_short (1)SoftWatch Overview_short (1)
SoftWatch Overview_short (1)
 
SoftWatch Overview_short (1)
SoftWatch Overview_short (1)SoftWatch Overview_short (1)
SoftWatch Overview_short (1)
 
The Shortest Path to Value for Business Mobile Apps
The Shortest Path to Value for Business Mobile Apps The Shortest Path to Value for Business Mobile Apps
The Shortest Path to Value for Business Mobile Apps
 
Decision Matrix for IoT Product Development
Decision Matrix for IoT Product DevelopmentDecision Matrix for IoT Product Development
Decision Matrix for IoT Product Development
 
Session 9-10 - UI/UX design for iOS 7 application
Session 9-10 - UI/UX design for iOS 7 applicationSession 9-10 - UI/UX design for iOS 7 application
Session 9-10 - UI/UX design for iOS 7 application
 
Matthias Bettag - Challenges for each the multi-channel, multi-device and mul...
Matthias Bettag - Challenges for each the multi-channel, multi-device and mul...Matthias Bettag - Challenges for each the multi-channel, multi-device and mul...
Matthias Bettag - Challenges for each the multi-channel, multi-device and mul...
 
Dell mobility Application Services
Dell mobility Application Services Dell mobility Application Services
Dell mobility Application Services
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
 
Application Insights and Jupyter Notebook(Opensource) combo to analyze large ...
Application Insights and Jupyter Notebook(Opensource) combo to analyze large ...Application Insights and Jupyter Notebook(Opensource) combo to analyze large ...
Application Insights and Jupyter Notebook(Opensource) combo to analyze large ...
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
 
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
 
Best Practices for Mobility
Best Practices for Mobility Best Practices for Mobility
Best Practices for Mobility
 
Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...
Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...
Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...
 
App testing and publishing
App testing and publishingApp testing and publishing
App testing and publishing
 

More from Samuel Chow

UI Design - Lessons Learned, Principles, and Best Practices
UI Design - Lessons Learned, Principles, and Best PracticesUI Design - Lessons Learned, Principles, and Best Practices
UI Design - Lessons Learned, Principles, and Best Practices
Samuel Chow
 

More from Samuel Chow (8)

Docker primer and tips
Docker primer and tipsDocker primer and tips
Docker primer and tips
 
Terraforming your Infrastructure on GCP
Terraforming your Infrastructure on GCPTerraforming your Infrastructure on GCP
Terraforming your Infrastructure on GCP
 
GCPLA Meetup Workshop - Migration from a Legacy Infrastructure to the Cloud
GCPLA Meetup Workshop - Migration from a Legacy Infrastructure to the CloudGCPLA Meetup Workshop - Migration from a Legacy Infrastructure to the Cloud
GCPLA Meetup Workshop - Migration from a Legacy Infrastructure to the Cloud
 
Docker, Kubernetes, and Google Cloud
Docker, Kubernetes, and Google CloudDocker, Kubernetes, and Google Cloud
Docker, Kubernetes, and Google Cloud
 
UI Design - Lessons Learned, Principles, and Best Practices
UI Design - Lessons Learned, Principles, and Best PracticesUI Design - Lessons Learned, Principles, and Best Practices
UI Design - Lessons Learned, Principles, and Best Practices
 
iOS Release Management
iOS Release ManagementiOS Release Management
iOS Release Management
 
Frisbee Thrower Prototype
Frisbee Thrower PrototypeFrisbee Thrower Prototype
Frisbee Thrower Prototype
 
Frisbee Thrower Concepts (Part 1)
Frisbee Thrower Concepts (Part 1)Frisbee Thrower Concepts (Part 1)
Frisbee Thrower Concepts (Part 1)
 

Recently uploaded

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Recently uploaded (20)

[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 

Mobile Analytics

  • 2. VALIDATED LEARNING LOOP • Analytics and Metrics Process = Build + Measure + Learn • Best summarized by Eric Ries’s Validated Learning Loop in Lean Startup methodology Not just code. Also alignment of measurement and business strategy REFERENCE: Lean Startup by Eric Ries
  • 3. OUTCOMES • Analytics don’t end with measurement • Must translate data into desirable outcomes Test, measure, and take action REFERENCE: Lean Startup by Eric Ries
  • 4. BUSINESS REQUIREMENTS • FUNDAMENTAL QUESTION: WHAT DEFINES SUCCESS? • All analysis start with a question • Understand what metrics and data are needed to make better decisions and perform better • Analyze mobile app architecture – Any constraints that may inhibit measurements – How to leverage technology
  • 5. PRODUCT USAGE METRICS AARRR! • What do you need to do to build your product and learn about your users? • Dave McClure’s AARRR model provides 5 useful metrics to learning about your product and how it is used Reference: dave McClure, 500 startups. Picture courtesy of walt Disney pictures
  • 6. THE AARRR MODEL Reference: dave McClure, 500 startups
  • 7. FUNNEL ANALYSIS • A funnel of steps that a user go through before meeting a goal, for example – Steps leading to contacting the company – Steps leading to purchasing the product – Steps leading to purchasing in-app modules/features – Steps leading to purchasing merchandise or tokens (for games( • Funnel analysis = understanding conversions • A step in a funnel = a page view (web) = a screen or action (mobile app)
  • 8. WEB VS MOBILE WEB MOBILE APP Session tracking done primarily thru Session tracking done primarily thru cookies and Javascript UDID Human user interface is keyboard and Human user interface is gestural and mouse based touch-based Web measurement model is centered Measurement model is less about around page views, referrals, search, referrals and search and visits Unique visitors are measured Unique visitors are tied to individual or differently because of gateway IPs of server IP addresses carriers
  • 9. SOLUTIONS • Flurry – http://flurry.com/ • Localytics – http://localytics.com/ • Webtrends – http://webtrends.com/products/analytics/mobile/ • AppClix – http://www.appclix.com/ • Kontagent – http://kontagent.com/ • Bango – http://bango.com/ • Apsalar – http://apsalar.com/ • Claritics – http://claritics.com/ • Others that we may have missed…
  • 10. MOBILE METRICS CATEGORIES • Application • Content • User Behavior • People/Location • Technical
  • 11. COMMON MOBILE METRICS 1 • Applications • Content – #Downloads – Screens – Conversions – Visits, unique visits (Monetization) – In-app – Engagement/loyalty – Ads (over time) – Links – User acquisition – Other events – User retention – Cohort analysis (retention, engagement, monetization)
  • 12. COMMON MOBILE METRICS 2 • User Behavior • People/Location – Screen flow (useful for – Users navigation and usability) – Social identity – Exits (how users are – Countries/Regions exiting an app) – Languages – Sessions – Marketplaces (length, frequency, type of users) – Carriers – Age
  • 13. COMMON MOBILE METRICS 3 • Technical – Errors – Devices – Operating systems – App Versions – Connections
  • 14. REPORT TERMINOLOGY • Common report terminology • Example: Breakdown of OS versions used to run the app FILTER: Time Duration DIMENSION: OS Version METRIC: Session Reference: Localytics report
  • 15. STRATEGIES • Define a few funnels to understand how user usage drives towards a goal like registration, purchase • If possible apply some of the advanced tracking and reporting features in the analytics tool to provide deeper insights – Filters (at the log and report levels) – Funnel analysis – Profiling • Keep refining how metrics are tracked
  • 16. EVENT TAGGING • Data collection • Mapping: Actions » Events » Metrics • Need to define events to tag so that we can measure the metrics • Example: – Start Time = Time when a player starts playing a game – End Time = Time when a player ends a game – Defines the names for both events
  • 17. Questions? Picture: Sean Dreilinger - http://www.flickr.com/photos/seandreilinger/2326448445/in/photostream/