SlideShare a Scribd company logo
2015 Pebble Developer Retreat
Data Analytics and Pebble
Jack Chai, Data Scientist
What are our common goals?
Pebble’s Goals Developer’s Goals
Increase
app usage
amongst
users
Increase
app usage
amongst
users
Where we are right now…
We (you) are doing pretty good so far:
~1/2 of our users will launch an installed app on a weekly basis
But that means there is an opportunity to engage the remaining half of
our users to use watchapps!
Currently, ~80% of users use a non-system watchface (really good)
1.Increase app downloads
2.Increase sustained usage of apps
How do we engage the remaining half?
What is sustained usage?
Users this week Users next week
Users who
sustained
usage
Users who left New users
What is sustained usage?
Keeping users involved consistently on a weekly basis
How can analytics help?
1.Give developers access to data about their app
The story of our data
Launch
App
Interact with
app - button
clicks
Close app -
elapsed time
of the app
App crash
Hourly
counts are
sent to us
How can analytics help?
1.Give developers access to data about their app
How can dev-portal analytics help you?
1. Give you basic statistics about your apps
2. Hopefully, this can be useful for troubleshooting - high crash
versions
3. Insight into areas of improvement:
A. Battery life
B. Button clicks (user interaction)
C. Timeline implementation
How can analytics help?
1.Give developers access to data about their app
2.Communicate to developers insights about sustaining
usage
Battery Life - Why it matters?
• Current battery life for:
• Pebble Classic - 7 days
• Pebble Steel - 5 days
• Pebble Time - 7 days
• Pebble Time Steel - 10 days
• Battery life for Pebble Time Round - 2 days
Any significant battery drain will affect experience on Pebble Time Round
If the battery is dead…. users cannot use your apps
Battery Life: Why it matters?
BetterBatteryPerformance
Arbitrary App/Face Index
!0.8%
!0.7%
!0.6%
!0.5%
!0.4%
!0.3%
!0.2%
!0.1%
0%
Ba#ery'Life'Performance'
!0.8%
!0.7%
!0.6%
!0.5%
!0.4%
!0.3%
!0.2%
!0.1%
0%
Ba#ery'Life'Performance'
Battery Life: Why it matters?
Danger Zone: Really want to
avoid having a battery impact in
this region
Good Region - Goal is to have
battery impact above this
threshold
!0.8%
!0.7%
!0.6%
!0.5%
!0.4%
!0.3%
!0.2%
!0.1%
0%
Ba#ery'Life'Performance'
What can be done about battery life?
• Look at the best practices for battery power:
• http://developer.getpebble.com/guides/best-practices/battery-perform-guide/
• Reduce the number of times animations refresh on both watchapps and
watchfaces
• Glancing vs updating every second
• Pebble Graphics (by Matt Hungerford)
• Previous discussion of best practices:
• http://developer.getpebble.com/community/events/developer-retreat-2014/
• See talks on:
• Graphics
• 101000
• Battery Life
How can dev-portal analytics help you?
1. Give you basic statistics about your apps
2. Hopefully, this can be useful for troubleshooting - high crash
versions
3. Insight into areas of improvement:
A. Battery life
B. Button clicks (user interaction)
C. Timeline implementation
Why do button clicks matter?
What has data taught us about how users like to interact with
watchapps?
Delivering what users want should increase sustained usage!
Usage relative to button clicks
Median'Bu*on'Clicks/Launch'
Sustained'Usage'Index'
0'
0.1'
0.2'
0.3'
0.4'
0.5'
0.6'
0.7'
0.8'
0.9'
0' 5' 10' 15' 20' 25'
Median'Bu*on'Clicks/Launch'
Sustained'Usage'Index'
0'
0.1'
0.2'
0.3'
0.4'
0.5'
0.6'
0.7'
0.8'
0.9'
0' 5' 10' 15' 20' 25'
More Button Clicks
BetterSustainedUsage
1. Usage decreases with
more button clicks
2. Rule of thumb - 8
button clicks/launch
maximum
Median'Bu*on'Clicks/Launch'
Sustained'Usage'Index'
0'
0.1'
0.2'
0.3'
0.4'
0.5'
0.6'
0.7'
0.8'
0.9'
0' 5' 10' 15' 20' 25'
Median'Bu*on'Clicks/Launch'
Sustained'Usage'Index'
0'
0.1'
0.2'
0.3'
0.4'
0.5'
0.6'
0.7'
0.8'
0.9'
0' 5' 10' 15' 20' 25'
Median'Bu*on'Clicks/Launch'
Sustained'Usage'Index'
0'
0.1'
0.2'
0.3'
0.4'
0.5'
0.6'
0.7'
0.8'
0.9'
0' 5' 10' 15' 20' 25'
Usage relative to button clicks
What Pebble feature can help us streamline our apps?
Timeline
• Timeline is developed to deliver information directly and avoid
increased button clicks
Scroll to Timeline
Open the Pin
Take more actions
Launch
app
Basalt vs Aplite
• Apps on Aplite cannot push pins (yet)
• Apps on Basalt can push pins to the timeline (but don’t have to)
• Timeline is coming to every Pebble platform (even Pebble
Classic and Pebble Steel)!
Timeline
• Timeline is developed to deliver information directly and avoid
increased button clicks
• ~3/4 of users will scroll through Timeline on a weekly basis
(only people on Basalt)
• >1/4 of pin opens will lead directly to app launches
• Currently < 4% of the apps in the App Store push pins to
timeline
Does pushing pins to timeline have a positive impact for app usage?
How do we prove the impact of incorporating
pins
• Case Study 1: We can look at apps that exist on both Basalt and Aplite
and look at the relative usage of the apps on Basalt vs Aplite, and
compare apps that use pins on Basalt vs apps that do not use pins.
• Case Study 2: We can look at an app on Basalt and compare its app
usage before it started incorporating pins against its usage after it
started using pins.
• Key point - If pins increase usage, we should see an increase in app
usage in both cases when pins are incorporated
Case Study 1: Basalt vs Aplite usage
0"
0.5"
1"
1.5"
2"
2.5"
3"
3.5"
8/18/15"
8/20/15"
8/22/15"
8/24/15"
8/26/15"
8/28/15"
8/30/15"
9/1/15"
9/3/15"
9/5/15"
9/7/15"
9/9/15"
9/11/15"
9/13/15"
9/15/15"
Apps"w/o"TL"pins"
Apss"w/"TL"pins"
Time"
Basalt"Usage"Rela@ve"to"Aplite"Usage" Apps$w/o$pins$
Apps$w/$pins$
0"
0.5"
1"
1.5"
2"
2.5"
3"
3.5"
8/18/15"
8/20/15"
8/22/15"
8/24/15"
8/26/15"
8/28/15"
8/30/15"
9/1/15"
9/3/15"
9/5/15"
9/7/15"
9/9/15"
9/11/15"
9/13/15"
9/15/15"
Apps"w/o"TL"pins"
Apss"w/"TL"pins"
Time"
Basalt"Usage"Rela@ve"to"Aplite"Usage" Apps$w/o$pins$
Apps$w/$pins$Equal Usage
HigherUsageonBasalt
Usage of apps on Basalt increases greatly with utilization of pins on timeline
0"
0.5"
1"
1.5"
2"
2.5"
3"
3.5"
8/18/15"
8/20/15"
8/22/15"
8/24/15"
8/26/15"
8/28/15"
8/30/15"
9/1/15"
9/3/15"
9/5/15"
9/7/15"
9/9/15"
9/11/15"
9/13/15"
9/15/15"
Apps"w/o"TL"pins"
Apss"w/"TL"pins"
Time"
Basalt"Usage"Rela@ve"to"Aplite"Usage" Apps$w/o$pins$
Apps$w/$pins$
Case Study 1: Basalt vs Aplite usage
Case Study 2: Before and after TL
0"
0.5"
1"
1.5"
2"
2.5"
6/29/15"
7/6/15"
7/13/15"
7/20/15"
7/27/15"
8/3/15"
8/10/15"
8/17/15"
8/24/15"
8/31/15"
9/7/15"
9/14/15"
9/21/15"
Usage&Rate&
App w/o pin
App w/ pin
Start incorporating Pins
App usage increases
after integrating pins
0"
0.5"
1"
1.5"
2"
2.5"
6/29/15"
7/6/15"
7/13/15"
7/20/15"
7/27/15"
8/3/15"
8/10/15"
8/17/15"
8/24/15"
8/31/15"
9/7/15"
9/14/15"
9/21/15"
Usage&Rate&
0"
0.5"
1"
1.5"
2"
2.5"
6/29/15"
7/6/15"
7/13/15"
7/20/15"
7/27/15"
8/3/15"
8/10/15"
8/17/15"
8/24/15"
8/31/15"
9/7/15"
9/14/15"
9/21/15"
Usage&Rate&
0"
0.5"
1"
1.5"
2"
2.5"
6/29/15"
7/6/15"
7/13/15"
7/20/15"
7/27/15"
8/3/15"
8/10/15"
8/17/15"
8/24/15"
8/31/15"
9/7/15"
9/14/15"
9/21/15"
Usage&Rate&
0"
0.5"
1"
1.5"
2"
2.5"
6/29/15"
7/6/15"
7/13/15"
7/20/15"
7/27/15"
8/3/15"
8/10/15"
8/17/15"
8/24/15"
8/31/15"
9/7/15"
9/14/15"
9/21/15"
Usage&Rate&
0"
0.5"
1"
1.5"
2"
2.5"
6/29/15"
7/6/15"
7/13/15"
7/20/15"
7/27/15"
8/3/15"
8/10/15"
8/17/15"
8/24/15"
8/31/15"
9/7/15"
9/14/15"
9/21/15"
Usage&Rate&
Timeline usage
Timeline has potential to help apps increase usage
Unique opportunity now to be among first apps to use timeline across
all Pebble platforms
Best Use Cases for Timeline (by Jon Barlow)
What I hope to have communicated
1.Use (the new and exciting) developer portal analytics!
2.Try to conserve on battery life
3.Streamline information from apps to decrease number of
interactions
4.Incorporate timeline pins!
We are interested in any feedback and requests for developer
portal analytics
How will you reduce battery drain?
How will you incorporate timeline?
Thank you!
Questions?

More Related Content

What's hot

Creating Enterprise Friendly Apps
Creating Enterprise Friendly AppsCreating Enterprise Friendly Apps
Creating Enterprise Friendly Apps
Tony Lenzi
 
Cocoa coders 141113-watch
Cocoa coders 141113-watchCocoa coders 141113-watch
Cocoa coders 141113-watch
Carl Brown
 
Automating Hybrid Applications with Appium
Automating Hybrid Applications with AppiumAutomating Hybrid Applications with Appium
Automating Hybrid Applications with Appium
Sauce Labs
 
Scrum breakfast skillset_toolset_mindset
Scrum breakfast skillset_toolset_mindsetScrum breakfast skillset_toolset_mindset
Scrum breakfast skillset_toolset_mindset
Michael Palotas
 
All your family secrets belong to us—Worrisome security issues in tracker apps
All your family secrets belong to us—Worrisome security issues in tracker appsAll your family secrets belong to us—Worrisome security issues in tracker apps
All your family secrets belong to us—Worrisome security issues in tracker apps
Priyanka Aash
 

What's hot (20)

Creating Enterprise Friendly Apps
Creating Enterprise Friendly AppsCreating Enterprise Friendly Apps
Creating Enterprise Friendly Apps
 
Cocoa coders 141113-watch
Cocoa coders 141113-watchCocoa coders 141113-watch
Cocoa coders 141113-watch
 
Background Fetch - the most powerful API you've never heard of
Background Fetch - the most powerful API you've never heard ofBackground Fetch - the most powerful API you've never heard of
Background Fetch - the most powerful API you've never heard of
 
Hands-On Mobile App Testing
Hands-On Mobile App TestingHands-On Mobile App Testing
Hands-On Mobile App Testing
 
Automating Hybrid Applications with Appium
Automating Hybrid Applications with AppiumAutomating Hybrid Applications with Appium
Automating Hybrid Applications with Appium
 
How to Break your App - Best Practices in Mobile App Testing
How to Break your App - Best Practices in Mobile App TestingHow to Break your App - Best Practices in Mobile App Testing
How to Break your App - Best Practices in Mobile App Testing
 
Android Instant Apps testing
Android Instant Apps testingAndroid Instant Apps testing
Android Instant Apps testing
 
Launch High Performing Mobile Apps with Appurify
Launch High Performing Mobile Apps with AppurifyLaunch High Performing Mobile Apps with Appurify
Launch High Performing Mobile Apps with Appurify
 
My 10 Mobile Automation Questions
My 10 Mobile Automation QuestionsMy 10 Mobile Automation Questions
My 10 Mobile Automation Questions
 
How to Break your App - Workshop - Testbash 2015
How to Break your App - Workshop - Testbash 2015How to Break your App - Workshop - Testbash 2015
How to Break your App - Workshop - Testbash 2015
 
Scrum breakfast skillset_toolset_mindset
Scrum breakfast skillset_toolset_mindsetScrum breakfast skillset_toolset_mindset
Scrum breakfast skillset_toolset_mindset
 
Appium - Reality check on the world’s leading Open Source Framework for Mobil...
Appium - Reality check on the world’s leading Open Source Framework for Mobil...Appium - Reality check on the world’s leading Open Source Framework for Mobil...
Appium - Reality check on the world’s leading Open Source Framework for Mobil...
 
10 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.510 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.5
 
Google Analytics for Quantified Self
Google Analytics for Quantified SelfGoogle Analytics for Quantified Self
Google Analytics for Quantified Self
 
Live Panel: Appium Core Committers Answer Your Questions
Live Panel: Appium Core Committers Answer Your Questions		Live Panel: Appium Core Committers Answer Your Questions
Live Panel: Appium Core Committers Answer Your Questions
 
Activity
ActivityActivity
Activity
 
Give Responsive Design a Mobile Performance Boost
Give Responsive Design a Mobile Performance BoostGive Responsive Design a Mobile Performance Boost
Give Responsive Design a Mobile Performance Boost
 
Mobile QA Metrics Risks and Automation Presentation By Yuval Golan
Mobile QA Metrics Risks and Automation Presentation  By Yuval GolanMobile QA Metrics Risks and Automation Presentation  By Yuval Golan
Mobile QA Metrics Risks and Automation Presentation By Yuval Golan
 
All your family secrets belong to us—Worrisome security issues in tracker apps
All your family secrets belong to us—Worrisome security issues in tracker appsAll your family secrets belong to us—Worrisome security issues in tracker apps
All your family secrets belong to us—Worrisome security issues in tracker apps
 
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram Thys
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram ThysOpenbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram Thys
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram Thys
 

Similar to #PDR15 - Data Analytics and Pebble

Similar to #PDR15 - Data Analytics and Pebble (20)

Product Analytics Playbook
Product Analytics PlaybookProduct Analytics Playbook
Product Analytics Playbook
 
Why Mobile App Retention Matters?
Why Mobile App Retention Matters?Why Mobile App Retention Matters?
Why Mobile App Retention Matters?
 
Data analyst for SaaS
Data analyst for SaaSData analyst for SaaS
Data analyst for SaaS
 
Progressive Web App
Progressive Web AppProgressive Web App
Progressive Web App
 
7 Tips for Optimizing Mobile App Metrics
7 Tips for Optimizing Mobile App Metrics7 Tips for Optimizing Mobile App Metrics
7 Tips for Optimizing Mobile App Metrics
 
TestElf Informational Presentation
TestElf Informational PresentationTestElf Informational Presentation
TestElf Informational Presentation
 
Grow Hack Athens Pt.2: Growth Hacking For Mobile Apps
Grow Hack Athens Pt.2: Growth Hacking For Mobile AppsGrow Hack Athens Pt.2: Growth Hacking For Mobile Apps
Grow Hack Athens Pt.2: Growth Hacking For Mobile Apps
 
Optimizing Dev Portals with Analytics and Feedback
Optimizing Dev Portals with Analytics and FeedbackOptimizing Dev Portals with Analytics and Feedback
Optimizing Dev Portals with Analytics and Feedback
 
Newly released app: tap-tap-tap or crap?
Newly released app: tap-tap-tap or crap?Newly released app: tap-tap-tap or crap?
Newly released app: tap-tap-tap or crap?
 
Apple guidelines for app approval
Apple guidelines for app approvalApple guidelines for app approval
Apple guidelines for app approval
 
Intro To Mobile Analytics
Intro To Mobile AnalyticsIntro To Mobile Analytics
Intro To Mobile Analytics
 
Nitin Rajput - Facebook Developer Garage Bangalore
Nitin Rajput - Facebook Developer Garage BangaloreNitin Rajput - Facebook Developer Garage Bangalore
Nitin Rajput - Facebook Developer Garage Bangalore
 
05: The 5 App Metrics That Are Crucial To Your App's Success
05: The 5 App Metrics That Are Crucial To Your App's Success05: The 5 App Metrics That Are Crucial To Your App's Success
05: The 5 App Metrics That Are Crucial To Your App's Success
 
Reqstr Bplan
Reqstr BplanReqstr Bplan
Reqstr Bplan
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
 
Building an app from scratch
Building an app from scratchBuilding an app from scratch
Building an app from scratch
 
Mobile Apps - Measuring Their Effectiveness
Mobile Apps - Measuring Their EffectivenessMobile Apps - Measuring Their Effectiveness
Mobile Apps - Measuring Their Effectiveness
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
 
How We Make Apps And Services
How We Make Apps And ServicesHow We Make Apps And Services
How We Make Apps And Services
 
Resume_4years_Exp_update
Resume_4years_Exp_updateResume_4years_Exp_update
Resume_4years_Exp_update
 

More from Pebble Technology

Overlay & Libraries | Pebble Meetup Oct. 2014
Overlay & Libraries | Pebble Meetup Oct. 2014Overlay & Libraries | Pebble Meetup Oct. 2014
Overlay & Libraries | Pebble Meetup Oct. 2014
Pebble Technology
 

More from Pebble Technology (18)

#PDR15 - Awesome Appstore Assets
#PDR15 - Awesome Appstore Assets#PDR15 - Awesome Appstore Assets
#PDR15 - Awesome Appstore Assets
 
#PDR15 - Smartstrap Workshop
#PDR15 - Smartstrap Workshop#PDR15 - Smartstrap Workshop
#PDR15 - Smartstrap Workshop
 
#PDR15 - waf, wscript and Your Pebble App
#PDR15 - waf, wscript and Your Pebble App#PDR15 - waf, wscript and Your Pebble App
#PDR15 - waf, wscript and Your Pebble App
 
#PDR15 - Voice API
#PDR15 - Voice API#PDR15 - Voice API
#PDR15 - Voice API
 
#PDR15 - Pebble Graphics
#PDR15 - Pebble Graphics#PDR15 - Pebble Graphics
#PDR15 - Pebble Graphics
 
#PDR15 Creating Pebble Apps for Aplite, Basalt, and Chalk
#PDR15 Creating Pebble Apps for Aplite, Basalt, and Chalk#PDR15 Creating Pebble Apps for Aplite, Basalt, and Chalk
#PDR15 Creating Pebble Apps for Aplite, Basalt, and Chalk
 
#PDR15 - Developing for Round
#PDR15 - Developing for Round#PDR15 - Developing for Round
#PDR15 - Developing for Round
 
#PDR15 - Designing for Pebble
#PDR15 - Designing for Pebble#PDR15 - Designing for Pebble
#PDR15 - Designing for Pebble
 
#PDR15 Kick-Off
#PDR15 Kick-Off#PDR15 Kick-Off
#PDR15 Kick-Off
 
Pebble Slate Workshop
Pebble Slate WorkshopPebble Slate Workshop
Pebble Slate Workshop
 
Overlay Technique | Pebble Developer Retreat 2014
Overlay Technique | Pebble Developer Retreat 2014Overlay Technique | Pebble Developer Retreat 2014
Overlay Technique | Pebble Developer Retreat 2014
 
Overlay & Libraries | Pebble Meetup Oct. 2014
Overlay & Libraries | Pebble Meetup Oct. 2014Overlay & Libraries | Pebble Meetup Oct. 2014
Overlay & Libraries | Pebble Meetup Oct. 2014
 
Connecting Pebble to the World
Connecting Pebble to the WorldConnecting Pebble to the World
Connecting Pebble to the World
 
Battery Life | Pebble Developer Retreat 2014
Battery Life | Pebble Developer Retreat 2014Battery Life | Pebble Developer Retreat 2014
Battery Life | Pebble Developer Retreat 2014
 
Advanced Techniques: Size | Pebble Developer Retreat 2014
Advanced Techniques: Size | Pebble Developer Retreat 2014Advanced Techniques: Size | Pebble Developer Retreat 2014
Advanced Techniques: Size | Pebble Developer Retreat 2014
 
Advanced Techniques: Graphics | Pebble Developer Retreat 2014
Advanced Techniques: Graphics | Pebble Developer Retreat 2014Advanced Techniques: Graphics | Pebble Developer Retreat 2014
Advanced Techniques: Graphics | Pebble Developer Retreat 2014
 
Pebble wearables devcon
Pebble wearables devconPebble wearables devcon
Pebble wearables devcon
 
Announcing Pebble SDK 2.0
Announcing Pebble SDK 2.0Announcing Pebble SDK 2.0
Announcing Pebble SDK 2.0
 

Recently uploaded

Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
UXDXConf
 

Recently uploaded (20)

FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
 
Buy Epson EcoTank L3210 Colour Printer Online.pdf
Buy Epson EcoTank L3210 Colour Printer Online.pdfBuy Epson EcoTank L3210 Colour Printer Online.pdf
Buy Epson EcoTank L3210 Colour Printer Online.pdf
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Strategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering TeamsStrategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering Teams
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024
 

#PDR15 - Data Analytics and Pebble

  • 1. 2015 Pebble Developer Retreat Data Analytics and Pebble Jack Chai, Data Scientist
  • 2. What are our common goals? Pebble’s Goals Developer’s Goals Increase app usage amongst users Increase app usage amongst users
  • 3. Where we are right now… We (you) are doing pretty good so far: ~1/2 of our users will launch an installed app on a weekly basis But that means there is an opportunity to engage the remaining half of our users to use watchapps! Currently, ~80% of users use a non-system watchface (really good)
  • 4. 1.Increase app downloads 2.Increase sustained usage of apps How do we engage the remaining half?
  • 5. What is sustained usage? Users this week Users next week Users who sustained usage Users who left New users
  • 6. What is sustained usage? Keeping users involved consistently on a weekly basis
  • 7. How can analytics help? 1.Give developers access to data about their app
  • 8. The story of our data Launch App Interact with app - button clicks Close app - elapsed time of the app App crash Hourly counts are sent to us
  • 9. How can analytics help? 1.Give developers access to data about their app
  • 10. How can dev-portal analytics help you? 1. Give you basic statistics about your apps 2. Hopefully, this can be useful for troubleshooting - high crash versions 3. Insight into areas of improvement: A. Battery life B. Button clicks (user interaction) C. Timeline implementation
  • 11. How can analytics help? 1.Give developers access to data about their app 2.Communicate to developers insights about sustaining usage
  • 12. Battery Life - Why it matters? • Current battery life for: • Pebble Classic - 7 days • Pebble Steel - 5 days • Pebble Time - 7 days • Pebble Time Steel - 10 days • Battery life for Pebble Time Round - 2 days Any significant battery drain will affect experience on Pebble Time Round If the battery is dead…. users cannot use your apps
  • 13. Battery Life: Why it matters? BetterBatteryPerformance Arbitrary App/Face Index !0.8% !0.7% !0.6% !0.5% !0.4% !0.3% !0.2% !0.1% 0% Ba#ery'Life'Performance' !0.8% !0.7% !0.6% !0.5% !0.4% !0.3% !0.2% !0.1% 0% Ba#ery'Life'Performance'
  • 14. Battery Life: Why it matters? Danger Zone: Really want to avoid having a battery impact in this region Good Region - Goal is to have battery impact above this threshold !0.8% !0.7% !0.6% !0.5% !0.4% !0.3% !0.2% !0.1% 0% Ba#ery'Life'Performance'
  • 15. What can be done about battery life? • Look at the best practices for battery power: • http://developer.getpebble.com/guides/best-practices/battery-perform-guide/ • Reduce the number of times animations refresh on both watchapps and watchfaces • Glancing vs updating every second • Pebble Graphics (by Matt Hungerford) • Previous discussion of best practices: • http://developer.getpebble.com/community/events/developer-retreat-2014/ • See talks on: • Graphics • 101000 • Battery Life
  • 16. How can dev-portal analytics help you? 1. Give you basic statistics about your apps 2. Hopefully, this can be useful for troubleshooting - high crash versions 3. Insight into areas of improvement: A. Battery life B. Button clicks (user interaction) C. Timeline implementation
  • 17. Why do button clicks matter? What has data taught us about how users like to interact with watchapps? Delivering what users want should increase sustained usage!
  • 18. Usage relative to button clicks Median'Bu*on'Clicks/Launch' Sustained'Usage'Index' 0' 0.1' 0.2' 0.3' 0.4' 0.5' 0.6' 0.7' 0.8' 0.9' 0' 5' 10' 15' 20' 25' Median'Bu*on'Clicks/Launch' Sustained'Usage'Index' 0' 0.1' 0.2' 0.3' 0.4' 0.5' 0.6' 0.7' 0.8' 0.9' 0' 5' 10' 15' 20' 25' More Button Clicks BetterSustainedUsage
  • 19. 1. Usage decreases with more button clicks 2. Rule of thumb - 8 button clicks/launch maximum Median'Bu*on'Clicks/Launch' Sustained'Usage'Index' 0' 0.1' 0.2' 0.3' 0.4' 0.5' 0.6' 0.7' 0.8' 0.9' 0' 5' 10' 15' 20' 25' Median'Bu*on'Clicks/Launch' Sustained'Usage'Index' 0' 0.1' 0.2' 0.3' 0.4' 0.5' 0.6' 0.7' 0.8' 0.9' 0' 5' 10' 15' 20' 25' Median'Bu*on'Clicks/Launch' Sustained'Usage'Index' 0' 0.1' 0.2' 0.3' 0.4' 0.5' 0.6' 0.7' 0.8' 0.9' 0' 5' 10' 15' 20' 25' Usage relative to button clicks
  • 20. What Pebble feature can help us streamline our apps?
  • 21. Timeline • Timeline is developed to deliver information directly and avoid increased button clicks Scroll to Timeline Open the Pin Take more actions Launch app
  • 22. Basalt vs Aplite • Apps on Aplite cannot push pins (yet) • Apps on Basalt can push pins to the timeline (but don’t have to) • Timeline is coming to every Pebble platform (even Pebble Classic and Pebble Steel)!
  • 23. Timeline • Timeline is developed to deliver information directly and avoid increased button clicks • ~3/4 of users will scroll through Timeline on a weekly basis (only people on Basalt) • >1/4 of pin opens will lead directly to app launches • Currently < 4% of the apps in the App Store push pins to timeline Does pushing pins to timeline have a positive impact for app usage?
  • 24. How do we prove the impact of incorporating pins • Case Study 1: We can look at apps that exist on both Basalt and Aplite and look at the relative usage of the apps on Basalt vs Aplite, and compare apps that use pins on Basalt vs apps that do not use pins. • Case Study 2: We can look at an app on Basalt and compare its app usage before it started incorporating pins against its usage after it started using pins. • Key point - If pins increase usage, we should see an increase in app usage in both cases when pins are incorporated
  • 25. Case Study 1: Basalt vs Aplite usage 0" 0.5" 1" 1.5" 2" 2.5" 3" 3.5" 8/18/15" 8/20/15" 8/22/15" 8/24/15" 8/26/15" 8/28/15" 8/30/15" 9/1/15" 9/3/15" 9/5/15" 9/7/15" 9/9/15" 9/11/15" 9/13/15" 9/15/15" Apps"w/o"TL"pins" Apss"w/"TL"pins" Time" Basalt"Usage"Rela@ve"to"Aplite"Usage" Apps$w/o$pins$ Apps$w/$pins$ 0" 0.5" 1" 1.5" 2" 2.5" 3" 3.5" 8/18/15" 8/20/15" 8/22/15" 8/24/15" 8/26/15" 8/28/15" 8/30/15" 9/1/15" 9/3/15" 9/5/15" 9/7/15" 9/9/15" 9/11/15" 9/13/15" 9/15/15" Apps"w/o"TL"pins" Apss"w/"TL"pins" Time" Basalt"Usage"Rela@ve"to"Aplite"Usage" Apps$w/o$pins$ Apps$w/$pins$Equal Usage HigherUsageonBasalt
  • 26. Usage of apps on Basalt increases greatly with utilization of pins on timeline 0" 0.5" 1" 1.5" 2" 2.5" 3" 3.5" 8/18/15" 8/20/15" 8/22/15" 8/24/15" 8/26/15" 8/28/15" 8/30/15" 9/1/15" 9/3/15" 9/5/15" 9/7/15" 9/9/15" 9/11/15" 9/13/15" 9/15/15" Apps"w/o"TL"pins" Apss"w/"TL"pins" Time" Basalt"Usage"Rela@ve"to"Aplite"Usage" Apps$w/o$pins$ Apps$w/$pins$ Case Study 1: Basalt vs Aplite usage
  • 27. Case Study 2: Before and after TL 0" 0.5" 1" 1.5" 2" 2.5" 6/29/15" 7/6/15" 7/13/15" 7/20/15" 7/27/15" 8/3/15" 8/10/15" 8/17/15" 8/24/15" 8/31/15" 9/7/15" 9/14/15" 9/21/15" Usage&Rate& App w/o pin App w/ pin Start incorporating Pins App usage increases after integrating pins 0" 0.5" 1" 1.5" 2" 2.5" 6/29/15" 7/6/15" 7/13/15" 7/20/15" 7/27/15" 8/3/15" 8/10/15" 8/17/15" 8/24/15" 8/31/15" 9/7/15" 9/14/15" 9/21/15" Usage&Rate& 0" 0.5" 1" 1.5" 2" 2.5" 6/29/15" 7/6/15" 7/13/15" 7/20/15" 7/27/15" 8/3/15" 8/10/15" 8/17/15" 8/24/15" 8/31/15" 9/7/15" 9/14/15" 9/21/15" Usage&Rate& 0" 0.5" 1" 1.5" 2" 2.5" 6/29/15" 7/6/15" 7/13/15" 7/20/15" 7/27/15" 8/3/15" 8/10/15" 8/17/15" 8/24/15" 8/31/15" 9/7/15" 9/14/15" 9/21/15" Usage&Rate& 0" 0.5" 1" 1.5" 2" 2.5" 6/29/15" 7/6/15" 7/13/15" 7/20/15" 7/27/15" 8/3/15" 8/10/15" 8/17/15" 8/24/15" 8/31/15" 9/7/15" 9/14/15" 9/21/15" Usage&Rate& 0" 0.5" 1" 1.5" 2" 2.5" 6/29/15" 7/6/15" 7/13/15" 7/20/15" 7/27/15" 8/3/15" 8/10/15" 8/17/15" 8/24/15" 8/31/15" 9/7/15" 9/14/15" 9/21/15" Usage&Rate&
  • 28. Timeline usage Timeline has potential to help apps increase usage Unique opportunity now to be among first apps to use timeline across all Pebble platforms Best Use Cases for Timeline (by Jon Barlow)
  • 29. What I hope to have communicated 1.Use (the new and exciting) developer portal analytics! 2.Try to conserve on battery life 3.Streamline information from apps to decrease number of interactions 4.Incorporate timeline pins! We are interested in any feedback and requests for developer portal analytics How will you reduce battery drain? How will you incorporate timeline?