Samsung Android Crash & Performance Analysis

Like this? Share it with your network

Share

Samsung Android Crash & Performance Analysis

  • 1,639 views
Uploaded on

This document provides a high level analysis of device performance metrics pulled from the Crittercism big data platform for August 2013: ...

This document provides a high level analysis of device performance metrics pulled from the Crittercism big data platform for August 2013:
- Top 100 Samsung Android devices (based on app loads)
- Installed base of ~250M (Android) devices
- Total of 10B+ app loads

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,639
On Slideshare
1,480
From Embeds
159
Number of Embeds
4

Actions

Shares
Downloads
4
Comments
0
Likes
1

Embeds 159

https://twitter.com 152
http://www.slideee.com 3
http://www.linkedin.com 2
https://www.linkedin.com 2

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Samsung Device Performance Analysis! San Francisco, October 2013!
  • 2. Agenda! Background ß! Data Analysis! Next Steps!
  • 3. Background! This document provides a high level analysis of device performance metrics pulled from the Crittercism big data platform for August 2013:! •  Top 100 Samsung Android devices (based on app loads) ! •  Installed base of ~250M (Android) devices! •  Total of 10B+ app loads!
  • 4. Key take-aways! Crashes & performance issues affect all devices regardless of app loads, however Samsung tablets (Galaxy Tab) and “phablets” (Galaxy Note) have the highest crash rates, 3-4x the crash rate of the best phones.! Some Samsung devices sold by non-US carriers are experiencing much higher crash rates than their US counterparts, such as the Galaxy S III in both Japan and Korea.! Other “bad offenders” are older models still in use like the Galaxy Y and Galaxy Ace that were shipped with Android versions as old as Froyo and Gingerbread (both originally released back in 2010).! More than 50% of Samsung devices have an average crash rate of greater than 0.25%; in addition, 10 of the top 100 devices account over 60% of total usage, suggesting a Pareto distribution of performance issues. !
  • 5. Agenda! Background! Data Analysis ß! Next Steps!
  • 6. 2.00% 1.50% 0.00% sc-06 gt-n8000 gt-p7500 gt-p6200 gt-p6800 gt-p7510 gt-s5360 gt-p1000 gt-p3100 gt-s5570 gt-s6102 gt-p3110 gt-s5660 shw-m250 shv-e250 gt-p5100 sc-04 gt-s5830 gt-p3113 gt-s5839 sch-r820 shv-e120 sc-02 sgh-i997 sgh-t889 shv-e210 sgh-t959 sch-r530 sch-s720 gt-s5302 gt-p5110 gt-n7100 sc-03 sch-s738 gt-s5300 sph-m930 sgh-t999 shv-e160 sch-i500 sch-i605 gt-s7562 sph-l900 sph-d700 gt-s6802 gt-i9305 gt-s5301 gt-p5113 gt-i9003 gt-n7105 gt-i9000 sgh-i747 shv-e300 sgh-i317 sph-l710 gt-i9105 gt-n7000 gt-i9082 sch-i535 gt-i8160 sch-r760 gt-s7560 gt-s7500 gt-s6500 gt-i9500 gt-i9070 sgh-i777 gt-b5330 shw-m440 gt-i8150 gt-i9100 sph-d710 gt-s6810 sgh-m919 gt-i9195 gt-i9001 sph-l300 sch-r830 sgh-t769 sgh-t679 sph-m830 gt-i8190 sph-l720 sch-i545 sgh-i727 sgh-i537 sch-i510 sch-i200 sgh-i547 gt-i9505 sch-r970 sch-i405 sch-i415 sgh-t989 sgh-t699 sph-m950 gt-i8730 sgh-i337 gt-i9300 sgh-i717 sgh-i437 3 orders of magnitude range for crash rates! Crash Rates for Top 100 Samsung Devices (by App Loads)! 5.00% 4.50% 4.00% 3.50% 3.00% Lowest! Highest! Mean! 2.50% 0.05%! 4.74%! 0.38%! Median! Std. Dev.! 0.28%! 0.58%! 3 orders of magnitude! 1.00% 0.50%
  • 7. Performance issues affect all devices! Performance Correlation for Top 100 Devices ! Performance for Top 30 Devices (by App Loads)! Device! App Loads (Millions)! gt-i9300 gt-i9505 sgh-t989 gt-n7000 sph-l720 gt-i9500 sch-i545 sph-l710 sgh-t999 gt-i9070 gt-i9001 gt-i9082 sgh-i717 gt-p5100 sgh-i727 521 426 371 367 288 254 201 184 180 179 174 165 161 148 142 138 130 119 114 98 92 86 83 81 79 77 66 63 910 Million App Loads (x) vs. Crash Rate (y)! Crash Rate (%)! 2,953 0.07% 0.17% 0.10% 0.11% 0.08% 0.14% 0.26% 0.07% 0.11% 0.16% 0.21% 0.35% 0.11% 0.25% 0.27% 0.32% 0.28% 0.20% 0.14% 0.06% 0.11% Crashes are independent from app loads, affect all devices! 5.00% 4.00% 3.00% 2.00% 0.52% 0.66% 1.00% 0.28% 0.26% 0.35% 0.24% 0.23% 0.00% 0.59% - 1,000 R² = 0.01284 2,000 3,000 0.73% -1.00% Crash rates do not correlate with app loads (R2 =0.01) ! 4,000
  • 8. Distribution for app loads / crash rates!
  • 9. Probability distribution (fitted)! Probability Distribution (30 day sample for top 100 devices, 10B+ app loads)! •  More than 50% of Samsung devices have an average crash rate of greater than 0.25%! Lowest Highest Mean 0.05% 4.74% 0.38% Median Std. Dev. 0.28% 0.58% 0.00% 0.50% 1.00% 1.50% 2.00% 2.50% 3.00% 3.50% 4.00% 4.50% 5.00% 5.50% •  10 of the top 100 devices account over 60% of total usage, suggesting a Pareto distribution !
  • 10. Agenda! Background! Data Analysis! Next Steps ß!