State of Mobile Web Performance<br />Guy Podjarny, CTO<br />
Agenda<br />Why Mobile Web Performance Matters<br />Challenges in Mobile WPO<br />Intro to Mobitest<br />State of Mobile W...
Why Mobile Web Perf Matters<br />Because Web Performance matters<br />Many studies show rev/perf correlation<br />Because ...
Japan is leading the charge<br />4<br />
iPhone & Android Growing Fast<br />5<br />
Challenges in Mobile WPO<br />Slower Clients<br />Less Powerful Devices, Slower Networks<br />Fragmentation<br />OS Fragme...
Current Mobile Performance Tools<br />Blaze Mobitest<br />Details to follow<br />Pcapperf (pcapperf.appspot.com)<br />Uplo...
Blaze Mobitest<br />
Mobitest - Overview<br />Free service for measuring mobile page load<br />Measures on real devices, using custom apps<br /...
How does it work?<br />Mobile WebPageTest Agents<br />Custom apps, created for each platform<br />Poll WPT to receive jobs...
Getting the Data<br />Mobile Devices are locked down<br />Getting the info out is hard<br />Each OS required different app...
State of Mobile Web Performance<br />
State of Mobile Web Perf Study<br />Goal: Statistically Strong Performance Bakeoff<br />What’s unique about it?<br />Scale...
Methdology<br />Measuring Software: Mobitest<br />Test Sites: Fortune 1,000 <br />Devices: iPhone 4, Nexus S, Galaxy S<br ...
iPhone vs. Android - Average<br />Android 52% Faster <br />On Mobile Sites, Android only 3% Faster<br />Effectively tied<b...
iPhone vs. Android – Races<br />Android Faster on 84% of Sites<br />iPhone won 16% of the races<br />On Mobile Sites, Andr...
Android Version Comparison<br />Android 2.3 is 10% Faster Than 2.2<br />2.144 Seconds vs. 2.370<br />Android 2.2 was still...
iPhone Version Comparison<br />iPhone 4.3 Not Faster than 4.2<br />4.3 is 2% Slower: 3.253 vs. 3.182<br />4.3 was faster o...
WiFi vs. 3G<br />Compared iPhone 4.2 on WiFi & 3G<br />Results: WiFi 13% Faster (3.6 vs. 3.2)<br />WiFi faster on 82% of S...
Mobile vs. Regular Site<br />Definition of a Mobile Site (in this study):<br />iPhone requires 30+ less resources than IE8...
Anecdotes & Insights<br />Preliminary<br />(use at your own risk)<br />
WSJ – iPhone 4.3<br />Load Time<br />17 Secs<br />Start Render<br />8.4 Secs<br />Requests<br />159<br />Size<br />1,252 K...
WSJ – Android 2.3<br />23<br />Load Time<br />7.5 Secs<br />Start Render<br />8.4 Secs<br />Requests<br />204<br />Size<br...
WSJ – Requests 20-35<br />iPhone<br />5 Domains<br />Android<br />1 Domain<br />24<br />
WSJ - Theories<br />Android downloads resources faster<br />Seen on other sites, more efficient network?<br />Speedtest.ne...
Velocity Conf – iPhone 4.3<br />26<br />Load Time<br />8.7 Secs<br />Start Render<br />6 Secs<br />Requests<br />75<br />S...
Velocity Conf – Android 2.3<br />27<br />Load Time<br />4.6 Secs<br />Start Render<br />2.1 Secs<br />Requests<br />78<br ...
Velocity Conf - # Connections<br />iPhone 4.3<br />More connections<br />6 per host, 35 max<br />More than 4.2<br />Androi...
Velocity Conf – JS/CSS In Parallel<br />iPhone<br />CSS & JS block each other<br />Android<br />CSS & JS don’t appear to b...
Velocity Conf – Conclusions<br />More connections doesn’t mean faster<br />Apparently even more on mobile devices<br />Doe...
Coming Soon<br />
iPad Agent<br />32<br />
iPad & iPhone – Same OS, Different Site<br />33<br />2.3 Seconds<br />9 seconds<br />
Blackberry<br />34<br />
Q&A<br />
Upcoming SlideShare
Loading in …5
×

State Of Mobile Web Performance

1,647 views

Published on

Presentation from 17/3/2011 at the NY Web Performance Chapter about the iPhone/Android Comparison Study by Blaze.io (http://www.blaze.io), presented by Guy Podjarny

Published in: Technology
1 Comment
5 Likes
Statistics
Notes
No Downloads
Views
Total views
1,647
On SlideShare
0
From Embeds
0
Number of Embeds
334
Actions
Shares
0
Downloads
0
Comments
1
Likes
5
Embeds 0
No embeds

No notes for slide
  • http://www.slideshare.net/Gomez_Inc/maximize-your-mcommerce-strategy-7032532http://gigaom.com/2010/04/12/mary-meeker-mobile-internet-will-soon-overtake-fixed-internet/
  • http://assets.en.oreilly.com/1/event/39/Internet%20Trends%20Presentation.pdf
  • http://www.slideshare.net/Gomez_Inc/maximize-your-mcommerce-strategy-7032532http://gigaom.com/2010/04/12/mary-meeker-mobile-internet-will-soon-overtake-fixed-internet/
  • State Of Mobile Web Performance

    1. 1. State of Mobile Web Performance<br />Guy Podjarny, CTO<br />
    2. 2. Agenda<br />Why Mobile Web Performance Matters<br />Challenges in Mobile WPO<br />Intro to Mobitest<br />State of Mobile Web Performance Study<br />Anecdotes & Insights<br />Coming Soon<br />Summary<br />Q&A<br />2<br />
    3. 3. Why Mobile Web Perf Matters<br />Because Web Performance matters<br />Many studies show rev/perf correlation<br />Because Mobile users are impatient<br />58% of users expect desktop speed on mobile<br />Tablets take away the “Mobile Site” solution<br />Because Mobile browsing is growing quickly<br />Mobile Browsing will pass Desktop by 2014<br />31% of US Mobile Users have a Smartphone<br />
    4. 4. Japan is leading the charge<br />4<br />
    5. 5. iPhone & Android Growing Fast<br />5<br />
    6. 6. Challenges in Mobile WPO<br />Slower Clients<br />Less Powerful Devices, Slower Networks<br />Fragmentation<br />OS Fragmentation<br />Browser Fragmentation<br />Device Fragmentation<br />Form-Factor Fragmentation<br />Network Fragmentation<br />Non-Smartphones (not in this presentation)<br />Lack of Tools<br />Emphasizes challenges above<br />
    7. 7. Current Mobile Performance Tools<br />Blaze Mobitest<br />Details to follow<br />Pcapperf (pcapperf.appspot.com)<br />Upload captured mobile network dump<br />Analysis Bookmarklets<br />Mobile Perf, DOM Monster, etc.<br />New: YSlowBookmarklet (Alpha)<br />JDrop<br />Collect on Device, Analyze Online<br />7<br />
    8. 8. Blaze Mobitest<br />
    9. 9. Mobitest - Overview<br />Free service for measuring mobile page load<br />Measures on real devices, using custom apps<br />Available devices include:<br />iPhone 4.3<br />iPhone 4.2<br />Android 2.3 (Nexus S)<br />Android 2.2 (Galaxy S)<br />Currently only measures over WiFi<br />3G works, but not yet included in service<br />9<br />
    10. 10. How does it work?<br />Mobile WebPageTest Agents<br />Custom apps, created for each platform<br />Poll WPT to receive jobs<br />Load pages while monitoring activities<br />Package and upload results<br />Supports multiple runs, first/repeat view & video<br />Private Modified WPT Instance<br />Supports different results format<br />10<br />
    11. 11. Getting the Data<br />Mobile Devices are locked down<br />Getting the info out is hard<br />Each OS required different approaches<br />And presented different limitations<br />iPhone: Embedded Browser Callbacks<br />Android: Browser Callbacks + On-device sniffer + pcap2har<br />Blackberry (Alpha): Networking API<br />11<br />
    12. 12. State of Mobile Web Performance<br />
    13. 13. State of Mobile Web Perf Study<br />Goal: Statistically Strong Performance Bakeoff<br />What’s unique about it?<br />Scale: Measured 45,000 Page Loads<br />Automation: More accurate than manual timing<br />Real Devices: Not measuring on simulators<br />Questions Answered:<br />Who’s Faster: Android or iPhone?<br />What’s the impact of the latest versions?<br />How does WiFi compare to 3G?<br />13<br />
    14. 14. Methdology<br />Measuring Software: Mobitest<br />Test Sites: Fortune 1,000 <br />Devices: iPhone 4, Nexus S, Galaxy S<br />Network: Mostly WiFi, one 3G test<br />Process:<br />Measure sites on a device 3 times, save median<br />Repeat 3 times on different days<br />Use median results of medians<br />14<br />
    15. 15. iPhone vs. Android - Average<br />Android 52% Faster <br />On Mobile Sites, Android only 3% Faster<br />Effectively tied<br />On Desktop Sites, Android is 59% Faster<br />Will manifest even more in Tablets<br />15<br />
    16. 16. iPhone vs. Android – Races<br />Android Faster on 84% of Sites<br />iPhone won 16% of the races<br />On Mobile Sites, Android won 71% of the time<br />Average gap decreased to 1.1 seconds<br />16<br />
    17. 17. Android Version Comparison<br />Android 2.3 is 10% Faster Than 2.2<br />2.144 Seconds vs. 2.370<br />Android 2.2 was still faster on 42% of sites<br />Average gap merely 65 milliseconds<br />JavaScript in 2.3 is 37% Faster<br />Based on SunSpider JavaScript Benchmark<br />Conclusions: <br />JavaScript Speed != Browsing Speed<br />We Optimize What We Measure<br />17<br />
    18. 18. iPhone Version Comparison<br />iPhone 4.3 Not Faster than 4.2<br />4.3 is 2% Slower: 3.253 vs. 3.182<br />4.3 was faster on 51% of Sites<br />Average gap is an even zero<br />JavaScript Engine is 2.5x Faster!<br />And yet, no browsing speed improvement<br />Theory: Nitro not always applied<br />Doesn’t manifest on full-screen websites, home page web apps, embedded browsers<br />18<br />
    19. 19. WiFi vs. 3G<br />Compared iPhone 4.2 on WiFi & 3G<br />Results: WiFi 13% Faster (3.6 vs. 3.2)<br />WiFi faster on 82% of Sites<br />Tests done under great 3G conditions:<br />Bell’s HSPA Network, Night time, good reception<br />Measured Mbps: 6 Download, 1.6 Upload<br />100 mid-day loads increase gap to 60%<br />19<br />
    20. 20. Mobile vs. Regular Site<br />Definition of a Mobile Site (in this study):<br />iPhone requires 30+ less resources than IE8<br />Result: Mobile Sites Loaded 39% Faster<br />66% Faster on iPhone, 8% Faster on Android<br />Simple Sites 2xFaster Than Complex<br />Simple = 30- Requests<br />20<br />
    21. 21. Anecdotes & Insights<br />Preliminary<br />(use at your own risk)<br />
    22. 22. WSJ – iPhone 4.3<br />Load Time<br />17 Secs<br />Start Render<br />8.4 Secs<br />Requests<br />159<br />Size<br />1,252 KB<br />22<br />
    23. 23. WSJ – Android 2.3<br />23<br />Load Time<br />7.5 Secs<br />Start Render<br />8.4 Secs<br />Requests<br />204<br />Size<br />1,313 KB<br />
    24. 24. WSJ – Requests 20-35<br />iPhone<br />5 Domains<br />Android<br />1 Domain<br />24<br />
    25. 25. WSJ - Theories<br />Android downloads resources faster<br />Seen on other sites, more efficient network?<br />Speedtest.net shows the same up/down speeds<br />Android reorders image requests?<br />Consistently seen in the WSJ waterfall<br />Has some constraints – domains do repeat later<br />Complex sites make room for optimizations<br />25<br />
    26. 26. Velocity Conf – iPhone 4.3<br />26<br />Load Time<br />8.7 Secs<br />Start Render<br />6 Secs<br />Requests<br />75<br />Size<br />1,147 KB<br />
    27. 27. Velocity Conf – Android 2.3<br />27<br />Load Time<br />4.6 Secs<br />Start Render<br />2.1 Secs<br />Requests<br />78<br />Size<br />1,075 KB<br />
    28. 28. Velocity Conf - # Connections<br />iPhone 4.3<br />More connections<br />6 per host, 35 max<br />More than 4.2<br />Android 4.2<br />Less connections<br />4 per host, 4 max<br />28<br />
    29. 29. Velocity Conf – JS/CSS In Parallel<br />iPhone<br />CSS & JS block each other<br />Android<br />CSS & JS don’t appear to block<br />29<br />
    30. 30. Velocity Conf – Conclusions<br />More connections doesn’t mean faster<br />Apparently even more on mobile devices<br />Doesn’t match with current desktop wisdom<br />Smart parallel actions matter<br />CSS & JS often mix together<br />Blocking resources are a major slowdown<br />Browser speed has many moving parts…<br />30<br />
    31. 31. Coming Soon<br />
    32. 32. iPad Agent<br />32<br />
    33. 33. iPad & iPhone – Same OS, Different Site<br />33<br />2.3 Seconds<br />9 seconds<br />
    34. 34. Blackberry<br />34<br />
    35. 35. Q&A<br />

    ×