Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Ad Load Performance Scoring  Working Group Update Eric Goldsmith Tony Ralph, Pramod Khincha, Bryant Mason, Mark Masterson,...
Motivation <ul><li>Does speed matter? </li></ul><ul><li>Causal connection between page load-time and user behavior </li></...
Motivation  cont’d <ul><li>Faster Pages  Users Do More  See More Ads </li></ul><ul><li>Faster  Ads   Faster Pages  …  See ...
Ad Load Performance Scoring ALPS <ul><li>ALPS Working Group goals </li></ul><ul><ul><li>Establish standards for measuring ...
Qualitative - Best Practices Scoring <ul><li>YSlow </li></ul><ul><ul><li>Tool used internally at Y! and by many publishers...
Best Practices Highlights <ul><li>How to speed it up? </li></ul><ul><ul><li>Reduce content!! Rule of thumb – No more than ...
Best Practices  cont’d <ul><li>Advanced Techniques – Best user experience  </li></ul><ul><ul><li>Avoid nesting IFRAMEs </l...
Quantitative - Load Performance Scoring <ul><li>Microsoft is a developing a prototype to  profile  and  score  Ad download...
Load Performance Scoring  cont’d <ul><li>The scoring algorithm is  platform independent </li></ul><ul><ul><li>Analysis is ...
Load Performance Scoring Example Ad Load Performance Score Result Total number of packets 8 Predicted Download Times Time ...
The View from the Summit <ul><li>Expected benefits of the ALPScore ™ </li></ul><ul><ul><li>Correlate Ad download times wit...
Next Steps <ul><li>Finish development of features needed for both scoring tools </li></ul><ul><li>Run a small-scale study ...
Questions? p  p
Upcoming SlideShare
Loading in …5
×

ALPS WG Update - IAB Ad Ops Summit, Fall 2009

848 views

Published on

Working group status update at the Interactive Advertising Bureau's 2009 Ad Operations Summit in New York, Nov 16, 2009.
The Ad Load Performance Scoring (ALPS) working group, with membership from AOL, Yahoo, Microsoft and Google, is developing a method for 'scoring' the load performance of ads, and incorporates best-practices compliance as well as measured load speed.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

ALPS WG Update - IAB Ad Ops Summit, Fall 2009

  1. 1. Ad Load Performance Scoring Working Group Update Eric Goldsmith Tony Ralph, Pramod Khincha, Bryant Mason, Mark Masterson, Sameer Ajmani 16-Nov-2009
  2. 2. Motivation <ul><li>Does speed matter? </li></ul><ul><li>Causal connection between page load-time and user behavior </li></ul><ul><ul><li>Public data from Google, Microsoft, Facebook, AOL, Amazon, etc. </li></ul></ul><ul><ul><li>Non-public data from even more ;-) </li></ul></ul><ul><li>When pages load faster, users: </li></ul><ul><ul><li>Browse more </li></ul></ul><ul><ul><li>Search more </li></ul></ul><ul><ul><li>View more </li></ul></ul><ul><ul><li>Buy more </li></ul></ul><ul><ul><li>DO MORE </li></ul></ul>p
  3. 3. Motivation cont’d <ul><li>Faster Pages Users Do More See More Ads </li></ul><ul><li>Faster Ads Faster Pages … See More Ads </li></ul><ul><li>How to make ads faster? </li></ul><ul><ul><li>Qualitative </li></ul></ul><ul><ul><ul><li>Follow Best Practices </li></ul></ul></ul><ul><ul><ul><ul><li>www.iab.net/media/file/IAB_Ad_Load_Perfomance_BP_FINAL.pdf </li></ul></ul></ul></ul><ul><ul><ul><li>Audit Compliance (tool) </li></ul></ul></ul><ul><ul><ul><li>Best practices important, but don't guarantee fast ads </li></ul></ul></ul><ul><ul><li>Quantitative </li></ul></ul><ul><ul><ul><li>Measure load time (tool) </li></ul></ul></ul><ul><ul><ul><li>Identify / resolve performance issues </li></ul></ul></ul>p
  4. 4. Ad Load Performance Scoring ALPS <ul><li>ALPS Working Group goals </li></ul><ul><ul><li>Establish standards for measuring ad load performance </li></ul></ul><ul><ul><ul><li>Test individual ads in isolation </li></ul></ul></ul><ul><ul><ul><li>Qualitative Measure - compliance with Best Practices </li></ul></ul></ul><ul><ul><ul><li>Quantitative Measure - score ads to predict actual ad download time </li></ul></ul></ul><ul><ul><li>Provide common language for ad speed, to help specify </li></ul></ul><ul><ul><ul><li>Agency / Vendor delivery performance </li></ul></ul></ul><ul><ul><ul><li>Publisher speed expectations / requirements </li></ul></ul></ul><ul><ul><li>Extend existing Ad Specs to incorporate load performance </li></ul></ul><ul><ul><ul><li>http://www.iab.net/iab_products_and_industry_services/508676/508767/Rich_Media </li></ul></ul></ul><ul><ul><li>Allow independent testing </li></ul></ul><ul><ul><ul><li>Hosted service provided by IAB </li></ul></ul></ul><ul><ul><ul><li>Open to all members </li></ul></ul></ul>p
  5. 5. Qualitative - Best Practices Scoring <ul><li>YSlow </li></ul><ul><ul><li>Tool used internally at Y! and by many publishers to improve web page performance </li></ul></ul><ul><ul><li>Measures best practices compliance and generates easy to understand letter grades [A-F] </li></ul></ul><ul><ul><li>Help in creating better user experiences by improving quality earlier in the cycle </li></ul></ul><ul><ul><li>Studies have shown that following these rules can improve performance by 25% - 50% </li></ul></ul><ul><li>YSlow for Ads </li></ul><ul><ul><li>Develop specialized rule set to score against Ad Load Best Practices </li></ul></ul><ul><ul><li>Rules, thresholds & scoring details will be published </li></ul></ul><ul><ul><ul><li>Can be implemented in any tool </li></ul></ul></ul>
  6. 6. Best Practices Highlights <ul><li>How to speed it up? </li></ul><ul><ul><li>Reduce content!! Rule of thumb – No more than 4 components a page </li></ul></ul><ul><ul><li>Not Found Error – One of your ad components is missing which renders the ad useless </li></ul></ul><ul><ul><li>Too many serving domains per ad – DNS Lookups are expensive – restrict to 2 domains per ad </li></ul></ul><ul><ul><li>Avoid redirects – Not optimal to use redirects for counting. </li></ul></ul><ul><ul><li>Cache aggressively - </li></ul></ul><ul><li>Easy Optimizations – Slim it down </li></ul><ul><ul><li>Compress as much as possible – Easy setting on serving side </li></ul></ul><ul><ul><li>Reduce cookie size </li></ul></ul><ul><ul><li>Use a CDN when you can </li></ul></ul><ul><ul><li>Minify JS/CSS </li></ul></ul><ul><ul><li>Avoid duplicate JS/CSS - </li></ul></ul><ul><ul><li>Optimize Images </li></ul></ul>
  7. 7. Best Practices cont’d <ul><li>Advanced Techniques – Best user experience </li></ul><ul><ul><li>Avoid nesting IFRAMEs </li></ul></ul><ul><ul><li>Do not scale images in HTML </li></ul></ul><ul><ul><li>In-lining vs. caching of JS/CSS </li></ul></ul><ul><ul><li>Counting beacons no more than 1 </li></ul></ul><ul><li>Ad Ruleset Demo using AdTool </li></ul>
  8. 8. Quantitative - Load Performance Scoring <ul><li>Microsoft is a developing a prototype to profile and score Ad download performance </li></ul><ul><ul><li>Tool is based on Visual Round Trip Analyzer </li></ul></ul><ul><ul><li>The “score” is the count of network packets in the critical path of the Ad response </li></ul></ul><ul><ul><li>The algorithm quantifies Ad performance independent of end user’s network connectivity and geographic location </li></ul></ul><ul><li>Prototype can predict real-world Ad download times </li></ul><ul><ul><li>Given the score and the location of a target user, the tool can estimate actual Ad download times by accounting for various underlying network interactions </li></ul></ul><ul><ul><li>The network modeling code was developed by Microsoft Research and is based on published studies </li></ul></ul>p p
  9. 9. Load Performance Scoring cont’d <ul><li>The scoring algorithm is platform independent </li></ul><ul><ul><li>Analysis is performed on captures of network traffic </li></ul></ul><ul><ul><li>Scoring could be built into existing Ad preview tools and Creative Acceptance processes </li></ul></ul><ul><li>The resulting score is also independent of the Ad Network </li></ul><ul><ul><li>Scoring can be done before the Ad has been submitted and published </li></ul></ul><ul><li>This approach complements existing measurements conducted by Publishers and in Ad Networks—but will flag performance issues earlier in the Ad lifecycle </li></ul>p p
  10. 10. Load Performance Scoring Example Ad Load Performance Score Result Total number of packets 8 Predicted Download Times Time in ms Domestic end users 270 Nearby international end users 798 Remote international end users 1589 Ad Load Performance Score Result Total number of packets 24 Predicted Download Times Time in ms Domestic end users 598 Nearby international end users 1770 Remote international end users 3527
  11. 11. The View from the Summit <ul><li>Expected benefits of the ALPScore ™ </li></ul><ul><ul><li>Correlate Ad download times with Business performance metrics, such as CSAT, abandonment, and CTR </li></ul></ul><ul><ul><li>Highlight opportunities for optimization of Ad download times during content development </li></ul></ul><ul><ul><li>Provide comparison of download performance of new Ads with similar Ad products </li></ul></ul><ul><ul><li>Produce estimates of Ad download times for new markets </li></ul></ul><ul><ul><li>Act as an additional standard for Creative Acceptance </li></ul></ul><ul><ul><li>Provide an additional criteria for selecting Ads at runtime </li></ul></ul>p p
  12. 12. Next Steps <ul><li>Finish development of features needed for both scoring tools </li></ul><ul><li>Run a small-scale study in a controlled lab environment </li></ul><ul><li>Refine scoring based on feedback and test results </li></ul><ul><li>Perform a larger-scale study with Ads from multiple vendors and Ad Networks </li></ul><ul><li>Conduct research to correlate Business metrics, CSAT, and AdSat with the Ad Load Performance Score </li></ul>p p
  13. 13. Questions? p p

×