SlideShare a Scribd company logo
1 of 28
What You Don’t Know
About 3rd Party Scripts Can
Hurt You
About the Speakers
Scott D. Lowe, vExpert
Partner and Co-Founder
ActualTech Media
Buddy Brewer
SVP, Products
SOASTA
Jason Trester
Senior Director of Site
Engineering
CBS Interactive
The Problem
 A typical web page today can contain requests with
upward of 75% happening via 3rd party scripts
 Do you really know what kind of experience your
visitors are having?
 How do you manage the risk and the ROI of the tools
provided by these parties?
The Needs
 Measure 3rd party scripts to make sure they’re not
driving your customers away
 Truly understand the impact that every script has on
your visitors
 Provide decision-makers with critical, simple, and
actionable metrics
SOASTA Customer Case Study
Jason Trester
Senior Director of Site Engineering
CBS Interactive
CBS Interactive Key Metrics
200 Million+
Page views per month
350-400 Requests
Per page load
50 Million+
Unique visitors per month
2 Seconds
Target page load time
CBS Interactive Key Metrics
Question
How does CBS Interactive optimize the
user experience and support massive
traffic patterns while adhering to
performance requirements?
CBS Interactive Key Metrics
Answers
It starts by knowing your numbers (Ensure
adherence to business objectives)
Leverage tools to enable actionable
intelligence
Develop data-driven optimization
processes
CBS Interactive Key Metrics
Actionable Intelligence
Leverage tools to enable actionable
intelligence
SOASTA mPulse enables CBS Interactive staff to put site
metrics in front of a non-technical audience so they can
easily see what their page load times look like
SOASTA SpeedCurve has also allowed CBS Interactive
to automate a lot of their manual web page tests
SOASTA mPulse – Actionable Metrics
SOASTA mPulse – Actionable Metrics
SOASTA SpeedCurve – Actionable Metrics
SOASTA SpeedCurve – Actionable Metrics
Actionable Intelligence
 Every third party must go through an A/B test to see
how they perform
 SOASTA enables these efforts
Actionable Intelligence
12/7 RUM Performance Results (Article Page)
3.65s Control
9.73s Sample Tool
267% Increase in Page Load Time
Note: Document Complete = time it takes for page to become usable (required CSS, JS, and Images)
Actionable Intelligence
12/7 Synthetic Performance Results
1. Delayed visual start render by 15%-31%
2. Increased our doc complete size by 49% and time by 113%-150%
3. Sample Tool makes ~31 requests
• 5 Sample Tool requests (30% time; 78% size)
• 27 third-party requests (70% time; 22% size)
• Bandwidth consumption does NOT include Ad creatives
4. Bandwidth consumption 3x > Visual Revenue, Qualtrics, and DW link
5. Bandwidth consumption 3x > CNET Site JS
Example resource comparison
Group Request Count
Time
(ms)
Size
(KB)
CNET JS 19 1,504 168
Sample Tool 33 4,528 210
Excludes ad/tracking services and video player
Actionable Intelligence
1/26 RUM Performance Results (Article Page)
3.01s Control
8.17s Sample Tool
271% Increase in Page Load Time
Note: Document Complete = time it takes for page to become usable (required CSS, JS, and Images)
Operationalizing Intelligence
Develop data-driven optimization
processes
Use the results of performance metrics to make
decisions based on performance cost of 3rd party scripts
Use the information to make critical decisions, such as
priority load order of requests
Key takeaway: It’s easy to glean relative importance of
scripts based on the order in which they load
Operationalizing Intelligence
Operationalizing Intelligence
The Details Matter!
 CBS Interactive spent 6 months making sure that
fonts load quickly
 They established certain requirements on the font vendor
 They try to keep all 3rd party scripts under 1000 ms
 SOASTA enables these efforts
The Tools Matter!
 SOASTA
 mPulse
 SpeedCurve
 Grafana, Sitespeed.io, PhantomJS
 Tealium
 Helps CBS Interactive control the order in which items load
on their sites
 RequireJS
GENERAL GUIDANCE
Figure Out How Fast You Need To Be
Use the Activity Impact Score
• Tells media companies which pages are most
important so they can prioritize their efforts
Define the ROI
• If you were going to make an investment to speed
things up, what would that mean for the business?
(add revenue at expense of performance?)
Try SOASTA for Yourself!
https://www.soasta.com/performance-monitorin
Plans start at just
$99/month!

More Related Content

Similar to What You Don't Know About 3rd Party Scripts Can Hurt You!

Module 1 introduction to web analytics
Module 1   introduction to web analyticsModule 1   introduction to web analytics
Module 1 introduction to web analytics
Gayathri Choda
 
Module 1 introduction to web analytics
Module 1   introduction to web analyticsModule 1   introduction to web analytics
Module 1 introduction to web analytics
Gayathri Choda
 
Web analyticsandbigdata techweek2011
Web analyticsandbigdata techweek2011Web analyticsandbigdata techweek2011
Web analyticsandbigdata techweek2011
Raghu Kashyap
 

Similar to What You Don't Know About 3rd Party Scripts Can Hurt You! (20)

Applying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website PerformanceApplying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website Performance
 
Show Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business ResultsShow Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business Results
 
Load Speed PSI development of webcore vitals
Load Speed PSI development of webcore vitalsLoad Speed PSI development of webcore vitals
Load Speed PSI development of webcore vitals
 
Tech Stack & Web App Development For Startups
Tech Stack & Web App Development For StartupsTech Stack & Web App Development For Startups
Tech Stack & Web App Development For Startups
 
The Evolution of a Scrappy Startup to a Successful Web Service
The Evolution of a Scrappy Startup to a Successful Web ServiceThe Evolution of a Scrappy Startup to a Successful Web Service
The Evolution of a Scrappy Startup to a Successful Web Service
 
Platform for Comprehensive Vendor Research & Analysis
Platform for Comprehensive Vendor Research & AnalysisPlatform for Comprehensive Vendor Research & Analysis
Platform for Comprehensive Vendor Research & Analysis
 
Module 1 introduction to web analytics
Module 1   introduction to web analyticsModule 1   introduction to web analytics
Module 1 introduction to web analytics
 
Module 1 introduction to web analytics
Module 1   introduction to web analyticsModule 1   introduction to web analytics
Module 1 introduction to web analytics
 
Website Loading Time Statistics Crucial Data for Optimal Performance.pdf
Website Loading Time Statistics Crucial Data for Optimal Performance.pdfWebsite Loading Time Statistics Crucial Data for Optimal Performance.pdf
Website Loading Time Statistics Crucial Data for Optimal Performance.pdf
 
Web analyticsandbigdata techweek2011
Web analyticsandbigdata techweek2011Web analyticsandbigdata techweek2011
Web analyticsandbigdata techweek2011
 
17 Web Performance Metrics You Should Care About
17 Web Performance Metrics You Should Care About17 Web Performance Metrics You Should Care About
17 Web Performance Metrics You Should Care About
 
Data Driven Design: Using Web Analytics to Improve Information Architectures
Data Driven Design: Using Web Analytics to Improve Information ArchitecturesData Driven Design: Using Web Analytics to Improve Information Architectures
Data Driven Design: Using Web Analytics to Improve Information Architectures
 
Content Management Systems: Would You? Could You? Should You?
Content Management Systems: Would You? Could You? Should You?Content Management Systems: Would You? Could You? Should You?
Content Management Systems: Would You? Could You? Should You?
 
2020 Chrome Dev Summit: Web Performance 101
2020 Chrome Dev Summit: Web Performance 1012020 Chrome Dev Summit: Web Performance 101
2020 Chrome Dev Summit: Web Performance 101
 
Cms Today: Knowing When You Need A CMS
Cms Today: Knowing When You Need A CMSCms Today: Knowing When You Need A CMS
Cms Today: Knowing When You Need A CMS
 
Starter Kit for Collaboration from Karuana @ Microsoft IT
Starter Kit for Collaboration from Karuana @ Microsoft ITStarter Kit for Collaboration from Karuana @ Microsoft IT
Starter Kit for Collaboration from Karuana @ Microsoft IT
 
Neev Load Testing Services
Neev Load Testing ServicesNeev Load Testing Services
Neev Load Testing Services
 
Migrating Large Amounts of Web Content
Migrating Large Amounts of Web ContentMigrating Large Amounts of Web Content
Migrating Large Amounts of Web Content
 
MeasureWorks - Why your customers don't like to wait!
MeasureWorks - Why your customers don't like to wait!MeasureWorks - Why your customers don't like to wait!
MeasureWorks - Why your customers don't like to wait!
 
IBM Collaborative Lifecycle Management Solution for DevOps v6
IBM Collaborative Lifecycle Management Solution for DevOps v6IBM Collaborative Lifecycle Management Solution for DevOps v6
IBM Collaborative Lifecycle Management Solution for DevOps v6
 

More from Jennifer Finney

Turning Digital Performance into Competitive Advantage
Turning Digital Performance into Competitive AdvantageTurning Digital Performance into Competitive Advantage
Turning Digital Performance into Competitive Advantage
Jennifer Finney
 

More from Jennifer Finney (14)

SOASTA Office Depot Case Study
SOASTA Office Depot Case StudySOASTA Office Depot Case Study
SOASTA Office Depot Case Study
 
Webinar: How to Load Test for Your Mobile Peak
Webinar: How to Load Test for Your Mobile PeakWebinar: How to Load Test for Your Mobile Peak
Webinar: How to Load Test for Your Mobile Peak
 
Turning Digital Performance into Competitive Advantage
Turning Digital Performance into Competitive AdvantageTurning Digital Performance into Competitive Advantage
Turning Digital Performance into Competitive Advantage
 
Welcome to the Intelligent Testing Revolution!
Welcome to the Intelligent Testing Revolution!Welcome to the Intelligent Testing Revolution!
Welcome to the Intelligent Testing Revolution!
 
Using JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous TestingUsing JMeter Scripts in CloudTest for Continuous Testing
Using JMeter Scripts in CloudTest for Continuous Testing
 
Webinar: Proactive Strategies for Finding and Fixing Performance Issues
Webinar: Proactive Strategies for Finding and Fixing Performance IssuesWebinar: Proactive Strategies for Finding and Fixing Performance Issues
Webinar: Proactive Strategies for Finding and Fixing Performance Issues
 
Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?
 
Webinar: Version Control in SOASTA 57
Webinar: Version Control in SOASTA 57Webinar: Version Control in SOASTA 57
Webinar: Version Control in SOASTA 57
 
Network Emulation in SOASTA 57 Spring Release
Network Emulation in SOASTA 57 Spring ReleaseNetwork Emulation in SOASTA 57 Spring Release
Network Emulation in SOASTA 57 Spring Release
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestIntegrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
 
New Features in CloudTest & TouchTest
New Features in CloudTest & TouchTestNew Features in CloudTest & TouchTest
New Features in CloudTest & TouchTest
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
 
DPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptxDPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptx
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest WebinarSoasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest Webinar
 

Recently uploaded

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 

What You Don't Know About 3rd Party Scripts Can Hurt You!

  • 1. What You Don’t Know About 3rd Party Scripts Can Hurt You
  • 2. About the Speakers Scott D. Lowe, vExpert Partner and Co-Founder ActualTech Media Buddy Brewer SVP, Products SOASTA Jason Trester Senior Director of Site Engineering CBS Interactive
  • 3. The Problem  A typical web page today can contain requests with upward of 75% happening via 3rd party scripts  Do you really know what kind of experience your visitors are having?  How do you manage the risk and the ROI of the tools provided by these parties?
  • 4. The Needs  Measure 3rd party scripts to make sure they’re not driving your customers away  Truly understand the impact that every script has on your visitors  Provide decision-makers with critical, simple, and actionable metrics
  • 5. SOASTA Customer Case Study Jason Trester Senior Director of Site Engineering CBS Interactive
  • 6. CBS Interactive Key Metrics 200 Million+ Page views per month 350-400 Requests Per page load 50 Million+ Unique visitors per month 2 Seconds Target page load time
  • 7. CBS Interactive Key Metrics Question How does CBS Interactive optimize the user experience and support massive traffic patterns while adhering to performance requirements?
  • 8. CBS Interactive Key Metrics Answers It starts by knowing your numbers (Ensure adherence to business objectives) Leverage tools to enable actionable intelligence Develop data-driven optimization processes
  • 10. Actionable Intelligence Leverage tools to enable actionable intelligence SOASTA mPulse enables CBS Interactive staff to put site metrics in front of a non-technical audience so they can easily see what their page load times look like SOASTA SpeedCurve has also allowed CBS Interactive to automate a lot of their manual web page tests
  • 11. SOASTA mPulse – Actionable Metrics
  • 12. SOASTA mPulse – Actionable Metrics
  • 13. SOASTA SpeedCurve – Actionable Metrics
  • 14. SOASTA SpeedCurve – Actionable Metrics
  • 15. Actionable Intelligence  Every third party must go through an A/B test to see how they perform  SOASTA enables these efforts
  • 16. Actionable Intelligence 12/7 RUM Performance Results (Article Page) 3.65s Control 9.73s Sample Tool 267% Increase in Page Load Time Note: Document Complete = time it takes for page to become usable (required CSS, JS, and Images)
  • 17. Actionable Intelligence 12/7 Synthetic Performance Results 1. Delayed visual start render by 15%-31% 2. Increased our doc complete size by 49% and time by 113%-150% 3. Sample Tool makes ~31 requests • 5 Sample Tool requests (30% time; 78% size) • 27 third-party requests (70% time; 22% size) • Bandwidth consumption does NOT include Ad creatives 4. Bandwidth consumption 3x > Visual Revenue, Qualtrics, and DW link 5. Bandwidth consumption 3x > CNET Site JS Example resource comparison Group Request Count Time (ms) Size (KB) CNET JS 19 1,504 168 Sample Tool 33 4,528 210 Excludes ad/tracking services and video player
  • 18. Actionable Intelligence 1/26 RUM Performance Results (Article Page) 3.01s Control 8.17s Sample Tool 271% Increase in Page Load Time Note: Document Complete = time it takes for page to become usable (required CSS, JS, and Images)
  • 19. Operationalizing Intelligence Develop data-driven optimization processes Use the results of performance metrics to make decisions based on performance cost of 3rd party scripts Use the information to make critical decisions, such as priority load order of requests Key takeaway: It’s easy to glean relative importance of scripts based on the order in which they load
  • 22. The Details Matter!  CBS Interactive spent 6 months making sure that fonts load quickly  They established certain requirements on the font vendor  They try to keep all 3rd party scripts under 1000 ms  SOASTA enables these efforts
  • 23. The Tools Matter!  SOASTA  mPulse  SpeedCurve  Grafana, Sitespeed.io, PhantomJS  Tealium  Helps CBS Interactive control the order in which items load on their sites  RequireJS
  • 25. Figure Out How Fast You Need To Be
  • 26. Use the Activity Impact Score • Tells media companies which pages are most important so they can prioritize their efforts
  • 27. Define the ROI • If you were going to make an investment to speed things up, what would that mean for the business? (add revenue at expense of performance?)
  • 28. Try SOASTA for Yourself! https://www.soasta.com/performance-monitorin Plans start at just $99/month!

Editor's Notes

  1. Create a culture where LOB people and decision makers are communicating
  2. Wants to show just the middle chart – Jason will send me a better image. Most of this data does not come from SOASTA. But it does speak to the percentage of CBSi stuff vs. other stuff. Move higher in the deck. Comes from sitespeed.io. Takeaway – they only control about 30% of their site.
  3. Jason will find a better graph here, too. Add Soasta example to deck
  4. Change to header bidding system (not BeanStock)
  5. Change to header bidding system (not BeanStock)
  6. Come back in and add some color Figure out how fast you need to be Activity Impact Score – tells media companies which pages are most important so they can prioritize their efforts Define the ROI – if you were going to make an investment to speed things up, what would that mean for the business? (add revenue at expense of performance?)
  7. Come back in and add some color Figure out how fast you need to be Activity Impact Score – tells media companies which pages are most important so they can prioritize their efforts Define the ROI – if you were going to make an investment to speed things up, what would that mean for the business? (add revenue at expense of performance?)
  8. Come back in and add some color Figure out how fast you need to be Activity Impact Score – tells media companies which pages are most important so they can prioritize their efforts Define the ROI – if you were going to make an investment to speed things up, what would that mean for the business? (add revenue at expense of performance?)