Performance in the cloud

Diego Cardozo
Diego CardozoPrincipal Performance Engineer at Oracle
v2016 September 30th 2016v2016 September 30th 2016
Performance in the Cloud
NetSuite
Sr. Web Performance Engineer
Diego Cardozo
v2016 September 30th 2016v2016 September 30th 2016
Agenda
• Why performance matters #perfmatters
• What to test
• How to test
• Performance on the cloud
• Test your cloud with local tools
• Test your cloud with cloud tools
• Let your users do the testing for you
v2016 September 30th 2016v2016 September 30th 2016
Why performance matters
Why is it important for our business?
• Google: 2% slower = 2% less searches per user
• Yahoo: 400 ms faster = 9% more traffic
• Amazon: 100ms faster = 1% more revenue
• Google uses site speed in web search ranking
Better performance  Happier users  More $
v2016 September 30th 2016v2016 September 30th 2016
What to test
Classification of performance tests
Type of test Goal
Performance Determine and validate speed
Load Verify application behavior under
normal and peak load conditions
Stress Verify application behavior beyond
normal and peak load conditions
Capacity Determine how many users and/or
transactions are supported while
meeting performance goals
v2016 September 30th 2016v2016 September 30th 2016
How to test
There are only 2 rules
1. Measure first, then optimize
2. Repeat rule number 1 frequently
v2016 September 30th 2016v2016 September 30th 2016
What to test
Have a goal – 3 alternatives
• Performance Budget
• Twitter uses “time to first Tweet”
• Google created the RAIL model
v2016 September 30th 2016v2016 September 30th 2016
How to test
2 approaches
• Synthetic monitoring
Emulate a user's browser, run a test case and
register response times for all requests
• Real User Monitoring (RUM)
Users passively send real performance data
v2016 September 30th 2016v2016 September 30th 2016
</talk>
time to see some real tools…
v2016 September 30th 2016v2016 September 30th 2016
Synthetic monitoring
• Quick performance tests
WebPage Test (free)
• Add load tests to your local dev suite
Visual Studio Enterprise  Load tests
• Run load tests from the cloud (free/paid)
Visual Studio Team Services
v2016 September 30th 2016v2016 September 30th 2016
Real User Monitoring (RUM)
Application Insights – available for free on Azure
• Gather performance data from real users
• 360° view of your application
• Server level – IIS
• Application level – SDK  Telemetry data
• Client level – data collection through JavaScript
v2016 September 30th 2016v2016 September 30th 2016
Application Insights
• Application performance monitoring
Measure performance, discover failures
• Interactive data analytics
Ad-hoc queries and deep diagnostics
• Proactive detection
Machine learning based anomaly detection
• Not just .NET
Java, Ruby, Python, PHP and Node.JS on Azure
v2016 September 30th 2016v2016 September 30th 2016
Resources and questions
• Slides
http://bit.ly/netconf-performance
• RAIL
http://bit.ly/rail-performance
• Microsoft’s performance testing guide
http://bit.ly/microsoft-performance
dcardozo@netsuite.com
@diecard
1 of 12

Recommended

Monitor SharePoint usage and performance using Application Insights by
Monitor SharePoint usage and performance using Application InsightsMonitor SharePoint usage and performance using Application Insights
Monitor SharePoint usage and performance using Application InsightsAnders Rask
537 views17 slides
Check username availability using php ajax by
Check username availability using php ajaxCheck username availability using php ajax
Check username availability using php ajaxbaabtra.com - No. 1 supplier of quality freshers
1.3K views15 slides
Novidades do ASP.NET e do Visual Studio 2013 by
Novidades do ASP.NET e do Visual Studio 2013Novidades do ASP.NET e do Visual Studio 2013
Novidades do ASP.NET e do Visual Studio 2013Jiéverson Maissiat
2K views41 slides
Scalable News Feed with Mongo DB by
Scalable News Feed with Mongo DBScalable News Feed with Mongo DB
Scalable News Feed with Mongo DBThierry Schellenbach
1.4K views11 slides
Tailor azure log analytics with kusto queries by
Tailor azure log analytics with kusto queriesTailor azure log analytics with kusto queries
Tailor azure log analytics with kusto queriesSamik Roy
127 views10 slides
NetConfUy 2016 - Cómo asegurar la performance de aplicaciones móviles tanto e... by
NetConfUy 2016 - Cómo asegurar la performance de aplicaciones móviles tanto e...NetConfUy 2016 - Cómo asegurar la performance de aplicaciones móviles tanto e...
NetConfUy 2016 - Cómo asegurar la performance de aplicaciones móviles tanto e...Federico Toledo
870 views57 slides

More Related Content

Similar to Performance in the cloud

Quality Jam 2016 Product Roadmap by
Quality Jam 2016 Product RoadmapQuality Jam 2016 Product Roadmap
Quality Jam 2016 Product RoadmapQASymphony
700 views24 slides
Getting Started with Amazon WorkSpaces by
 Getting Started with Amazon WorkSpaces Getting Started with Amazon WorkSpaces
Getting Started with Amazon WorkSpacesAmazon Web Services
1.1K views26 slides
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha... by
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...DevOps.com
153 views36 slides
Getting started with amazon workspaces - Toronto by
Getting started with amazon workspaces - TorontoGetting started with amazon workspaces - Toronto
Getting started with amazon workspaces - TorontoAmazon Web Services
3.3K views26 slides
Cutting-edge Performance Testing on eCommerce Websites by
Cutting-edge Performance Testing on eCommerce WebsitesCutting-edge Performance Testing on eCommerce Websites
Cutting-edge Performance Testing on eCommerce WebsitesTechWell
576 views17 slides
Continuous Delivery Automation of Cloud Infrastructure and Applications at Ch... by
Continuous Delivery Automation of Cloud Infrastructure and Applications at Ch...Continuous Delivery Automation of Cloud Infrastructure and Applications at Ch...
Continuous Delivery Automation of Cloud Infrastructure and Applications at Ch...Brian Mericle
304 views22 slides

Similar to Performance in the cloud(20)

Quality Jam 2016 Product Roadmap by QASymphony
Quality Jam 2016 Product RoadmapQuality Jam 2016 Product Roadmap
Quality Jam 2016 Product Roadmap
QASymphony 700 views
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha... by DevOps.com
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
Continuous Testing vs Test Automation Share on Facebook Share on LinkedIn Sha...
DevOps.com153 views
Getting started with amazon workspaces - Toronto by Amazon Web Services
Getting started with amazon workspaces - TorontoGetting started with amazon workspaces - Toronto
Getting started with amazon workspaces - Toronto
Amazon Web Services3.3K views
Cutting-edge Performance Testing on eCommerce Websites by TechWell
Cutting-edge Performance Testing on eCommerce WebsitesCutting-edge Performance Testing on eCommerce Websites
Cutting-edge Performance Testing on eCommerce Websites
TechWell576 views
Continuous Delivery Automation of Cloud Infrastructure and Applications at Ch... by Brian Mericle
Continuous Delivery Automation of Cloud Infrastructure and Applications at Ch...Continuous Delivery Automation of Cloud Infrastructure and Applications at Ch...
Continuous Delivery Automation of Cloud Infrastructure and Applications at Ch...
Brian Mericle304 views
Capturing speed of user experience using user timing api by SergeyChernyshev
Capturing speed of user experience using user timing apiCapturing speed of user experience using user timing api
Capturing speed of user experience using user timing api
SergeyChernyshev671 views
Turning Analysis into Action with APIs - Superweek2017 by Mark Edmondson
Turning Analysis into Action with APIs - Superweek2017Turning Analysis into Action with APIs - Superweek2017
Turning Analysis into Action with APIs - Superweek2017
Mark Edmondson1.5K views
Turning Analysis into Action with APIs - Superweek 2017 by Peter Meyer
Turning Analysis into Action with APIs - Superweek 2017Turning Analysis into Action with APIs - Superweek 2017
Turning Analysis into Action with APIs - Superweek 2017
Peter Meyer8.2K views
AppDynamics and ME Bank: Use Cases for a Modern Digital Bank - AppSphere16 by AppDynamics
AppDynamics and ME Bank: Use Cases for a Modern Digital Bank - AppSphere16AppDynamics and ME Bank: Use Cases for a Modern Digital Bank - AppSphere16
AppDynamics and ME Bank: Use Cases for a Modern Digital Bank - AppSphere16
AppDynamics1.2K views
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S... by BAINIDA
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
BAINIDA788 views
Going Serverless at AWS Startup Day Bangalore by Madhusudan Shekar
Going Serverless at AWS Startup Day Bangalore Going Serverless at AWS Startup Day Bangalore
Going Serverless at AWS Startup Day Bangalore
Madhusudan Shekar523 views
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab... by Gene Kim
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...
Gene Kim437 views
Microservices on AWS Spot instances by Jim Bugwadia
Microservices on AWS Spot instancesMicroservices on AWS Spot instances
Microservices on AWS Spot instances
Jim Bugwadia1K views
Odata V4 : The New way to REST for Your Applications by Alok Chhabria
Odata V4 : The New way to REST for Your Applications Odata V4 : The New way to REST for Your Applications
Odata V4 : The New way to REST for Your Applications
Alok Chhabria4.3K views
AWS re:Invent 2016: re:Source Mini Con for Security Services State of the Uni... by Amazon Web Services
AWS re:Invent 2016: re:Source Mini Con for Security Services State of the Uni...AWS re:Invent 2016: re:Source Mini Con for Security Services State of the Uni...
AWS re:Invent 2016: re:Source Mini Con for Security Services State of the Uni...

More from Diego Cardozo

El proximo billon de usuarios by
El proximo billon de usuariosEl proximo billon de usuarios
El proximo billon de usuariosDiego Cardozo
143 views19 slides
The next billion users by
The next billion usersThe next billion users
The next billion usersDiego Cardozo
237 views19 slides
Troubleshooting Ecommerce Performance by
 Troubleshooting Ecommerce Performance Troubleshooting Ecommerce Performance
Troubleshooting Ecommerce PerformanceDiego Cardozo
174 views72 slides
Cranking It Up - SuiteWorld 2017 by
Cranking It Up  - SuiteWorld 2017Cranking It Up  - SuiteWorld 2017
Cranking It Up - SuiteWorld 2017Diego Cardozo
149 views72 slides
Speed Thrills - Suiteworld 2016 by
Speed Thrills - Suiteworld 2016Speed Thrills - Suiteworld 2016
Speed Thrills - Suiteworld 2016Diego Cardozo
117 views43 slides
Cómo testear performance sin morir en el intento by
Cómo testear performance sin morir en el intentoCómo testear performance sin morir en el intento
Cómo testear performance sin morir en el intentoDiego Cardozo
409 views12 slides

More from Diego Cardozo(16)

El proximo billon de usuarios by Diego Cardozo
El proximo billon de usuariosEl proximo billon de usuarios
El proximo billon de usuarios
Diego Cardozo143 views
Troubleshooting Ecommerce Performance by Diego Cardozo
 Troubleshooting Ecommerce Performance Troubleshooting Ecommerce Performance
Troubleshooting Ecommerce Performance
Diego Cardozo174 views
Cranking It Up - SuiteWorld 2017 by Diego Cardozo
Cranking It Up  - SuiteWorld 2017Cranking It Up  - SuiteWorld 2017
Cranking It Up - SuiteWorld 2017
Diego Cardozo149 views
Speed Thrills - Suiteworld 2016 by Diego Cardozo
Speed Thrills - Suiteworld 2016Speed Thrills - Suiteworld 2016
Speed Thrills - Suiteworld 2016
Diego Cardozo117 views
Cómo testear performance sin morir en el intento by Diego Cardozo
Cómo testear performance sin morir en el intentoCómo testear performance sin morir en el intento
Cómo testear performance sin morir en el intento
Diego Cardozo409 views
Optimize performance and not die trying by Diego Cardozo
Optimize performance and not die tryingOptimize performance and not die trying
Optimize performance and not die trying
Diego Cardozo1.2K views
Optimizar performance sin morir en el intento by Diego Cardozo
Optimizar performance sin morir en el intentoOptimizar performance sin morir en el intento
Optimizar performance sin morir en el intento
Diego Cardozo386 views
How to test performance and not die trying by Diego Cardozo
How to test performance and not die tryingHow to test performance and not die trying
How to test performance and not die trying
Diego Cardozo721 views
Testeando performance sin morir en el intento by Diego Cardozo
Testeando performance sin morir en el intentoTesteando performance sin morir en el intento
Testeando performance sin morir en el intento
Diego Cardozo458 views
Organización de aplicaciones web con Backbone.js by Diego Cardozo
Organización de aplicaciones web con Backbone.jsOrganización de aplicaciones web con Backbone.js
Organización de aplicaciones web con Backbone.js
Diego Cardozo1.5K views
Structuring web applications with Backbone.js by Diego Cardozo
Structuring web applications with Backbone.jsStructuring web applications with Backbone.js
Structuring web applications with Backbone.js
Diego Cardozo1.2K views
Component Based Software Development by Diego Cardozo
Component Based Software DevelopmentComponent Based Software Development
Component Based Software Development
Diego Cardozo2.9K views
Desarrollo de Software Basado en Componentes by Diego Cardozo
Desarrollo de Software Basado en ComponentesDesarrollo de Software Basado en Componentes
Desarrollo de Software Basado en Componentes
Diego Cardozo1.9K views
Single page applications by Diego Cardozo
Single page applicationsSingle page applications
Single page applications
Diego Cardozo2.4K views
Single Page Applications by Diego Cardozo
Single Page ApplicationsSingle Page Applications
Single Page Applications
Diego Cardozo2.4K views

Recently uploaded

20231123_Camunda Meetup Vienna.pdf by
20231123_Camunda Meetup Vienna.pdf20231123_Camunda Meetup Vienna.pdf
20231123_Camunda Meetup Vienna.pdfPhactum Softwareentwicklung GmbH
33 views73 slides
STPI OctaNE CoE Brochure.pdf by
STPI OctaNE CoE Brochure.pdfSTPI OctaNE CoE Brochure.pdf
STPI OctaNE CoE Brochure.pdfmadhurjyapb
13 views1 slide
PRODUCT PRESENTATION.pptx by
PRODUCT PRESENTATION.pptxPRODUCT PRESENTATION.pptx
PRODUCT PRESENTATION.pptxangelicacueva6
13 views1 slide
Attacking IoT Devices from a Web Perspective - Linux Day by
Attacking IoT Devices from a Web Perspective - Linux Day Attacking IoT Devices from a Web Perspective - Linux Day
Attacking IoT Devices from a Web Perspective - Linux Day Simone Onofri
15 views68 slides
Evolving the Network Automation Journey from Python to Platforms by
Evolving the Network Automation Journey from Python to PlatformsEvolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to PlatformsNetwork Automation Forum
12 views21 slides
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveNetwork Automation Forum
30 views35 slides

Recently uploaded(20)

STPI OctaNE CoE Brochure.pdf by madhurjyapb
STPI OctaNE CoE Brochure.pdfSTPI OctaNE CoE Brochure.pdf
STPI OctaNE CoE Brochure.pdf
madhurjyapb13 views
Attacking IoT Devices from a Web Perspective - Linux Day by Simone Onofri
Attacking IoT Devices from a Web Perspective - Linux Day Attacking IoT Devices from a Web Perspective - Linux Day
Attacking IoT Devices from a Web Perspective - Linux Day
Simone Onofri15 views
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Serverless computing with Google Cloud (2023-24) by wesley chun
Serverless computing with Google Cloud (2023-24)Serverless computing with Google Cloud (2023-24)
Serverless computing with Google Cloud (2023-24)
wesley chun10 views
handbook for web 3 adoption.pdf by Liveplex
handbook for web 3 adoption.pdfhandbook for web 3 adoption.pdf
handbook for web 3 adoption.pdf
Liveplex22 views
The details of description: Techniques, tips, and tangents on alternative tex... by BookNet Canada
The details of description: Techniques, tips, and tangents on alternative tex...The details of description: Techniques, tips, and tangents on alternative tex...
The details of description: Techniques, tips, and tangents on alternative tex...
BookNet Canada126 views
Data Integrity for Banking and Financial Services by Precisely
Data Integrity for Banking and Financial ServicesData Integrity for Banking and Financial Services
Data Integrity for Banking and Financial Services
Precisely12 views
Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10237 views
Five Things You SHOULD Know About Postman by Postman
Five Things You SHOULD Know About PostmanFive Things You SHOULD Know About Postman
Five Things You SHOULD Know About Postman
Postman30 views

Performance in the cloud

  • 1. v2016 September 30th 2016v2016 September 30th 2016 Performance in the Cloud NetSuite Sr. Web Performance Engineer Diego Cardozo
  • 2. v2016 September 30th 2016v2016 September 30th 2016 Agenda • Why performance matters #perfmatters • What to test • How to test • Performance on the cloud • Test your cloud with local tools • Test your cloud with cloud tools • Let your users do the testing for you
  • 3. v2016 September 30th 2016v2016 September 30th 2016 Why performance matters Why is it important for our business? • Google: 2% slower = 2% less searches per user • Yahoo: 400 ms faster = 9% more traffic • Amazon: 100ms faster = 1% more revenue • Google uses site speed in web search ranking Better performance  Happier users  More $
  • 4. v2016 September 30th 2016v2016 September 30th 2016 What to test Classification of performance tests Type of test Goal Performance Determine and validate speed Load Verify application behavior under normal and peak load conditions Stress Verify application behavior beyond normal and peak load conditions Capacity Determine how many users and/or transactions are supported while meeting performance goals
  • 5. v2016 September 30th 2016v2016 September 30th 2016 How to test There are only 2 rules 1. Measure first, then optimize 2. Repeat rule number 1 frequently
  • 6. v2016 September 30th 2016v2016 September 30th 2016 What to test Have a goal – 3 alternatives • Performance Budget • Twitter uses “time to first Tweet” • Google created the RAIL model
  • 7. v2016 September 30th 2016v2016 September 30th 2016 How to test 2 approaches • Synthetic monitoring Emulate a user's browser, run a test case and register response times for all requests • Real User Monitoring (RUM) Users passively send real performance data
  • 8. v2016 September 30th 2016v2016 September 30th 2016 </talk> time to see some real tools…
  • 9. v2016 September 30th 2016v2016 September 30th 2016 Synthetic monitoring • Quick performance tests WebPage Test (free) • Add load tests to your local dev suite Visual Studio Enterprise  Load tests • Run load tests from the cloud (free/paid) Visual Studio Team Services
  • 10. v2016 September 30th 2016v2016 September 30th 2016 Real User Monitoring (RUM) Application Insights – available for free on Azure • Gather performance data from real users • 360° view of your application • Server level – IIS • Application level – SDK  Telemetry data • Client level – data collection through JavaScript
  • 11. v2016 September 30th 2016v2016 September 30th 2016 Application Insights • Application performance monitoring Measure performance, discover failures • Interactive data analytics Ad-hoc queries and deep diagnostics • Proactive detection Machine learning based anomaly detection • Not just .NET Java, Ruby, Python, PHP and Node.JS on Azure
  • 12. v2016 September 30th 2016v2016 September 30th 2016 Resources and questions • Slides http://bit.ly/netconf-performance • RAIL http://bit.ly/rail-performance • Microsoft’s performance testing guide http://bit.ly/microsoft-performance dcardozo@netsuite.com @diecard