SlideShare a Scribd company logo
1 of 27
Performance Testing its not
that Scary!
Stephen Mounsey
Performance is Scary
Real World Performance Examples
• Obama Care 4.7
million people in 24
hours
• M&S re-launch 8.1%
• According to Google,
an extra 500MS of
latency costs them
20% of their search
traffic
Performance is important
• Google rankings
• Mobile – more
sensitive
• User experience
• Conversion rates
• Money
Amazon report a 1% increase in revenue
for Every 100ms of Improvement
PerformanceTesting
Stress
Scalability
LoadSoak
Failover
Capacit
y Resilience
Spike
Performance
Regression
Ramp
Endurance
Volume
Speed
Stability
Load
Load
Agile, Continuous Delivery
Early and Often,
Continuous
Early and Often
• How can we do it earlier, smaller units,
complete system earlier can you stub or
virtualize
• Title: Performance Testing its not that
scary
• We all need to do it – Everyone is
responsible for Quality
Get Performance Noticed
• Repeatability
– Change
– Trends
• Realistic
– TVM
– Concurrency
Principles
•
Understand
Scientific
Performance Tools
• Loadrunner
Performance Center
• Jmeter
• Grinder
• Smart Bear
• Gatling
• MS Load Test
• Neo-load
• WebLoad
• Rational
• Skills
• Products
• Technology culture
• Support vs Business
Critical
• Cost
• Wider dev integration
Tools
Selection
• It’s tough
• PT: It’s not that scary
• Make your own
Recruitment
What do we do?
What do we
do?
Monitoring vs Testing
• What if we didn’t performance test?
• Pre production is it the same as
production?
• Always on performance
• Do you test in
production?
• Are you outsourcing
your perf testing to
users
• Performance Testing
its not that scary!
Testing In
Production
A Little about me
@stephenmounsey
People of Interest

More Related Content

Viewers also liked (8)

D146243
D146243D146243
D146243
 
D146247
D146247D146247
D146247
 
D146248
D146248D146248
D146248
 
D146242
D146242D146242
D146242
 
D146241
D146241D146241
D146241
 
D146245
D146245D146245
D146245
 
D146504
D146504D146504
D146504
 
D146246
D146246D146246
D146246
 

Similar to Performance testing its not that scary

Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...
Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...
Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...agilemaine
 
Performance Testing: Evolving The Performance
Performance Testing: Evolving The PerformancePerformance Testing: Evolving The Performance
Performance Testing: Evolving The PerformanceGlobant
 
Lightning Talks by Globant - One step into the future of performance testing
Lightning Talks by Globant - One step into the future of performance testing Lightning Talks by Globant - One step into the future of performance testing
Lightning Talks by Globant - One step into the future of performance testing Globant
 
Velocity NY - How to Measure Revenue in Milliseconds
Velocity NY - How to Measure Revenue in MillisecondsVelocity NY - How to Measure Revenue in Milliseconds
Velocity NY - How to Measure Revenue in MillisecondsCliff Crocker
 
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013TEST Huddle
 
Intuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramIntuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramOptimizely
 
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...Codemotion
 
Thomas Jensen. Machine Learning
Thomas Jensen. Machine LearningThomas Jensen. Machine Learning
Thomas Jensen. Machine LearningVolha Banadyseva
 
An Agile Approach to Machine Learning
An Agile Approach to Machine LearningAn Agile Approach to Machine Learning
An Agile Approach to Machine LearningRandy Shoup
 
Goal driven performance optimization (Пётр Зайцев)
Goal driven performance optimization (Пётр Зайцев)Goal driven performance optimization (Пётр Зайцев)
Goal driven performance optimization (Пётр Зайцев)Ontico
 
Horizon: Deep Reinforcement Learning at Scale
Horizon: Deep Reinforcement Learning at ScaleHorizon: Deep Reinforcement Learning at Scale
Horizon: Deep Reinforcement Learning at ScaleDatabricks
 
Webinar mobile monitoring_intro
Webinar mobile monitoring_introWebinar mobile monitoring_intro
Webinar mobile monitoring_introPerfecto Mobile
 
The Global State of EQMS
The Global State of EQMSThe Global State of EQMS
The Global State of EQMSLNSResearch
 
DEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOpsDEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOpsAmazon Web Services
 
Achieving Operational Excellence With AI And Machine Learning
Achieving Operational Excellence With AI And Machine LearningAchieving Operational Excellence With AI And Machine Learning
Achieving Operational Excellence With AI And Machine LearningFaisal Hoque
 
Web Performance BootCamp 2013
Web Performance BootCamp 2013Web Performance BootCamp 2013
Web Performance BootCamp 2013Daniel Austin
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software QualityAnand Prabhala
 
Qualitia - Scriptless Test Automation Platform
Qualitia - Scriptless Test Automation PlatformQualitia - Scriptless Test Automation Platform
Qualitia - Scriptless Test Automation PlatformMonica Paul
 
Plant Managers Workshop.ppt
Plant Managers Workshop.pptPlant Managers Workshop.ppt
Plant Managers Workshop.pptkhoang74
 

Similar to Performance testing its not that scary (20)

Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...
Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...
Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...
 
Performance Testing: Evolving The Performance
Performance Testing: Evolving The PerformancePerformance Testing: Evolving The Performance
Performance Testing: Evolving The Performance
 
Lightning Talks by Globant - One step into the future of performance testing
Lightning Talks by Globant - One step into the future of performance testing Lightning Talks by Globant - One step into the future of performance testing
Lightning Talks by Globant - One step into the future of performance testing
 
Velocity NY - How to Measure Revenue in Milliseconds
Velocity NY - How to Measure Revenue in MillisecondsVelocity NY - How to Measure Revenue in Milliseconds
Velocity NY - How to Measure Revenue in Milliseconds
 
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
 
Rational Quality Manager
Rational Quality ManagerRational Quality Manager
Rational Quality Manager
 
Intuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramIntuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation Program
 
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
 
Thomas Jensen. Machine Learning
Thomas Jensen. Machine LearningThomas Jensen. Machine Learning
Thomas Jensen. Machine Learning
 
An Agile Approach to Machine Learning
An Agile Approach to Machine LearningAn Agile Approach to Machine Learning
An Agile Approach to Machine Learning
 
Goal driven performance optimization (Пётр Зайцев)
Goal driven performance optimization (Пётр Зайцев)Goal driven performance optimization (Пётр Зайцев)
Goal driven performance optimization (Пётр Зайцев)
 
Horizon: Deep Reinforcement Learning at Scale
Horizon: Deep Reinforcement Learning at ScaleHorizon: Deep Reinforcement Learning at Scale
Horizon: Deep Reinforcement Learning at Scale
 
Webinar mobile monitoring_intro
Webinar mobile monitoring_introWebinar mobile monitoring_intro
Webinar mobile monitoring_intro
 
The Global State of EQMS
The Global State of EQMSThe Global State of EQMS
The Global State of EQMS
 
DEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOpsDEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOps
 
Achieving Operational Excellence With AI And Machine Learning
Achieving Operational Excellence With AI And Machine LearningAchieving Operational Excellence With AI And Machine Learning
Achieving Operational Excellence With AI And Machine Learning
 
Web Performance BootCamp 2013
Web Performance BootCamp 2013Web Performance BootCamp 2013
Web Performance BootCamp 2013
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
 
Qualitia - Scriptless Test Automation Platform
Qualitia - Scriptless Test Automation PlatformQualitia - Scriptless Test Automation Platform
Qualitia - Scriptless Test Automation Platform
 
Plant Managers Workshop.ppt
Plant Managers Workshop.pptPlant Managers Workshop.ppt
Plant Managers Workshop.ppt
 

Recently uploaded

WSO2CON 2024 - OSU & WSO2: A Decade Journey in Integration & Innovation
WSO2CON 2024 - OSU & WSO2: A Decade Journey in Integration & InnovationWSO2CON 2024 - OSU & WSO2: A Decade Journey in Integration & Innovation
WSO2CON 2024 - OSU & WSO2: A Decade Journey in Integration & InnovationWSO2
 
WSO2Con2024 - Hello Choreo Presentation - Kanchana
WSO2Con2024 - Hello Choreo Presentation - KanchanaWSO2Con2024 - Hello Choreo Presentation - Kanchana
WSO2Con2024 - Hello Choreo Presentation - KanchanaWSO2
 
WSO2CON 2024 Slides - Unlocking Value with AI
WSO2CON 2024 Slides - Unlocking Value with AIWSO2CON 2024 Slides - Unlocking Value with AI
WSO2CON 2024 Slides - Unlocking Value with AIWSO2
 
WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2
 
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2
 
WSO2CON 2024 - Software Engineering for Digital Businesses
WSO2CON 2024 - Software Engineering for Digital BusinessesWSO2CON 2024 - Software Engineering for Digital Businesses
WSO2CON 2024 - Software Engineering for Digital BusinessesWSO2
 
WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...
WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...
WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...WSO2
 
WSO2Con2024 - Simplified Integration: Unveiling the Latest Features in WSO2 L...
WSO2Con2024 - Simplified Integration: Unveiling the Latest Features in WSO2 L...WSO2Con2024 - Simplified Integration: Unveiling the Latest Features in WSO2 L...
WSO2Con2024 - Simplified Integration: Unveiling the Latest Features in WSO2 L...WSO2
 
WSO2Con2024 - Organization Management: The Revolution in B2B CIAM
WSO2Con2024 - Organization Management: The Revolution in B2B CIAMWSO2Con2024 - Organization Management: The Revolution in B2B CIAM
WSO2Con2024 - Organization Management: The Revolution in B2B CIAMWSO2
 
WSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go PlatformlessWSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go PlatformlessWSO2
 
WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...
WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...
WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...WSO2
 
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With SimplicityWSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With SimplicityWSO2
 
WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!
WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!
WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!WSO2
 
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024VictoriaMetrics
 
WSO2Con2024 - Low-Code Integration Tooling
WSO2Con2024 - Low-Code Integration ToolingWSO2Con2024 - Low-Code Integration Tooling
WSO2Con2024 - Low-Code Integration ToolingWSO2
 
Architecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the pastArchitecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the pastPapp Krisztián
 
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open SourceWSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open SourceWSO2
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareJim McKeeth
 
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...WSO2
 

Recently uploaded (20)

WSO2CON 2024 - OSU & WSO2: A Decade Journey in Integration & Innovation
WSO2CON 2024 - OSU & WSO2: A Decade Journey in Integration & InnovationWSO2CON 2024 - OSU & WSO2: A Decade Journey in Integration & Innovation
WSO2CON 2024 - OSU & WSO2: A Decade Journey in Integration & Innovation
 
WSO2Con2024 - Hello Choreo Presentation - Kanchana
WSO2Con2024 - Hello Choreo Presentation - KanchanaWSO2Con2024 - Hello Choreo Presentation - Kanchana
WSO2Con2024 - Hello Choreo Presentation - Kanchana
 
WSO2CON 2024 Slides - Unlocking Value with AI
WSO2CON 2024 Slides - Unlocking Value with AIWSO2CON 2024 Slides - Unlocking Value with AI
WSO2CON 2024 Slides - Unlocking Value with AI
 
WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?
 
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
 
WSO2CON 2024 - Software Engineering for Digital Businesses
WSO2CON 2024 - Software Engineering for Digital BusinessesWSO2CON 2024 - Software Engineering for Digital Businesses
WSO2CON 2024 - Software Engineering for Digital Businesses
 
WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...
WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...
WSO2CON 2024 - IoT Needs CIAM: The Importance of Centralized IAM in a Growing...
 
WSO2Con2024 - Simplified Integration: Unveiling the Latest Features in WSO2 L...
WSO2Con2024 - Simplified Integration: Unveiling the Latest Features in WSO2 L...WSO2Con2024 - Simplified Integration: Unveiling the Latest Features in WSO2 L...
WSO2Con2024 - Simplified Integration: Unveiling the Latest Features in WSO2 L...
 
WSO2Con2024 - Organization Management: The Revolution in B2B CIAM
WSO2Con2024 - Organization Management: The Revolution in B2B CIAMWSO2Con2024 - Organization Management: The Revolution in B2B CIAM
WSO2Con2024 - Organization Management: The Revolution in B2B CIAM
 
WSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go PlatformlessWSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go Platformless
 
WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...
WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...
WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...
 
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With SimplicityWSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
 
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
 
WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!
WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!
WSO2CON 2024 - Not Just Microservices: Rightsize Your Services!
 
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
 
WSO2Con2024 - Low-Code Integration Tooling
WSO2Con2024 - Low-Code Integration ToolingWSO2Con2024 - Low-Code Integration Tooling
WSO2Con2024 - Low-Code Integration Tooling
 
Architecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the pastArchitecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the past
 
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open SourceWSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK Software
 
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
 

Performance testing its not that scary

Editor's Notes

  1. Description: An interactive talk about why performance testing isn't that scary, key messages being we should all be doing performance testing, why performance is scary and really important and increasingly so. Packed with take home practical advice; key performance terminology discussed and principles and practices which can and should be applied to any performance test, tools and tool selection, recruitment and more. Also discussing why and how we need to change how we performance test with regards agile, dev ops and continuous delivery. Intro – Performance is scary What is Performance Testing and what do the terms mean Principles and Practices which apply to any performance test Tools and tool selection Recruitment – How to find a good performance tester What we do and what we are thinking about. Monitoring vs Testing and Performance in production.
  2. New Pic
  3. How many fo you have had a real world performance problem Is it easy to diagnose and fix – was it one or two lines of code
  4. Amazon – Shopping basket faster payment – less time to think Delivery – Drones (Faster) UK delivery network Walmart increased conversions by 2% for every second of load time improvement
  5. Ask the audience what terms they use?????? Language is important
  6. Load vs Performance To do performance testing you need to load the system
  7. Have you ever felt like there is too much stuff coming at you. With agile, Dev Ops and continuous delivery we cant do perf test in the same way. Mentality Change More PT is required Why did we leave it to the last minute anyway? It has the ability to completely ruin a project
  8. Start thinking about performance testing in a different way this is no longer something which happens after an app is pretty much complete Change Mentality from a last record and playback test to an early performance engineering approach Continuous – Environment challenges V model
  9. Repeatability As we are benchmarking – Performance regression we need to be very aware of how repeatable our testing is. Caching – artificially quickly Cleardowns Data – Keep same Network traffic – Jobs Time of Day Realistic to the environment – 1/10 CPU Live Like Data – Obfuscation, Anonamise tools Tests – Live functions Live volumes Changing one thing Scientific thing – only change the thing which you are trying to test Monitor – Vauxhall Corsa vs Nissan GTR
  10. Understand: Monitor Measure Interoperability
  11. Ask Audience what they use?
  12. People are reluctant – Niche Build your own
  13. Scott Barber Simon Knight Mark Tomlinson James Pulley