SlideShare a Scribd company logo
Performance Testing its not
that Scary!
Stephen Mounsey
Performance is Scary
Real World Performance Examples
• Obama Care 4.7
million people in 24
hours
• M&S re-launch 8.1%
• According to Google,
an extra 500MS of
latency costs them
20% of their search
traffic
Performance is important
• Google rankings
• Mobile – more
sensitive
• User experience
• Conversion rates
• Money
Amazon report a 1% increase in revenue
for Every 100ms of Improvement
PerformanceTesting
Stress
Scalability
LoadSoak
Failover
Capacit
y Resilience
Spike
Performance
Regression
Ramp
Endurance
Volume
Speed
Stability
Load
Load
Agile, Continuous Delivery
Early and Often,
Continuous
Early and Often
• How can we do it earlier, smaller units,
complete system earlier can you stub or
virtualize
• Title: Performance Testing its not that
scary
• We all need to do it – Everyone is
responsible for Quality
Get Performance Noticed
• Repeatability
– Change
– Trends
• Realistic
– TVM
– Concurrency
Principles
•
Understand
Scientific
Performance Tools
• Loadrunner
Performance Center
• Jmeter
• Grinder
• Smart Bear
• Gatling
• MS Load Test
• Neo-load
• WebLoad
• Rational
• Skills
• Products
• Technology culture
• Support vs Business
Critical
• Cost
• Wider dev integration
Tools
Selection
• It’s tough
• PT: It’s not that scary
• Make your own
Recruitment
What do we do?
What do we
do?
Monitoring vs Testing
• What if we didn’t performance test?
• Pre production is it the same as
production?
• Always on performance
• Do you test in
production?
• Are you outsourcing
your perf testing to
users
• Performance Testing
its not that scary!
Testing In
Production
A Little about me
@stephenmounsey
People of Interest

More Related Content

Similar to Performance testing its not that scary v2

Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
TEST Huddle
 
Rational Quality Manager
Rational Quality ManagerRational Quality Manager
Rational Quality Manager
Strongback Consulting
 
Intuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramIntuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation Program
Optimizely
 
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Codemotion
 
Thomas Jensen. Machine Learning
Thomas Jensen. Machine LearningThomas Jensen. Machine Learning
Thomas Jensen. Machine Learning
Volha Banadyseva
 
An Agile Approach to Machine Learning
An Agile Approach to Machine LearningAn Agile Approach to Machine Learning
An Agile Approach to Machine Learning
Randy Shoup
 
Goal driven performance optimization (Пётр Зайцев)
Goal driven performance optimization (Пётр Зайцев)Goal driven performance optimization (Пётр Зайцев)
Goal driven performance optimization (Пётр Зайцев)Ontico
 
Horizon: Deep Reinforcement Learning at Scale
Horizon: Deep Reinforcement Learning at ScaleHorizon: Deep Reinforcement Learning at Scale
Horizon: Deep Reinforcement Learning at Scale
Databricks
 
Webinar mobile monitoring_intro
Webinar mobile monitoring_introWebinar mobile monitoring_intro
Webinar mobile monitoring_introPerfecto Mobile
 
The Global State of EQMS
The Global State of EQMSThe Global State of EQMS
The Global State of EQMS
LNSResearch
 
DEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOpsDEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOps
Amazon Web Services
 
Achieving Operational Excellence With AI And Machine Learning
Achieving Operational Excellence With AI And Machine LearningAchieving Operational Excellence With AI And Machine Learning
Achieving Operational Excellence With AI And Machine Learning
Faisal Hoque
 
Web Performance BootCamp 2013
Web Performance BootCamp 2013Web Performance BootCamp 2013
Web Performance BootCamp 2013
Daniel Austin
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
Anand Prabhala
 
Qualitia - Scriptless Test Automation Platform
Qualitia - Scriptless Test Automation PlatformQualitia - Scriptless Test Automation Platform
Qualitia - Scriptless Test Automation Platform
Monica Paul
 
Plant Managers Workshop.ppt
Plant Managers Workshop.pptPlant Managers Workshop.ppt
Plant Managers Workshop.ppt
khoang74
 
Ecommerce testing
Ecommerce testingEcommerce testing
Ecommerce testing
badurkar
 
Ecommerce testing
Ecommerce testingEcommerce testing
Ecommerce testing
badurkar
 
Mykola Mykytenko: MLOps: your way from nonsense to valuable effect (approache...
Mykola Mykytenko: MLOps: your way from nonsense to valuable effect (approache...Mykola Mykytenko: MLOps: your way from nonsense to valuable effect (approache...
Mykola Mykytenko: MLOps: your way from nonsense to valuable effect (approache...
Lviv Startup Club
 
Testing within an Agile Environment - Beyza Sakir and Chris Gollop
Testing within an Agile Environment - Beyza Sakir and Chris GollopTesting within an Agile Environment - Beyza Sakir and Chris Gollop
Testing within an Agile Environment - Beyza Sakir and Chris Gollop
JAXLondon2014
 

Similar to Performance testing its not that scary v2 (20)

Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013
 
Rational Quality Manager
Rational Quality ManagerRational Quality Manager
Rational Quality Manager
 
Intuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramIntuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation Program
 
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
 
Thomas Jensen. Machine Learning
Thomas Jensen. Machine LearningThomas Jensen. Machine Learning
Thomas Jensen. Machine Learning
 
An Agile Approach to Machine Learning
An Agile Approach to Machine LearningAn Agile Approach to Machine Learning
An Agile Approach to Machine Learning
 
Goal driven performance optimization (Пётр Зайцев)
Goal driven performance optimization (Пётр Зайцев)Goal driven performance optimization (Пётр Зайцев)
Goal driven performance optimization (Пётр Зайцев)
 
Horizon: Deep Reinforcement Learning at Scale
Horizon: Deep Reinforcement Learning at ScaleHorizon: Deep Reinforcement Learning at Scale
Horizon: Deep Reinforcement Learning at Scale
 
Webinar mobile monitoring_intro
Webinar mobile monitoring_introWebinar mobile monitoring_intro
Webinar mobile monitoring_intro
 
The Global State of EQMS
The Global State of EQMSThe Global State of EQMS
The Global State of EQMS
 
DEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOpsDEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOps
 
Achieving Operational Excellence With AI And Machine Learning
Achieving Operational Excellence With AI And Machine LearningAchieving Operational Excellence With AI And Machine Learning
Achieving Operational Excellence With AI And Machine Learning
 
Web Performance BootCamp 2013
Web Performance BootCamp 2013Web Performance BootCamp 2013
Web Performance BootCamp 2013
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
 
Qualitia - Scriptless Test Automation Platform
Qualitia - Scriptless Test Automation PlatformQualitia - Scriptless Test Automation Platform
Qualitia - Scriptless Test Automation Platform
 
Plant Managers Workshop.ppt
Plant Managers Workshop.pptPlant Managers Workshop.ppt
Plant Managers Workshop.ppt
 
Ecommerce testing
Ecommerce testingEcommerce testing
Ecommerce testing
 
Ecommerce testing
Ecommerce testingEcommerce testing
Ecommerce testing
 
Mykola Mykytenko: MLOps: your way from nonsense to valuable effect (approache...
Mykola Mykytenko: MLOps: your way from nonsense to valuable effect (approache...Mykola Mykytenko: MLOps: your way from nonsense to valuable effect (approache...
Mykola Mykytenko: MLOps: your way from nonsense to valuable effect (approache...
 
Testing within an Agile Environment - Beyza Sakir and Chris Gollop
Testing within an Agile Environment - Beyza Sakir and Chris GollopTesting within an Agile Environment - Beyza Sakir and Chris Gollop
Testing within an Agile Environment - Beyza Sakir and Chris Gollop
 

More from Stephen Mounsey

Practical tools for team wellbeing agilene
Practical tools for team wellbeing agilenePractical tools for team wellbeing agilene
Practical tools for team wellbeing agilene
Stephen Mounsey
 
Conflict in Agile Teams
Conflict in Agile TeamsConflict in Agile Teams
Conflict in Agile Teams
Stephen Mounsey
 
Software Economies of Scale
Software Economies of ScaleSoftware Economies of Scale
Software Economies of Scale
Stephen Mounsey
 
Benefits realisation vs business value
Benefits realisation vs business valueBenefits realisation vs business value
Benefits realisation vs business value
Stephen Mounsey
 
Gamify your route to live
Gamify your route to liveGamify your route to live
Gamify your route to live
Stephen Mounsey
 
Motivation
MotivationMotivation
Motivation
Stephen Mounsey
 
Testing Lessons from Sketchnoting
Testing Lessons from SketchnotingTesting Lessons from Sketchnoting
Testing Lessons from Sketchnoting
Stephen Mounsey
 
Test Bash 2015 Sketch Notes
Test Bash 2015 Sketch NotesTest Bash 2015 Sketch Notes
Test Bash 2015 Sketch Notes
Stephen Mounsey
 
Performance Testing Principles and Practices Cube
Performance Testing Principles and Practices CubePerformance Testing Principles and Practices Cube
Performance Testing Principles and Practices Cube
Stephen Mounsey
 

More from Stephen Mounsey (9)

Practical tools for team wellbeing agilene
Practical tools for team wellbeing agilenePractical tools for team wellbeing agilene
Practical tools for team wellbeing agilene
 
Conflict in Agile Teams
Conflict in Agile TeamsConflict in Agile Teams
Conflict in Agile Teams
 
Software Economies of Scale
Software Economies of ScaleSoftware Economies of Scale
Software Economies of Scale
 
Benefits realisation vs business value
Benefits realisation vs business valueBenefits realisation vs business value
Benefits realisation vs business value
 
Gamify your route to live
Gamify your route to liveGamify your route to live
Gamify your route to live
 
Motivation
MotivationMotivation
Motivation
 
Testing Lessons from Sketchnoting
Testing Lessons from SketchnotingTesting Lessons from Sketchnoting
Testing Lessons from Sketchnoting
 
Test Bash 2015 Sketch Notes
Test Bash 2015 Sketch NotesTest Bash 2015 Sketch Notes
Test Bash 2015 Sketch Notes
 
Performance Testing Principles and Practices Cube
Performance Testing Principles and Practices CubePerformance Testing Principles and Practices Cube
Performance Testing Principles and Practices Cube
 

Recently uploaded

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Crescat
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
Fermin Galan
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate
 
E-commerce Application Development Company.pdf
E-commerce Application Development Company.pdfE-commerce Application Development Company.pdf
E-commerce Application Development Company.pdf
Hornet Dynamics
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Łukasz Chruściel
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Mind IT Systems
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
Adele Miller
 
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissancesAtelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Neo4j
 
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)
Boni García
 
AI Genie Review: World’s First Open AI WordPress Website Creator
AI Genie Review: World’s First Open AI WordPress Website CreatorAI Genie Review: World’s First Open AI WordPress Website Creator
AI Genie Review: World’s First Open AI WordPress Website Creator
Google
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
Aftab Hussain
 
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
Alina Yurenko
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
Deuglo Infosystem Pvt Ltd
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
Drona Infotech
 
2024 eCommerceDays Toulouse - Sylius 2.0.pdf
2024 eCommerceDays Toulouse - Sylius 2.0.pdf2024 eCommerceDays Toulouse - Sylius 2.0.pdf
2024 eCommerceDays Toulouse - Sylius 2.0.pdf
Łukasz Chruściel
 
Launch Your Streaming Platforms in Minutes
Launch Your Streaming Platforms in MinutesLaunch Your Streaming Platforms in Minutes
Launch Your Streaming Platforms in Minutes
Roshan Dwivedi
 
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdfAutomated software refactoring with OpenRewrite and Generative AI.pptx.pdf
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf
timtebeek1
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
Shane Coughlan
 

Recently uploaded (20)

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
 
E-commerce Application Development Company.pdf
E-commerce Application Development Company.pdfE-commerce Application Development Company.pdf
E-commerce Application Development Company.pdf
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
 
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissancesAtelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissances
 
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)
 
AI Genie Review: World’s First Open AI WordPress Website Creator
AI Genie Review: World’s First Open AI WordPress Website CreatorAI Genie Review: World’s First Open AI WordPress Website Creator
AI Genie Review: World’s First Open AI WordPress Website Creator
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
 
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
 
2024 eCommerceDays Toulouse - Sylius 2.0.pdf
2024 eCommerceDays Toulouse - Sylius 2.0.pdf2024 eCommerceDays Toulouse - Sylius 2.0.pdf
2024 eCommerceDays Toulouse - Sylius 2.0.pdf
 
Launch Your Streaming Platforms in Minutes
Launch Your Streaming Platforms in MinutesLaunch Your Streaming Platforms in Minutes
Launch Your Streaming Platforms in Minutes
 
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdfAutomated software refactoring with OpenRewrite and Generative AI.pptx.pdf
Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
 

Performance testing its not that scary v2

Editor's Notes

  1. Description: An interactive talk about why performance testing isn't that scary, key messages being we should all be doing performance testing, why performance is scary and really important and increasingly so. Packed with take home practical advice; key performance terminology discussed and principles and practices which can and should be applied to any performance test, tools and tool selection, recruitment and more. Also discussing why and how we need to change how we performance test with regards agile, dev ops and continuous delivery. Intro – Performance is scary What is Performance Testing and what do the terms mean Principles and Practices which apply to any performance test Tools and tool selection Recruitment – How to find a good performance tester What we do and what we are thinking about. Monitoring vs Testing and Performance in production.
  2. New Pic
  3. How many fo you have had a real world performance problem Is it easy to diagnose and fix – was it one or two lines of code
  4. Amazon – Shopping basket faster payment – less time to think Delivery – Drones (Faster) UK delivery network Walmart increased conversions by 2% for every second of load time improvement
  5. Ask the audience what terms they use?????? Language is important
  6. Load vs Performance To do performance testing you need to load the system
  7. Have you ever felt like there is too much stuff coming at you. With agile, Dev Ops and continuous delivery we cant do perf test in the same way. Mentality Change More PT is required Why did we leave it to the last minute anyway? It has the ability to completely ruin a project
  8. Start thinking about performance testing in a different way this is no longer something which happens after an app is pretty much complete Change Mentality from a last record and playback test to an early performance engineering approach Continuous – Environment challenges V model
  9. Repeatability As we are benchmarking – Performance regression we need to be very aware of how repeatable our testing is. Caching – artificially quickly Cleardowns Data – Keep same Network traffic – Jobs Time of Day Realistic to the environment – 1/10 CPU Live Like Data – Obfuscation, Anonamise tools Tests – Live functions Live volumes Changing one thing Scientific thing – only change the thing which you are trying to test Monitor – Vauxhall Corsa vs Nissan GTR
  10. Understand: Monitor Measure Interoperability
  11. Ask Audience what they use?
  12. People are reluctant – Niche Build your own
  13. Scott Barber Simon Knight Mark Tomlinson James Pulley