SlideShare a Scribd company logo
Performance Testing:
       Throughout the Application Life-Cycle
                               Created for:




                                   By:

                            Scott Barber
                            Chief Technologist
                            PerfTestPlus, Inc.
Throughout the Life-Cycle                        © 2012 PerfTestPlus, Inc. All rights reserved.
Performance Testing:
                 Throughout the Application Life-Cycle

                              Scott Barber
                               Chief Technologist, PerfTestPlus, Inc.
                                  sbarber@perftestplus.com
                                  www.perftestplus.com
                                  @sbarber
                               Co-Founder: Workshop On Performance and Reliability
                                  www.performance-workshop.org

        Author:               Co-Author:                Contributing Author:




 Books: www.perftestplus.com/pubs                   About me: about.me/scott.barber
Throughout the Life-Cycle                                    © 2012 PerfTestPlus, Inc. All rights reserved.
Notes
This keynote is a sub-set of 7 days of instruction
      (about the same as a 1 semester university course)
I do not believe in “Best Practices” (I believe in
      problem solving via experience, experiment & education)
Everything in this keynote is based on personal
  experience in *some* context (but not yours)
Adapt concepts to your situation/context
Do network with others who are here (I bet they have
      great ideas too)
Follow–up with me (what works for you… or doesn’t)
I *like* questions!
Throughout the Life-Cycle                 © 2012 PerfTestPlus, Inc. All rights reserved.
Throughout the Life-Cycle   © 2012 PerfTestPlus, Inc. All rights reserved.
What is Performance?
 System or application characteristics related to:
      Speed:
        - responsiveness
        - user experience

      Scalability:
        - capacity
        - load
        - volume

      Stability
         - consistency
         - reliability
         - stress
Throughout the Life-Cycle          © 2012 PerfTestPlus, Inc. All rights reserved.
What is Performance Testing?
 What mom tells people:
   I help people make websites go fast.

What I tell people:
  I help and/or teach individuals and organizations to
  optimize software systems by balancing:
      •    Cost
      •    Time to market
      •    Capacity
      while remaining focused on the quality of service
      to system users.


Throughout the Life-Cycle               © 2012 PerfTestPlus, Inc. All rights reserved.
Performance vs. Load Testing?




Throughout the Life-Cycle   © 2012 PerfTestPlus, Inc. All rights reserved.
Throughout the Life-Cycle   © 2012 PerfTestPlus, Inc. All rights reserved.
Who is Responsible?
Where Does it Fit?
To Prevent Poor Performance…




  … don’t just react when it happens.
An Ounce of Prevention…
The Performance Lifecycle is:
   Conception to Headstone


             Not


       Cradle to Grave
… Do you like Swim Lanes?
…Or maybe Circles?
…Or Annotated Pie Charts?
•   Current Capacity                             • Single User
•   Projections                                    Responsiveness
                                                 • Resource Management
•   Scalability Plan
                                    Architects   • Component-Level
•   Reliability        DevOps &                    Concurrency
                                    Analysts &
                       Architects
                                      Scrum
                            Prod    Dev




                            Stage   Test


                       Load Team     Scrum &
• Prepare for Prod
                       & DevOps     Load Team
• Tune/Optimize                                  • Multi-User
• Predict                                          Responsiveness
• Early Warning                                  • Resource Trending
  Identification                                 • Limit Identification
…Relativistic Comparisons?
…How about Colors?
Application Delivery Activities
With:




  A “Test-Driven” Application
Performance Management Model
The four T’s   Units
Proactive
Micro & Macro
                  stand for…     Stories
                                 Tiers
Establish Goals                  Resources
Update Targets                   Goals




Dev & Prod
Times                            Assess
Resources                        Compare
Sizes                            Investigate
Frequencies                      Accept
Dashboard!                       Answer
Throughout the Life-Cycle   © 2012 PerfTestPlus, Inc. All rights reserved.
Throughout the Life-Cycle   © 2012 PerfTestPlus, Inc. All rights reserved.
Throughout the Life-Cycle   © 2012 PerfTestPlus, Inc. All rights reserved.
Load Testing Principles
                   Project context is central to successful testing.

                   Business, project, system, & user success criteria.

                   Identify system usage, and key metrics; plan and design tests.

                   Install and prepare environment, tools, & resource monitors.

                   Script the tests as designed.

                   Run and monitor tests. Validate tests, test data, and results.

                   Analyze the data individually and as a cross-functional team.

                   Consolidate and share results, customized by audience.

                   "Lather, rinse, repeat" as necessary.

Throughout the Life-Cycle                                  © 2012 PerfTestPlus, Inc. All rights reserved.
Unit-Level Testing Tools
                  (‘cause folks always ask)


FireBenchmarks; Performance testing addin for NUnit
JUnitPerf; a collection of JUnit test decorators for performance
Firefox Performance Tester's Pack
HTTPerf
Questions?
Preventing Poor Performance with
           a little work…
            every day…
         from every one.
Contact Info

                               Scott Barber
                            Chief Technologist
                             PerfTestPlus, Inc

  E-mail:                                Web Site:
  sbarber@perftestplus.com               www.PerfTestPlus.com

  Blog:                                  Twitter:
  scott-barber.blogspot.com              @sbarber

Throughout the Life-Cycle                     © 2012 PerfTestPlus, Inc. All rights reserved.
Review & Questions
Did we learn anything?




Throughout the Life-Cycle              © 2012 PerfTestPlus, Inc. All rights reserved.

More Related Content

What's hot

Evolving Team Structure in DevOps
Evolving Team Structure in DevOpsEvolving Team Structure in DevOps
Evolving Team Structure in DevOps
Sherry Chang
 
A DevOps Primer: Whole Team Approaches for Better Software Quality
A DevOps Primer: Whole Team Approaches for Better Software QualityA DevOps Primer: Whole Team Approaches for Better Software Quality
A DevOps Primer: Whole Team Approaches for Better Software Quality
TechWell
 
Managing Application Performance: A Simplified Universal Approach
Managing Application Performance: A Simplified Universal ApproachManaging Application Performance: A Simplified Universal Approach
Managing Application Performance: A Simplified Universal Approach
TechWell
 
Building a DevOps Team that isn't Evil
Building a DevOps Team that isn't EvilBuilding a DevOps Team that isn't Evil
Building a DevOps Team that isn't EvilIBM UrbanCode Products
 
DOES15 - Sherry Chang - Intel’s Journey to Large Scale DevOps Transformation
DOES15 - Sherry Chang - Intel’s Journey to Large Scale DevOps Transformation DOES15 - Sherry Chang - Intel’s Journey to Large Scale DevOps Transformation
DOES15 - Sherry Chang - Intel’s Journey to Large Scale DevOps Transformation
Gene Kim
 
Hybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated WorldHybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated World
Perforce
 
"Deploy. Sneller." Webinar Slides (Dutch webinar)
"Deploy. Sneller." Webinar Slides (Dutch webinar)"Deploy. Sneller." Webinar Slides (Dutch webinar)
"Deploy. Sneller." Webinar Slides (Dutch webinar)XebiaLabs
 
Application Performance Testing: A Simplified Universal Approach
Application Performance Testing: A Simplified Universal ApproachApplication Performance Testing: A Simplified Universal Approach
Application Performance Testing: A Simplified Universal Approach
TechWell
 
Agile testing overview
Agile testing overviewAgile testing overview
Agile testing overviewraianup
 
Puppet Labs EMC DevOps Day NYC Aug-2015
Puppet Labs  EMC DevOps Day NYC Aug-2015Puppet Labs  EMC DevOps Day NYC Aug-2015
Puppet Labs EMC DevOps Day NYC Aug-2015
Bob Sokol
 
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy EnvironmentsDOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
Gene Kim
 
Managing Application Performance: A Simplified Universal Approach
Managing Application Performance: A Simplified Universal ApproachManaging Application Performance: A Simplified Universal Approach
Managing Application Performance: A Simplified Universal Approach
TechWell
 
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Puppet
 
Qa team sport
Qa team sportQa team sport
Qa team sportLeanDog
 
Advancing Testing Using Axioms
Advancing Testing Using AxiomsAdvancing Testing Using Axioms
Advancing Testing Using Axioms
Paul Gerrard
 
Integrating Automated Testing into DevOps
Integrating Automated Testing into DevOpsIntegrating Automated Testing into DevOps
Integrating Automated Testing into DevOps
TechWell
 
Continuous Quality: What DevOps Means for QA
Continuous Quality: What DevOps Means for QAContinuous Quality: What DevOps Means for QA
Continuous Quality: What DevOps Means for QAJeff Sussna
 
Agile Testing at Scale
Agile Testing at ScaleAgile Testing at Scale
Agile Testing at Scale
TechWell
 
Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?
Paul Gerrard
 
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Jwooldridge
 

What's hot (20)

Evolving Team Structure in DevOps
Evolving Team Structure in DevOpsEvolving Team Structure in DevOps
Evolving Team Structure in DevOps
 
A DevOps Primer: Whole Team Approaches for Better Software Quality
A DevOps Primer: Whole Team Approaches for Better Software QualityA DevOps Primer: Whole Team Approaches for Better Software Quality
A DevOps Primer: Whole Team Approaches for Better Software Quality
 
Managing Application Performance: A Simplified Universal Approach
Managing Application Performance: A Simplified Universal ApproachManaging Application Performance: A Simplified Universal Approach
Managing Application Performance: A Simplified Universal Approach
 
Building a DevOps Team that isn't Evil
Building a DevOps Team that isn't EvilBuilding a DevOps Team that isn't Evil
Building a DevOps Team that isn't Evil
 
DOES15 - Sherry Chang - Intel’s Journey to Large Scale DevOps Transformation
DOES15 - Sherry Chang - Intel’s Journey to Large Scale DevOps Transformation DOES15 - Sherry Chang - Intel’s Journey to Large Scale DevOps Transformation
DOES15 - Sherry Chang - Intel’s Journey to Large Scale DevOps Transformation
 
Hybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated WorldHybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated World
 
"Deploy. Sneller." Webinar Slides (Dutch webinar)
"Deploy. Sneller." Webinar Slides (Dutch webinar)"Deploy. Sneller." Webinar Slides (Dutch webinar)
"Deploy. Sneller." Webinar Slides (Dutch webinar)
 
Application Performance Testing: A Simplified Universal Approach
Application Performance Testing: A Simplified Universal ApproachApplication Performance Testing: A Simplified Universal Approach
Application Performance Testing: A Simplified Universal Approach
 
Agile testing overview
Agile testing overviewAgile testing overview
Agile testing overview
 
Puppet Labs EMC DevOps Day NYC Aug-2015
Puppet Labs  EMC DevOps Day NYC Aug-2015Puppet Labs  EMC DevOps Day NYC Aug-2015
Puppet Labs EMC DevOps Day NYC Aug-2015
 
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy EnvironmentsDOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
 
Managing Application Performance: A Simplified Universal Approach
Managing Application Performance: A Simplified Universal ApproachManaging Application Performance: A Simplified Universal Approach
Managing Application Performance: A Simplified Universal Approach
 
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
 
Qa team sport
Qa team sportQa team sport
Qa team sport
 
Advancing Testing Using Axioms
Advancing Testing Using AxiomsAdvancing Testing Using Axioms
Advancing Testing Using Axioms
 
Integrating Automated Testing into DevOps
Integrating Automated Testing into DevOpsIntegrating Automated Testing into DevOps
Integrating Automated Testing into DevOps
 
Continuous Quality: What DevOps Means for QA
Continuous Quality: What DevOps Means for QAContinuous Quality: What DevOps Means for QA
Continuous Quality: What DevOps Means for QA
 
Agile Testing at Scale
Agile Testing at ScaleAgile Testing at Scale
Agile Testing at Scale
 
Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?
 
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
 

Similar to Iqnite keynote

Best Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility TestingBest Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility Testing
Perfecto by Perforce
 
Load and Performance Testing in Production, featuring Scott Barber
Load and Performance Testing in Production, featuring Scott BarberLoad and Performance Testing in Production, featuring Scott Barber
Load and Performance Testing in Production, featuring Scott Barber
Neotys
 
Simple2rocketscience 120513214533 Phpapp01
Simple2rocketscience 120513214533 Phpapp01Simple2rocketscience 120513214533 Phpapp01
Simple2rocketscience 120513214533 Phpapp01Archana Survase
 
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
KMS Technology
 
Agile 101
Agile 101 Agile 101
Agile 101
Vineet Shukla
 
Ptformanagersppt - Scott Barber
Ptformanagersppt - Scott BarberPtformanagersppt - Scott Barber
Ptformanagersppt - Scott BarberArchana Survase
 
Performance Testing for Managers
Performance Testing for ManagersPerformance Testing for Managers
Performance Testing for Managers
Scott Barber
 
Continuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps SuccessContinuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps Success
TechWell
 
Agile Testing 20021015
Agile Testing 20021015Agile Testing 20021015
Agile Testing 20021015
Raghu Karnati
 
Holistic Product Development
Holistic Product DevelopmentHolistic Product Development
Holistic Product Development
Gary Pedretti
 
Approachesppt 111112121701 Phpapp02
Approachesppt 111112121701 Phpapp02Approachesppt 111112121701 Phpapp02
Approachesppt 111112121701 Phpapp02Archana Survase
 
Approaches to Software Testing
Approaches to Software TestingApproaches to Software Testing
Approaches to Software Testing
Scott Barber
 
Scrum plus – why scrum is not enough for successful delivery
Scrum plus – why scrum is not enough for successful deliveryScrum plus – why scrum is not enough for successful delivery
Scrum plus – why scrum is not enough for successful delivery
Naveen Kumar Singh
 
AgileCamp 2014 Track 1: Accelerating Agile Enterprise Adoption with Scaled Ag...
AgileCamp 2014 Track 1: Accelerating Agile Enterprise Adoption with Scaled Ag...AgileCamp 2014 Track 1: Accelerating Agile Enterprise Adoption with Scaled Ag...
AgileCamp 2014 Track 1: Accelerating Agile Enterprise Adoption with Scaled Ag...
Hyperdrive Agile Leadership (powered by Bratton & Company)
 
Delivering A Great End User Experience
Delivering A Great End User ExperienceDelivering A Great End User Experience
Delivering A Great End User Experience
Trevor Warren
 
Achieving DevOps using Open Source Tools in the Enterprise
Achieving DevOps using Open Source Tools in the EnterpriseAchieving DevOps using Open Source Tools in the Enterprise
Achieving DevOps using Open Source Tools in the Enterprise
CollabNet
 
Testing Sap: Modern Methodology
Testing Sap: Modern MethodologyTesting Sap: Modern Methodology
Testing Sap: Modern Methodology
Ethan Jewett
 
Scaling DevOps Beyond Teams with Azure
Scaling DevOps Beyond Teams with AzureScaling DevOps Beyond Teams with Azure
Scaling DevOps Beyond Teams with Azure
Sandeep Joshi
 
DevTestOps
DevTestOpsDevTestOps
DevTestOps
Paul Mateos
 

Similar to Iqnite keynote (20)

Best Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility TestingBest Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility Testing
 
Load and Performance Testing in Production, featuring Scott Barber
Load and Performance Testing in Production, featuring Scott BarberLoad and Performance Testing in Production, featuring Scott Barber
Load and Performance Testing in Production, featuring Scott Barber
 
Simple2rocketscience 120513214533 Phpapp01
Simple2rocketscience 120513214533 Phpapp01Simple2rocketscience 120513214533 Phpapp01
Simple2rocketscience 120513214533 Phpapp01
 
Perf Intro Ppt
Perf Intro PptPerf Intro Ppt
Perf Intro Ppt
 
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
 
Agile 101
Agile 101 Agile 101
Agile 101
 
Ptformanagersppt - Scott Barber
Ptformanagersppt - Scott BarberPtformanagersppt - Scott Barber
Ptformanagersppt - Scott Barber
 
Performance Testing for Managers
Performance Testing for ManagersPerformance Testing for Managers
Performance Testing for Managers
 
Continuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps SuccessContinuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps Success
 
Agile Testing 20021015
Agile Testing 20021015Agile Testing 20021015
Agile Testing 20021015
 
Holistic Product Development
Holistic Product DevelopmentHolistic Product Development
Holistic Product Development
 
Approachesppt 111112121701 Phpapp02
Approachesppt 111112121701 Phpapp02Approachesppt 111112121701 Phpapp02
Approachesppt 111112121701 Phpapp02
 
Approaches to Software Testing
Approaches to Software TestingApproaches to Software Testing
Approaches to Software Testing
 
Scrum plus – why scrum is not enough for successful delivery
Scrum plus – why scrum is not enough for successful deliveryScrum plus – why scrum is not enough for successful delivery
Scrum plus – why scrum is not enough for successful delivery
 
AgileCamp 2014 Track 1: Accelerating Agile Enterprise Adoption with Scaled Ag...
AgileCamp 2014 Track 1: Accelerating Agile Enterprise Adoption with Scaled Ag...AgileCamp 2014 Track 1: Accelerating Agile Enterprise Adoption with Scaled Ag...
AgileCamp 2014 Track 1: Accelerating Agile Enterprise Adoption with Scaled Ag...
 
Delivering A Great End User Experience
Delivering A Great End User ExperienceDelivering A Great End User Experience
Delivering A Great End User Experience
 
Achieving DevOps using Open Source Tools in the Enterprise
Achieving DevOps using Open Source Tools in the EnterpriseAchieving DevOps using Open Source Tools in the Enterprise
Achieving DevOps using Open Source Tools in the Enterprise
 
Testing Sap: Modern Methodology
Testing Sap: Modern MethodologyTesting Sap: Modern Methodology
Testing Sap: Modern Methodology
 
Scaling DevOps Beyond Teams with Azure
Scaling DevOps Beyond Teams with AzureScaling DevOps Beyond Teams with Azure
Scaling DevOps Beyond Teams with Azure
 
DevTestOps
DevTestOpsDevTestOps
DevTestOps
 

Recently uploaded

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 

Recently uploaded (20)

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 

Iqnite keynote

  • 1. Performance Testing: Throughout the Application Life-Cycle Created for: By: Scott Barber Chief Technologist PerfTestPlus, Inc. Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 2. Performance Testing: Throughout the Application Life-Cycle Scott Barber Chief Technologist, PerfTestPlus, Inc. sbarber@perftestplus.com www.perftestplus.com @sbarber Co-Founder: Workshop On Performance and Reliability www.performance-workshop.org Author: Co-Author: Contributing Author: Books: www.perftestplus.com/pubs About me: about.me/scott.barber Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 3. Notes This keynote is a sub-set of 7 days of instruction (about the same as a 1 semester university course) I do not believe in “Best Practices” (I believe in problem solving via experience, experiment & education) Everything in this keynote is based on personal experience in *some* context (but not yours) Adapt concepts to your situation/context Do network with others who are here (I bet they have great ideas too) Follow–up with me (what works for you… or doesn’t) I *like* questions! Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 4. Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 5. What is Performance? System or application characteristics related to: Speed: - responsiveness - user experience Scalability: - capacity - load - volume Stability - consistency - reliability - stress Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 6. What is Performance Testing? What mom tells people: I help people make websites go fast. What I tell people: I help and/or teach individuals and organizations to optimize software systems by balancing: • Cost • Time to market • Capacity while remaining focused on the quality of service to system users. Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 7. Performance vs. Load Testing? Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 8. Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 11.
  • 12. To Prevent Poor Performance… … don’t just react when it happens.
  • 13. An Ounce of Prevention…
  • 14.
  • 15. The Performance Lifecycle is: Conception to Headstone Not Cradle to Grave
  • 16.
  • 17. … Do you like Swim Lanes?
  • 19. …Or Annotated Pie Charts? • Current Capacity • Single User • Projections Responsiveness • Resource Management • Scalability Plan Architects • Component-Level • Reliability DevOps & Concurrency Analysts & Architects Scrum Prod Dev Stage Test Load Team Scrum & • Prepare for Prod & DevOps Load Team • Tune/Optimize • Multi-User • Predict Responsiveness • Early Warning • Resource Trending Identification • Limit Identification
  • 22.
  • 23.
  • 24.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33. With: A “Test-Driven” Application Performance Management Model
  • 34.
  • 35. The four T’s Units Proactive Micro & Macro stand for… Stories Tiers Establish Goals Resources Update Targets Goals Dev & Prod Times Assess Resources Compare Sizes Investigate Frequencies Accept Dashboard! Answer
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46.
  • 47.
  • 48.
  • 49.
  • 50. Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 51. Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 52.
  • 53. Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 54. Load Testing Principles Project context is central to successful testing. Business, project, system, & user success criteria. Identify system usage, and key metrics; plan and design tests. Install and prepare environment, tools, & resource monitors. Script the tests as designed. Run and monitor tests. Validate tests, test data, and results. Analyze the data individually and as a cross-functional team. Consolidate and share results, customized by audience. "Lather, rinse, repeat" as necessary. Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 55.
  • 56.
  • 57.
  • 58. Unit-Level Testing Tools (‘cause folks always ask) FireBenchmarks; Performance testing addin for NUnit JUnitPerf; a collection of JUnit test decorators for performance Firefox Performance Tester's Pack HTTPerf
  • 59.
  • 61. Preventing Poor Performance with a little work… every day… from every one.
  • 62. Contact Info Scott Barber Chief Technologist PerfTestPlus, Inc E-mail: Web Site: sbarber@perftestplus.com www.PerfTestPlus.com Blog: Twitter: scott-barber.blogspot.com @sbarber Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.
  • 63. Review & Questions Did we learn anything? Throughout the Life-Cycle © 2012 PerfTestPlus, Inc. All rights reserved.