Recent and constant changes in technology have resulted in a transition from the traditional Center of Excellence model, to an agile development model, which has made its way into the mainstream and caused a shift in how testing, particularly performance testing, is done. Join our Webinar to learn how a top tier manufacturer transformed their ability to deliver high quality projects, faster, by adapting their load testing to fit an agile development approach. In this webinar you’ll learn: Why you need to think differently about performance testing in an agile development environment How to shift Performance Testing to the left in the development cycle What adjustments to consider in your performance testing centers of excellence model Technology platform considerations for faster, more collaborative load testing Utopia Solutions Founder and CTO, Lee Barnes, will dive into tips and techniques for bringing effective performance testing to your agile organization. The SOASTA team will demonstrate how continuous, cloud-based testing makes it easier.

1. 1Webinar
Presents
with
Agile Load Testing in the
Real World

2. 2
Continuous Load Testing Realized
TODAY’S PRESENTERS
Lee Barnes: Utopia Solutions, Founder & CTO
Mike Ostenberg: SOASTA, Dir. Systems Engineering
Brad Johnson: SOASTA, VP Product
Agenda
• A case study in driving a performance culture with agile delivery
• A platform for delivering continuous load testing
Questions:
Submit in chat box during event

3. 3

4. © Utopia Solutions
Agile Load Testing in the Real World
Lee Barnes, CTO
Utopia Solutions
@USI_LeeBarnes

5. © Utopia Solutions5
Key Questions
What needs to change?
How do we make those changes?
Why don’t traditional performance
testing models fit nicely with agile?

6. © Utopia Solutions6
Case Study
Background
• Large global manufacturer
• Performance Testing CoE in operation for ~10 yrs
• Seen as a huge value to the enterprise
• Began moving toward agile a few years ago…
and the luster of the CoE began to dull…

7. © Utopia Solutions7
Traditional Performance Testing Model
Provides Consistency in…
•Resources / Skills
•Processes
•Deliverable Quality
•Technology
Request Test
Project
Team
Center of
Excellence
Perform Discovery
Develop & Execute
Deliver ResultsEvaluate Results
Info / Environment

8. © Utopia Solutions8
• One size fits all
• Strict entry criteria
• Performed late in SDLC
• One-way communication of
results
Service Characteristics
CoE in the Waterfall Years
Performance Testing
Too late!

9. © Utopia Solutions9
Agile Development
Deploy
Where does performance
testing fit?

10. © Utopia Solutions10
Early Attempts on Agile Projects
Agile
Performance Testing
Same Process…
Same Risk!

11. © Utopia Solutions11
Early Attempts on Agile Projects
Agile
Performance
Testing
Performance
Testing
Performance
Testing
Performance
Testing
CoE Approach
•Rigid
•4 week test cycle
Agile Approach
•Flexible
•2 week sprints
+ =

12. © Utopia Solutions
Back to the drawing
board…

13. © Utopia Solutions13
Early Cycle /
Ongoing
Performance
Analysis
Establish Objectives
Ultimate Goal…
Late Cycle
Performance
Testing
Shift Left

14. © Utopia Solutions14
Identify Gaps
What’s stopping us from analyzing performance
continuously?
• Performance objectives weren’t part of
user stories
• Agile teams lacked performance
engineering expertise
• Performance testing knowledge and tools
were locked in the CoE
• APM tools / skills were non-existent

15. © Utopia Solutions15
Disclaimers
It was not easy.
The changes discussed on the next few
slides were implemented over a two
year duration.
It was not painless.

16. © Utopia Solutions16
Performance Testing in an Agile Environment
Build performance objectives in to user
stories
Make performance everyone’s job
Create a role to coordinate
performance activities
CoE performance test architects
become mentors
Begin developing a
performance focused
culture

17. © Utopia Solutions17
Performance Testing in an Agile Environment
Map business and end user
requirements onto system components
Create both single and multi user tests
Benchmark in development / QA
environment
Look for trends in measurements vs.
absolutes
Use service virtualization to stub out 3rd
party or yet to be developed
components
Execute unit performance tests as part
of continuous integration
Implement Unit /
Component
Performance Testing

18. © Utopia Solutions18
Waterfall Agile
Responsibility for
Performance
Performance CoE Everyone
Role of CoE End of cycle PT Provide mentorship to agile team
Pre-deployment system PT
Role of
development
Throw system over wall
Wait for results
Continuous focus on performance
Tools Traditional load test tools Traditional load test tools
APM tools
Service virtualization
Continuous integration
Environment Dedicated / production-like Development / desktop
Deliverable Boiler plate results delivered
just prior to release
Continuous feed of actionable
data
Performance Testing in an Agile Environment
Transformation Summary
Waterfall Agile
Responsibility for
Performance
Performance CoE
Role of CoE End of cycle PT
Role of
development
Throw system over wall
Wait for results
Tools Traditional load test tools
Environment Dedicated / production-like
Deliverable Boiler plate results delivered
just prior to release

19. © Utopia Solutions19
Summary
Key takeaways…
•Agile performance testing is not more /
quicker performance tests
•Success requires an shift in people,
process and technology

20. 20
Mike Ostenberg

21. 21
Direct Questions?
Lee Barnes
Founder and CTO
Email:lee.barnes@utopiasolutions.com
twitter.com/USI_LeeBarnes
linkedin.com/in/leebarnes
Blog
www.RaiseYourMQ.com
Thanks & Q&A
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
866.344.8766
Follow us:
twitter.com/cloudtesttwitter.com/cloudtest
facebook.com/cloudtestfacebook.com/cloudtest
Knowledge Center
•White Papers
•Webinar
Recordings
•Case Studies
CloudLink
Community
•Support
•Tutorials
•Video
RESOURCES
Contact Utopia
www.utopiasolutions.com
630.375.6610
www.SOASTA.com www.UtopiaSolutions.com

22. 22
www.SOASTA.com