1Webinar
Presents
with
Agile Load Testing in the
Real World
2
Continuous Load Testing Realized
TODAY’S PRESENTERS
Lee Barnes: Utopia Solutions, Founder & CTO
Mike Ostenberg: SOASTA, ...
3
© Utopia Solutions
Agile Load Testing in the Real World
Lee Barnes, CTO
Utopia Solutions
@USI_LeeBarnes
© Utopia Solutions5
Key Questions
What needs to change?
How do we make those changes?
Why don’t traditional performance
te...
© Utopia Solutions6
Case Study
Background
• Large global manufacturer
• Performance Testing CoE in operation for ~10 yrs
•...
© Utopia Solutions7
Traditional Performance Testing Model
Provides Consistency in…
•Resources / Skills
•Processes
•Deliver...
© Utopia Solutions8
• One size fits all
• Strict entry criteria
• Performed late in SDLC
• One-way communication of
result...
© Utopia Solutions9
Agile Development
Deploy
Where does performance
testing fit?
© Utopia Solutions10
Early Attempts on Agile Projects
Agile
Performance Testing
Same Process…
Same Risk!
© Utopia Solutions11
Early Attempts on Agile Projects
Agile
Performance
Testing
Performance
Testing
Performance
Testing
Pe...
© Utopia Solutions
Back to the drawing
board…
© Utopia Solutions13
Early Cycle /
Ongoing
Performance
Analysis
Establish Objectives
Ultimate Goal…
Late Cycle
Performance...
© Utopia Solutions14
Identify Gaps
What’s stopping us from analyzing performance
continuously?
• Performance objectives we...
© Utopia Solutions15
Disclaimers
It was not easy.
The changes discussed on the next few
slides were implemented over a two...
© Utopia Solutions16
Performance Testing in an Agile Environment
Build performance objectives in to user
stories
Make perf...
© Utopia Solutions17
Performance Testing in an Agile Environment
Map business and end user
requirements onto system compon...
© Utopia Solutions18
Waterfall Agile
Responsibility for
Performance
Performance CoE Everyone
Role of CoE End of cycle PT P...
© Utopia Solutions19
Summary
Key takeaways…
•Agile performance testing is not more /
quicker performance tests
•Success re...
20
Mike Ostenberg
21
Direct Questions?
Lee Barnes
Founder and CTO
Email:lee.barnes@utopiasolutions.com
twitter.com/USI_LeeBarnes
linkedin.co...
22
www.SOASTA.com
Upcoming SlideShare
Loading in...5
×

Agile Load Testing In The Real World

933

Published on

Recent and constant changes in technology have resulted in a transition from the traditional Center of Excellence model, to an agile development model, which has made its way into the mainstream and caused a shift in how testing, particularly performance testing, is done.

Join our Webinar to learn how a top tier manufacturer transformed their ability to deliver high quality projects, faster, by adapting their load testing to fit an agile development approach.

In this webinar you’ll learn:

Why you need to think differently about performance testing in an agile development environment
How to shift Performance Testing to the left in the development cycle
What adjustments to consider in your performance testing centers of excellence model
Technology platform considerations for faster, more collaborative load testing
Utopia Solutions Founder and CTO, Lee Barnes, will dive into tips and techniques for bringing effective performance testing to your agile organization. The SOASTA team will demonstrate how continuous, cloud-based testing makes it easier.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
933
On Slideshare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
21
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Agile Load Testing In The Real World

  1. 1. 1Webinar Presents with Agile Load Testing in the Real World
  2. 2. 2 Continuous Load Testing Realized TODAY’S PRESENTERS Lee Barnes: Utopia Solutions, Founder & CTO Mike Ostenberg: SOASTA, Dir. Systems Engineering Brad Johnson: SOASTA, VP Product Agenda • A case study in driving a performance culture with agile delivery • A platform for delivering continuous load testing Questions: Submit in chat box during event
  3. 3. 3
  4. 4. © Utopia Solutions Agile Load Testing in the Real World Lee Barnes, CTO Utopia Solutions @USI_LeeBarnes
  5. 5. © Utopia Solutions5 Key Questions What needs to change? How do we make those changes? Why don’t traditional performance testing models fit nicely with agile?
  6. 6. © Utopia Solutions6 Case Study Background • Large global manufacturer • Performance Testing CoE in operation for ~10 yrs • Seen as a huge value to the enterprise • Began moving toward agile a few years ago… and the luster of the CoE began to dull…
  7. 7. © Utopia Solutions7 Traditional Performance Testing Model Provides Consistency in… •Resources / Skills •Processes •Deliverable Quality •Technology Request Test Project Team Center of Excellence Perform Discovery Develop & Execute Deliver ResultsEvaluate Results Info / Environment
  8. 8. © Utopia Solutions8 • One size fits all • Strict entry criteria • Performed late in SDLC • One-way communication of results Service Characteristics CoE in the Waterfall Years Performance Testing Too late!
  9. 9. © Utopia Solutions9 Agile Development Deploy Where does performance testing fit?
  10. 10. © Utopia Solutions10 Early Attempts on Agile Projects Agile Performance Testing Same Process… Same Risk!
  11. 11. © Utopia Solutions11 Early Attempts on Agile Projects Agile Performance Testing Performance Testing Performance Testing Performance Testing CoE Approach •Rigid •4 week test cycle Agile Approach •Flexible •2 week sprints + =
  12. 12. © Utopia Solutions Back to the drawing board…
  13. 13. © Utopia Solutions13 Early Cycle / Ongoing Performance Analysis Establish Objectives Ultimate Goal… Late Cycle Performance Testing Shift Left
  14. 14. © Utopia Solutions14 Identify Gaps What’s stopping us from analyzing performance continuously? • Performance objectives weren’t part of user stories • Agile teams lacked performance engineering expertise • Performance testing knowledge and tools were locked in the CoE • APM tools / skills were non-existent
  15. 15. © Utopia Solutions15 Disclaimers It was not easy. The changes discussed on the next few slides were implemented over a two year duration. It was not painless.
  16. 16. © Utopia Solutions16 Performance Testing in an Agile Environment Build performance objectives in to user stories Make performance everyone’s job Create a role to coordinate performance activities CoE performance test architects become mentors Begin developing a performance focused culture
  17. 17. © Utopia Solutions17 Performance Testing in an Agile Environment Map business and end user requirements onto system components Create both single and multi user tests Benchmark in development / QA environment Look for trends in measurements vs. absolutes Use service virtualization to stub out 3rd party or yet to be developed components Execute unit performance tests as part of continuous integration Implement Unit / Component Performance Testing
  18. 18. © Utopia Solutions18 Waterfall Agile Responsibility for Performance Performance CoE Everyone Role of CoE End of cycle PT Provide mentorship to agile team Pre-deployment system PT Role of development Throw system over wall Wait for results Continuous focus on performance Tools Traditional load test tools Traditional load test tools APM tools Service virtualization Continuous integration Environment Dedicated / production-like Development / desktop Deliverable Boiler plate results delivered just prior to release Continuous feed of actionable data Performance Testing in an Agile Environment Transformation Summary Waterfall Agile Responsibility for Performance Performance CoE Role of CoE End of cycle PT Role of development Throw system over wall Wait for results Tools Traditional load test tools Environment Dedicated / production-like Deliverable Boiler plate results delivered just prior to release
  19. 19. © Utopia Solutions19 Summary Key takeaways… •Agile performance testing is not more / quicker performance tests •Success requires an shift in people, process and technology
  20. 20. 20 Mike Ostenberg
  21. 21. 21 Direct Questions? Lee Barnes Founder and CTO Email:lee.barnes@utopiasolutions.com twitter.com/USI_LeeBarnes linkedin.com/in/leebarnes Blog www.RaiseYourMQ.com Thanks & Q&A Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtesttwitter.com/cloudtest facebook.com/cloudtestfacebook.com/cloudtest Knowledge Center •White Papers •Webinar Recordings •Case Studies CloudLink Community •Support •Tutorials •Video RESOURCES Contact Utopia www.utopiasolutions.com 630.375.6610 www.SOASTA.com www.UtopiaSolutions.com
  22. 22. 22 www.SOASTA.com
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×