DevOpsGuys
Perf Testing with APM
Workshop
Live demo without a safety net!

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

1
Workshop agenda
•
•
•
•
•
•
•
•

Intro – Steve – 10mins
Load Testing Portal – Gareth – 10 mins
APM Analysis – Steve – 10 m...
NCC
Test
Servers

@DevOpsGuys

Load Balancer

Test Environment

Web #1
MS SQL
Server
Web #2

DevOpsGuys

www.devopsguys.co...
Cloud Servers

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

4
Load Balancer

Only one node
active (for now)

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

5
Test Application
• Online Art Shop Demo App
• .Net MVC Application
• http://spark.devopsguys.com/

@DevOpsGuys

DevOpsGuys...
The Art Shop

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

7
APM Weapon of Choice
• AppDynamics APM
– Gartner Magic Quadrant Leader

• SaaS Portal
• Agent install
– 15 minutes to inst...
OctopusDeploy

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

9
A brief overview of the Portal & Test setup

NCC GROUP LOAD TESTING
@DevOpsGuys

DevOpsGuys

www.devopsguys.com

10
Where we break stuff live, for your viewing pleasure!

WORKSHOP DEMO PART 1
@DevOpsGuys

DevOpsGuys

www.devopsguys.com

1...
AppDynamics Portal

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

12
Failure in Minute 8(ish)

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

13
What went wrong?

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

14
SQL Client Exceptions

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

15
Slow Connection Open?

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

16
Code Bug (Thread.Sleep)

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

17
Fix it problems, deploy & re-test

WORKSHOP DEMO PART 2
@DevOpsGuys

DevOpsGuys

www.devopsguys.com

18
Fix the Bugs…

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

19
Deploy it…

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

20
#3
Faster Iteration
= Better Value

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

21
Maximise Testing Value

Deploy
Fix

@DevOpsGuys

Test
Analyse

DevOpsGuys

www.devopsguys.com

22
While we wait for the load to ramp up…

MORE ON APM…
@DevOpsGuys

DevOpsGuys

www.devopsguys.com

23
Comparing the two releases

SHOW THE IMPROVEMENT
@DevOpsGuys

DevOpsGuys

www.devopsguys.com

24
10,000 vs 45,000

@DevOpsGuys

DevOpsGuys

www.devopsguys.com

25
Summary
1.
2.
3.
4.

See the Big Picture (systems thinking)
Drill down to the details
Faster Iteration = Better Value
Stop...
DevOpsGuys
Thank You
AppDynamics Free Trial
http://ow.ly/ubW6r
operations | availability | performance | scalability | mig...
What We Do
DevOpsGuys provide development &
operations support (DevOps) services
for your online applications.

You run yo...
Our service portfolio
• 24 x 7 Application-Centric
web operations
• DevOps Transformation &
Training
• Continuous Delivery...
The Leadership Team
James Smith
(@TheDevMgr)

Steve Thair
(@TheOpsMgr)

• 16 years of software
delivery experience.
• Prov...
Contact Us

Visit us at www.devopsguys.com
Call our team on +44 (0)20 8798 3079
Email our engineers at
team@devopsguys.com...
Upcoming SlideShare
Loading in...5
×

DevOpsGuys Performance Testing with APM Tools workshop

4,371

Published on

A set of static slides that accompanied a "Live Demo" of using APM tools (AppDynamics) during load testing to isolate a performance issue, fix it, de-deploy and compare the improvement. This presentation accompanies the workshop held at the NCC Group Web Performance event in March 2014. Videos should be available on the NCC Group Community website - http://community.nccgroup-webperf.com/

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
4,371
On Slideshare
0
From Embeds
0
Number of Embeds
12
Actions
Shares
0
Downloads
17
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • JuCL8DhEdLYM
  • DevOpsGuys Performance Testing with APM Tools workshop

    1. 1. DevOpsGuys Perf Testing with APM Workshop Live demo without a safety net! @DevOpsGuys DevOpsGuys www.devopsguys.com 1
    2. 2. Workshop agenda • • • • • • • • Intro – Steve – 10mins Load Testing Portal – Gareth – 10 mins APM Analysis – Steve – 10 mins Deploy Fix & Re-Test – Steve – 5 mins APM Demo + Q&A – Steve – 10 mins Test #2 Analysis – Steve – 10 mins Result Comparison – Gareth – 10 mins Wrap up Q&A – Steve & Gareth @DevOpsGuys DevOpsGuys www.devopsguys.com 2
    3. 3. NCC Test Servers @DevOpsGuys Load Balancer Test Environment Web #1 MS SQL Server Web #2 DevOpsGuys www.devopsguys.com 3
    4. 4. Cloud Servers @DevOpsGuys DevOpsGuys www.devopsguys.com 4
    5. 5. Load Balancer Only one node active (for now) @DevOpsGuys DevOpsGuys www.devopsguys.com 5
    6. 6. Test Application • Online Art Shop Demo App • .Net MVC Application • http://spark.devopsguys.com/ @DevOpsGuys DevOpsGuys www.devopsguys.com 6
    7. 7. The Art Shop @DevOpsGuys DevOpsGuys www.devopsguys.com 7
    8. 8. APM Weapon of Choice • AppDynamics APM – Gartner Magic Quadrant Leader • SaaS Portal • Agent install – 15 minutes to install on 2 web servers • OOTB Configuration – 2 minor instrumentation changes – Create a dashboard (~1hr) @DevOpsGuys DevOpsGuys www.devopsguys.com 8
    9. 9. OctopusDeploy @DevOpsGuys DevOpsGuys www.devopsguys.com 9
    10. 10. A brief overview of the Portal & Test setup NCC GROUP LOAD TESTING @DevOpsGuys DevOpsGuys www.devopsguys.com 10
    11. 11. Where we break stuff live, for your viewing pleasure! WORKSHOP DEMO PART 1 @DevOpsGuys DevOpsGuys www.devopsguys.com 11
    12. 12. AppDynamics Portal @DevOpsGuys DevOpsGuys www.devopsguys.com 12
    13. 13. Failure in Minute 8(ish) @DevOpsGuys DevOpsGuys www.devopsguys.com 13
    14. 14. What went wrong? @DevOpsGuys DevOpsGuys www.devopsguys.com 14
    15. 15. SQL Client Exceptions @DevOpsGuys DevOpsGuys www.devopsguys.com 15
    16. 16. Slow Connection Open? @DevOpsGuys DevOpsGuys www.devopsguys.com 16
    17. 17. Code Bug (Thread.Sleep) @DevOpsGuys DevOpsGuys www.devopsguys.com 17
    18. 18. Fix it problems, deploy & re-test WORKSHOP DEMO PART 2 @DevOpsGuys DevOpsGuys www.devopsguys.com 18
    19. 19. Fix the Bugs… @DevOpsGuys DevOpsGuys www.devopsguys.com 19
    20. 20. Deploy it… @DevOpsGuys DevOpsGuys www.devopsguys.com 20
    21. 21. #3 Faster Iteration = Better Value @DevOpsGuys DevOpsGuys www.devopsguys.com 21
    22. 22. Maximise Testing Value Deploy Fix @DevOpsGuys Test Analyse DevOpsGuys www.devopsguys.com 22
    23. 23. While we wait for the load to ramp up… MORE ON APM… @DevOpsGuys DevOpsGuys www.devopsguys.com 23
    24. 24. Comparing the two releases SHOW THE IMPROVEMENT @DevOpsGuys DevOpsGuys www.devopsguys.com 24
    25. 25. 10,000 vs 45,000 @DevOpsGuys DevOpsGuys www.devopsguys.com 25
    26. 26. Summary 1. 2. 3. 4. See the Big Picture (systems thinking) Drill down to the details Faster Iteration = Better Value Stop the “Blame Game” – aka “There’s your Problem!” @DevOpsGuys DevOpsGuys www.devopsguys.com 26
    27. 27. DevOpsGuys Thank You AppDynamics Free Trial http://ow.ly/ubW6r operations | availability | performance | scalability | migration | strategy @DevOpsGuys DevOpsGuys www.devopsguys.com 27
    28. 28. What We Do DevOpsGuys provide development & operations support (DevOps) services for your online applications. You run your business. We run your website. It’s as simple as that. @DevOpsGuys DevOpsGuys www.devopsguys.com 28
    29. 29. Our service portfolio • 24 x 7 Application-Centric web operations • DevOps Transformation & Training • Continuous Delivery implementation • Infrastructure Automation & “Infrastructure as Code” • Application Performance Management • AppDynamics Implementation & Consultancy @DevOpsGuys • Web Performance consulting • Web monitoring • Load Testing • Test Automation and scripting • JetBrains Product Implementation & Consultancy • Octopus Deploy implementation DevOpsGuys www.devopsguys.com 29
    30. 30. The Leadership Team James Smith (@TheDevMgr) Steve Thair (@TheOpsMgr) • 16 years of software delivery experience. • Proven track record • 25 years of IT Operations experience. • Proven track record – – – – – – – Pizza Hut KFC Dell RAC Aviva Fujitsu Siemens Whitbread @DevOpsGuys – – – – – – – DevOpsGuys Vodafone Credit Suisse Group IBM BNP Paribas Zurich Financial Services Totaljobs Group TSL Education www.devopsguys.com 30
    31. 31. Contact Us Visit us at www.devopsguys.com Call our team on +44 (0)20 8798 3079 Email our engineers at team@devopsguys.com @DevOpsGuys DevOpsGuys www.devopsguys.com 31
    1. ¿Le ha llamado la atención una diapositiva en particular?

      Recortar diapositivas es una manera útil de recopilar información importante para consultarla más tarde.

    ×