1. Performance Testingatthe Edge Alois Reitbauer, dynaTrace Software

2. 3,000,000,000 10,500,000,000

3. The Classical Approach

4. Waterfallsarepretty

5. But mightgetscary

6. The dynaTrace Approach

7. Manyplatforms Different usagescenarios High numberofconfigurations No easy waytopatchsoftware

8. 8 OurArchitecture DYNATRACE CLIENT DYNATRACE SERVER DYNATRACE COLLECTOR (OPTIONAL) DYNATRACE COLLECTOR (OPTIONAL) WAN Java Server .NET Server Database Web Server APPLICATION

9. Lessonslearned

10. Profiling was not enough Goodforfindingproblems Resultcomparisonhard Only valid untilnextcheck-in Toomuchwork

11. The Life of a Log Statement Enterthecode publicvoidfoo (){ … // do something bar (); } publicvoid bar (){ … // do somethingelse Logger.log (“executiontook“ + time); }

12. The Life of a Log Statement Somebodychangessomething publicvoidfoo (){ … // do something if (condition) bar (); else otherBar (); } publicvoid bar (){ … // do somethingelse Logger.log (“executiontook“ + time); }

13. The Life of a Log Statement Yourcodegetsdeprecated publicvoidfoo (){ … // do something newBar (); } publicvoid bar (){ … // do somethingelse Logger.log (“executiontook“ + time); }

14. Methodology

15. Definingourstrategy Startearly Break in pieces Test Continuously

16. Frequency vs.Granularity JUnit-based Tests (2x day) Total System Tests Long-running Stabiltiy Tests (2 w duration) Granularity Frequency

17. Granularity Comparability Complexity Quality

18. Avoid Re-Runs Whatcould happen? Whichinformation do youwant? Whatdescribesyoursystem? Whatis different fromthe last run?

19. Aim high … … test50%more

20. Create Instability .. addingsomevolatilityincreasesthelikelyness todiscoverproblems …“

21. „Last MileTesting“

22. Measurements

23. Stabilityof Tests

24. UseDedicated Hardware Comparability Stability Efficiency

25. Trends in Unstable Tests

26. Testingscalability Big DumpOperations Small DumpOperations

27. Understandyourmeasurements Response Time and GC Response Time only

28. BeSpecific on whattotest Throughput Response Time Memory Consumption Other KPI …

29. Beyond Response Time KPI Chart: Server Throughput Over Time

30. Motivateyourteam

31. Howtomakedeveloperswritetests #1 Heroism #2 Boomerang #3 The otherguy #4 Bug me not #5 Feedback #6 Code vs. Wine #7 Newb vs. Noob

32. Test Case Complexity First Start dynaTrace infrastructure Whenready Start n WebSphereinstances on servers … Whenready Start LoadtestagainstWebSphereservers After loadteststart Execute testcase

33. Making complexthings easy @DtdRemoteSud( host = "lab2", name = "WAS7.0", startupPriority = 1, postStartClosure = WaitForWebSphereSudIsUp.class ) private SudInterfacewebSphereSud;

34. Findingtheresponsiblecode Version ControlHistory Lookup

35. Alwaysavailable Continuous Integration Reports

36. E-Mail Notification

37. alois.reitbauer@dynatrace.com Mail blog.dynatrace.com Blog AloisReitbauerTwitter