Short presentation on how to start performance testing. Going from phase of requirement gathering to the writing your first test scripts and using performance test tool. Glance over JMeter - open source performance testing tool.

1. How to Start Performance Testing?
Nebojsa Videnov
15 December 2015, Belgrade, Serbia
PHP Meetup
http://nos.twnsnd.co/

2. I wish, I wish,..
https://stocksnap.io/author/622

3. Agenda
Requirements
Vocabulary
Test Planning
JMeter
Takeaways
https://stocksnap.io/author/403 Jeffrey Betts

4. Requirements
https://stocksnap.io/author/652 Daria Nepriakhina

5. Badly formulated
“We expect 20 million users per year.”
“We anticipate 50,000 users a day.”
https://stocksnap.io/author/5574 Avel Chuklanov

6. How to format Requirements?
● What does web site needs to do well?
● What is usage pattern of the proposed system?
● What is daily peak demand?
● How much testing environment is similar to production environment?
● Can you provide a breakdown of the frequency of certain activities?
(for example, 75% browse, 2% check their order status, and so on)
● Where is the project in terms of the overall project performance goals?
● ...
Questions.

7. Vocabulary

8. What is a hit?
- HTTP request
- Whole page
- Entire visit by a given user
https://stocksnap.io/author/402 Skitter Photo

9. What is a day?
Determining the period of time
when most users arrive
on the system becomes
critical for estimating
peak load.
https://stocksnap.io/author/56 Sonja Langford

10. Throughput
- Transaction per unit of time
(Transaction pair - HTTP request and response)
- Page rate
- User rate
https://stocksnap.io/author/3350 Will Langenberg

11. Throughput plateau
Requests per
second
Load
Throughput plateauSaturation point
10 30 8020 5040 7060
25
50
100
125
Buckle point
Heavy load zone
Light load zone
THROUGHPUT

12. Response Time
https://stocksnap.io/author/4440 Luis Llerena

13. Standard Deviation
Standard Deviation is
measure of variability of data set.
https://stocksnap.io/author/3350 Will Langenberg

14. 90% Line
90% Line is the value below which 90% of the samples fail.
https://stocksnap.io/author/9429 Raymond Sam

15. Median
Number which divides
the samples into two equal halves.
Half of the samples are
smaller than the median and
half are larger.
https://stocksnap.io/author/4440 Luis Llerena

16. Latency
Time between first request
is sent until first byte of response
reaches the client.
https://stocksnap.io/author/2784 Wil Stewart

17. Concurrent Load
https://stocksnap.io/author/16087 Marcin Czaja

18. Active Load
https://stocksnap.io/author/403 Jeffrey Betts

19. Pick Load
Peak Load refers to the maximum
concurrent users within some
time period.
https://stocksnap.io/author/408 Fré Sonneveld

20. What is a user?
User is:
1. User is a hit.
2. User is all day visitor.
Once logged in for the whole day.
user = whole set of activities by the user for the whole
day.
May or may not be very active.
3. User visit.
visit = the most common usage of user
https://stocksnap.io/author/15749 Stephen Radford

21. Thinking Time
Interval between user requests
https://stocksnap.io/author/17101 Greg Rakozy

22. Steady state
Throughput
10 30 1020 5040 3040
25
50
100
125
Steady state
Ramp-down
Ramp-up
Load

23. Ramp-up period
Throughput
10 30 1020 5040 3040
25
50
100
125
Steady state
Ramp-down
Ramp-up
Load

24. Ramp-down period
Throughput
10 30 1020 5040 3040
25
50
100
125
Steady state
Ramp-down
Ramp-up
Load

25. Operation ceiling
Number of concurrent
users that the application
can withstand before becoming totally unresponsive
https://stocksnap.io/author/5300 Joseph Barrientos

26. Starting
Performance
Testing
http://nos.twnsnd.co/

27. Team for Performance Testing

28. Before you start
Develop goals and plan for obtaining the desired
measurements.
Develop realistic scenarios
https://stocksnap.io/author/1949 Startup Stock Photos

29. 1. Gather requirements
https://stocksnap.io/author/5257 Lukasz Kowalewski

30. 2. Set your goals
https://stocksnap.io/author/16572 Chen YiZhou

31. 3. Estimate
https://stocksnap.io/user/saumya04 Saumya Rastogi

32. https://stocksnap.io/author/1949 Startup Stock Photos
Estimation - part 1.
- We anticipate 50,000 users a day?
- What is a user? User is a visit.
- What is a day? 8 hours
- Average user visit: 10 minutes
- Session timeout: 15 minutes
- Average pages per visit: 5
- Peak time factor: 5
- Requests per page: 6

33. https://stocksnap.io/author/1949 Startup Stock Photos
Estimation - part 2.
50,000 users per day / 8 hour day = … ~= 1.7 users/second
Peak hours: 1.7 users/second * 5 ~= 8.5 users/second
During visit: 8.5 users/second * 10 minutes ~= 5,100 users
5,100 users * 5 pages per visit = 25,500 pages per 10 minute visit
6 requests per page * (25,500 / 10) / 60 =
THROUGHPUT = 255 requests/second

34. 4. Performance testing tools
JMeter.
https://stocksnap.io/author/6696 Peter Belch

35. JMeter - Getting started
Test Plan
Test Group
Samplers
Logic controllers

36. Listeners

37. Assertions
Response Assertion
Duration Assertion
Size Assertion

38. Distributed testing

39. Plugins
Stepping Thread Group
Ultimate Thread Group

40. Others
Sending JSON using HTTP
HTTP Cookie Manager
CSV File Reading
Timers

41. Takeaways
https://stocksnap.io/author/63 Pawel Kadysz

42. JMeter Best Practices
https://stocksnap.io/author/402 Skitter Photo

43. - Generate reports after test run.
- Use CSV output rather than XML
- Use distributed (remote) testing
- Do not use XPath extractor
- Do not use Regular Expression Extractor with checked Body (unescaped)
- Use latest version of JMeter
- Use Cookie Manager for each Thread Group
- Read data from CSV files
- Use variables
- Use non-GUI mode
- …
- http://testerfenster.com/blog/jmeter-tutorials-best-practices/
https://stocksnap.io/author/1949 Startup Stock Photos

44. Test script
https://stocksnap.io/author/403 Jeffrey Betts
-

45. - Provide a warm-up period to initiate the environment
- Obtain measurements within a steady-state period
- Verify error-free test execution
- Drive same workload between runs
- Capture measurement without impacting performances
https://stocksnap.io/author/1949 Startup Stock Photos

46. Use performance terminology consistently.
https://stocksnap.io/author/5678 Piotr Lohunko

47. Your performance test
is as good as data it produces.
https://stocksnap.io/author/4440 Luis Llerena

48. Resources

49. Resources
Performance Testing Guidance for Web Applications Microsoft Corporation
Performance Testing with Jmeter - Second Edition Bayo Erinle
Performance Analysis for Java Web Sites Stacy Joines, Ruth Willenborg, Ken Hygh
https://blazemeter.com/blog/

50. http://www.testerfenster.com
http://testerfenster.com/blog/jmeter-tutorials/

51. Thank You
Nebojsa Videnov
www.testerfenster.com
@TesterFenster