More Related Content Similar to Introduction to Performance testing (20) Introduction to Performance testing1. Introduction to
performance testing
Silvia A Siqueira
WW Sr. Product Mktg. Manager
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
2. Delivering applications that perform well
Think about building a
fancy and huge
tower…
and discovering later
that it can’t handle
more than 10% of the
planned capacity!
2 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
3. Performance is fundamental!
When customers “struggle”
43% 12% 16% 14%
Abandon the Go directly to Become more Log a complaint
transaction, a competitor likely to prefer with customer
try later on a competitor service
computer
3 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
4. Performance testing lifecycle
Step 1 Planning the test
Test preparation: creating the scripts
Step 2 and scenarios
Test execution: running and monitoring
Step3 scenarios
Test analysis and reporting:
Step 4 understanding the results
Step 5 Monitoring in production
4 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
5. Step 1 - Planning the testing
• Team
• Business goals and SLAs
• Application under test (AUT)
• Criticality
• Environment of the AUT
• Test requirements
• User behavior, user
locations, and application
timeframe usability
• Special factors regarding
the application under test
5 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
6. Performance testing solution
Emulate production workloads end-to-end
Performance Simulates Internet/ Web server App. server Database
test thousands of users WAN
• Simulates real users with thousands of “virtual” users
• Generates accurate, measurable and repeatable load on the system from a single
point of control
• Pinpoints bottlenecks in the system
6 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
7. Understanding the terminology for
performance testing
Application under testing (AUT)
End user Middle tier
Application Internet/WAN Database
(HTTP, WebSphere, server, network)
4 Measure
1 Author scripts 3 Generate load
• Transaction record impact
• Check balance
• Transfer funds Analysis, diagnostics
• Pay bills
5 and reporting
Simulate
thousands of users
Test Scenario
2 Plan and control load tests
7 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
8. Understanding the terminology for
performance testing
Virtual User generator (VUGEN)
End user Middle tier
Application Internet/WAN Database
(HTTP, WebSphere, server, network)
4 Measure
1
1 Author scripts 3 Generate load
impact
• Transaction record
• Check balance
• Transfer funds Analysis, diagnostics
• Pay bills
5 and reporting
Simulate
thousands of users
Test Scenario
2 Plan and control load tests
8 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
9. Understanding the terminology for
performance testing
Controller
End user Middle tier
Application Internet/WAN Database
(HTTP, WebSphere, server, network)
4 Measure
1 Author scripts 3 Generate load
• Transaction record impact
• Check balance
• Transfer funds Analysis, diagnostics
• Pay bills
5 and reporting
Simulate
thousands of users
Test Scenario
2
2 Plan and control load tests
9 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
10. Understanding the terminology for
performance testing
Load Generators
End user Middle tier
Application Internet/WAN Database
(HTTP, WebSphere, server, network)
4 Measure
1 Author scripts
• Transaction record
3
3 Generate load
impact
• Check balance
• Transfer funds Analysis, diagnostics
• Pay bills
5 and reporting
Simulate
thousands of users
Test Scenario
2 Plan and control load tests
10 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
11. Understanding the terminology for
performance testing
Monitoring & profiling
End user Middle tier
Application Internet/WAN Database
(HTTP, WebSphere, server, network)
4 Measure
1 Author scripts 3 Generate load 4
• Transaction record impact
• Check balance
• Transfer funds Analysis, diagnostics
• Pay bills
5 and reporting
Simulate
thousands of users
Test Scenario
2 Plan and control load tests
11 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
12. Understanding the terminology for
performance testing
Analysis
End user Middle tier
Application Internet/WAN Database
(HTTP, WebSphere, server, network)
4 Measure
1 Author scripts 3 Generate load
• Transaction record impact
• Check balance
• Transfer funds Analysis, diagnostics
• Pay bills 5
5 and reporting
Simulate
thousands of users
Test Scenario
2 Plan and control load tests
12 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
13. Step 2 - Test preparation:
Creating the scripts and scenarios
Determine what is the best “protocol” to emulate user
interaction based on the environment of the AUT
Create a scenario for each transaction to be tested
Understand and apply correlations for complex
applications
13 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
14. Step 3 - Test execution:
Running and monitoring scenarios
Now is time to simulate thousands of users running
multiple scenarios simultaneously
Monitor the test execution
Have a profiler (HP Diagnostics) to accelerate the
resolution of issues found in the performance testing
14 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
15. Step 4 - Test analysis and reporting
Determine which transactions passed or failed the set
service-level objective
Analyze possible causes of failure
Review application performance risks
15 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
16. Performance testing
in action
© Copyright 2012 Hewlett-Packard Development Company, L.P.
The information contained herein is subject to change without notice.
17. Grows with your organization’s demands
Accommodates your needs from project teams to the Performance Centers of Excellence
Flexible delivery options
On-premise Term licenses In-the-cloud and SaaS Testing-as-a-Service
Daily, monthly, quarterly, Multiple service options
semester, annual
• HP performance testing for small budget or limited time to complete your testing
• Any size project or company size
• One day, multiple days…or years
• Unlimited options for testing in-the-cloud
17 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
18. Ensure unique customer experience
with HP LoadRunner
• Innovated solution
• Scalable to support any size project organization
• Integrated products for the entire application lifecycle
• Flexible licensing and deployment models
• Broadest technology and platform support in the
industry
• Extensive eco-systems of partners and IT
professionals for local support and resources
18 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
19. Q&A
© Copyright 2012 Hewlett-Packard Development Company, L.P.
The information contained herein is subject to change without notice.
20. Thank you
© Copyright 2012 Hewlett-Packard Development Company, L.P.
The information contained herein is subject to change without notice.