More Related Content Similar to 3 12-2013 performance-testing_service_virtualization (20) 3 12-2013 performance-testing_service_virtualization1. Performance Testing + Service Virtualization:
The one-two punch for applications that rock
March 20, 2013
© Copyright 2013 Vivit Worldwide
© Copyright 2013 Vivit Worldwide
2. June 11 - 13
Las Vegas, Nevada
Save $300. Use code Vivit. Win 2014 conference pass.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
3. Vivit Advanced Training
Dive deep.
June 11, before HP Discover begins
Las Vegas, Nevada
Add course to your HP Discover
registration account.
© Copyright 2013 Vivit Worldwide
4. Brought to you by
Performance Testing 101 – A webinar
series focused on your needs!
http://bit.ly/101performancetesting
© Copyright 2013 Vivit Worldwide
5. Speakers
Ferhan Kilical, Ph.D. Mirek Novotny
WW Product Marketing Manager WW Product Manager
HP Software HP Software
© Copyright 2013 Vivit Worldwide
7. Question #1
How much do you know about Service
Virtualization?
• I have no idea
• Just heard about and want to learn how that helps
• Some knowledge, have try already
• Expert level
7 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
8. Question #2
What are your current challenges for
performance testing?
• No test environment, not enough resources to test
• Complex platform, composite applications
• Time on scripting
• Correlation
• Test data preparation
8 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
9. Performance Testing with
Service Virtualization:
The one-two punch for
applications that rocks
Ferhan Kilical, WW Sr. Product Marketing Manager
Mirek Novotny, Product Manager
Silvia Siqueira, WW Sr. Product Marketing Manager
March 2013
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without
notice.
10. Applications have become compositions,
representing business processes
Shopping Process Each of these steps are
interconnected software
components, also called services
Search Buy Pay Ship Track
Product Customer Profiles Payment Shipping
Components can run
anywhere– in-house Track package
Managed Cloud Traditional Public Cloud
or in the cloud
10 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
11. Speed, change and complexity stymies delivery
Hybrid and Cloud composite applications bring three challenges
1. It takes too long to develop and
deliver applications
2. It’s too costly and risky to use
cloud sourced and third party
services
3. It’s too difficult to test all
scenarios– too many defects leak
to production
11 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
12. Challenges of a real distributed environment!
REST
• No Availability
• Limited Access
• Dependency on third party Third Party
LDAP Single sign on
MQ
Mainframe
Web
browser JDBC
Existing database
SOAP JMS Web service and
Composite Application
Mobile Application services Legacy application
App
Application Under Test Existing Infrastructure
12 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
13. Service Virtualization becomes a key answer
Keep developing and testing moving forward with virtualized services
REST
Pay-per-transaction
• Virtualize for always available services
• Virtualize data scenarios
Third Party
• Make available for Dev and Test
• Share services-- lower infrastructure
costs MQ/CIC
S
Mainframe
RFC/IDO
SAP System
C
SOAP
Web Data
REST
browser JDBC JDBC
API Perf. Existing database
MQ
RFC
Config
CICS
SOAP
Composite
Simulatio
Under Web service and
Applicationn construction Legacy application
Mobile
App
Application Under Test Service Existing Infrastructure
13 © Copyright 2012 Hewlett-Packard Development Company, L.P. Virtualization notice.
The information contained herein is subject to change without
14. Modern Applications and Performance Test In
distributed environments
• Software components not ready yet REST
• Speed and performance test is a Pay-per-transaction
major issue
• Components/services with limited Third Party
access
• Dependency on third party– costs CICS Mainframe
• Data too difficult to source
• Security and compliance restrict
access RFC/IDO
Existing SAP
C
Web
browser JDBC
Existing database
SOAP Under Web service and
JMS
Composite
Application constructionLegacy application
Mobile
App
Application Under Test Existing Infrastructure
14 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
15. How do you test performance characteristics?
AUT Configuration
Virtual
users
SLA
Load generators
3rd Party services
Monitors
? PayPal APISLA
Loadrunner controller
SLA
Equifax Credit Report
2.0s ->0.5s
15 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
16. Virtualize to Allow Testing of Performance
Characteristics
AUT Configuration SV Virtualized
Virtual
users
SLA
Load generators
3rd Party services
Monitors
PayPal API
Monitor response time and throughput 0.5x
Control performance profiles SLA
Equifax Credit Report
Loadrunner controller
16 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
17. Mobile Apps? Virtualize services and network to deliver
high quality faster
The complete user experience with Network and Service Virtualization
Load Testing: Multi-user and multi-
location with Performance Center /
LoadRunner
App. server
Backend Monitoring:
Real-World Sitescope and
Network Conditions Diagnostics
& Performance App. server
Services
Device-Side Functionality / & Systems Service Virtualization
Response
17 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
18. Complete HP Test Automation Platform
Agile Application Delivery with HP Service Virtualization
HP Application Lifecycle Management
state, profiles, metrics
store, run, report store, find, deploy
Functionality SOAP
Web UI Data
REST
MQ
Performance API Perf.
JDBC
RFC Config
Security
CICS
Composite
Simulatio
Mobile Application
n
App
Test Application Under Test Service
Automation Virtualization
18 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
19. Speeding up release cycles by eliminating testing
delays for unlimited testing
TTNET is the largest internet service provider in Turkey with more than six million
customers providing internet services, IPTV, Voice over IP and mobile phone
services
Challenge
Deploy more than 200 apps per year. Major delays in testing and were never able to complete
test on time. Test had a lot of down time.
Test blocking issues were: Dependency on third party services, authorization issues, services not
“We can start testing earlier available during working hours, development was always behind.
without waiting the end to
end systems to be ready. Solution
Now we can do efficient Virtualize 3rd party endpoints to validate coding changes
resource management, Multiple development teams started using Service Virtualization to eliminate dependencies
predict schedule and launch
Modify performance factors of the virtualize service to ensure upstream calls
apps in a timely manner.”
Deploy virtual services as shared resource
Test and Release Results
Manager, TTNET Reduced test wait time 100%. On average saved 5-8 days/month.
95% of test cases are available through use of HP Service Virtualization.
Increased test cycles and test coverage 45%
Less defects in Production.
19 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
20. Benefits of service virtualization for performance
testing
Start performance testing early
Reduce cost
No wait time for performance test
No late-night performance testing schedules
Improve performance testing analysis and prediction
20 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
21. Service Virtualisation ROI
24% 75%
Reduced Wait Times
Faster Time to Market
23%
50% Decreased Software
Cycles
Increase in Service 58%
Availability Shorter Test Cycle Times
22% 45%
Fewer Production Increased Test Coverage
Defects
Source: voke Research
21 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
23. HP Service Virtualization
Designer Server
Authoring of virtual services Runtime for virtual services
Virtual services are stored on file Agents connecting to application
system environment (HTTP, JMS,
Embedded server included CICS…)
23 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
24. Virtual Service Designer
Performance
Virtual Service Data Model
Model
Control
Configuration
Virtual
Service
States
24 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
25. Wizard based Virtual Service creation
Dialog Based
Wizards
Pre-Set
Starting Points
25 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
26. Functional Model Stateful
Conversations
Functions Rule Detail
Service
Operations
Simulation
Rules
26 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
27. Performance Model
Performance
Throttles
Performance
Parameters
Service
Operations
27 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
28. Virtual Services within Functional and Load
testing
Virtualization Virtualization
Control Control
Virtual
Environment Virtual
Profiles Services Real-
time
Performance
28 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
29. HP Service Virtualization Demo
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
30. UC: Load test application for various backend
SLAs
Challenges: How to change backend
SLA?
• Multiple depending systems SOAP
• 3rd Party and Production Systems Exchange
Rates
• Cannot replicate in lab environment
?
Third Party
Approval
MQ
Service
Loadrunner
UI JMS
Member
Claim Accounts
Processing
Test Application Under Test Existing Infrastructure
30 Automation
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
31. UC: Load test application for various backend
SLAs
Solution: HP Service
Virtualization
1. Virtualize depending systems
SOAP
2. Create data model by learning Exchange
Rates
3. Model desired SLA conditions
4. profiles, metrics
Execute test and collect metrics Third Party
1 Simulate
4 SOAP
MQ
2
Data Custom SLA
Approval
Service
MQ Perf.
Loadrunner
JMS 3
Config
UI JMS
Member
Claim SimulatioAccounts
Processing n
Test Application Under Test Existing Infrastructure
Service
31 Automation Virtualization
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
32. Question #3
How can Service Virtualization accelerate
your performance testing?
• Easier the preparation of your test environment
• Re-use of scripts
• Reduce time to test
• Cost savings on resources
• Fasten the performance testing results
32 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
33. Q&A
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
3
34. Thank you!
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
3
35. Your Performance, Our Passion!
Got questions?
performancetesting@hp.com
Mirek.novotny@hp.com
Ferhan.kilical@hp.com
For more information go to:
hp.com/go/sv
hp.com/go/loadrunner
35 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.