Shift-Left Performance Testing with CA Service Virtualization
•
8 likes•860 views
Pre-Con Education: Shift-Left Performance Testing for Shift-Forward Quality
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Shift-Left Performance Testing with CA Service Virtualization
Similar to Shift-Left Performance Testing with CA Service Virtualization (20)
More from CA Technologies
More from CA Technologies (20)
Recently uploaded
Recently uploaded (20)
Shift-Left Performance Testing with CA Service Virtualization
- 2. 2 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD © 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The content provided in this CA World 2016 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA. For Informational Purposes Only Terms of this Presentation
- 9. 9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Benefits to Performance Testing Virtual Services + current testing tools CHALLENGE Creating a lab capable of handling production capacity loads may not be realistically possible. APPLICATION “X” CURRENT TESTING TOOLS Thousands of transactions BillMeLater PayPal TNT Express 3rd Party Service Load Test at the Component Level Test for Volume and Capacity Independently Locate Bottlenecks early Virtualize 3rd Party Systems, Mainframe Data: Always Ready, Highly Scalable Immune to Availability and Constraint Issues Vary the response times from the virtual services! Run thousands of transactions through the actual application on the actual hardware with NO IMPACT on your existing systems!
- 15. 15 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD + Linking Performance Monitoring and Testing
- 19. 19 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Save Millions in infrastructure costs and 3rd party fees Detect Defects earlier in the SDLC Eliminate capacity constraints for performance testing Reduce delays with high-performance masking and subsetting, and automated data discovery Application “X” Test Cases Thousands of transactions Agent Performance Testing in a Box Innovate Faster while Delivering a High Quality Experience ü Use the same test cases created and optimized for functional testing ü Simulate backend load by running test thru an API ü Simulate life like test environments ü Generate purpose built test data ü Control outlier conditions ü Adjust think times
- 20. 20 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Deliver Innovations… Faster! TIME Week 4Week 2Week 1 x Week 6Week 3 DEV 1 DEV 2 DEV 3 DEV 1 DEV 2 DEV 3 DEV 1 DEV 2 DEV 3 DEV 1 DEV 2 DEV 3 DEV 1 DEV 2 DEV 3 DEV 1 DEV 2 DEV 3 App 3 App 2 App 1 Week 7Week 5 Sequential Parallel App 3 App 2 App 1 Accelerate Application Delivery Simulate needed systems … end-to-end Create virtual services … easily Increase developer productivity 1 2 3 Cut of Set up time for dev environments (from 42 days to 3) Reduced Time-to-Market by for key applications. http://bcove.me/4rx4wt6x 30 Days 15% http://bit.ly/SV-TelefonicaChile
- 21. 21 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD 99% reduction in testing times ------------------- 25% reduction in software defects Business Autotrader sells advertising that allows private and trade buyers and sellers to exchange vehicles. More than 18 million people use Auto- Trader.com each month. Challenge To meet customer demand for new online features and accessible across multiple devices, Autotrader needed to release software updates on a weekly basis. Testing, however, had become complex, costly and time- consuming. Solution CA Service Virtualization enables Autotrader to virtualize and test new services and apps on a multitude of devices, while simulating both apps working normally and while experiencing performance issues. CA Services completed implementation and training in just six weeks. Autotrader Avoids $300,000 in Testing Costs with CA Service Virtualization Autotrader is improving the customer experience with faster time-to-market. “The CA Technologies team blew the competition away with their knowledge and passion.”
- 22. 22 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA Continuous Delivery Portfolio Development OperationsTestPlanning Deploy CA Agile Requirements Designer CA Test Data Manager CA Continuous Application Insight CA Application Test CA Release Automation Agile Ops Agile Central CA Service Virtualization CA Release Automation Standard + Continuous Delivery Edition APIM APM
- 24. 24 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Resources § Next Generation Performance Testing Executive Brief – http://bit.ly/2alTsrr § Forrester SV TEI Study – http://bit.ly/CASV-TEI § Service Virtualization Today – www.servicevirtualization.com § Gartner Market Guide for API Testing and Virtualization – http://bit.ly/Gartner_SV-Guide § Key Capabilities of CA Service Virtualization Whitepaper - http://bit.ly/CASV_WP § Real Customers. Real Results – Service Virtualization customer success stories www.ca.com/CDResults § IT Central Station – Real User Reviews and Comparison Guide https://www.itcentralstation.com/products/ca-service-virtualization § CA Service Virtualization Home Page - http://www.ca.com/us/products/ca- service-virtualization.html?intcmp=headernav
- 25. 25 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Recommended Sessions SESSION # TITLE DATE/TIME DO5T01S Keynote: End-to-End Integrated Continuous Delivery Ecosystem: How to Drive Innovation and Differentiation 11/16/2016 at 10:30 am DO5T02P Leadership Panel: DevOps Leaders Discuss the Journey to Continuous Delivery 11/16/2016 at 01:45 pm DO5T03P Leadership Panel: Continuous Delivery in the Financial Services Industry 11/16/2016 at 04:30 pm
- 26. 26 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Must See Demos Modernize App Delivery Integrated CD Theater 5 - DOV501P Deliver Test Data Faster Test Data Manager Theater 5 - DOV511P Deliver Better Apps Service Virtualization Theater 5 - DOV507P Orchestrate Your Release Release Automation Theater 5 - DOV513P
- 27. 27 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Thank you. Stay connected at communities.ca.com
- 28. @CAWORLD #CAWORLD © 2016 CA. All RIGHTS RESERVED.28 @CAWORLD #CAWORLD DevOps – Continuous Delivery For more information on DevOps – Continuous Delivery, please visit: http://cainc.to/PiTFpu
Editor's Notes
- As you build out your presentation, here are a few dos and don’ts.
- CA Continuous Application Insight (CA CAI) can observe a manual test and then generate tests for web UI APIs by creating the database validation steps for you. We will also show you how CA CAI can be used to generate 1000’s of tests vs. spending days getting the validation right for a single manual test! Topics Covered: Where are the APIs? Finding the APIs with CA CAI What are baseline, data driven, and expanded tests? High fidelity tests – remove human editing of API tests Demo
- Only 13% of Agile adopters have implemented Agile testing. – Forrester February 5, 2014, “How Can You Scale Your Agile Adoption?” report.
- Rubber hits the road !!!
- Virtualize Dependencies of System Under Development/Test Create Automated Functional Tests at the Component Level Leverage Service Virtualization and Drive Testing at the API Layer Move Functional Virtual Services to Performance Server Convert Functional Tests to Performance / Concurrency Tests App Test use Staging Documents to convert Functional to Performance Other Tools - Sorry Performance Test System Under Development backed by Virtual Services beyond Peak Loads
- Live application on the actual hardware it will be deployed on in Production. Surround the live application with models of every other system it will integrate with in Production. Run 10x the expected level of transactions. Vary the response times of the upstream and downstream systems used by the application – watch the results to know the points of failure.
- Talk about having a more realistic Insurance company testing time example.
- Some of the testing teams we talk to only refresh test data every 6 months and when they do it is a 3+ week process. This is where CAs Test Data Manager solution comes into play. It enables you to provision the test data you need to run production level tests.
- Con-Way – Saved 2 months of development/testing Increased number of load and performance Testing cycles from 1 to 10 Environment issues Higher Complexity of 3rd Party, Aggregated Portals, Mobile and Web More Dependencies both inside and outside the firewall Faster Change Rate + Iterative and Agile Development, DevOps Performance testing labs are a bottleneck: not able to handle increased influx of releases Too late Application level performance issues mixed with network, capacity and configuration issues. Increases mean time to identification (MTTI) of the root cause Too late to fix architectural defects Too expensive Multiple dedicated Physical environments, Mainframe test partitions Hardware costs (procure, deploy and administer) Load runner license costs Not comprehensive Application teams going to production bypassing performance labs Dependent systems are capacity constrained for high volume testing Dependent systems in test labs do not behave as in production, leading to invalid results Lack of right test data synchronized across all systems How does CA help – Understand the true scope: Test with Realism from the User to Server Testing from Development through Production – Continuous Validation Better insight – Leverage Analytics and Integrated monitoring Accelerate the Cycle – Work in Real Time -- Internal and External Testing Create a Virtuous Circle – Performance as an Operational Discipline On-Demand. No need to schedule. Ready when you are
- Reduce time to market. 3 dev teams here. Let’s say you need to redo your app, front end-web site, whatever. Typically, these teams are dependant on each other. Instead, create a virtual system that replicates the dependant system so you can begin your dev/testing today.
- SV, RA, CAI, AppTest, VAPI, GT (different color), etc