Improving Overall Software Quality Through Profiling and Performance Testing


Published on

Visual Studio 2010 Ultimate lets you profile and stress test your application early and throughout its development lifecycle with realistically modeled simulated load. By integrating performance validations early into your applications, you can ensure that your solution copes with real-world demands and behaves in a predictable manner, effectively increasing overall software quality. In this session, we will learn the importance of performance and stress testing, as well as the capabilities of Visual Studio 2010 Ultimate to improve profiling and testing throughout the application lifecycle.

Published in: Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Improving Overall Software Quality Through Profiling and Performance Testing

  1. 1. Improving Overall SoftwareQuality Through Profiling andPerformance TestingErvin Loh and Lai EeALM Program Manager and ALM EngineerK365Labs Sdn Bhd
  2. 2. Agenda Load & Performance Testing with Visual Studio Proven within Microsoft External Success Stories The Visual Studio Load & Performance Offering The Visual Studio Load & Performance Community
  3. 3. Visual Studio: Battle HardenedVisual Studio isthe de facto loadtesting toolwithin Microsoft Scales to massive loads Handles the most complex scenarios
  4. 4. Load Test Internal Success StoriesTeam Test Target DescriptionOffice Server Office SharePoint Perf and stress testing of Office Server System Windows SharePoint Excel ServerSQL SQL Reporting Services Perf and Stress, benchmarking, sizing SQL BIDynamics AX Dynamics 4.0 Perf and Stress, benchmarking, sizingMSN/Live Ad Center High volume perf and stress testing Hot Mail Virtual Earth Recent 12-hour production test: Autos March Madness Total requests generated 3.63 Billion Music Average requests/sec 84,248 More…Groove Open Office Perf and Stress TestingDevDiv Team Foundation Server Perf and Stress Test TFSMSIT SAP Load Test SAP via Web ServicesMSTV IPTV servers Huge tests to load test IPTV national rolloutMS CRM MS CRM Perf and Stress, benchmarking, sizing Using Load Tests to validate IPTV Perf and Stress Testing Each services 100,000 customersDr Watson Log collection servers Perf andmajor telecoms are customers: Many Stress TestingWindows Update Patch download servers Perf andTel Italia, Bell Canada, more… AT&T, Stress Testing
  5. 5. External Success Stories Services Test Labs Professional performance and stress testing services Before: 100% on HP Load Runner and Borland Silk Performer After: 100% on VS, with many successful customer engagements Prefer VS over Load Runner and Silk Performer Many others
  6. 6. Tailspin Toys
  7. 7. Agenda Load & Performance Testing with Visual Studio The Visual Studio Load & Performance Offering Web Test Architecture & Feature Set Load Test Architecture & Feature Set The Visual Studio Load & Performance Community
  8. 8. Web Performance Test Feature Set Deep integration with Visual Studio Web (HTTP) Tests Data Collection Performance Counter Sets capture key measurements Test results stored in SQL for custom reporting Performance Analysis Correlate of server activity with performance measurements Drill into error logs
  9. 9. Web Performance Test Recorder Visual Studio Launches Internet Explorer Visual Studio Internet Explorer Recorder BHO Browser eventsRecorder Listener Record events Browser Control Browser Recorder Merging Recorder Wininet Shim Record events Wininet Recorder Record events Wininet Intercepts wininet calls
  10. 10. Web Test Recorder Plugin Visual Studio Launches Internet Explorer Internet Explorer Visual Studio Recorder BHO Browser events Record events Browser Browser Control Merging Recorder Recorder Wininet Wininet Shim Recorder Wininet Record events Intercept s wininet calls Record events Recorder Listener
  11. 11. Key Capabilities in 2010 Declarative branching and looping in a web performance test Excel based performance reporting Run UI tests as performance tests Integration with data collectors profiler Intellitrace™
  12. 12. Web Performance Tests
  13. 13. Visual Studio 2010 Load TestArchitectureVisual Studio Load agent web server test controller database serverMicrosoft Test Manager 2010
  14. 14. Load/Stress Test Feature Set Flexible Load Modeling “Scenarios” for modeling different user groups Goal-based, step, constant, and custom load patterns Model different browsers and networks Duration-based and iteration based Efficient Load Generation “Unit” tests can be run under load
  15. 15. Key Capabilities in 2010 Virtual user activity chart 64-bit test execution Driver level network emulation Collect the full test result on error Numerous enhancements to make creating scripts easier New extensibility points … and more
  16. 16. Load Tests
  17. 17. Agenda Load & Performance Testing with Visual Studio The Visual Studio Load & Performance Offering The Visual Studio Load & Performance Community Plugins, Extensibility Forums, Blogs
  18. 18. Extensibility Load test plugins Many extensibility points in Web performance tests web test plugins web test request plugins web test recorder plugins diagnostic data adapters (DDA) (a.k.a “data collectors”)
  19. 19. Visual Studio Load & PerformanceCommunity Forums US/vstswebtest/threads Blogs index-for-web-tests-and-load-tests.aspx
  20. 20. Visual Studio Load & PerformanceCommunity CodePlex Quick Reference Guide WCF Load Test Recorder SQL Load Test Recorder Load Test Reports Web and Load Test Plugins SharePoint Scripts continue….
  21. 21. How Do I Get It?
  22. 22. Questions & Answers
  23. 23. ResourcesGetting Started with Load and Web Performance Test Walkthroughs Performance Test Walkthroughs Test Walkthroughs Using a Test Controller and Test Agents in a Load Test
  24. 24. We value your feedback!Please remember to complete theoverall conference evaluation form andreturn it to the Registration Counter.