Performance Testing w/ SharePoint<br />SharePoint Saturday Charlotte<br />Jeff Dalton<br />Twitter.com/jefferydalton<br />...
About Me<br />6/20/2009<br />2<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<b...
Performance Testing Basics<br />Identify Environment - Capture Application and Infrastructure architecture<br />Identify P...
Identify Environment<br />Architecture<br />Logical <br />Physical<br />System<br />Core Functions / Business Process<br /...
Identify Performance Acceptance Criteria<br />Establish Requirements<br />SLA / OLA, Regulations, Contracts<br />Request X...
Design Tests<br />Define usage scenarios (web transactions)<br />Requirements and Goals.<br />Common Usage Scenarios<br />...
Configure Test Environment<br />Setup Test Lab<br />Network<br />Hardware<br />Setup / Configure load testing software<br ...
Construct Tests<br />Plan on this taking longer than expected<br />Build scripts to create simulated data <br />SharePoint...
Run Tests / Analyze Results / Create Test Reports<br />Make sure proper people are in place when running tests.<br />Colle...
Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<b...
Performance Testing w/ Visual Studio 2008<br />Visual Studio 2005 or 2008 Team Test or Team Suite<br />Visual Studio Team ...
Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<b...
SharePoint Considerations<br />Web Front Ends<br />Caching Enabled / Content DB Size / Site Collection Size<br />Is Securi...
Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<b...
Lessons Learned<br />Plan, Plan, Plan <br />Know your environment<br />Establish your goals<br /> Know your tests<br /> Kn...
Lessons Learned<br />Think Times Matter / End User Variations Matter<br />Pure load is nice, but it doesn’t reflect real w...
Lessons Learned<br />Load Agents can max out quickly (do not want to over stress those machines)<br />Over worked Load Age...
Upcoming SlideShare
Loading in...5
×

#Spsclt Performance Testing W Share Point

1,217

Published on

Slide deck from SharePoint Saturday Charlotte presentation on Performance Testing with SharePoint

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,217
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
63
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

#Spsclt Performance Testing W Share Point

  1. 1. Performance Testing w/ SharePoint<br />SharePoint Saturday Charlotte<br />Jeff Dalton<br />Twitter.com/jefferydalton<br />Sharepoint.nailhead.net<br />
  2. 2. About Me<br />6/20/2009<br />2<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  3. 3. Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<br />6/20/2009<br />3<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  4. 4. Performance Testing Basics<br />Identify Environment - Capture Application and Infrastructure architecture<br />Identify Performance Acceptance Criteria - Requirements<br />Design Tests – Capture Scenarios, Navigation Paths, Workload Model<br />Configure Test Environment<br />Construct Tests<br />Run Tests / Analyze Results / Create Test Reports<br />Rinse / Repeat as Needed<br />6/20/2009<br />4<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  5. 5. Identify Environment<br />Architecture<br />Logical <br />Physical<br />System<br />Core Functions / Business Process<br />What happens if this system is down?<br />User Activites<br />How do people use this system?<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />5<br />
  6. 6. Identify Performance Acceptance Criteria<br />Establish Requirements<br />SLA / OLA, Regulations, Contracts<br />Request X must respond &lt; 5 seconds<br />Press Releases must be available with 2 minutes of release<br />Application Requirements<br />Application must support 5 orders per second.<br />Determine Thresholds<br />Processor Utilization should not exceed 80% for 5 consecutive seconds.<br />Establish Goals<br />95% of page requests should execute in less than 2 seconds.<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />6<br />
  7. 7. Design Tests<br />Define usage scenarios (web transactions)<br />Requirements and Goals.<br />Common Usage Scenarios<br />Business Critical Scenarios<br />Technical Concerns<br />Stakeholder Concerns<br />High Visibility usage.<br />Strive for real word usage<br />User delays / think times<br />User abandonment<br />Common user errors<br />Work Load models<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />7<br />
  8. 8. Configure Test Environment<br />Setup Test Lab<br />Network<br />Hardware<br />Setup / Configure load testing software<br />Setup monitoring software<br />Considerations<br />How much load before bottleneck on test generators.<br />Synchronize System Clocks<br />Validate Network components (Switches, Firewall, Load Balancer …)<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />8<br />
  9. 9. Construct Tests<br />Plan on this taking longer than expected<br />Build scripts to create simulated data <br />SharePoint Test Data Population Tool (CodePlex)<br />SharePoint Site Builder (CodePlex)<br />Ensure validation rules are working correctly<br />Plan on issues (usually test tools lag behind technology)<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />9<br />
  10. 10. Run Tests / Analyze Results / Create Test Reports<br />Make sure proper people are in place when running tests.<br />Collect / Analyze data as soon as tests are finished (everything is fresh in memory)<br />Meticulous documenting start / stop times, special circumstance with test.<br />Archive Test Results<br />Run Tests Multiple times (to reduce chance of anomalies) <br />Stakeholder Reports / Technical Reports <br />Content is tailored to audience<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />10<br />
  11. 11. Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<br />6/20/2009<br />11<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  12. 12. Performance Testing w/ Visual Studio 2008<br />Visual Studio 2005 or 2008 Team Test or Team Suite<br />Visual Studio Team System 2008 Test Load Agent <br />Now let’s get out of slides<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />12<br />
  13. 13. Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<br />6/20/2009<br />13<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  14. 14. SharePoint Considerations<br />Web Front Ends<br />Caching Enabled / Content DB Size / Site Collection Size<br />Is Security included?<br />SQL Server<br />Do Not Ignore<br />Timer Jobs<br />How will these impact your operations? <br />Have you included these in your tests?<br />SSP<br />Search, BDC, User Profiles, Session State, Excel Services,…<br />Solution Deployments<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />14<br />
  15. 15. Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<br />6/20/2009<br />15<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  16. 16. Lessons Learned<br />Plan, Plan, Plan <br />Know your environment<br />Establish your goals<br /> Know your tests<br /> Know your tools<br />Test, Test, Test (or search / destroy bottlenecks)<br />Leave plenty of time to shake out the tests<br />Size Matters (when Testing SharePoint)<br />Witnessed 100% performance degradation between empty site collection and one with 22k webs.<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />16<br />
  17. 17. Lessons Learned<br />Think Times Matter / End User Variations Matter<br />Pure load is nice, but it doesn’t reflect real world<br />Try to mix-up those IP-Addresses<br />Running all tests over 2 – 4 IP-Addresses does not simulate real world.<br />Dedicated Test Labs Are Good, Ummmkay<br />Testing in Production is Bad, Ummmkay<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />17<br />
  18. 18. Lessons Learned<br />Load Agents can max out quickly (do not want to over stress those machines)<br />Over worked Load Agent will skew test results.<br />Testing for under 30 minutes may cause you to miss out on major problems.<br />Rule of thumb is about 1000 concurrent users for 1 VSTS Load Agent (most I’ve been able to run is around 300)<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />18<br />
  19. 19. References<br />Patterns and Practices: Performance Testing Guidelines for Web Applications<br />Web and Load Testing with Visual Studio Team System<br />Visual Studio 2008 Testing (Load Test)<br />Advanced Load Testing Features of Visual Studio Team System<br />MSDN: Working with Load Tests<br />Lessons Learned (Part 1)<br />Lessons Learned (Part 2)<br />More Lessons Learned<br />6/20/2009<br />19<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×