Your SlideShare is downloading. ×
0
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
#Spsclt Performance Testing W Share Point
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

#Spsclt Performance Testing W Share Point

1,209

Published on

Slide deck from SharePoint Saturday Charlotte presentation on Performance Testing with SharePoint

Slide deck from SharePoint Saturday Charlotte presentation on Performance Testing with SharePoint

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,209
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
63
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Performance Testing w/ SharePoint<br />SharePoint Saturday Charlotte<br />Jeff Dalton<br />Twitter.com/jefferydalton<br />Sharepoint.nailhead.net<br />
  • 2. About Me<br />6/20/2009<br />2<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  • 3. Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<br />6/20/2009<br />3<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  • 4. Performance Testing Basics<br />Identify Environment - Capture Application and Infrastructure architecture<br />Identify Performance Acceptance Criteria - Requirements<br />Design Tests – Capture Scenarios, Navigation Paths, Workload Model<br />Configure Test Environment<br />Construct Tests<br />Run Tests / Analyze Results / Create Test Reports<br />Rinse / Repeat as Needed<br />6/20/2009<br />4<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  • 5. Identify Environment<br />Architecture<br />Logical <br />Physical<br />System<br />Core Functions / Business Process<br />What happens if this system is down?<br />User Activites<br />How do people use this system?<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />5<br />
  • 6. Identify Performance Acceptance Criteria<br />Establish Requirements<br />SLA / OLA, Regulations, Contracts<br />Request X must respond &lt; 5 seconds<br />Press Releases must be available with 2 minutes of release<br />Application Requirements<br />Application must support 5 orders per second.<br />Determine Thresholds<br />Processor Utilization should not exceed 80% for 5 consecutive seconds.<br />Establish Goals<br />95% of page requests should execute in less than 2 seconds.<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />6<br />
  • 7. Design Tests<br />Define usage scenarios (web transactions)<br />Requirements and Goals.<br />Common Usage Scenarios<br />Business Critical Scenarios<br />Technical Concerns<br />Stakeholder Concerns<br />High Visibility usage.<br />Strive for real word usage<br />User delays / think times<br />User abandonment<br />Common user errors<br />Work Load models<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />7<br />
  • 8. Configure Test Environment<br />Setup Test Lab<br />Network<br />Hardware<br />Setup / Configure load testing software<br />Setup monitoring software<br />Considerations<br />How much load before bottleneck on test generators.<br />Synchronize System Clocks<br />Validate Network components (Switches, Firewall, Load Balancer …)<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />8<br />
  • 9. Construct Tests<br />Plan on this taking longer than expected<br />Build scripts to create simulated data <br />SharePoint Test Data Population Tool (CodePlex)<br />SharePoint Site Builder (CodePlex)<br />Ensure validation rules are working correctly<br />Plan on issues (usually test tools lag behind technology)<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />9<br />
  • 10. Run Tests / Analyze Results / Create Test Reports<br />Make sure proper people are in place when running tests.<br />Collect / Analyze data as soon as tests are finished (everything is fresh in memory)<br />Meticulous documenting start / stop times, special circumstance with test.<br />Archive Test Results<br />Run Tests Multiple times (to reduce chance of anomalies) <br />Stakeholder Reports / Technical Reports <br />Content is tailored to audience<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />10<br />
  • 11. Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<br />6/20/2009<br />11<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  • 12. Performance Testing w/ Visual Studio 2008<br />Visual Studio 2005 or 2008 Team Test or Team Suite<br />Visual Studio Team System 2008 Test Load Agent <br />Now let’s get out of slides<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />12<br />
  • 13. Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<br />6/20/2009<br />13<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  • 14. SharePoint Considerations<br />Web Front Ends<br />Caching Enabled / Content DB Size / Site Collection Size<br />Is Security included?<br />SQL Server<br />Do Not Ignore<br />Timer Jobs<br />How will these impact your operations? <br />Have you included these in your tests?<br />SSP<br />Search, BDC, User Profiles, Session State, Excel Services,…<br />Solution Deployments<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />14<br />
  • 15. Agenda<br />Foundation<br />Performance Testing w/ Visual Studio 2008<br />SharePoint Consideration<br />Lessons Learned<br />6/20/2009<br />15<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />
  • 16. Lessons Learned<br />Plan, Plan, Plan <br />Know your environment<br />Establish your goals<br /> Know your tests<br /> Know your tools<br />Test, Test, Test (or search / destroy bottlenecks)<br />Leave plenty of time to shake out the tests<br />Size Matters (when Testing SharePoint)<br />Witnessed 100% performance degradation between empty site collection and one with 22k webs.<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />16<br />
  • 17. Lessons Learned<br />Think Times Matter / End User Variations Matter<br />Pure load is nice, but it doesn’t reflect real world<br />Try to mix-up those IP-Addresses<br />Running all tests over 2 – 4 IP-Addresses does not simulate real world.<br />Dedicated Test Labs Are Good, Ummmkay<br />Testing in Production is Bad, Ummmkay<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />17<br />
  • 18. Lessons Learned<br />Load Agents can max out quickly (do not want to over stress those machines)<br />Over worked Load Agent will skew test results.<br />Testing for under 30 minutes may cause you to miss out on major problems.<br />Rule of thumb is about 1000 concurrent users for 1 VSTS Load Agent (most I’ve been able to run is around 300)<br />6/20/2009<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />18<br />
  • 19. References<br />Patterns and Practices: Performance Testing Guidelines for Web Applications<br />Web and Load Testing with Visual Studio Team System<br />Visual Studio 2008 Testing (Load Test)<br />Advanced Load Testing Features of Visual Studio Team System<br />MSDN: Working with Load Tests<br />Lessons Learned (Part 1)<br />Lessons Learned (Part 2)<br />More Lessons Learned<br />6/20/2009<br />19<br />SharePoint Saturday Charlotte / Performance Testing with SharePoint<br />

×