SharePoint Performance, Stress or Load Testing

SharePoint Performance, Stress or Load Testing

Whenever I’ve helped my customers in performance testing and analysis of SharePoint, I get one common question: Can you tell us more about "SharePoint Load Testing" and links where I can learn more? Doing a quick web search on "SharePoint Load Testing" or "SharePoint Performance Testing" - you get all kinds of results such as data population tools, performance tuning techniques, handling large lists etc. However, it’s not very easy to get results about, How to go about load testing SharePoint, what are the counters that I should measure, where can I find real life bench mark results of SharePoint? That’s exactly, what I am trying to in this post. I’m trying to cover all the resources that I know about load testing. I wouldn’t be covering much about Performance Tuning and Analysis.

One important thing than many people don’t know is this - There’s nothing much specific to SharePoint when it comes to performance testing. SharePoint provides a few objects (e.g. for Publishing Cache, Search Indexer). Otherwise, same principles that apply to ASP.net also apply to SharePoint. Basically, we have to analyze different objects and counters (Memory, CPU, Disk, Network, and CLR) in relation with required parameters such as throughput, response time, user load etc. to find out various issues. Below is the list of resources that would help you in doing that:

Official Documentation

• Plan for performance and capacity (Office SharePoint Server) - It is landing page for all the documentation available for SharePoint related to performance and capacity. There are many resources in this page that I’ve referred in other section also.

References of Real life performance testing to get the bench mark results

There are many times when you do performance testing in your environment, but don’t know if your results are good or not. The links in this section would help you in finding that.

• Estimate performance and capacity requirements (Office SharePoint Server) Provides references of actual performance testing done by Microsoft in difference scenarios and the benchmark results from those tests. Provides specific results and guidance for the following scenarios:

• WSS collaboration

• Portal collaboration

• Search

• Excel Services

• Internet/WCM

• Hyper-V environment

• 2 Million User Scale Test by Microsoft Enterprise Engineering Center: Results from scalability test that Microsoft conducted to address the concerns of a customer who wanted to deploy MOSS for 2 million internal users. The report provides a description of the goals achieved, test architecture, metrics and success criteria, testing methodology and terminology. A very useful and comprehensive resource that provides understanding of almost every aspect of performance testing in SharePoint context.

• Best Practices and Performance Paper from HP - HP Solutions Alliance Engineering (SAE) labs runs tests to ascertain performance on newly released HP server and storage technologies and also on new versions of Microsoft software that form part of the solution. This page provides technical papers having actual test results. Below is the list of different performance related papers:

• Microsoft Office SharePoint Server 2007 on HP ProLiant Servers - Performance Summary – provides guidance, example configurations and interesting facts include the load test results for various workloads on 12 different servers having various combination of Processors - single core and dual core, AMD and Intel, x86 and x64. You can read a quick summary about this paper in one of my previous post

• Microsoft Office SharePoint Server 2007 with Windows 2008 and SQL Server 2008 on HP servers and storage technologies - describes the performance differences observed when comparing MOSS running on Windows Server 2008 and SQL Server 2008 versus current deployments running Windows Server 2003 and SQL Server 2005.

• Results from low cost single server MOSS setups on Intel and AMD based servers

• Results from Virtualized Hyper-V based setups on Intel (different servers) and AMD based servers

• Intel Performance Testing of Windows SharePoint Services

Testing Tools

This section provides links to the tools that helps in the load testing. There are tools

• VSTS 2008 Test Edition – Combined Knowledge has published a detailed “How To” guide for configuring a stress testing project for MOSS 2007 using VSTS 2008. Liam Cleary [SharePoint MVP] has published some good posts on how to create and run a web test and load test on SharePoint with VSTS 2008

• Free Tools from Microsoft – In case you don’t have VSTS, and looking for free tools, you can use Web Application Stress Tool orWeb Capacity Analysis Tool (WCAT)

• SharePoint 2007 Test Data Population Tool and the test data - populates data for testing SharePoint deployments. Description on How to use the tool: Tools for performance and capacity planning (Windows SharePoint Services)

• Fiddler – a very handy and light weight tool that can provide quick overview of you web site performance. It can also records scripts that you can use in VSTS. This MSDN article provides detailed information on how Fiddler can be used for performance tuning. 

• HP LoadRunner – you can also use this tool to test SharePoint.

At times, you need to focus on end-user response time. As it is difficult to simulate real life network bandwidth, it becomes difficult to test, how your application perform for end users. The following tools help you to find end-user experience

• Visual Round Trip Analyzer - Web page performance visualizer and analyzer tool. You can find Ed Glas’s blog post introducing this tool and detailed article on using the tool.

• webPageTest -   webPageTest is a free over-the-web tool for performance testing a page from either Dulles, VA, USA or Wellington New Zealand. Pagetest allows you to provide the URL of a webpage to be tested provides a waterfall of your page load performance as well as a comparison against an optimization checklist.

There are other tools available for sizing and capacity planning also such as HP ProLiant Sizer for Microsoft Office SharePoint Server 2007 and SharePoint Capacity Planning Tool from Microsoft

Useful Blogs, Third Party Articles

• Joel Oleson: Good List of Performance Counters (MOSS 2007)

• Bill Baer: Stress Testing Microsoft Office SharePoint Server 2007/Windows SharePoint Services 3.0 

• Using tool Runtime Optimizer to measure SharePoint performance and setting page load goals

• Case study on load testing & Tuning to improve SharePoint performance using WebPerformance tools

ASP.Net performance testing and Analysis

The following links provide information on performance testing of ASP.net based web sites. Everything you wanted to know such as how to setup Performance Monitor, what counters to analyze, what should be threshold value of the counters, what to do if some counters are overshooting the threshold – you’ll get here.

• Overview of ASP.NET Performance Monitoring

• patterns & practices Performance Testing Guidance for Web Applications

• ASP.NET Performance Monitoring, and When to Alert Administrators

• Checklist: ASP.NET Performance

• Chapter 15 — Measuring .NET Application Performance

• Chapter 16 — Testing .NET Application Performance

• Chapter 17 — Tuning .NET Application Performance

SharePoint Performance Improvements

Though this post is focuses on Performance Testing, I’m also providing a few links on Performance improvements, tuning and optimization

• Technet Performance Page on SharePoint, which is referred above also has many resources on performance tuning and improvements

• How to Optimize a SharePoint Server 2007 Web Content Management Site for Performance

• Bill’s 5-min. SharePoint Performance Recommendations

• 10 Tips for Writing High-Performance Web Applicationshttp://msdn.microsoft.com/msdnmag/issues/05/01/ASPNETPerformance/

• Chapter 6 — Improving ASP.NET Performance http://msdn2.microsoft.com/en-us/library/ms998549.aspx

Hopefully, you’ll find these useful