• Like

Deploying a 100,000 user SharePoint farm on FlexPod

  • 815 views
Uploaded on

 

More in: Technology , Education
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
815
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
14
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Control the server, storage, and network infrastructure through a single, cohesive management system. Cisco UCS, via UCS Manager and Cisco PowerTool, delivers tight integration with Microsoft System Center 2010 suite of tools.T: UCS further enhances SharePoint 2010 by managing costs.
  • The FlexPod is the best of breed infrastructure foundation supporting both virtualized and nonvirtualized workloads using Cisco UCS, Nexus (servers and network), and NetApp FAS (storage). This is the best of breed Unified Compute, Unified Network, and Unified StorageThe FlexPod is built around three key capabilities:Lower Risk with a validated, simplified data center solution and a cooperative support model for a safe and proven journey to virtualization and toward the CloudEnable business agility with Flexible IT that scales out and up to fit a variety of use cases and environmentsReduce TCO with higher data center efficiency, while decreasing the number of operational processes, reduce energy consumption, and maximize resources VMware vCenterAutomated workflowsScalable, extensible platformCisco® UCS PlatformEmbedded unified management Integrated with VMware vCenterNetApp OnCommand Manager suite: Automate, analyze, and controlIntegration with VMware vCenter ServerEnables server administrators to perform storage tasks
  • This solution provides an end-to-end architecture with technologies from Cisco, VMware, Microsoft, and NetApp.Each vendor brings different technologies that to jointly drive data center efficiency.VMware vCenterAutomated workflowsScalable, extensible platformCisco UCS PlatformEmbedded unified management Integrated with VMware vCenterNetApp OnCommandManager suite: Automate, analyze, and controlIntegration with VMware vCenter ServerEnables server administrators to perform storage tasks T:
  • FlexPod Deployment :No single point of failure 1 x Cisco UCS 5108 Chassis2 x Cisco UCS 2248 Fabric Extenders2 x Cisco UCS 6248 up Fabric interconnects2 x Nexus 5548 up FAS 3270 HA Pair3 x DS4243disk Shelf'sBetween the FI 6248 and Nexus 5548up we have configured with Virtual port channeling A vPC allows links that are physically connected to two different Cisco Nexus 5000 Series switches to appear as a single port channel to a third switch.VM-FEX technology is configured to improve I/O and reduce CPU cycles. Virtual machine I/O is sent directly to the upstream physical network switch, in this case, the Cisco UCS 6100/6200 Series Fabric Interconnect, which takes full responsibility for virtual machine switching and policy enforcement.
  • Microsoft SharePoint 2010 Farm Architecture on FlexPodThe enterprise deployment design was determined using results from the evaluation deployment based on concurrent users, request per second, and page response times for different features. The final design incorporated additional Cisco UCS, VMware, and NetApp end-to-end solution components. The environment was comprised of eight Web front end servers, two application servers, and a mirrored SQL database with a witness server (Datacenter provisioned with these Virtual servers has been configured with HA/DRS ).The above slide showcases the deployment and placement of VM on the ESX hosts and also showcases that there is no single point of failure. VMware Datacenter provisioned with Virtual servers -HA / DRS configured SharePoint environment:WFE - configured with NLB Application server –Multiple Application ServersSQL servers - Mirrored witness server
  • StorageConfiguration:In this solution, the SharePoint 2010 farm has a pair of FAS 3270 storage arrays equipped with three disk shelves, each disk shelf consists of 24 drives for a total of 72 SAS 15k RPM drives with a storage space total of 43 TB.A single large 64 bit aggregate is created for the SharePoint 2010. Single large aggregate may maximize performance for the SharePoint data. The SharePoint 2010 volumes are allocated based on load distIn this design, the user database log has been separated onto its own volume. This provides more granular control of which disks it resides on and how many LUNs it is composed of. Spreading the log across multiple LUNs can help improve its ability to handle higher I/O requirements. This also allows the log file to be managed Independently of the data file. distribution across the 3270 controllers. NFS Volume for this data center, a shared Virtual machine file system (VMFS) Datastore is provisioned, which stores the VM images is required to support VMware DRS/VMotion feature for this solution.
  • VM-FEX technology eliminates the virtual switch within the hypervisor by providing individual virtualmachine virtual ports on the physical network switch. Virtual machine I/O is sent directly to the upstreamphysical network switch, in this case, the Cisco UCS 6100/6200 Series Fabric Interconnect, which takes fullresponsibility for virtual machine switching and policy enforcement.All the SharePoint server were deployed with VM-FEX and QoS policy..In the test our observation with vMotion took 27 sec to move 200 GB VM.
  • Requests Per Secondshows the highest number of received requests per second for several user loads (60 RPH). The graph shows the smooth performance of the Virtual servers on Cisco UCS servers B200 M2 as the request per second scale ascending linearly with the user load without causing any or much stress on the server. The following graph also shows the possibility to further scale up the user load with an ensured stable server performance. However the decline in request per second is seen which is due to ASP.Net and IIS limitations due to the default configuration setting at the Web Front End Servers.Pages per second : pages per second metrics for several user loads (60 RPH) of the SharePoint farm. SharePoint 2010 farm served on an average 332 pages per second.Average Page Time :SharePoint 2010 average page time well below 1 sec. The SharePoint achieved sub-second response time in the performance test for a concurrent user load 10000 users, the response time varies with increased load on the SharePoint 2010.Average Response TimeThe designed SharePoint farm can support more than 100,000 with the 10 percent user concurrency and achieve sub-second response time. WFE -The following graph shows the CPU utilization of the 8 SharePoint Web Front End servers. Under heavy workloads of 10000 users and with Network Load Balancer to balance the load at the web front end tier, Virtual servers are hosted on Cisco UCS B200 M2 servers. CPU utilizationremained at around 60% . The graph shows the linear growth in the CPU utilization for the increase in the user load and their workloads. The graph shows virtual servers on Cisco UCS B200 M2 server's capacity to accommodate much more workloads with ease without causing any stress.
  • Application server The following graphs show the Application Server CPU Utilization. The Application server hosted the Central Administration and search services. The spikes shown on the graph are due to the search crawl at the time of the performance test. At Application Tier both the virtual servers spiked to 100 percent CPU utilizationSearch crawls causes intermittent spikes on CPUDB -The SQL 2008 R2 database server CPU utilization. The high availability scenario requires one server to be active and another mirrored. The CPU spikes in the graph shows the search crawl services while updating the search databases. On an average, the overall CPU utilization at the database tier with virtual servers remained at around 60 percent. This is when the server is hosted on the Cisco UCS B250 M2. FlexPod accommodates more CPU utilization without causing stress on its performance.
  • Ability to easily recover failed server to standby blade, including SQL Cluster nodeDynamically add capacity based on service consumption spikes with on-demand provisioningPre-Positioned offline role and service images associated with service profilesProfiles assigned to standby blades and OS image bootedDeactivate underutilized redundant roles and services.
  • Requests Per Secondshows the highest number of received requests per second for several user loads (60 RPH). The graph shows the smooth performance of the Virtual servers on Cisco UCS servers B200 M2 as the request per second scale ascending linearly with the user load without causing any or much stress on the server. The following graph also shows the possibility to further scale up the user load with an ensured stable server performance. However the decline in request per second is seen which is due to ASP.Net and IIS limitations due to the default configuration setting at the Web Front End Servers.Pages per second : pages per second metrics for several user loads (60 RPH) of the SharePoint farm. SharePoint 2010 farm served on an average 332 pages per second.Average Page Time :SharePoint 2010 average page time well below 1 sec. The SharePoint achieved sub-second response time in the performance test for a concurrent user load 10000 users, the response time varies with increased load on the SharePoint 2010.Average Response TimeThe designed SharePoint farm can support more than 100,000 with the 10 percent user concurrency and achieve sub-second response time.
  • More detailed information can be found in the SharePoint 2010 on FlexPod for VMware CVD

Transcript

  • 1. Deploying a 100,000 user SharePoint farm on FlexPodVadiraja BhattPerformance Architect, DC Solutions Engineering and Ecosystem© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1
  • 2. • SharePoint Basic Concept• SharePoint 2010 Characteristics• Deploying a 100,000 user SharePoint farm on FlexPod• Solution Overview• FlexPod for VMware Components• Solution Summary• References© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
  • 3. WFE Server Application server SQL - Database server Clustered or Mirrored© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3
  • 4. Application -Tier Web Front End -Tier Service Application CPU Load Memory LoadService Application CPU Load Memory LoadSharePoint Foundation SharePoint Foundation Service None None High HighService Central Administration Service Medium MediumTimer Service Very High Very HighLogging Service Very High Very High Timer Service Very High Very HighWorkflow Capabilities High High Logging Service None None User Profile Service Very High Very High Word Viewing Service High High Database Tier Service Application CPU Load I/O Load Storage SharePoint Foundation Service Very High High High Timer Service None None None Logging Service Very High High High User Profile Service High High Very High Word Viewing Service None None None Workflow Capabilities None None None © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4
  • 5. • Published March 2012 • 100,000 seats environment with 10% concurrency • Design considerations – compute/network/storage • Performance Study© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5
  • 6. Cisco Validated Designs Unified Platform • Making a move to SharePoint 2010 on Cisco UCS is easier • Cisco provides all the components needed for the Microsoft and less risky. SharePoint farm • Provides confidence via a tested and validated reference • Controls the server, storage, and network infrastructure architecture for Microsoft SharePoint 2010 through a single, cohesive management system© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6
  • 7. Benefits • Low-risk standardized shared infrastructure supporting a wide range of environments: scale out or scale out based on needs • Highest possible DC efficiency Features • Performance-matched stack • Step-by-step deployment guides • Solutions guide for multiple environments • Multiple classes of compute and storage supported in a single FlexPod • Centralized management: NetApp OnCommand and Cisco UCS™ Manager • Ideal foundation for virtualized applications…including MS SharePoint 2010© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7 7
  • 8. Cisco ® UCS Platform VMware vSphere NetApp FAS and Unified Fabric • Industry’s Leading Server Virtualization • High-Density Virtualization and • Storage Efficiency Guaranteed Technology Computing • RAID-DP and Deduplication • VMware vMotion and Storage vMotion • Consolidate Wiring • Thin Provisioning • VMware Distributed Resource Scheduler • 10 GE Unified and Virtualized Fabric • Space-Efficient Clones • Resource Pooling • Resource Pooling • Thin Replication • Resource Pooling Each vendor brings Powerful technologies that jointly drive data center efficiency and flexibility.© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8 8
  • 9. • 1 x Cisco UCS FlexPod Deployment 5108 Chassis NetAPP 3270 A NetAPP 3270 B • 2 x Cisco UCS • 2248 Fabric Extenders vPC vPC • 2 x Cisco UCS 6248 up Fabric interconnects Nexus 5548up Nexus 5548up • 2 x Nexus 5548 up vPC vPC • FAS 3270 HA Pair FI 6248 FI 6248 • 3 x DS4243 disk Shelfs IOM Links IOM Links Chassis 5108 FC Ethernet© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9
  • 10. Highly Available SharePoint ESX Deployment farm • VMware Datacenter provisioned with Virtual NetApp FAS 3270 servers -HA / DRS SharePoint 2010 SP1 configured Web Front End/App/DB Tier 10GE ESX 1 VM VM VM SharePoint environment: Vmware vCenter • WFE - configured with NLB B200 M2 – ESX 1 ESX 2 VM VM VM • Application server –Multiple 10GE B200 M2 – ESX 2 Application Servers ESX 3 VM VM VM • SQL servers - Mirrored HA B200 M2 – ESX 3 DRS ESX 4 VM VM witness server B200 M2 – ESX 4 NetApp FAS 3270 B200 M2 – ESX 4 ESX 4 VM VM ESX VMFS RDM CIFS NFS SAN DataStore LUN’s Share BOOT LUN’s LUN’s VM Windows 2008 R2 Web Front vol vol vol vol vol vSphere End VM Windows 2008 R2 Web Application Server Aggregate 64-bit Windows 2008 R2 SQL 2008 VM R2 Windows 2008 R2 SQL Mirror FAS-3270 A FAS-3270 B VM Witness Server FlexPod constitutes various technologies mainly, Cisco Unified Computing System, VMware vSphere 5.0 and NetApp Storage Technologies together to form a highly reliable, robust and a virtualized solution for SharePoint 2010.© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10
  • 11. Single Large 64 bit Aggregate configured with RiadDP. • NetApp FAS3270A Single large aggregate may maximize performance for the SharePoint data. • 3 x DS4243 disk shelf RDM-LUN RDM-LUN RDM-LUN RDM-LUN DB MDF DB TLog DB MDF DB TLog OS OS OS OS OS (2500 GB) (1000 GB) (2500 GB) (1000 GB) • (10 GB) (10 GB) (10 GB) (10 GB) (10 GB) 600GB 15k rpm VMFS LUN SAS disks (1500 GB) • Single large 64 Aggregate • Boot LUNs for the FlexVol FlexVol FlexVol FlexVol Mirrored 5 ESX hosts Database (4 TB) Database (4 TB) CIFS (400 GB) OS Boot (100 GB) FlexVol FlexVol NFS Vol 0 • (480 GB) NFS datastore hosts (2 TB) the ESX vmdk files . SAS Drives 15K RPM • FC/VMFS LUNs with RDMs attached to database VM’s to store MDF and Tlogs Files Aggregate (64 bit)© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11
  • 12. Cisco VM-FEX with vMotion(A.K.A Universal pass through switching /Direct path i/o) Enhance performance by VM-FEX In test vMotion took 27 sec to move a VM of 200 Gb between the ESX Hosts VNIC VM VM VM VETH Hypervisor Hypervisor UCS VIC UCS VIC UCS Server UCS Server Port Profiles VC Deploys VMs with port Defined in UCSM groups VM WEB Apps UCS 6200 Application vCenter UCSM exports Port Profiles to VC DB© 2012 Cisco and/or its affiliates. All rights reserved. Compliance Confidential Cisco 12
  • 13. • Collaboration & Workflow both 1. client & Web-based 2.• Enterprise Social Networking• Enterprise Content Management (ECM)• Web Content Management (WCM)• Discovery (Search)© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13
  • 14. 100K User Seat Deployment on Cisco UCSCPU utilization Average RPS achieved – 560 request/second, for multiple user load with anUsers Vs Request Per Secondaverage for 60 request/hour/user Maximum RPS was around 800 request/secondEach user targeted with 60 RPH• Avg Req/sec – 560 req/sec• Max Req/sec – 800 req/secWeb Front End• • 8 Linear growth of CPU utilization with increased concurrent users. x WFE deployed WFE Server %Processor Time 100• Each WFE configured with 4vCPU & up the user load with an Graph shows the possibility to further scale 16 Gb memory 50 ensured stable server performance.• Linear growth of CPU utilization with increased 0 • Smooth performance of the Virtual servers on Cisco UCS servers Users 400 1200 1600 2000 2400 3200 4000 4400 concurrent the request per second scale ascending linearly with the users 4600 5000 5400 6200 6600 7000 7400 B200 M2 as 7800 8600 9000 9400 9800• Max CPU without causing 60% for 10k the server user load utilization – much stress on users WFE1, Processor, % Processor Time, _Total WFE2, Processor, % Processor Time, _Total WFE3, Processor, % Processor Time, _Total © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14
  • 15. © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15
  • 16. • Unified Fabric simplifies SharePoint infrastructure while delivering scalability. • SharePoint servers, especially SQL Clusters, benefit from multiple Ethernet adapters for cluster communication, replication, and management. • Multiple HBA provide storage access path redundancy in conjunction with Microsoft MPIO. • Create server profiles to consistently manage server attributes for each SharePoint Server role in the farm Service Profiles and stateless blades allow consistent management for all server attributes for each SharePoint Server role. Ease of failover. Add Capacity. All SharePoint server roles can run in a virtual machine. Templates based Service profile for Dev/Staging /QA environmentMicrosoft hyper-v (R2 recommended) or VMware ESX supported (KB 897615)© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16
  • 17.  Each user was targeted with a utilization of 60 requests per hour.  Request Per Second -The number of received requests per second for several user loads (60 RPH) at the end of testing on average was ~560.  Pages Per second - SharePoint 2010 farm served on an average 332 pages per second.  Average Page Time - SharePoint 2010 average page time well below 1 sec.  Web Front End servers utilization was around ~60%.  Application server reached a bottleneck of 100% utilization.  At this ratio, the SQL database CPU was around 60% utilized.© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17
  • 18. Cisco UCS: http://www.cisco.com/en/US/netsol/ns944/index.html Cisco CVD FlexPod for VMware -100K user seat http://www.cisco.com/en/US/docs/unified_computing/ucs/UCS_CVDs/ucs_sharepoint2010_flexpod_vmware.ht ml Cisco CVD FlexPod for VMware -50K user Seat http://www.cisco.com/en/US/docs/solutions/Enterprise/Data_Center/Virtualization/flexpod_vmware.html Microsoft SharePoint Server 2010 on Cisco Unified Computing System Medium Farm Solution-Performance and Scalability Study http://www.cisco.com/en/US/solutions/collateral/ns340/ns517/ns224/ns944/cisco_ucs_scalability_performance. pdf Cisco Nexus http://www.cisco.com/en/US/products/ps9441/Products_Sub_Category_Home.html Cisco Nexus 5000 http://www.cisco.com/en/US/docs/switches/datacenter/nexus5000/sw/configuration/guide/cli/CLIConfigurationG uide.html© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18
  • 19. Thank you.