SharePoint SpeedMetal - Admin 101 SPSPhilly

SharePoint SpeedMetal – Admin 101
SharePoint Saturday Philly

Chris McNulty

SharePoint Strategic Product Manager

February 2012

©2011 Quest Software, Inc. All rights reserved..

Quest Market Presence
Americas
60 Offices, 3 HQs EMEA
APJa

Sales/Mrkg
3600+ Employees R&D
Support

178 Countries
100,000+ Customers All Verticals
Global 200
SMB

Multiple Business Lines Database, Monitoring, Data
Protection, User
Workspace/Virtualization,
Windows (SharePoint, AD,
Messaging), Identity Mgmt
2
2

©2011 Quest Software, Inc. All rights reserved. Confidential.

3
3

©2011 Quest Software, Inc. All rights reserved. Confidential.

Chris McNulty
• SharePoint Strategic Product
Manager at Quest Software
• 10+ years with SharePoint
• 20 years consulting (led KMA
SharePoint practice) and financial
services technology (Santander, John
Hancock/Manulife, GMO, State Street)
• MBA in Inv Mgmt from Boston College
• Write and speak often on Microsoft IW
technologies (blogs & books)
• MCSE MCTS MSA MVTSP MCC
• Hiking, cooking, playing guitar, colonial
history, photography
• My family: Hayley, three kids (17, 8, 5)
and my dog Stan
• 411 on 516: Born in Nassau
County, grew up in Suffolk County

4


For tomorrow…

6


Agenda
• The dilemma
• Architecture, Design & Planning
• Installation and Upgrade
• Post Installation Best Practices
• Service/Feature Placement
• Support
• Monitoring and Optimization
• Backup
• PowerShell
• Development Functions
• Optimization
• Patching
• SQL Maintenance
• Best Practices

@cmcnulty2000 7


Presentation Governance
• Out Of Scope
• Deep Dives (e.g. PowerShell, BI, Upgrade, SQL DBA)
• Development
• Customization
• Design & Architecture
• Power User (e.g. Library Customization, Designer Workflows, etc.)
• Rules
• Move fast, PowerPoint is shared – http://[TBD]
• Questions – time permitting during session
• Any time after session – email etc. - @cmcnulty2000

@cmcnulty2000 8


Congratulations!
o You‘re the new SharePoint Administrator!!!
o But…
o You‘re still responsible for:
• Exchange
• Active Directory
• SQL
• Desktop
• Help Desk
• Network/Firewall
• Cooking & Cleaning
• Etc.

@cmcnulty2000 9


The Dilemma
o SharePoint administration is often an ‗add-on‘ for other IT
professionals (SQL DBAs, AD Admins, Exchange Engineers)
o Time and focus are scarce resources!
o Common pain points include
• Upgrades are complex and hard to monitor
• Dispersed workforce, little control of browsers and Office
versions
• Hard to understand and troubleshoot ―behind the scenes‖
performance and capacity planning
• Best practices not always understood or compared to system
health
• ―All or nothing‖ administration means IT must be engaged for all
admin responsibilities, even search

@cmcnulty2000 10


Microsoft SharePoint Server 2010 … the bright frontier

Eastern Long Island, July 4, 2010

Server Farm – Web Front End
• Typical Roles:
• http services
• Search query
• Scaling
• Add servers to load balanced
cluster
• Performance Optimization
• RAM
• Easily virtualized

13 13


Server Farm - Application Server
• Typical Roles:
• Search index/crawl
• Excel calculation
• User profiles
• Managed Metadata
• Scaling
• Add search servers and
partitions
• Move shared services to
dedicated servers
• CPU

14 14


Server Farm - Database
• Typical Roles:
• Data storage
• SQL Reporting
• Scaling
• Add storage capacity
• Disk I/O

15 15


Sizing - Single Server
• Typical Roles:
• Small teams
• Small pools of documents
• Considerations
• Performance & fault tolerance
less of a concern
• SQL & Web on same system
• Search not a core function

16


Sizing - Medium Farm
• Typical Roles:
• 100-10,000 users
• 10,000 – 1MM documents
• Scenarios
• Enterprise portal
• Large scale collaboration
• Broader applications platform
• Larger external search pool
• Mix and match internal external
front end servers on common
content databases

17


Sizing - Large Farm
• Typical Roles:
• Large distributed
enterprise users
(10000+)
• Large pools of
documents
(>1MM)

18


Sizing – No Servers – Office 365
Office 365
Enterprise Plans
E1 E2 E3 E4
• Constraints/Unavailable
SharePoint Online √ √ √ √ • Custom, non sandbox solutions
• Power Pivot
Office Web Apps √ √ √
• SQL Server Reporting Service
Local Copy of √ √ Integration
Office • Business Connectivity Services
Professional 2010
Plus (OK for web services- based
remote data in O365 BCS.)
Forms Services, √ √
Vision Services, • FAST Search Server Integration
Access Services
• Web Analytics
• Site collections greater than
Monthly cost per $10 $16 $24 $27
user 100GB

19


Top Level Logical Components
• Farm level
• Web applications Web Applications
• Independent top level URLs
• Run inside IIS pools
http://intranet
Site Collections
• Consume shared services and
admin from the farm or other Site Hierarchies
Sites
farms
• Site collections http://centadmin Single Sites (MySite)
Lists Libraries Pages Web Parts

• Security, branding, database
frontier
• Contain single sites or site
hierarchies
• Sites
• Group related SharePoint
elements
(lists, libraries, pages, web
parts)

20 20


Logical Components
• High capacity!
• Maximums
• 250,000 sites per site
collection
• 5,000 site collections per
content DB
• 200GB max content DB
(single site collection)
• >200GB post SP1
• 300 Content DBs per web
application
• 30MM documents/library
• 2GB document size
• 2011 News
• 14TB Demo

22


Disk Sizing
Content Search

Initial Content Size XXX GB External Crawl Size YYY GB

Initial User Pool U

User Collab Size .25GB

n YR Growth Rate – G%
Archive Rate
End Content Size XXX (1+G)n = ECS End Search Size YYY (1+G)n = ESS

End User Collab Size .25 * U * (1+G)n = EUCS

Content DBs ECS + EUCS

Search DBs .05 * (ECS + EUCS + ESS)

Search Index Files .05 * (ECS + EUCS + ESS)

• Inputs: Size of SharePoint content and non-SharePoint content included in search
• For DBs, don‘t forget transaction logs, disk dumps (if used for backup) which can
add 1-3X.
• In SAN or virtual environments, not all disk need be provisioned early

@cmcnulty2000 23


Internet Topology – Edge Firewall
• Traditional
• Inexpensive
• Simple Edge
Firewall WFE App SQL AD

• Only one firewall Internet

• External traffic comes
inside internal network Internal Network

24


Internet Topology – Perimeter
• More complex
• Duplicative
networks, backup, AD
Edge Router/
WFE App SQL AD
Firewall Firewall

• External traffic is reserved Internet

• Larger server foot print
(exposure) in perimeter Perimeter Network Internal Net

• Internal users need
domain trusts
• Internal users access site
across firewall

25


Internet Topology – Split Back to Back
• Most complex
• Intricate firewall rules
• App, AD and search roles
Edge Router/
Firewall WFE Firewall App SQL AD

optionally in perimeter Internet

• Optional internal WFE or
internal users always Perimeter Network Internal Network

cross a firewall
• Crawl topologies
important to avoid
overtaxing the firewall

26


Common Integration Touchpoints
Internal
Active Directory
Exchange / File Shares
Index and integrate BCS data
External
• LDAP
• Mail Relay
• Indexed search content
Other Systems
• FAST (Search)
• Project Server / TFS
• BizTalk
• LoB/Dynamics
• Oracle (BCS)
• Notes (Search)
• Wikis and other indexed web sites

27


Internet Topology – Enhanced Techniques
• Multi-farm
• SSA farm
• Content publishing

@cmcnulty2000 28


Platform Basics
• SharePoint 2010 is a 64 bit only platform. Direct
upgrades from 32 bit to 64 bit requires prep work.
• Windows Server 2008 or Windows Server 2008 R2
X64
• SQL Server 2005 x64 SP3 CU3
Or
• SQL Server 2008 x64 SP1 CU2
Or
• SQL Server 2008 R2

@cmcnulty2000 29


Shared Service Applications
• 2007 Shared Services
Provider has been broken up;
each of its elements is now a
User Profiles

Metadata
Shared Service Application
Search

• Mix and match them singly Excel Calc

or in groups, to match farm‘s Visio

needs.
• Crawl/index no longer a
single server role
• In 2010, administration can
be delegated
http://globalweb http://itportal
• Key targets: Enterprise
search, metadata, user profiles

30


Client/Browser Technology
• Internet Explorer 7/8/9, Firefox and Safari are all supported.
• Some support for Chrome
• IE6 is not supported
• Most other browsers are still supported for Internet
configurations
• Office 2010 includes optimizations for the new platforms
• Offline Access
• 2007: used Outlook 2007 and Groove
• SharePoint Workspace 2010 integrates offline documents and lists

@cmcnulty2000 31


Office Web Applications
• SharePoint 2010 provides a
server version of Office
applications – Office Web
Access, or ―OWA‖.
• In part, this enables
simultaneous multiuser editing
of Office documents:
• Excel in OWA, not client
• Word/PowerPoint on client
only if file opened from a
shared document library
• OneNote client or OWA

32


Installation - Prerequisites
• Servers:
• Windows 2008 R2 X64 Enterprise Edition
• SQL Server 2008 R2 x64
• Service Accounts
• spfarm (Farm acct; local admin on the SharePoint servers and either sa or dbcreate, dbowner and
security admin on the SQL server.)
• svcsql (SQL Server service acct)
• sppool (IIS pool acct)
• spcrawl (Search accts)
• spadmin Interactive admin (install account; local, site collection and farm admin privileges)
• Install as SPAdmin
• Install Software Prerequisites - Checks for following elements:
• Application Server Role, Web Server (IIS) Role, Microsoft SQL Server 2008 Native Client, Hotfix for
Microsoft Windows (KB976462), Windows Identity Foundation (KB974405), Microsoft Sync
Framework Runtime v1.0 (x64), Microsoft Chart Controls for Microsoft .NET Framework 3.5, Microsoft
Filter Pack 2.0, Microsoft SQL Server 2008 Analysis Services ADOMD.NET, Microsoft Server Speech
Platform Runtime (x64), Microsoft Server Speech Recognition Language - TELE(en-US), SQL 2008 R2
Reporting Services SharePoint 2010 Add-in

@cmcnulty2000 34


Installation – Grey Wizard
• Initial
• Product Key
• Type of installation - Always SERVER FARM
• Installation Type - Complete [Not Single
Server]
• Accept default file locations – index files will
stay on C:Program FilesMicrosoft Office
Servers14.0Data
• At end NO Wizard
• Run OWA Setup
• Then, WIZARD! The wizard starts, and
yes, it‘s OK for IIS to reset during the wizard…
• Create a new farm
• Set farm account
• Pick configuration
database, Passphrase, CentralAdmin Port
(Conventions)
• Final confirm and let the wizard run

35


Installation – White Wizard?
• Pros
• Easy – shaken and stirred
• All SSAs Configured
• Saves time and PowerShell hand
tooling of SSAs
• Cons
• My Sites setup in same app and DB as
primary
• Database Names are default, GUID
happy
• What it does
• Sets up service acct for SSAs and other
services (sppool)
• Sets up a port 80 web app with a My
Sites Host sub-site collection in
WSS_Content database

36


Upgrade Preparation
Additional Prepwork
• Content pruning

• Database alignment
• stsadm-o mergecontentdbs

DB Attach
• Preinstall Required Features
• Stsadm –o addcontentdb –
databasename DBNAME –url
URL –assignnewdatabaseid
• PowerShell Mount-
ContentDatabase
• Test, test, test!

37


Pre-Upgrade Check
• SharePoint 2007 SP2 minimum, October
2009 CU best
• STSADM.exe –o preupgradecheck

• Documentation
• All servers and components in the farm, and
whether the servers meet 64-bit hardware/OS
requirements
• Alternate access mapping URLs
• A list of all site definitions, site
templates, features, and language packs that are
installed in the farm.
• Unsupported farm customizations (such as
database schema modifications).
• Database or site orphans
• Missing or invalid configuration settings in the
farm (missing Web.config file, invalid host
names, invalid service accts).
• Whether the databases meet the requirements
— for example, databases are set to
read/write, and any databases stored in Windows
38
Internal Database and larger than 4 GB.

IT Pro Investments – Visual Upgrade

39


DEMO
• Upgrade

40


Monitoring and Operations
Monitoring

Proactive Issue Resolution
• Developer Dashboard
• Empower developers and users

• Integrated Health
Analyzer
• Runs when necessary
• Alerts anomalies
• Fixes when it can

• Web Analytics
• User usage
• Resource usage

42


Logging, Monitoring, and Alerts

• Unified Logging
ULS Logs

• Out-of-the-box reports
• Richer Web Analytics Windows
Events

• Open Schema
Logging
• SCOM Integration
Page
requests
DB

• PLUS
Feature
Logging

• Health Analyzer
Health
data

43


Monitoring – General
• Monitoring
• SCOM
• Central Admin
• Health Analyzer

• Site Collection Web Analytics
• stsadm –o setproperty –pn developer-dashboard –pv OnDemand
• (Get-SPFarm).PerformanceMonitor.DeveloperDashboardLevel = "OnDemand"

• Troubleshooting
• Correlation ID – One GUID to rule them all!
• ULS Logs, Event Logs, Performance Monitor
• OR
• WSS_Logging DB

@cmcnulty2000 44


Developer Dashboard
Improve customized solutions with the Developer Dashboard

45


Monitoring – WSS_Logging
• Query Database Views Directly
• Requires Timer Jobs Enabled
• Diagnostic Data Provider: Trace Log
• Diagnostic Data Provider: Event Log

• ULS Configuration Matters
• Database will GROW!
• Aggregates from ALL Servers
• Sample:
• SELECT * FROM
[WSS_Logging].[dbo].[ULSTraceLog]
WHERE CorrelationID = '04377DAE-
C2FD-4DBE-A57E-101B3005059E'

46


Backup/Recovery
• Third Party Tools
• Recycle Bin
• Granular / Site Collection Backup (UI)
• *.bak file
• Restore-SPSite
• Unattached Recovery
• Browse unattached content database
• Account needs DB permissions
• Database need not be on the same server!
• No more granular than list or library!
• Browse Content
• Export Site or List

• Export as a CMP file
• PowerShell restore
• PS: Import-SPWeb http://msshome2010 –Path
C:ListRecovery.cmp

• SQL Backup
• SharePoint Backup (UI or script)

47


STSADM Backup
@echo off
echo
==================================================
echo Backup the farm
echo
==================================================
@SET stsadm="C:Program FilesCommon FilesMicrosoft SharedWeb Server
Extensions12BINstsadm"
rmdir /S /Q "spsql08spbackupfarmold"
ren "spsql08spbackupfarm" "farmold"
md "spsql08spbackupfarm"
%stsadm% -o backup -directory "spsql08spbackupfarm" -backupmethod full
echo complete

48


PowerShell Backup
# NOT NEEDED write-output
write-host
==================================================
write-host Backup the farm
write-host
==================================================
Add-PSSnapIn Microsoft.SharePoint.Powershell
Remove-Item -Path "C:PSBackupfarmold― -recurse
Rename-Item -Path "C:PSBackupfarm" -NewName "farmold"
New-Item -type directory -path C:PSBackupfarm
Backup-SPFarm -directory "C:PSBackupfarm" -backupmethod full –
verbose –percentage 5
Write-host Backup complete

49


PowerShell
• SharePoint Shell vs. Base Shell
• Add-PSSnapin Microsoft.Sharepoint.Powershell
• Command -?
• Get-Help Command
• Get-Help Command –examples
• Pipe
• Get-Command –Noun SP*
• Get-Command – Noun SP* | Select Name
• Get-Command – Noun SP* | Select Name | Out-File Commands.txt
• Get-SPSite –limit all | Get-SPWeb –limit all | Select URL,
webtemplate | Out-GridView
• WindowsPowerShell Integrated Scripting Environment to allow Out-GridView

@cmcnulty2000 50


Some Useful PowerShell Snippets
• Visual Update a range of sites:
$webapp = Get-SPWebApplication http://sitename
foreach ($s in $webapp.sites)
{$s.VisualUpgradeWebs() }

• Site Backup
• Add MMS Term
$str = “SAMPLE”
$site = new-object Microsoft.SharePoint.SPSite("http://MYSITE")
$session = new-object
Microsoft.SharePoint.Taxonomy.TaxonomySession($site)
$termstore = $session.TermStores[“MYTERMSTORE"]

[…create group…]
[…create term set…]

$term = $termset.CreateTerm($str, 1033)

@cmcnulty2000 51


Some Useful PowerShell Snippets II
• Create and configure a library

#Load the Sharepoint .net Assembly
[System.Reflection.Assembly]::LoadWithPartialName("Microsoft.SharePoin
t")

#set the url of the site collection to a variable
$siteurl = "http://msshome2010/"
$subsitename = "Marketing"
$newlibraryname = "NewLib"
$newlibrarydesc = "NewLib Description"

#create the new object passing the site collection URL, attach subsite
$mysite=new-object Microsoft.SharePoint.SPSite($siteurl)
$subsite = $mysite.openweb($subsitename)

#make the new library - 101 is the generic for DocumentLibrary
template
$subsite.lists.add($newlibraryname ,$newlibrarydesc, 101)

#open the new library and break inheritance
$mylib = $subsite.lists[$newlibraryname]
$mylib.BreakRoleInheritance($false)

@cmcnulty2000 52


Development Support – Three Regions
Development Staging/Test Production

• often internal to developers • no Visual Studio, no MS • optimized hardware
• problem reproduction that Office configurations
require advanced inspection • match/mirror production as • highly secure
tools (e.g. Visual Studio) are closely as possible; match • no use of user rotating
done here hardware/system password accounts as
• permissions can be looser, performance as closely as service accounts
may have multiple practical • changes here can only be
environments for multiple • security permissions match delivered and deployed
developers production from source control and
• sensitive data from • any sensitive data copied according to production
production cannot be here stays under release methods
copied here without production-grade controls
masking or customer signoff • test accounts should be
• changes here can be created in a separate OU if
deployed ad hoc possible
• changes here can only be
delivered and deployed
from source control and
according to production
release methods

@cmcnulty2000 54


demo
Monitoring
Developer Dashboard
Health Analyzer
PowerShell

55


Optimization
• Disk-based BLOB Caching
• Local store for audio/video, PDF other frequent read only files
• Edit in Web.config (C:Inetpubwwwrootwssvirtualdirectories...)
• <BlobCache location=""
path=".(gif|jpg|jpeg|jpe|jfif|bmp|dib|tif|tiff|ico|png|wdp|hdp|cs
s|js|asf|avi|flv|m4v|mov|mp3|mp4|mpeg|mpg|rm|rmvb|wma|wmv)$"
maxSize="10" enabled="false" />
• Location = Local Disk Location
• maxSize = GB
• Enabled = true

• Different from RBS/EBS!
• For publishing sites

@cmcnulty2000 57


Patching – Process through August 2011

• SharePoint Foundation

Patch

• SharePoint Server
Patch

• Run SharePoint Products and Technologies Wizard
• (Or psconfig)
• Sequential Application to Central Admin, Application Server(s), Web Front
Deploy End Servers

@cmcnulty2000 58


Patching – Process After August 2011

• Separate patch longer needed – single patch CU now available

Patch

• SharePoint Foundation
• OR SPF/Server

Patch • OR SPF/Server/Project Server

• Run SharePoint Products and Technologies Wizard
• (Or psconfig)
• Sequential Application to Central Admin, Application Server(s), Web Front
Deploy End Servers

@cmcnulty2000 59


Patching – Notes
• Test before installation!!!
• Cumulative Updates every two months
• Service Pack every 6-18 months
• Service Pack 1 REQUIRES at least the June 2011 CU
• December 2011 CU added iOS 5 Mobile Safari support for
performance Point
• December 2011 CU also fixed Administrator updates to user
profile pictures
• Check my blog for latest:
http://www.chrismcnulty.net/blog/Lists/Categories/Category.
aspx?CategoryId=5&Name=Version-Build Numbers

@cmcnulty2000 60


SQL Maintenance
• Backups
• Local Disk – easy but storage intensive
• Agents – remote, requires extra software

• RBS Maintenance
• BLOB Orphans

• Log Sizing
• Full logged (default) generates huge t-logs
• Simple doesn‘t but prevents point in time restore

• Maintenance Plans

@cmcnulty2000 61


Troubleshooting – Top Support Questions
• Users Receive ―Cannot Connect to Configuration Database‖
Web Page
• SharePoint farm account is locked out
• No one can upload anything but site is up
• Database disk volume is full – check transaction logs, backups
• In virtualized environment, host file systems may be full
• I can‘t find a document I think I should see; Someone can‘t
see a file I just uploaded
• Security and permission variations
• Document ―movement‖ (a/k/a ECM) try search by name or Document ID.
Check ECM logs/audits
• Confirm permissions, and make sure document is checked in (Required
properties may be missing)

@cmcnulty2000 64


Troubleshooting – More Support Questions
• Repeated requests to re-enter Windows credentials
• Add to Local intranet zone, add site, custom level, automatic login with
current user name and password (it‘s the last thing in the item list)
• OR Trusted sites
• My workflow didn‘t start
• Recycle timer service
• ―FixSharePoint.exe‖ = IISReset & Timer Service Recycle
• I‘m not seeing the right search results
• Confirm that crawls are running and complete by checking crawl logs; restart
a full crawl if crawls finish OK
• I need a file back that I deleted
• Recycle Bin Recovery
• Use Backup & Restore

@cmcnulty2000 65


Seven Deadly Sins for the SharePoint Professional

Seven Deadly Sins
• No SQL maintenance plans
• Default names for every database
(WSS_CONTENT_12345abc…)
• No patching
• One environment for everything
• One acct for everything
• Single server install with SQL Express
• Runaway content database size

@cmcnulty2000 67


Seven Virtues for the SharePoint Professional

Seven SharePoint Virtues
• Security Applied via AD Groups and SharePoint Groups
• Review System Health
• Test Restore and Recovery
• Monthly Web Analytics Review –
Usage, Storage, Search
• PowerShell instead of STSADM
• Governance
• Use ECM, MMS, Clients, Archiving and Training to Keep
Content in SharePoint, reduce accidental duplication
and keep searching and browsing fresh

@cmcnulty2000 69


Congratulations!
• You‘re the new SharePoint
Administrator!!!
• And now
• You understand:
• Design and Architecture
• Installation and Upgrade
• Support and Maintenance and
Optimization
• PowerShell
• Customizations
• Troubleshooting
• Best Practices
• People from New York?

70


•Questions
•Contact Me
•SharePint
71


Thank you…
• Contact
• Email chris.mcnulty@quest.com
• Blog http://www.chrismcnulty.net/blog
• Also http://www.sharepointforall.com
• Twitter: @cmcnulty2000
• LinkedIn:http://www.linkedin.com/in/cmcnulty
• Upcoming:
• Feb 2012 – O365 Sat Redmond, SPTechCon San Francisco
• Mar 2012 – SharePoint Conference Heartland (Columbus OH),SharePoint
Conference AUS, SharePoint Connections (Las Vegas)
• April 2012 – SharePoint Saturday Twin Cities; The Experts Conference San
Diego
• July 2012 – SharePoint Saturday NYC

73


Questions?
Get more information at
www.Quest.com/ControlYourChaos

74


SharePoint SpeedMetal - Admin 101 SPSPhilly

More Related Content

What's hot

Similar to SharePoint SpeedMetal - Admin 101 SPSPhilly

More from Chris McNulty

Recently uploaded

SharePoint SpeedMetal - Admin 101 SPSPhilly

Editor's Notes