SlideShare a Scribd company logo
1 of 32
Building a scalable Search
architecture in SharePoint
2013
Thuan Nguyen, SharePoint MVP
thuan@outlook.com
@nnthuan
Vietnam SharePoint User Group
About Me
 SharePoint Practice Lead, Solution Architect – FPT Software
 Microsoft SharePoint MVP (2011, 2012, 2013, 2014)
 Used to love start-up with two SharePoint-based products.
 Now focus on building a SharePoint core standard and
framework for Singapore Government.
Vietnam SharePoint User Group
Agenda
 Common Misunderstandings
 Architecture & Topology
 Practical Guide
 Question & Answer
Vietnam SharePoint User Group
For those who are looking into having multiple Search servers
handling millions documents.
Common Misunderstandings
 For High Availability, create two Search Service
Applications.
 There is only one machine playing Search role in your farm
 Scale out Search architecture by adding more servers.
 Start Search service is to make search functionality work.
Vietnam SharePoint User Group
Architecture & Topology
Logical Architecture
Crawl
Content Processing
Analytics Processing
Index
Administration
Query Processing
Understand each component will help better design a scalable &
maintainable Search for your organization.
Vietnam SharePoint User Group
Crawl Component
 Responsible for crawling content from
different sources
 SharePoint sites
 Exchange
 Lotus Notes
 Documentum
 HTTP Website
 Deliver crawled items to content
processing component.
 Crawl database stores information
about crawl items and crawl history
Vietnam SharePoint User Group
dbo.MSSCrawlHistoryLocal
Content Processing
 Processes crawled items and passes these
items to the index component
 Performs linguistic processing at index
time (e.g. language detection and entity
extraction)
 Writes information about links and URLs
to the Link database
Vietnam SharePoint User Group
dbo.MSSQLogResultDocs
Analytics Processing
Vietnam SharePoint User Group
 Analyzes crawled items and how users interact
with search results.
 When an user does an action (e.g. view a page)
the event is collected in usage files on the WFE’s
and regularly pushed to event store where they
are stored until processed
 Results are then returned to the Content
Processing Component to be included in the
search index
dbo.SearchReportData
Index Component
Vietnam SharePoint User Group
 Receives the processed items from the content
processing component and writes them to the
search index.
 Handles incoming queries, retrieves information
from the search index, and sends back the result set
to the query processing component.
Index Architecture
Vietnam SharePoint User Group
 An index partition is a logical portion of
the entire search index.
 Each partition is served by one or more
index components (or “replicas”)
 In a partition there’s only one
primary (or “Active”) replica who’s the
only one that writes data in a
partition
 Other secondary (or “passive”) replicas are
there for fault tolerance and increased
query throughput
 Index can scale in both horizontal
(partitions) and vertical (replicas) ways
 Partitions can be added but NOT
removed
Secondary
Replica 1
Secondary
Replica 2
Secondary
Replica 1
Secondary
Replica 2
Secondary
Replica 3
Secondary
Replica 2
Secondary
Replica 1
Partition #1 Partition #2 Partition #3
Secondary
Replica 3
Secondary
Replica 3
Servers
Index Servers
1, 2 & 3
Index Servers
4, 5 & 6
Index Servers
7, 8 & 9
Index Servers
10, 11 & 12
Query Processing
 Analyses and processes search queries and results.
 The processed query is then submitted to the index
component, which returns a set of search results for the
query.
Vietnam SharePoint User Group
Search Administration
Vietnam SharePoint User Group
 Search Admin Component
 Runs number of system processes required
for search
 Is responsible for search provisioning and
topology changes
 Coordinates search components – Content
Processing, Query Processing, Analytics, and
Indexing.
 Search Admin DB
 Stores search configuration data:
 Topology
 Crawl rules
 Query rules
 Managed property mappings
 Content sources
 Crawl schedules
 Stores Analytics settings
dbo.MSSConfiguration
Practical Guide
Vietnam SharePoint User Group
Assessment Design Implementation Verification
Practical Guide- Assessment
 Don’t hastily touch your
SharePoint. Leave it alone!
 Think about your content
 What are your content sources
(SharePoint document library,
Exchange, File Server..)?
 How much of content you want
to search? (e.g. 100,000
documents)
 Assess the number of concurrent
users.
 Search database sizing
Vietnam SharePoint User Group
Practical Guide- Assessment
Vietnam SharePoint User Group
 Sizing factor:
 Total Database Size
 Total Index Size
 Query Component Index Size
 Disk Storage
 Link Database
 Search Admin Database
 Total Crawl Database Size
 Total Crawl Database Log Size
 Analytics Database Size
=> Total database size for Search
Microsoft already published the formula for these things above.
Practical Guide - Assessment
Vietnam SharePoint User Group
What is exactly High Availability for Search?
 Business language: Search doesn’t stop end
users searching something.
 Technical language: All search logical
components and Search databases must be
functional as always.
 Two or more Search service applications
 Two or more Search servers
Practical Guide- Design
 Don’t hastily touch your SharePoint. Leave it alone!
 Start with one machine hosting all components
Vietnam SharePoint User Group
Practical Guide - Design
Vietnam SharePoint User Group
 Don’t hastily touch your SharePoint. Leave it alone!
 Think about two machines for Search but different
set of components
Redundant set of (Query + Crawl). If one goes down, Query
component in another machine still keeps functioning.
Practical Guide - Design
Vietnam SharePoint User Group
 Don’t hastily touch your
SharePoint. Leave it alone!
 Do you need three machines for
Search?
 Speed up Query component?
 Reduce crawling time?
 Balance CPU utilization in
machine?
With more three machines, go to start an assessment of
components in terms of the usage of hardware resources
Practical Guide - Design
Component CPU Network Disk RAM
Crawl Component MEDIUM HIGH MEDIUM MEDIUM
Content processing (CPC) HIGH MEDIUM HIGH
Analytics processing (APC) MEDIUM HIGH MEDIUM MEDIUM
Index Component HIGH MEDIUM HIGH HIGH
Query processing (QPC) MEDIUM MEDIUM MEDIUM
Search Admin Component LOW LOW LOW
Vietnam SharePoint User Group
Microsoft Ignite – BK3176
If logical architecture requires scale-out, consider utilization
Practical Guide - Design
Volume of content Sample Search Architecture
< 1 mil items Single-server Search farm
1 mil – 5 mil Two-server Search farm
5 mil – 10 mil Small Search farm (3-4 servers)
10 mil – 40 mil Medium Search farm (5-6 servers)
> 40 mil Large Search farm
Vietnam SharePoint User Group
Sample Search Architecture
Vietnam SharePoint User Group
 Handle number of different content
sources (with 20 custom applications)
 Nearly 1 million items currently
 Full crawl takes 2 hours
 Serving for nearly 20,000 users with
500 concurrent users.
Sample Search Architecture
Vietnam SharePoint User Group
 Optimize search query to serve
hundreds of concurrent users.
 Handle million of documents (approx.
5 TB)
Sample Search Architecture
Vietnam SharePoint User Group
 Serve for 20 million
documents & items (approx.
10-15 TB).
Central Administration doesn’t help much.
PowerShell is your friend
1. Create Search Service Application
2. Clone existing topology
3. Modify Search component based on your designated
architecture
4. Assign Index component and location
5. Activate the new Search topology
Vietnam SharePoint User Group
Practical Guide- Implementation
Build Search farm with PowerShell http://bit.ly/search_multi_server_PS
$app1 = "APP-Server-01"
$app2 = "APP-Server-02"
$SearchAppPoolName = "SharePoint_SearchApp"
$SearchAppPoolAccountName = "TestDomainSPSearchPool"
$SearchServiceName = "SharePoint_Search_Service"
$SearchServiceProxyName = "SharePoint_Search_Proxy"
$DatabaseName = "SharePoint_Search_AdminDB"
#Create a Search Service Application Pool
$spAppPool = New-SPServiceApplicationPool -Name $SearchAppPoolName -Account
$SearchAppPoolAccountName -Verbose
#Start Search Service Instance on all Application Servers
Start-SPEnterpriseSearchServiceInstance $App1 -ErrorAction SilentlyContinue
Start-SPEnterpriseSearchServiceInstance $App2 -ErrorAction SilentlyContinue
Start-SPEnterpriseSearchQueryAndSiteSettingsServiceInstance $App1 -ErrorAction SilentlyContinue
Start-SPEnterpriseSearchQueryAndSiteSettingsServiceInstance $App2 -ErrorAction SilentlyContinue
#Create Search Service Application
$ServiceApplication = New-SPEnterpriseSearchServiceApplication -Partitioned -Name $SearchServiceName
-ApplicationPool $spAppPool.Name -DatabaseName $DatabaseName
#Create Search Service Proxy
New-SPEnterpriseSearchServiceApplicationProxy -Partitioned -Name $SearchServiceProxyName -
SearchApplication $ServiceApplication
Vietnam SharePoint User Group
Practical Guide- Implementation
Practical Guide- Implementation
#We need only one admin component
New-SPEnterpriseSearchAdminComponent –SearchTopology $clone -SearchServiceInstance $App1SSI
#We need two content processing components for HA
New-SPEnterpriseSearchContentProcessingComponent –SearchTopology $clone -SearchServiceInstance $App1SSI
#We need two analytics processing components for HA
New-SPEnterpriseSearchAnalyticsProcessingComponent –SearchTopology $clone -SearchServiceInstance $App1SSI
#We need two crawl components for HA
New-SPEnterpriseSearchCrawlComponent –SearchTopology $clone -SearchServiceInstance $App1SSI
New-SPEnterpriseSearchCrawlComponent –SearchTopology $clone -SearchServiceInstance $App2SSI
#We need two query processing components for HA
New-SPEnterpriseSearchQueryProcessingComponent –SearchTopology $clone -SearchServiceInstance $App1SSI
New-SPEnterpriseSearchQueryProcessingComponent –SearchTopology $clone -SearchServiceInstance $App2SSI
Vietnam SharePoint User Group
$clone = $ServiceApplication.ActiveTopology.Clone()
$App1SSI = Get-SPEnterpriseSearchServiceInstance -Identity $app1
$App2SSI = Get-SPEnterpriseSearchServiceInstance -Identity $app2
$IndexLocation = “APP2Index_Search"
New-SPEnterpriseSearchIndexComponent –SearchTopology $clone -SearchServiceInstance $App2SSI -
RootDirectory $IndexLocation -IndexPartition 0
$clone.Activate()
Practical Guide- Implementation
Vietnam SharePoint User Group
Practical Guide- Verification
Vietnam SharePoint User Group
Central Administration can help
 PowerShell
 Get-
SPEnterpriseSearchStatus
 Get-
SPEnterpriseSearchTopolog
y
Search PowerShell http://bit.ly/PowerShell_SP2013_Search
Helpful References
 SharePoint 2013: SharePoint and Enterprise Search Survival
Guide http://bit.ly/search_survival_guide
 Plan enterprise search architecture in SharePoint Server 2013
http://bit.ly/plan_for_ent_search
 Search Architecture for SharePoint 2013 http://zoom.it/Tsuy
Vietnam SharePoint User Group
Vietnam SharePoint User Group
Thank you

More Related Content

What's hot

Sps boston 2014_o365_power_shell_csom_amitv
Sps boston 2014_o365_power_shell_csom_amitvSps boston 2014_o365_power_shell_csom_amitv
Sps boston 2014_o365_power_shell_csom_amitvamitvasu
 
SharePoint 2013 Search - Whats new for End Users
SharePoint 2013 Search - Whats new for End UsersSharePoint 2013 Search - Whats new for End Users
SharePoint 2013 Search - Whats new for End UsersMark Stokes
 
Introduction to SharePoint 2013 Search
Introduction to SharePoint 2013 SearchIntroduction to SharePoint 2013 Search
Introduction to SharePoint 2013 SearchSurfRay
 
SharePoint Search Secrets for Power Users & Administrators - Mike Smith
SharePoint Search Secrets for Power Users & Administrators - Mike SmithSharePoint Search Secrets for Power Users & Administrators - Mike Smith
SharePoint Search Secrets for Power Users & Administrators - Mike SmithMAX Technical Training
 
Search First Migration - Using SharePoint 2013 Search for SharePoint 2010
Search First Migration - Using SharePoint 2013 Search for SharePoint 2010Search First Migration - Using SharePoint 2013 Search for SharePoint 2010
Search First Migration - Using SharePoint 2013 Search for SharePoint 2010Bob German
 
MetaVis Webinar - 10 Things I Like in SharePoint 2013 Search
MetaVis Webinar - 10 Things I Like in SharePoint 2013 SearchMetaVis Webinar - 10 Things I Like in SharePoint 2013 Search
MetaVis Webinar - 10 Things I Like in SharePoint 2013 SearchAgnes Molnar
 
#SPSPhilly search topology & optimization
#SPSPhilly search topology & optimization#SPSPhilly search topology & optimization
#SPSPhilly search topology & optimizationMike Maadarani
 
Avoiding 10 common SharePoint Administration mistakes
Avoiding 10 common SharePoint Administration mistakesAvoiding 10 common SharePoint Administration mistakes
Avoiding 10 common SharePoint Administration mistakesBenjamin Athawes
 
Search Solution in SharePoint 2013
Search Solution in SharePoint 2013Search Solution in SharePoint 2013
Search Solution in SharePoint 2013Thuan Ng
 
Drilling Down to the Challenges of SharePoint Taxonomy Implementation
Drilling Down to the Challenges of SharePoint Taxonomy ImplementationDrilling Down to the Challenges of SharePoint Taxonomy Implementation
Drilling Down to the Challenges of SharePoint Taxonomy ImplementationTSoholt
 
B365 saturday practical guide to building a scalable search architecture in s...
B365 saturday practical guide to building a scalable search architecture in s...B365 saturday practical guide to building a scalable search architecture in s...
B365 saturday practical guide to building a scalable search architecture in s...Thuan Ng
 
Overview of Search in SharePoint Server 2013 - Australian SharePoint Conferen...
Overview of Search in SharePoint Server 2013 - Australian SharePoint Conferen...Overview of Search in SharePoint Server 2013 - Australian SharePoint Conferen...
Overview of Search in SharePoint Server 2013 - Australian SharePoint Conferen...Sezai Komur
 
SharePoint Search - SPSNYC 2014
SharePoint Search - SPSNYC 2014SharePoint Search - SPSNYC 2014
SharePoint Search - SPSNYC 2014Avtex
 
Cloud Hybrid Search with SharePoint
Cloud Hybrid Search with SharePointCloud Hybrid Search with SharePoint
Cloud Hybrid Search with SharePointJeff Fried
 
Fives ways to query SharePoint 2013 Search - SharePoint Summit Toronto 2013
Fives ways to query SharePoint 2013 Search - SharePoint Summit Toronto 2013Fives ways to query SharePoint 2013 Search - SharePoint Summit Toronto 2013
Fives ways to query SharePoint 2013 Search - SharePoint Summit Toronto 2013Corey Roth
 
Building Search Driven Applications in SharePoint 2010 - SharePoint Fest 2012
Building Search Driven Applications in SharePoint 2010 - SharePoint Fest 2012Building Search Driven Applications in SharePoint 2010 - SharePoint Fest 2012
Building Search Driven Applications in SharePoint 2010 - SharePoint Fest 2012Nik Patel
 
Understanding and Applying Cloud Hybrid Search
Understanding and Applying Cloud Hybrid SearchUnderstanding and Applying Cloud Hybrid Search
Understanding and Applying Cloud Hybrid SearchJeff Fried
 
Fried sp techcon hybrid search deeper dive
Fried sp techcon hybrid search deeper diveFried sp techcon hybrid search deeper dive
Fried sp techcon hybrid search deeper diveJeff Fried
 
Take Cloud Hybrid Search to the Next Level
Take Cloud Hybrid Search to the Next LevelTake Cloud Hybrid Search to the Next Level
Take Cloud Hybrid Search to the Next LevelJeff Fried
 
Understanding and Applying Cloud Hybrid Search
Understanding and Applying Cloud Hybrid SearchUnderstanding and Applying Cloud Hybrid Search
Understanding and Applying Cloud Hybrid SearchJeff Fried
 

What's hot (20)

Sps boston 2014_o365_power_shell_csom_amitv
Sps boston 2014_o365_power_shell_csom_amitvSps boston 2014_o365_power_shell_csom_amitv
Sps boston 2014_o365_power_shell_csom_amitv
 
SharePoint 2013 Search - Whats new for End Users
SharePoint 2013 Search - Whats new for End UsersSharePoint 2013 Search - Whats new for End Users
SharePoint 2013 Search - Whats new for End Users
 
Introduction to SharePoint 2013 Search
Introduction to SharePoint 2013 SearchIntroduction to SharePoint 2013 Search
Introduction to SharePoint 2013 Search
 
SharePoint Search Secrets for Power Users & Administrators - Mike Smith
SharePoint Search Secrets for Power Users & Administrators - Mike SmithSharePoint Search Secrets for Power Users & Administrators - Mike Smith
SharePoint Search Secrets for Power Users & Administrators - Mike Smith
 
Search First Migration - Using SharePoint 2013 Search for SharePoint 2010
Search First Migration - Using SharePoint 2013 Search for SharePoint 2010Search First Migration - Using SharePoint 2013 Search for SharePoint 2010
Search First Migration - Using SharePoint 2013 Search for SharePoint 2010
 
MetaVis Webinar - 10 Things I Like in SharePoint 2013 Search
MetaVis Webinar - 10 Things I Like in SharePoint 2013 SearchMetaVis Webinar - 10 Things I Like in SharePoint 2013 Search
MetaVis Webinar - 10 Things I Like in SharePoint 2013 Search
 
#SPSPhilly search topology & optimization
#SPSPhilly search topology & optimization#SPSPhilly search topology & optimization
#SPSPhilly search topology & optimization
 
Avoiding 10 common SharePoint Administration mistakes
Avoiding 10 common SharePoint Administration mistakesAvoiding 10 common SharePoint Administration mistakes
Avoiding 10 common SharePoint Administration mistakes
 
Search Solution in SharePoint 2013
Search Solution in SharePoint 2013Search Solution in SharePoint 2013
Search Solution in SharePoint 2013
 
Drilling Down to the Challenges of SharePoint Taxonomy Implementation
Drilling Down to the Challenges of SharePoint Taxonomy ImplementationDrilling Down to the Challenges of SharePoint Taxonomy Implementation
Drilling Down to the Challenges of SharePoint Taxonomy Implementation
 
B365 saturday practical guide to building a scalable search architecture in s...
B365 saturday practical guide to building a scalable search architecture in s...B365 saturday practical guide to building a scalable search architecture in s...
B365 saturday practical guide to building a scalable search architecture in s...
 
Overview of Search in SharePoint Server 2013 - Australian SharePoint Conferen...
Overview of Search in SharePoint Server 2013 - Australian SharePoint Conferen...Overview of Search in SharePoint Server 2013 - Australian SharePoint Conferen...
Overview of Search in SharePoint Server 2013 - Australian SharePoint Conferen...
 
SharePoint Search - SPSNYC 2014
SharePoint Search - SPSNYC 2014SharePoint Search - SPSNYC 2014
SharePoint Search - SPSNYC 2014
 
Cloud Hybrid Search with SharePoint
Cloud Hybrid Search with SharePointCloud Hybrid Search with SharePoint
Cloud Hybrid Search with SharePoint
 
Fives ways to query SharePoint 2013 Search - SharePoint Summit Toronto 2013
Fives ways to query SharePoint 2013 Search - SharePoint Summit Toronto 2013Fives ways to query SharePoint 2013 Search - SharePoint Summit Toronto 2013
Fives ways to query SharePoint 2013 Search - SharePoint Summit Toronto 2013
 
Building Search Driven Applications in SharePoint 2010 - SharePoint Fest 2012
Building Search Driven Applications in SharePoint 2010 - SharePoint Fest 2012Building Search Driven Applications in SharePoint 2010 - SharePoint Fest 2012
Building Search Driven Applications in SharePoint 2010 - SharePoint Fest 2012
 
Understanding and Applying Cloud Hybrid Search
Understanding and Applying Cloud Hybrid SearchUnderstanding and Applying Cloud Hybrid Search
Understanding and Applying Cloud Hybrid Search
 
Fried sp techcon hybrid search deeper dive
Fried sp techcon hybrid search deeper diveFried sp techcon hybrid search deeper dive
Fried sp techcon hybrid search deeper dive
 
Take Cloud Hybrid Search to the Next Level
Take Cloud Hybrid Search to the Next LevelTake Cloud Hybrid Search to the Next Level
Take Cloud Hybrid Search to the Next Level
 
Understanding and Applying Cloud Hybrid Search
Understanding and Applying Cloud Hybrid SearchUnderstanding and Applying Cloud Hybrid Search
Understanding and Applying Cloud Hybrid Search
 

Similar to Build a scalable Search architecture in SharePoint 2013

Enterprise Search in SharePoint 2010
Enterprise Search in SharePoint 2010Enterprise Search in SharePoint 2010
Enterprise Search in SharePoint 2010bgerman
 
EPC Group - Comprehensive Overview of SharePoint 2010's Enterprise Search Cap...
EPC Group - Comprehensive Overview of SharePoint 2010's Enterprise Search Cap...EPC Group - Comprehensive Overview of SharePoint 2010's Enterprise Search Cap...
EPC Group - Comprehensive Overview of SharePoint 2010's Enterprise Search Cap...EPC Group
 
Fried dallas spug
Fried dallas spugFried dallas spug
Fried dallas spugJeff Fried
 
SharePoint 2013 Search Architecture with Russ Houberg
SharePoint 2013  Search Architecture with Russ HoubergSharePoint 2013  Search Architecture with Russ Houberg
SharePoint 2013 Search Architecture with Russ Houbergknowledgelakemarketing
 
Fried houston spug
Fried houston spugFried houston spug
Fried houston spugJeff Fried
 
Best Practices to SharePoint Architecture Fundamentals NZ & AUS
Best Practices to SharePoint Architecture Fundamentals NZ & AUSBest Practices to SharePoint Architecture Fundamentals NZ & AUS
Best Practices to SharePoint Architecture Fundamentals NZ & AUSguest7c2e070
 
Solve Todays Problems with 10 New SharePoint 2010 Features
Solve Todays Problems with 10 New SharePoint 2010 FeaturesSolve Todays Problems with 10 New SharePoint 2010 Features
Solve Todays Problems with 10 New SharePoint 2010 FeaturesCory Peters
 
SharePoint User Group Meeting- SharePoint 2013 Search
SharePoint User Group Meeting- SharePoint 2013 SearchSharePoint User Group Meeting- SharePoint 2013 Search
SharePoint User Group Meeting- SharePoint 2013 SearchC/D/H Technology Consultants
 
SharePoint 2010 Enterprise Search
SharePoint 2010 Enterprise SearchSharePoint 2010 Enterprise Search
SharePoint 2010 Enterprise SearchAgnes Molnar
 
SharePoint 2013 governance model
SharePoint 2013 governance modelSharePoint 2013 governance model
SharePoint 2013 governance modelYash Goley
 
11 Strategic Considerations for SharePoint Migrations #SPSVB
11 Strategic Considerations for SharePoint Migrations #SPSVB11 Strategic Considerations for SharePoint Migrations #SPSVB
11 Strategic Considerations for SharePoint Migrations #SPSVBChristian Buckley
 
The Searchmaster's Toolbox - David Hawking, Funnelback Search
The Searchmaster's Toolbox - David Hawking, Funnelback SearchThe Searchmaster's Toolbox - David Hawking, Funnelback Search
The Searchmaster's Toolbox - David Hawking, Funnelback SearchSquiz
 
Enhancing Relevancy & User Experience with #SharePoint Search sps-philly 2015
Enhancing Relevancy & User Experience with #SharePoint Search   sps-philly 2015Enhancing Relevancy & User Experience with #SharePoint Search   sps-philly 2015
Enhancing Relevancy & User Experience with #SharePoint Search sps-philly 2015Gina Montgomery, V-TSP
 
SharePoint Jumpstart #2 Making Basic SharePoint Search Work
SharePoint Jumpstart #2 Making Basic SharePoint Search WorkSharePoint Jumpstart #2 Making Basic SharePoint Search Work
SharePoint Jumpstart #2 Making Basic SharePoint Search WorkEarley Information Science
 
ESPC13 - 10 Things I Like in SharePoint 2013 Search
ESPC13 - 10 Things I Like in SharePoint 2013 SearchESPC13 - 10 Things I Like in SharePoint 2013 Search
ESPC13 - 10 Things I Like in SharePoint 2013 SearchAgnes Molnar
 
Fishbowl Solutions WebCenter Search Webinar Presentation
Fishbowl Solutions WebCenter Search Webinar PresentationFishbowl Solutions WebCenter Search Webinar Presentation
Fishbowl Solutions WebCenter Search Webinar PresentationKim Negaard
 
SharePoint 2013 Search Operations
SharePoint 2013 Search OperationsSharePoint 2013 Search Operations
SharePoint 2013 Search OperationsSPC Adriatics
 
SPS Phoenix Optimizing SharePoint for Transactional Content Management
SPS Phoenix Optimizing SharePoint for Transactional Content ManagementSPS Phoenix Optimizing SharePoint for Transactional Content Management
SPS Phoenix Optimizing SharePoint for Transactional Content ManagementDocFluix, LLC
 
CREATE SEARCH DRIVEN BUSINESS INTELLIGENCE APPLICATION USING FAST SEARCH FO...
CREATE SEARCH DRIVEN BUSINESS  INTELLIGENCE APPLICATION USING  FAST SEARCH FO...CREATE SEARCH DRIVEN BUSINESS  INTELLIGENCE APPLICATION USING  FAST SEARCH FO...
CREATE SEARCH DRIVEN BUSINESS INTELLIGENCE APPLICATION USING FAST SEARCH FO...Netwoven Inc.
 
Implementing Site Search in CQ5 / AEM
Implementing Site Search in CQ5 / AEMImplementing Site Search in CQ5 / AEM
Implementing Site Search in CQ5 / AEMrtpaem
 

Similar to Build a scalable Search architecture in SharePoint 2013 (20)

Enterprise Search in SharePoint 2010
Enterprise Search in SharePoint 2010Enterprise Search in SharePoint 2010
Enterprise Search in SharePoint 2010
 
EPC Group - Comprehensive Overview of SharePoint 2010's Enterprise Search Cap...
EPC Group - Comprehensive Overview of SharePoint 2010's Enterprise Search Cap...EPC Group - Comprehensive Overview of SharePoint 2010's Enterprise Search Cap...
EPC Group - Comprehensive Overview of SharePoint 2010's Enterprise Search Cap...
 
Fried dallas spug
Fried dallas spugFried dallas spug
Fried dallas spug
 
SharePoint 2013 Search Architecture with Russ Houberg
SharePoint 2013  Search Architecture with Russ HoubergSharePoint 2013  Search Architecture with Russ Houberg
SharePoint 2013 Search Architecture with Russ Houberg
 
Fried houston spug
Fried houston spugFried houston spug
Fried houston spug
 
Best Practices to SharePoint Architecture Fundamentals NZ & AUS
Best Practices to SharePoint Architecture Fundamentals NZ & AUSBest Practices to SharePoint Architecture Fundamentals NZ & AUS
Best Practices to SharePoint Architecture Fundamentals NZ & AUS
 
Solve Todays Problems with 10 New SharePoint 2010 Features
Solve Todays Problems with 10 New SharePoint 2010 FeaturesSolve Todays Problems with 10 New SharePoint 2010 Features
Solve Todays Problems with 10 New SharePoint 2010 Features
 
SharePoint User Group Meeting- SharePoint 2013 Search
SharePoint User Group Meeting- SharePoint 2013 SearchSharePoint User Group Meeting- SharePoint 2013 Search
SharePoint User Group Meeting- SharePoint 2013 Search
 
SharePoint 2010 Enterprise Search
SharePoint 2010 Enterprise SearchSharePoint 2010 Enterprise Search
SharePoint 2010 Enterprise Search
 
SharePoint 2013 governance model
SharePoint 2013 governance modelSharePoint 2013 governance model
SharePoint 2013 governance model
 
11 Strategic Considerations for SharePoint Migrations #SPSVB
11 Strategic Considerations for SharePoint Migrations #SPSVB11 Strategic Considerations for SharePoint Migrations #SPSVB
11 Strategic Considerations for SharePoint Migrations #SPSVB
 
The Searchmaster's Toolbox - David Hawking, Funnelback Search
The Searchmaster's Toolbox - David Hawking, Funnelback SearchThe Searchmaster's Toolbox - David Hawking, Funnelback Search
The Searchmaster's Toolbox - David Hawking, Funnelback Search
 
Enhancing Relevancy & User Experience with #SharePoint Search sps-philly 2015
Enhancing Relevancy & User Experience with #SharePoint Search   sps-philly 2015Enhancing Relevancy & User Experience with #SharePoint Search   sps-philly 2015
Enhancing Relevancy & User Experience with #SharePoint Search sps-philly 2015
 
SharePoint Jumpstart #2 Making Basic SharePoint Search Work
SharePoint Jumpstart #2 Making Basic SharePoint Search WorkSharePoint Jumpstart #2 Making Basic SharePoint Search Work
SharePoint Jumpstart #2 Making Basic SharePoint Search Work
 
ESPC13 - 10 Things I Like in SharePoint 2013 Search
ESPC13 - 10 Things I Like in SharePoint 2013 SearchESPC13 - 10 Things I Like in SharePoint 2013 Search
ESPC13 - 10 Things I Like in SharePoint 2013 Search
 
Fishbowl Solutions WebCenter Search Webinar Presentation
Fishbowl Solutions WebCenter Search Webinar PresentationFishbowl Solutions WebCenter Search Webinar Presentation
Fishbowl Solutions WebCenter Search Webinar Presentation
 
SharePoint 2013 Search Operations
SharePoint 2013 Search OperationsSharePoint 2013 Search Operations
SharePoint 2013 Search Operations
 
SPS Phoenix Optimizing SharePoint for Transactional Content Management
SPS Phoenix Optimizing SharePoint for Transactional Content ManagementSPS Phoenix Optimizing SharePoint for Transactional Content Management
SPS Phoenix Optimizing SharePoint for Transactional Content Management
 
CREATE SEARCH DRIVEN BUSINESS INTELLIGENCE APPLICATION USING FAST SEARCH FO...
CREATE SEARCH DRIVEN BUSINESS  INTELLIGENCE APPLICATION USING  FAST SEARCH FO...CREATE SEARCH DRIVEN BUSINESS  INTELLIGENCE APPLICATION USING  FAST SEARCH FO...
CREATE SEARCH DRIVEN BUSINESS INTELLIGENCE APPLICATION USING FAST SEARCH FO...
 
Implementing Site Search in CQ5 / AEM
Implementing Site Search in CQ5 / AEMImplementing Site Search in CQ5 / AEM
Implementing Site Search in CQ5 / AEM
 

More from Terrence Nguyen

Azure.application development.nhut.nguyen
Azure.application development.nhut.nguyenAzure.application development.nhut.nguyen
Azure.application development.nhut.nguyenTerrence Nguyen
 
SPSHK.PowerBI.SharePoint.NhutNguyen
SPSHK.PowerBI.SharePoint.NhutNguyenSPSHK.PowerBI.SharePoint.NhutNguyen
SPSHK.PowerBI.SharePoint.NhutNguyenTerrence Nguyen
 
Business Intelligent (BI) for Office 365
Business Intelligent (BI) for Office 365Business Intelligent (BI) for Office 365
Business Intelligent (BI) for Office 365Terrence Nguyen
 
SharePoint Saturday Vietnam 8th - sharepoint and the internet of thing
SharePoint Saturday Vietnam 8th - sharepoint and the internet of thingSharePoint Saturday Vietnam 8th - sharepoint and the internet of thing
SharePoint Saturday Vietnam 8th - sharepoint and the internet of thingTerrence Nguyen
 
SharePoint Saturday Vietnam 8th - managed metadata.pptx
SharePoint Saturday Vietnam 8th - managed metadata.pptxSharePoint Saturday Vietnam 8th - managed metadata.pptx
SharePoint Saturday Vietnam 8th - managed metadata.pptxTerrence Nguyen
 
SharePoint Saturday Vietnam 8th - angularjs and signalr in sharepoint
SharePoint Saturday Vietnam 8th - angularjs and signalr in sharepointSharePoint Saturday Vietnam 8th - angularjs and signalr in sharepoint
SharePoint Saturday Vietnam 8th - angularjs and signalr in sharepointTerrence Nguyen
 
User and License Management on SharePoint Online
User and License Management on SharePoint OnlineUser and License Management on SharePoint Online
User and License Management on SharePoint OnlineTerrence Nguyen
 
Lotus Notes Application to SharePoint Migration Process
Lotus Notes Application to SharePoint Migration ProcessLotus Notes Application to SharePoint Migration Process
Lotus Notes Application to SharePoint Migration ProcessTerrence Nguyen
 
Corporate social network get meet_core_value
Corporate social network get meet_core_valueCorporate social network get meet_core_value
Corporate social network get meet_core_valueTerrence Nguyen
 

More from Terrence Nguyen (10)

Azure.application development.nhut.nguyen
Azure.application development.nhut.nguyenAzure.application development.nhut.nguyen
Azure.application development.nhut.nguyen
 
SPSHK.PowerBI.SharePoint.NhutNguyen
SPSHK.PowerBI.SharePoint.NhutNguyenSPSHK.PowerBI.SharePoint.NhutNguyen
SPSHK.PowerBI.SharePoint.NhutNguyen
 
Business Intelligent (BI) for Office 365
Business Intelligent (BI) for Office 365Business Intelligent (BI) for Office 365
Business Intelligent (BI) for Office 365
 
SharePoint Saturday Vietnam 8th - sharepoint and the internet of thing
SharePoint Saturday Vietnam 8th - sharepoint and the internet of thingSharePoint Saturday Vietnam 8th - sharepoint and the internet of thing
SharePoint Saturday Vietnam 8th - sharepoint and the internet of thing
 
SharePoint Saturday Vietnam 8th - managed metadata.pptx
SharePoint Saturday Vietnam 8th - managed metadata.pptxSharePoint Saturday Vietnam 8th - managed metadata.pptx
SharePoint Saturday Vietnam 8th - managed metadata.pptx
 
SharePoint Saturday Vietnam 8th - angularjs and signalr in sharepoint
SharePoint Saturday Vietnam 8th - angularjs and signalr in sharepointSharePoint Saturday Vietnam 8th - angularjs and signalr in sharepoint
SharePoint Saturday Vietnam 8th - angularjs and signalr in sharepoint
 
User and License Management on SharePoint Online
User and License Management on SharePoint OnlineUser and License Management on SharePoint Online
User and License Management on SharePoint Online
 
AppBattle VietNam 1st
AppBattle VietNam 1stAppBattle VietNam 1st
AppBattle VietNam 1st
 
Lotus Notes Application to SharePoint Migration Process
Lotus Notes Application to SharePoint Migration ProcessLotus Notes Application to SharePoint Migration Process
Lotus Notes Application to SharePoint Migration Process
 
Corporate social network get meet_core_value
Corporate social network get meet_core_valueCorporate social network get meet_core_value
Corporate social network get meet_core_value
 

Recently uploaded

TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 

Recently uploaded (20)

TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 

Build a scalable Search architecture in SharePoint 2013

  • 1. Building a scalable Search architecture in SharePoint 2013 Thuan Nguyen, SharePoint MVP thuan@outlook.com @nnthuan Vietnam SharePoint User Group
  • 2. About Me  SharePoint Practice Lead, Solution Architect – FPT Software  Microsoft SharePoint MVP (2011, 2012, 2013, 2014)  Used to love start-up with two SharePoint-based products.  Now focus on building a SharePoint core standard and framework for Singapore Government. Vietnam SharePoint User Group
  • 3. Agenda  Common Misunderstandings  Architecture & Topology  Practical Guide  Question & Answer Vietnam SharePoint User Group For those who are looking into having multiple Search servers handling millions documents.
  • 4. Common Misunderstandings  For High Availability, create two Search Service Applications.  There is only one machine playing Search role in your farm  Scale out Search architecture by adding more servers.  Start Search service is to make search functionality work. Vietnam SharePoint User Group
  • 5. Architecture & Topology Logical Architecture Crawl Content Processing Analytics Processing Index Administration Query Processing Understand each component will help better design a scalable & maintainable Search for your organization. Vietnam SharePoint User Group
  • 6. Crawl Component  Responsible for crawling content from different sources  SharePoint sites  Exchange  Lotus Notes  Documentum  HTTP Website  Deliver crawled items to content processing component.  Crawl database stores information about crawl items and crawl history Vietnam SharePoint User Group dbo.MSSCrawlHistoryLocal
  • 7. Content Processing  Processes crawled items and passes these items to the index component  Performs linguistic processing at index time (e.g. language detection and entity extraction)  Writes information about links and URLs to the Link database Vietnam SharePoint User Group dbo.MSSQLogResultDocs
  • 8. Analytics Processing Vietnam SharePoint User Group  Analyzes crawled items and how users interact with search results.  When an user does an action (e.g. view a page) the event is collected in usage files on the WFE’s and regularly pushed to event store where they are stored until processed  Results are then returned to the Content Processing Component to be included in the search index dbo.SearchReportData
  • 9. Index Component Vietnam SharePoint User Group  Receives the processed items from the content processing component and writes them to the search index.  Handles incoming queries, retrieves information from the search index, and sends back the result set to the query processing component.
  • 10. Index Architecture Vietnam SharePoint User Group  An index partition is a logical portion of the entire search index.  Each partition is served by one or more index components (or “replicas”)  In a partition there’s only one primary (or “Active”) replica who’s the only one that writes data in a partition  Other secondary (or “passive”) replicas are there for fault tolerance and increased query throughput  Index can scale in both horizontal (partitions) and vertical (replicas) ways  Partitions can be added but NOT removed Secondary Replica 1 Secondary Replica 2 Secondary Replica 1 Secondary Replica 2 Secondary Replica 3 Secondary Replica 2 Secondary Replica 1 Partition #1 Partition #2 Partition #3 Secondary Replica 3 Secondary Replica 3 Servers Index Servers 1, 2 & 3 Index Servers 4, 5 & 6 Index Servers 7, 8 & 9 Index Servers 10, 11 & 12
  • 11. Query Processing  Analyses and processes search queries and results.  The processed query is then submitted to the index component, which returns a set of search results for the query. Vietnam SharePoint User Group
  • 12. Search Administration Vietnam SharePoint User Group  Search Admin Component  Runs number of system processes required for search  Is responsible for search provisioning and topology changes  Coordinates search components – Content Processing, Query Processing, Analytics, and Indexing.  Search Admin DB  Stores search configuration data:  Topology  Crawl rules  Query rules  Managed property mappings  Content sources  Crawl schedules  Stores Analytics settings dbo.MSSConfiguration
  • 13. Practical Guide Vietnam SharePoint User Group Assessment Design Implementation Verification
  • 14. Practical Guide- Assessment  Don’t hastily touch your SharePoint. Leave it alone!  Think about your content  What are your content sources (SharePoint document library, Exchange, File Server..)?  How much of content you want to search? (e.g. 100,000 documents)  Assess the number of concurrent users.  Search database sizing Vietnam SharePoint User Group
  • 15. Practical Guide- Assessment Vietnam SharePoint User Group  Sizing factor:  Total Database Size  Total Index Size  Query Component Index Size  Disk Storage  Link Database  Search Admin Database  Total Crawl Database Size  Total Crawl Database Log Size  Analytics Database Size => Total database size for Search Microsoft already published the formula for these things above.
  • 16. Practical Guide - Assessment Vietnam SharePoint User Group What is exactly High Availability for Search?  Business language: Search doesn’t stop end users searching something.  Technical language: All search logical components and Search databases must be functional as always.  Two or more Search service applications  Two or more Search servers
  • 17. Practical Guide- Design  Don’t hastily touch your SharePoint. Leave it alone!  Start with one machine hosting all components Vietnam SharePoint User Group
  • 18. Practical Guide - Design Vietnam SharePoint User Group  Don’t hastily touch your SharePoint. Leave it alone!  Think about two machines for Search but different set of components Redundant set of (Query + Crawl). If one goes down, Query component in another machine still keeps functioning.
  • 19. Practical Guide - Design Vietnam SharePoint User Group  Don’t hastily touch your SharePoint. Leave it alone!  Do you need three machines for Search?  Speed up Query component?  Reduce crawling time?  Balance CPU utilization in machine? With more three machines, go to start an assessment of components in terms of the usage of hardware resources
  • 20. Practical Guide - Design Component CPU Network Disk RAM Crawl Component MEDIUM HIGH MEDIUM MEDIUM Content processing (CPC) HIGH MEDIUM HIGH Analytics processing (APC) MEDIUM HIGH MEDIUM MEDIUM Index Component HIGH MEDIUM HIGH HIGH Query processing (QPC) MEDIUM MEDIUM MEDIUM Search Admin Component LOW LOW LOW Vietnam SharePoint User Group Microsoft Ignite – BK3176 If logical architecture requires scale-out, consider utilization
  • 21. Practical Guide - Design Volume of content Sample Search Architecture < 1 mil items Single-server Search farm 1 mil – 5 mil Two-server Search farm 5 mil – 10 mil Small Search farm (3-4 servers) 10 mil – 40 mil Medium Search farm (5-6 servers) > 40 mil Large Search farm Vietnam SharePoint User Group
  • 22. Sample Search Architecture Vietnam SharePoint User Group  Handle number of different content sources (with 20 custom applications)  Nearly 1 million items currently  Full crawl takes 2 hours  Serving for nearly 20,000 users with 500 concurrent users.
  • 23. Sample Search Architecture Vietnam SharePoint User Group  Optimize search query to serve hundreds of concurrent users.  Handle million of documents (approx. 5 TB)
  • 24. Sample Search Architecture Vietnam SharePoint User Group  Serve for 20 million documents & items (approx. 10-15 TB).
  • 25. Central Administration doesn’t help much. PowerShell is your friend 1. Create Search Service Application 2. Clone existing topology 3. Modify Search component based on your designated architecture 4. Assign Index component and location 5. Activate the new Search topology Vietnam SharePoint User Group Practical Guide- Implementation Build Search farm with PowerShell http://bit.ly/search_multi_server_PS
  • 26. $app1 = "APP-Server-01" $app2 = "APP-Server-02" $SearchAppPoolName = "SharePoint_SearchApp" $SearchAppPoolAccountName = "TestDomainSPSearchPool" $SearchServiceName = "SharePoint_Search_Service" $SearchServiceProxyName = "SharePoint_Search_Proxy" $DatabaseName = "SharePoint_Search_AdminDB" #Create a Search Service Application Pool $spAppPool = New-SPServiceApplicationPool -Name $SearchAppPoolName -Account $SearchAppPoolAccountName -Verbose #Start Search Service Instance on all Application Servers Start-SPEnterpriseSearchServiceInstance $App1 -ErrorAction SilentlyContinue Start-SPEnterpriseSearchServiceInstance $App2 -ErrorAction SilentlyContinue Start-SPEnterpriseSearchQueryAndSiteSettingsServiceInstance $App1 -ErrorAction SilentlyContinue Start-SPEnterpriseSearchQueryAndSiteSettingsServiceInstance $App2 -ErrorAction SilentlyContinue #Create Search Service Application $ServiceApplication = New-SPEnterpriseSearchServiceApplication -Partitioned -Name $SearchServiceName -ApplicationPool $spAppPool.Name -DatabaseName $DatabaseName #Create Search Service Proxy New-SPEnterpriseSearchServiceApplicationProxy -Partitioned -Name $SearchServiceProxyName - SearchApplication $ServiceApplication Vietnam SharePoint User Group Practical Guide- Implementation
  • 27. Practical Guide- Implementation #We need only one admin component New-SPEnterpriseSearchAdminComponent –SearchTopology $clone -SearchServiceInstance $App1SSI #We need two content processing components for HA New-SPEnterpriseSearchContentProcessingComponent –SearchTopology $clone -SearchServiceInstance $App1SSI #We need two analytics processing components for HA New-SPEnterpriseSearchAnalyticsProcessingComponent –SearchTopology $clone -SearchServiceInstance $App1SSI #We need two crawl components for HA New-SPEnterpriseSearchCrawlComponent –SearchTopology $clone -SearchServiceInstance $App1SSI New-SPEnterpriseSearchCrawlComponent –SearchTopology $clone -SearchServiceInstance $App2SSI #We need two query processing components for HA New-SPEnterpriseSearchQueryProcessingComponent –SearchTopology $clone -SearchServiceInstance $App1SSI New-SPEnterpriseSearchQueryProcessingComponent –SearchTopology $clone -SearchServiceInstance $App2SSI Vietnam SharePoint User Group $clone = $ServiceApplication.ActiveTopology.Clone() $App1SSI = Get-SPEnterpriseSearchServiceInstance -Identity $app1 $App2SSI = Get-SPEnterpriseSearchServiceInstance -Identity $app2
  • 28. $IndexLocation = “APP2Index_Search" New-SPEnterpriseSearchIndexComponent –SearchTopology $clone -SearchServiceInstance $App2SSI - RootDirectory $IndexLocation -IndexPartition 0 $clone.Activate() Practical Guide- Implementation Vietnam SharePoint User Group
  • 29. Practical Guide- Verification Vietnam SharePoint User Group Central Administration can help  PowerShell  Get- SPEnterpriseSearchStatus  Get- SPEnterpriseSearchTopolog y Search PowerShell http://bit.ly/PowerShell_SP2013_Search
  • 30. Helpful References  SharePoint 2013: SharePoint and Enterprise Search Survival Guide http://bit.ly/search_survival_guide  Plan enterprise search architecture in SharePoint Server 2013 http://bit.ly/plan_for_ent_search  Search Architecture for SharePoint 2013 http://zoom.it/Tsuy Vietnam SharePoint User Group
  • 31.
  • 32. Vietnam SharePoint User Group Thank you