Search Administration in
   SharePoint 2013
          Agnes Molnar
Senior Search Solutions Consultant,
     SharePoint Server MVP
Introduction
• Senior Search Solutions Consultant
• SharePoint Server MVP

• Speaker, Blogger, Community Lead
     http://aghy.hu
     http://www.DoMoreWithSearch.com


     Agnes.Molnar@BAInsight.com
     @molnaragnes
Overview

•   Architecture
•   Crawling
•   Content Processing
•   Query Processing
•   Debugging and Troubleshooting
What’s New in Enterprise
         Search
       in SP2013

      Wed 14:25, Room B
Architecture
Major Changes in Search

 Combination                                Used
 of FAST and                                pervasively
 SharePoint    Content by                   throughout                      Continuous
 Search        Search       WCM             the platform   Result Sources   Crawling




 High                                       Query                           Search
 Scalability   CSOM         Result Blocks   Suggestions    Query Rules      Refinements




Search is used pervasively throughout the platform




                                                                                          6
Search System

host

content                                          http://search

          feed                           query
content



content
           indexing
           connectors




content


                        federate query
index
Search Administration is Difficult
• Heterogeneous Data Models
  – Every system is different
  – Mapping to common metadata is essential for
    findability
• Heterogeneous Security
• Bandwidth and Performance
  – LOTS of content
  – Cross-site bandwidth can be expensive/limited
  – Source Systems can be the limiting factor
Crawling
Content Sources
host

                                                                             http://search
content
          feed                                                query

content


           indexing
           connectors
content

                        federate query
 index




                                              OOB Solutions           Custom Solutions

                                         •   File Share
                                         •   SharePoint
                                         •   Website
                                         •   People Profile
                                         • Lotus Notes
                                                                      Custom Solutions on
                                         • Exchange Public
                                                                      Connector
                                           Folder
                                                                      Framework
                                         • Documentum
Continuous Crawl




   Gotcha! - For SharePoint content sources only!
Content Freshness
Content Freshness
Result Sources
Scopes and Federated Search in SharePoint 2010
 “Result Sources” in SP2013

• Local SharePoint Index
    • This farm
• Remote SharePoint
    • Another farm
    • oAuth Trust
• Open Search
    • Upgraded support for 1.1
• Exchange
    • Same Search
• Anonymous Authentication is
  supported

                           Gotcha! - You can’t interleave results from sources

                                                                            14
Search Schema
• Crawl Properties
   – metadata extracted from the documents/items during the crawl
• Managed Properties
   – created and controlled by the Search Admins
   – mapped to Crawled Properties
   – helping users perform more efficient and successful queries:
       •       Refiners
       •       Properties displayed in Search Results
       •       Sorting Properties (FAST)
• Property Mapping
   – Many-to-Many relationship between Crawled and Managed
     Properties
Search Schema
Crawled Property    Managed Property

 Author



CreatedBy               Author



  From
Query Processing
Result Types
 New framework for presenting search results to
  end users called Result Types
 Enable each type to be rendered differently:
Query Rules
    Query Conditions
    (does it meet a condition?)
    •    Contains Words
    •    Source
    •    Type
    •    Source
    •    RegEX


    Query Actions
    (What action to perform)
    •    Promoted Results
           •    Best Bets
           •    Visual Best Bets
    •    Result Blocks
           •    Additional Query
    •    Query Modification
           •    XRANK
           •    Query Re-Write


Query Publishing
(When to perform this action)
•       Start Date
•       End Date

                                                 19
Result Blocks
      Promoted Result
      (Visual Best Bet)

       Promoted Result
          (Best Bet)


Office 365 Results Block




  Search Core Results

                                  20
Query Suggestions
Pre-Query Suggestions
A list of items that others are
typing for their queries


A list of items you have clicked on
before from your personal query log




Post-Query Suggestions
Based upon the results that you have
clicked on at least twice




                                          21
Search Query Builder
New Tool to help you build complex queries

• Used Pervasively
   • Query Rules
   • Result Blocks
   • And More…
• Visually build complex queries
• Allows for testing queries
• Refiners
• Sorting




                                             22
Delegated Search
 Administration
More Control at the Site Admin
                    Level
                                        Task                                           Site      Site Admin
                                                                                    Collection
                                                                                     Admin
Create and/or override Query Rules, including Promoted Results

Create and/or override Result types and display templates

Create and/or override Result Sources, either for remote locations or as a custom
search “vertical”

Create managed properties

Create refiners

Start a local crawl – can even be done down to the list level



                                                                Built for the Cloud
                                                                  • Multi-Tenant
Debugging and
Troubleshooting
Debugging and Troubleshooting
            Crawl Processes
• Crawl Logs
  – Crawl time / crawl rate
  – Crawl errors/warnings
• Crawl Reports
  –   Crawl Rate
  –   Crawl Latency
  –   Crawl Queue
  –   Crawl Freshness
  –   Content Processing Activity
  –   CPU and Memory Load
  –   Continuous Crawl
Debugging and Troubleshooting
      Crawl Processes
Debugging and Troubleshooting
      Crawl Processes
Debugging and Troubleshooting
      Crawl Processes
Query Debugging –
Developer Dashboard
Want to Know More About SharePoint 2013
Search?
                                    The Essential Guide
                                    to Enterprise Search
                                    in SharePoint 2013
                                    Everything You Need to Know to
                                    Get the Most Out of Search and
                                    Search-based Applications

                                    Download from
                                    www.SharePointSearch2013.com

                       This book contains 20 chapters, and more than 100 pages packed full of valuable
                                               insights. Also includes helpful call outs and screenshots.




                       Working with                                  Architecture,          Applications
             User                              Working with
                       Queries and                                   Deployment                  &
          Experience                            Content
                         Results                                     & Operations           Development
Questions?

Email:      Agnes.Molnar@BAInsight.com
Twitter:    @molnaragnes

Blog: http://aghy.hu
      http://DoMoreWithSearch.com
SPConnections - Search Administration in SharePoint 2013
SPConnections - Search Administration in SharePoint 2013
SPConnections - Search Administration in SharePoint 2013
SPConnections - Search Administration in SharePoint 2013

SPConnections - Search Administration in SharePoint 2013

  • 1.
    Search Administration in SharePoint 2013 Agnes Molnar Senior Search Solutions Consultant, SharePoint Server MVP
  • 2.
    Introduction • Senior SearchSolutions Consultant • SharePoint Server MVP • Speaker, Blogger, Community Lead http://aghy.hu http://www.DoMoreWithSearch.com Agnes.Molnar@BAInsight.com @molnaragnes
  • 3.
    Overview • Architecture • Crawling • Content Processing • Query Processing • Debugging and Troubleshooting
  • 4.
    What’s New inEnterprise Search in SP2013  Wed 14:25, Room B
  • 5.
  • 6.
    Major Changes inSearch Combination Used of FAST and pervasively SharePoint Content by throughout Continuous Search Search WCM the platform Result Sources Crawling High Query Search Scalability CSOM Result Blocks Suggestions Query Rules Refinements Search is used pervasively throughout the platform 6
  • 7.
    Search System host content http://search feed query content content indexing connectors content federate query index
  • 8.
    Search Administration isDifficult • Heterogeneous Data Models – Every system is different – Mapping to common metadata is essential for findability • Heterogeneous Security • Bandwidth and Performance – LOTS of content – Cross-site bandwidth can be expensive/limited – Source Systems can be the limiting factor
  • 9.
  • 10.
    Content Sources host http://search content feed query content indexing connectors content federate query index OOB Solutions Custom Solutions • File Share • SharePoint • Website • People Profile • Lotus Notes Custom Solutions on • Exchange Public Connector Folder Framework • Documentum
  • 11.
    Continuous Crawl Gotcha! - For SharePoint content sources only!
  • 12.
  • 13.
  • 14.
    Result Sources Scopes andFederated Search in SharePoint 2010  “Result Sources” in SP2013 • Local SharePoint Index • This farm • Remote SharePoint • Another farm • oAuth Trust • Open Search • Upgraded support for 1.1 • Exchange • Same Search • Anonymous Authentication is supported Gotcha! - You can’t interleave results from sources 14
  • 15.
    Search Schema • CrawlProperties – metadata extracted from the documents/items during the crawl • Managed Properties – created and controlled by the Search Admins – mapped to Crawled Properties – helping users perform more efficient and successful queries: • Refiners • Properties displayed in Search Results • Sorting Properties (FAST) • Property Mapping – Many-to-Many relationship between Crawled and Managed Properties
  • 16.
    Search Schema Crawled Property Managed Property Author CreatedBy Author From
  • 17.
  • 18.
    Result Types  Newframework for presenting search results to end users called Result Types  Enable each type to be rendered differently:
  • 19.
    Query Rules Query Conditions (does it meet a condition?) • Contains Words • Source • Type • Source • RegEX Query Actions (What action to perform) • Promoted Results • Best Bets • Visual Best Bets • Result Blocks • Additional Query • Query Modification • XRANK • Query Re-Write Query Publishing (When to perform this action) • Start Date • End Date 19
  • 20.
    Result Blocks Promoted Result (Visual Best Bet) Promoted Result (Best Bet) Office 365 Results Block Search Core Results 20
  • 21.
    Query Suggestions Pre-Query Suggestions Alist of items that others are typing for their queries A list of items you have clicked on before from your personal query log Post-Query Suggestions Based upon the results that you have clicked on at least twice 21
  • 22.
    Search Query Builder NewTool to help you build complex queries • Used Pervasively • Query Rules • Result Blocks • And More… • Visually build complex queries • Allows for testing queries • Refiners • Sorting 22
  • 23.
  • 24.
    More Control atthe Site Admin Level Task Site Site Admin Collection Admin Create and/or override Query Rules, including Promoted Results Create and/or override Result types and display templates Create and/or override Result Sources, either for remote locations or as a custom search “vertical” Create managed properties Create refiners Start a local crawl – can even be done down to the list level Built for the Cloud • Multi-Tenant
  • 25.
  • 26.
    Debugging and Troubleshooting Crawl Processes • Crawl Logs – Crawl time / crawl rate – Crawl errors/warnings • Crawl Reports – Crawl Rate – Crawl Latency – Crawl Queue – Crawl Freshness – Content Processing Activity – CPU and Memory Load – Continuous Crawl
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
    Want to KnowMore About SharePoint 2013 Search? The Essential Guide to Enterprise Search in SharePoint 2013 Everything You Need to Know to Get the Most Out of Search and Search-based Applications Download from www.SharePointSearch2013.com This book contains 20 chapters, and more than 100 pages packed full of valuable insights. Also includes helpful call outs and screenshots. Working with Architecture, Applications User Working with Queries and Deployment & Experience Content Results & Operations Development
  • 32.
    Questions? Email: Agnes.Molnar@BAInsight.com Twitter: @molnaragnes Blog: http://aghy.hu http://DoMoreWithSearch.com