Enterprise Search in SharePoint 2010


Published on

Overview of what's new in Enterprise Search for SharePoint 2010

Published in: Technology
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • This diagram illustrates the differences between how the service models work in SharePoint 2007 and SharePoint 2010. As was described in previous slides, in SharePoint 2007 you essentially consumed all or nothing from a Shared Service Provider (SSP). That’s what is displayed in the diagram on the left.In the diagram on the right, we see multiple Service Applications. They are not bound together by an SSP, so they can be consumed independently of any Service Applications. In this example, HRWEB is consuming multiple Service Applications, but not all of them. ITWEB is only consuming a few Service Applications. There are a couple of Service Applications, USER PROFILES and WAC, that are being consumed by both web applications.
  • Enterprise Search in SharePoint 2010

    1. 1. Enterprise Search in SharePoint 2010<br />Bob GermanTechnology ArchitectMicrosoft Technology Center | Boston<br />
    2. 2. Agenda<br />SharePoint Search Options<br />SharePoint Search Engine<br />FAST for SharePoint<br />Social Search<br />Content Acquisition<br />Federation<br />
    3. 3. You Asked, We Listened!<br />Scale – content and query scale becomes a non-issue<br />User experience –guide users with rich, visual navigation<br />Social and people search – search unlocks the value of the people and expertise<br />Relevance –improving our matching and ranking capabilities and language support<br />Platform –tools to customize, extend, or build new applications. <br />Management & reliability –reliable crawling, scriptable admin, improved monitoring.<br />Rich Content Processing–extract metadata from my enterprise content<br />
    4. 4. A Family of Search Solutions<br />Quick, easy, powerful search (for free!)<br />Complete intranet search<br />High-end search delivered through SharePoint <br />Family Values <br /><ul><li>Common UI Framework
    5. 5. Social search features and integration
    6. 6. SharePoint platform integration
    7. 7. End user and site administrator enablement
    8. 8. Common Connector Framework (BDC)
    9. 9. APIs and developer experience
    10. 10. Admin & deployment capabilities
    11. 11. Operations advantages (SCOM, scripting)</li></li></ul><li>FAST Search Extends SharePoint Server<br />Superset of capabilities; common base functionality and platform<br />Best High-End Content Search based on FAST ESP<br />FAST Search <br />for SharePoint<br />Common connectors and content APIs<br />Common query and federation APIs<br />End <br />Users<br />Content+ <br />Profiles <br />Unique Social Search from SharePoint Server<br />SharePoint Search<br />Queries<br />Common developer experience <br />and IT Pro Foundation<br />People<br />Content<br />
    12. 12. SharePoint Search Engine<br />What’s new in 2010?<br />
    13. 13. SharePoint 2010 Shared Service Applications<br />SSP<br />Search<br />UserProfiles<br />Excel Calc<br />UserProfiles<br />Search<br />HRBusinessData<br />Visio <br />Excel Calc<br />BusinessData<br />OfficeWeb Apps<br />3rd party Service<br />IT Search<br />http://itweb/<br />http://hrweb/<br />http://hrweb/<br />http://itweb/<br />Corp Farm<br />Corp Farm<br />SharePoint 2007 Model<br />SharePoint 2010 Model<br />
    14. 14. SharePoint Search SA<br />Each Search Service Application (SSA):<br />Administration component , database<br />Query Topology<br />Query Components (1+)<br />Property Databases (1+)<br />Crawl Topology<br />Crawl Components (1+)<br />Crawl Databases (1+)<br />Services (Query, Admin)<br />
    15. 15. Default Search Configuration<br />Out of the Box:<br />1 Admin component<br />1 Crawl component<br />1 Query component<br />Databases on drive specified in post-setup configuration<br />Fully functional:<br />Crawl content<br />Develop customizations<br />Query<br />Crawl<br />Admin<br />Property DB<br />Crawl DB<br />Admin DB<br />(other SharePoint DBs)<br />
    16. 16. Component Scale-out<br />Query<br />Q2<br />Q1<br />Q2<br />Q1<br />Q6<br />Q5<br />Q4<br />Q3<br />Query:<br />Segregate<br />Partition for scale<br />Passive mirrors provide failover<br />Active mirrors increase throughput<br />Crawl <br />Additional crawl components<br />Crawl Database<br />Q2<br />Q1<br />Q1<br />Q2<br />Q5<br />Q6<br />Q3<br />Q4<br />Query<br />Crawl<br />Crawl<br />Admin<br />Crawl<br />Crawl<br />100 million items!<br />Property DB<br />Crawl DB<br />Crawl DB<br />Admin DB<br />Crawl DB<br />Admin DB<br />
    17. 17. Manageability – Monitor Crawl<br />“Levels” of reports<br />Current rate<br />Crawl rate per type<br />Crawl processing<br />Filter by SSA, time<br />Optimize crawl resources to achieve freshness goals.<br />
    18. 18. Manageability – Monitor Query<br />“Levels” of reports<br />Current rate<br />Overall Query Latency<br />Detailed Backend Query Latency<br />Optimize query latency<br />Enable verbosequery latency, trend<br />
    19. 19. FAST Search Engine<br />High-end Search for SharePoint<br />
    20. 20. Go Beyond the Search Box<br />Visual, Conversational Search<br />Sorting on any property<br />Scrolling PowerPoint<br />Previews<br />Visual Best Bets<br />Thumbnails<br />Refinement with counts<br />on any property<br />Similarity Search<br />
    21. 21. FAST for SharePointArchitecture<br />Users <br />SearchCenter <br />ContentConnectors<br /><ul><li>SharePoint
    22. 22. FAST
    23. 23. CCF</li></ul>SharePointAPI’s<br />Document<br />Processing<br />Indexing<br />Search<br />Query &Result<br />Administration<br />FAST Search Engine Shared with SharePoint Search Engine<br />
    24. 24. Content Pipeline<br />Advanced Content Processing Out-of-the-Box<br />Processing & refinement<br />Configurable content processing pipeline<br />Transform and process content automatically<br />Strong linguistic coverage<br />80+ languages detected<br />45 languages with advanced linguistics features<br />Property Extraction to create new metadata<br />Prebuilt extractors: Person, Location, Company<br />Generic extractors to extend<br />Extensibility<br />Location<br />Company<br />Company<br />Company<br />REDMOND, Wash., andOSLO, Norway — Jan. 8, 2008<br />Microsoft Corp. (Nasdaq “MSFT”) today announced that it will make an offer to acquire Fast Search & Transfer ASA (OSE: “FAST”), a leading provider of enterprise search solutions, through a cash tender offer for 19.00 Norwegian kroner (NOK) per share. This offer represents a 42 percent premium to the closing share price on Jan. 4, 2008 (the last trading day prior to this announcement), and values the fully diluted equity of FAST at 6.6 billion NOK (or approximately $1.2 billion U.S. ). FAST’s board of directors has unanimously recommended that its shareholders accept the offer.<br />Mapper<br />…<br />Configurable<br />Stages<br />EntityExtraction<br />Language<br />Detection<br />Format<br />Conversion<br />
    25. 25. Enable Conversational Search<br />Deep Refiners with Exact Counts<br />Search results can be refined based on:<br /><ul><li>Metadata from SharePoint (such as Author)
    26. 26. Enriched meta data based on entity extraction (such as Company)</li></ul>Custom refiners can be made by:<br /><ul><li>Enabling new Managed Properties to be used as refiners
    27. 27. Configuring the Refinement Web Part to display the new refiner</li></li></ul><li>User Context Matters<br />Renee Lo, Engineer<br />What should I know about implementing ERP?<br />Alan Brewer, Sales<br />What should I know about selling ERP consulting?<br />
    28. 28. Large Scale Deployment<br />Add columns to extend document capacity<br />Add rows to extend query capacity or fault tolerance<br />Column 0<br />1<br />2<br />3<br />Indexer/Search<br />Indexer/Search<br />Indexer/Search<br />Indexer/Search<br />Row 0<br />Row 1<br />Indexer/Search<br />Indexer/Search<br />Indexer/Search<br />Indexer/Search<br />
    29. 29. Social Search<br />
    30. 30. Go Behind the Search Box<br />Connect with People and Expertise<br />Vanity search<br />Recently authored content<br />Phonetic and nickname matching<br />Improved result layout and hit-highlighting<br />Sort by relevance, name or social distance<br />Refine by query type, and many other pivots<br />
    31. 31. Leveraging the Managed Metadata Service for better People Search<br />Out of box:<br />Responsibilities, Interest, Skills, Schools, are all taxonomy properties<br />Automatic refinement on relevant pivots<br />Extensibility<br />Adding a new taxonomy property to the profile store<br />
    32. 32. Click through improves relevance <br />The wisdom of the masses helps the masses<br />Documents are boosted by ‘popularity’: if many users find a document useful, it must be useful. <br />
    33. 33. Search suggestions<br />Helping users form better queries<br />Pre-query suggestions<br />Post-query suggestions<br />
    34. 34. Social tags<br />Recall<br />Results with social tags are returned.<br />Ranking<br />Results with social tags are boosted.<br />Refinement<br />Users can filter results on social tags.<br />Results<br />Top social tags are displayed as metadata on each result.<br />
    35. 35. Content Acquisition<br />Feeding the Search Engines<br />
    36. 36. Making Content Searchable<br />Use Query Federation<br />Query across external indexes<br />Based on OpenSearch standard(http://www.opensearch.org/)<br />Use Indexing Connectors<br />Crawl, enumerate and create local index of content<br />Use out-of-box connectors or write custom connector<br />
    37. 37. Shared Out-of-box Indexing Connectors in SharePoint 2010<br />SharePoint content (Protocol Handler - PH)<br />File shares (PH)<br />Web sites (PH)<br />People profiles (PH)<br />Lotus Notes™ (Connector Framework - CF)<br />Exchange public folders (CF)<br />External systems(CF)<br />Documentum™ content (CF)<br />
    38. 38. Fast Search out-of-box Connectors<br />Enterprise crawler<br />Good for large scale crawling across multiple nodes<br />Supports dynamic data including JavaScript<br />JDBC™ connector<br />Simple configuration using SQL commands<br />Supports push based crawling<br />Supports change detection through checksums<br />
    39. 39. SharePoint Connector<br />Accesses data through SharePoint web service (using Windows credentials)<br />Supports full crawl through enumeration of content and incremental crawl through change log<br />Built-in support for security trimming (Windows and pluggable)<br />
    40. 40. Connector Framework<br />Easy to build<br />Write managed code instead of PH interface<br />Built connectors shared across SharePoint Search and FAST search<br />‘No-code’ solution for Databases and Web Services<br />Easy to manage<br />Use existing user interfaces for crawl configuration<br />Faster iteration on connectivity using SharePoint Designer (SPD)<br />Shared advantages across SharePoint<br />Can use other BCS features such as external lists<br />
    41. 41. Search page points to Profile Page or custom page to show search result<br />Search results page – results based on metadata<br />Connector Framework Architecture<br />Search user queries<br />Search Engine/Index<br />BCSProfile Pages or External Lists<br />Search BCS Runtime<br />Execution call routing through BCS<br />Connectors using BCS model file<br />Fetch data from repository<br />WCF<br />Databases<br />.NET BCSConnector<br />Custom BCSConnector<br />Protocol Handlers<br />
    42. 42. Enabling Connectivity<br />Every indexing connector needs<br />A BDC model file to express connection information and the structure of the backend<br />A BDC Connector for code to execute when accessing the backend<br />Out-of-box BDC Connectors<br />Database<br />WCF (Web Services)<br />.NET (custom code)<br />
    43. 43. Federation<br />Combining Search Results<br />
    44. 44. Eliminate Compromise<br />Easily Connect to Corporate Assets that live Outside of SharePoint<br />Files<br />OpenSearch Federation<br />Web<br />Databases<br />SharePoint<br />Easy to Connect<br />Easy to Build<br />Exchange Server<br />Enterprise Content Mgmt Systems<br />Line of Business Apps<br />Custom Apps<br />Asset Mgmt systems<br />Documentum<br />Indexing Connectors<br />Lotus Notes<br />…<br />
    45. 45. “Out of the Box” Federation<br />People Search and Related Searches<br />Bing and other OpenSearch providers<br />Windows 7 and IE8 searching SharePoint 2010<br />Rich RSS feeds and federation generator<br />
    46. 46. How OpenSearch federation works<br />HTTP request<br />Search Client<br />Search Provider<br />RSS/Atom Results<br />HTTP request with query in the URL:<br />http://www.site.com/srchrss.aspx?q={searchTerms}<br />RSS / Atom results:<br />RSS results with <title>, <link>, <description><br />Best sources also include: <pubdate>, <author>, <category>, <media:thumbnail><br />Optionally include custom metadata: <recordid>, <projectname>, <contactnumber><br />
    47. 47. Deploying a federation connectorUse or create a searchable feed<br />Search Client<br />OpenSearchPage<br />Search Provider<br />Use an existing searchable feed or create your own.<br />Anything searchable– takes a query as a URL parameter.<br />Must return results in RSS or Atom formatted XML.<br />Creating a searchable feed is simple. Just code a basic ASPX page.<br />
    48. 48. Make Search Pervasive!Deploy OpenSearch (OSDX files) Everywhere<br />SharePoint 2010:<br />Import the file. <br />Add it to a Search Center.<br />Windows 7:<br />Pull: Add a link to the OSDX file on the search center or team site.<br />Push: Deploy the OSDX file via Group Policy.<br />IE8<br />Link to Search Provider<br />Discoverable Search Provider<br />
    49. 49. Extend and Create Search Web Parts<br />The OOB Web Parts are no longer sealed!<br />
    50. 50. Microsoft Enterprise Search - Productivity<br />Products for Every Search Need<br />
    51. 51. FAST Search for SharePoint and ESP<br />A new choice; a different world<br />Bringing high-end search to the mainstream market<br />
    52. 52. © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.<br />The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.<br />
    53. 53.
    54. 54. End User perspective<br />Go Beyond the Search Box<br />
    55. 55. IT Pro perspective<br />Eliminate Compromise<br />
    56. 56. Do More with Search<br />Developer Perspective<br />
    57. 57. Search Technology Concepts<br />Concepts <br />Search Center - UI for users to issue queries and interact with results<br />Federated Source<br />Query Object Model<br />Query Servers- Accept query requests from users and return results<br />Index Files<br />Query Servers<br />Query Federation - Return results from non-SharePoint Indexes<br />Indexing - Extract information from items to enable efficient matching<br />Indexer<br />Index Partition - Subset of the overall index<br />Crawling - Traverse URL space to record items in search catalog<br />Crawler<br />Indexing Connectors - Know how to process different content sources<br />Content Sources - Host the content we want to return in main results<br />Content<br />Content<br />Content<br />