Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

MSDN Live Meeting - Introduction to FAST Search Server for SharePoint Server 2010

3,342 views

Published on

Published in: Technology
  • Be the first to comment

MSDN Live Meeting - Introduction to FAST Search Server for SharePoint Server 2010

  1. 1. FAST Search Server 2010 for SharePoint: a developers walkthrough <br />MSDN Live Meeting<br />24/05/2010<br />Joris Poelmans, ECM Unit manager<br />
  2. 2. About Me<br />ECM Unit Manager @ RealDolmen<br />SharePoint Server MVP<br />Blog – http://jopx.blogspot.com<br />Twitter – jopxtwits <br />Co-founder BIWUG – www.biwug.be<br />Co-author<br />Real World SharePoint 2010 (November 2010, Wrox)<br />Real World SharePoint 2007 (August 2007, Wrox)<br />SharePoint 2007, The definitive guide (September 2007, O’Reilly)<br />
  3. 3. Agenda<br />Introduction to FAST Search Server 2010 for developers<br />FAST Search Server 2010 – common developer tasks<br />
  4. 4. About Fast Search for SharePoint<br />April 2008<br />Microsoft acquires Norwegian Enterprise Search Solution Fast Search & Transfer<br />Overall Vision<br />To provide a market leading enterprise search platform that integrates with your existing infrastructure<br />Leader in the Gartner Magic Quadrant around Information Access<br />Gartner MQ<br />4<br />
  5. 5. Microsoft Enterprise Search - Productivity<br /><ul><li> Common UI Framework
  6. 6. Social search features and integration
  7. 7. SharePoint platform integration
  8. 8. End user and site administrator enablement
  9. 9. Common Connector Framework (BDC)
  10. 10. Object Model, APIs and developer XP
  11. 11. Admin & deployment capabilities
  12. 12. Operations advantages (SCOM, scripting)</li></ul>Common across the product line<br />
  13. 13. DEMO OOTB FAST Search<br />
  14. 14. Visual, conversational search<br />Promote / Demote Results<br />Sorting on any property<br />7<br />Scrolling PowerPoint<br />Previews<br />Visual Best Bets<br />Thumbnails<br />Similarity Search<br />Deep refinement with counts<br />on any property<br />Extractors to generate metadata<br />
  15. 15. Didyouknow?<br />Thumbnail and preview feature possibletoimplementfor SharePoint Server as well – check out http://techmikael.blogspot.com/2011/05/document-thumbnails-and-powerpoint.html#more<br />
  16. 16. Contextual Relevancy Tuning<br />Kevin Kennedy<br />Healthcare Sales<br />”What’s the latest product news for productivity”<br />Alan Brewer<br />Financial Services Sales<br />”What’s the latest product news for productivity”<br />
  17. 17. FAST Search Differentiators<br />The features above and beyond SharePoint Search<br />Conversational<br />User Experience<br />Precise Control<br />Content Processing<br />Platform<br />Visual Cues<br /><ul><li>Thumbnails & Previews
  18. 18. Visual Best Bets</li></ul>Exploration<br /><ul><li>Deep refiners
  19. 19. Similarity Search
  20. 20. Multilevel Sorting
  21. 21. …on any property</li></ul>Context-Based Results<br /><ul><li>Promote/Demote
  22. 22. User Context </li></ul>Relevance Control<br /><ul><li>Multiple profiles
  23. 23. Word/Term control
  24. 24. Custom/Extensibility</li></ul>Property extraction <br /><ul><li>Prebuilt
  25. 25. Custom/Extensibility</li></ul>Content coverage<br /><ul><li>400+ document types
  26. 26. 82 languages
  27. 27. Advanced Linguistics
  28. 28. Offensive content filter</li></ul>Extreme scale <br /><ul><li>in 3 dimensions
  29. 29. at best footprint</li></ul>Query Expressiveness (FQL)<br /><ul><li>Relevance and sorting
  30. 30. Symbol & proximity search</li></ul>Features<br />Provide the best, most productive, user experience<br />Maximize productivity through control<br />Make the most of all your content<br />Tackle the most demanding search challenges<br />Benefit<br />
  31. 31. FAST Extends Capabilities of SharePoint Server<br />This is the out of the box SharePoint implementation<br />FAST builds on top of this<br />Content search<br />People search<br />SharePoint Server<br />End <br />Users<br />Content + <br />Profiles <br />
  32. 32. FAST Extends Capabilities of SharePoint Server<br />Content search<br />FAST Search <br />for SharePoint<br />People search<br />Unique Social Search from SharePoint Server<br />SharePoint Server<br />Common developer experience and IT Pro Foundation<br />
  33. 33. FAST Search for SharePoint<br />Summary of architectural elements<br />Administration and Schema Object Model<br />Content<br /> Processing<br />And <br />Linguistics<br />Connectors:<br />- SharePoint<br />- BDC<br />- Exchange<br />Indexing<br />FAST Search <br />Authorization<br />SharePoint <br />Front-end<br />Content<br />Content<br />Query Object Model<br />Custom <br />front-end<br />Connectors:<br />- Web Crawler<br /><ul><li> JDBC
  34. 34. Lotus Notes</li></ul>Search <br />Query and <br />Result <br />Processing<br />Query Web Service<br />Content<br />Federation <br />Object Model<br />Monitoring Services<br />OpenSearch or other Sources<br />People Search<br />
  35. 35. Content Processing<br />A new level of search quality<br />Content Processing Pipeline<br />…<br />…<br />End Users<br />Format<br />Conversion<br />Lemmatization<br />Language<br />Detection<br />EntityExtraction<br />Mapper<br />OpenSearch Source<br />Content<br />Content Processor<br />Crawler<br />Indexer<br />Query Processor<br />Federation<br />Index Partition<br />Search Center <br />Profiles<br />Metadata<br />Relevance<br />Control<br />User<br />Context<br />Indexing<br />Connectivity<br />
  36. 36. Content Processing CapabilitiesLeverage existing metadata, use property extraction to add structure<br />The Content Pipeline<br />Processing & refinement<br /><ul><li>Strong linguistic coverage
  37. 37. 82 languages detected
  38. 38. 45 languages with advanced linguistics features
  39. 39. Spell checking & synonyms improve search experience
  40. 40. Unique offensive content filtering
  41. 41. Configurable content pipeline
  42. 42. Transform and process content automatically
  43. 43. Index over 400 document types
  44. 44. Property Extraction creates metadata
  45. 45. Prebuilt extractors: Person, Location, Company, E-mail, Date, Time
  46. 46. Generic extractors for extension</li></ul>Location<br />Amount<br />Date<br />Company<br />REDMOND, Wash., andOSLO, Norway — Jan. 8, 2008<br />Microsoft Corp. (Nasdaq “MSFT”) today announced that it will make an offer to acquire Fast Search & Transfer ASA (OSE: “FAST”), a leading provider of enterprise search solutions, through a cash tender offer for 19.00 Norwegian kroner (NOK) per share. This offer represents a 42 percent premium to the closing share priceon<br />Jan. 4, 2008 (the last trading day prior to this announcement), and values the fully diluted equity of FAST at 6.6 billion NOK (or approximately $1.2 billion U.S. ). FAST’s board of directors has unanimously recommended that its shareholders accept the offer.<br />Mapper<br />…<br />Configurable<br />Stages<br />EntityExtraction<br />Language<br />Detection<br />Format<br />Conversion<br />
  47. 47. Content Processing pipeline configuration<br />
  48. 48. The Power of FQL – FAST Query Language<br />Used to perform exact search and narrow the scope of search to a field<br />Check out – FQL Syntax reference on MSDN –<br />http://msdn.microsoft.com/en-us/library/ff394606.aspx<br />Two modes:<br />Fast Query Language (FQL)<br />FQL Simple Query Language<br />Standard web parts use the FQL simple query language<br />You cannot use FQL directly from OOB search box in SharePoint<br />
  49. 49. The Power of FQL -Full FQL Operators<br />
  50. 50. Using XRANK and FQL<br />Boost all documents that contain the name<br />Dianne<br />Tibbott<br />Boost all documents that contain the name<br />Mary<br />Baker<br />Or, in the FAST Query Language: <br />Single (documents containing either Mary, Diane or both gets a boost of 5000): Xrank(string(”performance”), or(person:string(”dianetibbott”), person:string(”mary baker”)), boost=5000)) <br />Accumulative (documents with both Mary and Diane gets a boost of 10000): Xrank(Xrank(string(”performance”), person:string(”dianetibbott”), boost=5000), person:string(”mary baker”), boost=5000) <br />
  51. 51. Result<br />Content<br />Processing<br />Search/Index<br />Query<br />External data<br />Sort results by distance from end-user location<br />(50,100)<br />Index<br />Geo specific processing<br />ABC<br />XYZ<br />Geo<br />123<br />Pos_1<br />Pos_2<br />Geo data<br />Lat<br />Lon<br />Lon<br />Lat<br />Using Location Awareness and FQLGeo-search using sortformula<br />Formula sorting allows complete control of distance calculations (standard or ‘warped’ geometries) <br />Distance(from 50,100) =(50−latitude)2+(100−longitude)2 <br /> <br />query=hotel&sortby=+[formula:sqrt(pow(50-latitude,2)+pow(100-longitude,2))]<br />
  52. 52. The Power of FQL - Toolset<br />FAST Search for SharePoint MOSS 2010 Query Tool - http://fastforsharepoint.codeplex.com/<br />FS4SP2010 Query logger - http://fs4splogger.codeplex.com/<br />
  53. 53. Demo FAST Helper Tools from Codeplex<br />
  54. 54. Agenda<br />Introduction to FAST Search Server 2010 for developers<br />FAST Search Server 2010 – common developer tasks<br />
  55. 55. Top Customization Scenarios<br /><ul><li>Add new Refinement category
  56. 56. Show results from federated location
  57. 57. Modify the look and feel of OOB end user experience
  58. 58. Enable sorting by custom metadata
  59. 59. Add visual Best Bet for upcoming sales event
  60. 60. Configure different ranking for HR vs. Engineering department</li></ul>Modify the OOB End User Experience<br /><ul><li>Create new visual elements
  61. 61. Show Location refinement on Chart/Maps
  62. 62. Show tags in tag cloud
  63. 63. Enable export results to Spread Sheet
  64. 64. Summarize Financial Information from customers in Graphs</li></li></ul><li>Top Customization Scenarios (Ctd.)<br /><ul><li>Query & Indexing Shims
  65. 65. Show email results from personal mailbox on Exchange Server through the EWS
  66. 66. Index content from custom repositories like Documentum
  67. 67. Create content processing plug-ins to create new metadata
  68. 68. Create new Search Driven Applications
  69. 69. Create new customer search experience
  70. 70. Indexing content
  71. 71. Define content for search
  72. 72. Design search experience
  73. 73. Create new Audio/Video/Image search experience</li></li></ul><li>Top Customization Scenarios (Ctd.)<br /><ul><li>Expand query terms based on synonyms defined in Term Store
  74. 74. Augment customer results with project information
  75. 75. Show popular customers/people inline with search results
  76. 76. Show people results from other sources
  77. 77. Query & Result Pipeline Plug-ins
  78. 78. create a new customer page that shows:
  79. 79. Customer Contact Details
  80. 80. Customer Project Details
  81. 81. Customer Contacts
  82. 82. Internal Experts
  83. 83. Customer related documents
  84. 84. Create a new Search Verticals</li></li></ul><li>Common development scenarios – 3 scenarios explained<br />Modify the OOB End User experience<br />Configure FAST Search webparts using additional search refiners<br />Create new visual elements<br />Create new Extend Search UI with extra webparts leveraging the SharePoint object model<br />Query & Indexing Shims<br />Create content processing plugins to create new metadata<br />
  85. 85. Common development scenarios – 3 scenarios explained<br />Modify the OOB End User experience<br />Configure FAST Search webparts using additional search refiners<br />Create new visual elements<br />Create new Extend Search UI with extra webparts leveraging the SharePoint object model<br />Query & Indexing Shims<br />Create content processing plugins to create new metadata<br />
  86. 86. Modify the OOTB end user experience<br />Adding refiners<br /> Refiners will use Managed Properties<br />Refinement webpart uses specific XML syntax see http://msdn.microsoft.com/en-us/library/ff625183.aspx<br />Important fields<br />Type: TaxonomyFilterGenerator, ManagedPropertyFilterGenerator,RankingModelFilterGenerator,CustomFilterGenerator<br />MappedProperty: defines the name of the managed property in the service application which will be used as search refiner.<br />
  87. 87. Using Location and Person search refiners<br />
  88. 88. Common development scenarios – 3 scenarios explained<br />Modify the OOB End User experience<br />Configure FAST Search webparts using additional search refiners<br />Create new visual elements<br />Create new Extend Search UI with extra webparts leveraging the SharePoint object model<br />Query & Indexing Shims<br />Create content processing plugins to create new metadata<br />
  89. 89. Extend Search UI using SharedQueryManager class<br />All search web parts use SharedQueryManager class<br />One shared instance of the SharedQueryManager per search page<br />At least one search results web part needs to be on the page <br />Use SharedQueryManager to access other classes of the Federation Object Model<br />SharedQueryManager.GetInstance(this.Page).QueryManager<br />
  90. 90. Build a Search result Driven Tag Cloud webpart using fast document vectors<br />
  91. 91. Common development scenarios – 3 scenarios explained<br />Modify the OOB End User experience<br />Configure FAST Search webparts using additional search refiners<br />Create new visual elements<br />Create new Extend Search UI with extra webparts leveraging the SharePoint object model<br />Query & Indexing Shims<br />Create content processing plugins to create new metadata<br />
  92. 92. Content Pipeline Stages<br />Default<br />Optional (sleeper stages)<br />Format Conversion<br />iFilters, OutSideIn<br />Language and encoding detection<br />Lemmatizer<br /> Linguistics normalization<br />Tokenizer<br /> Word breaking<br />Entity Extraction<br /> Companies, locations<br />DateTimeNormalizer<br /> Date normalization<br />Vectorizer<br /> Create document vector for similarity searching<br />WebAnalyzer<br /> Anchor text and link cardinality analysis<br />PropertiesMapper<br /> Map to crawled properties<br />PropertiesReporter<br /> Report detected properties<br />XML Properties mapper<br />Offensive Content Filter<br />Verbatim (wholeword) extractor<br />Loads dictionary for custom extraction, e.g product names<br />Field Collapsing<br />Entity Extraction<br />Persons<br />…<br />…<br />Format<br />Conversion<br />Lemmatization<br />Language<br />Detection<br />EntityExtraction<br />Mapper<br /> The different plug-ins can either be configured from UI or from config files<br /> Extensibility options to add custom processing modules / 3rd party SW<br />
  93. 93. Creating content processing plugins to create new metadata<br />Extending the content processing pipeline<br />Configure entity extraction (companies, people, location)<br />Standard property extractors available in FAST for Location, Company and Person<br />Person property extractor – default not enabled – modify optionalprocessing.xml<br />Whole word extraction<br />Add custom property extractors using code<br />
  94. 94. Pipeline Extensibility API<br />Motivation<br />Straightforward way to add text analysis functionality<br />Flexibility and supportability<br />Example uses<br />Sentiment analysis<br />Translation<br />Auto-Classification<br />Mechanism<br />Just before Mapper<br />“any” binary<br />Runs in sandbox with timeout<br />Mapper<br />Extensibility<br />…<br />Standard processing<br />
  95. 95. Whole word extractionSentiment analysis using Custom property Extractor<br />
  96. 96. Summary<br />FAST provides building blocks for search applications such as:<br />Research portals for R&D teams<br />Call center portals with 360° view on customer<br />Employee self service using social search and conversational search<br />...<br />
  97. 97. Resources<br />
  98. 98. Recommended Resources<br />FAST Search Top Blogs:<br />On the Search - http://blogs.msdn.com/b/arnts/<br />Microsoft Enterprise Search Blog - http://blogs.msdn.com/b/enterprisesearch/<br />Search Unleashed - http://searchunleashed.wordpress.com<br />Tech and Me (Mikael Svenson) - http://techmikael.blogspot.com/<br />Knut Brandrud - http://blogs.msdn.com/b/knutbran/<br />
  99. 99. Recommended Resources (Ctd)<br />SharePoint Server 2010 Virtual Labs (incl. FAST) - http://msdn.microsoft.com/en-us/cc707678.aspx<br />SPS 2010 IW Trial Virtual Image (incl. FAST) - http://www.microsoft.com/downloads/en/details.aspx?FamilyID=751fa0d1-356c-4002-9c60-d539896c66ce&displaylang=en<br />TechNet Survival Guide – FAST Search Server 2010 for SharePoint http://social.technet.microsoft.com/wiki/contents/articles/2149.aspx<br />
  100. 100. Thank you<br />
  101. 101. Stay up to date with MSDN Belux<br />Register for our newsletters and stay up to date:http://www.msdn-newsletters.be<br />Technical updates<br />Event announcements and registration<br />Top downloads<br />Follow our bloghttp://blogs.msdn.com/belux<br />Join us on Facebookhttp://www.facebook.com/msdnbehttp://www.facebook.com/msdnbelux<br />LinkedIn: http://linkd.in/msdnbelux/<br />Twitter: @msdnbelux<br />DownloadMSDN/TechNet Desktop Gadgethttp://bit.ly/msdntngadget<br />

×