Your SlideShare is downloading. ×
0
FAST Search Server 2010 for SharePoint: a developers walkthrough <br />MSDN Live Meeting<br />24/05/2010<br />Joris Poelma...
About Me<br />ECM Unit Manager @ RealDolmen<br />SharePoint Server MVP<br />Blog – http://jopx.blogspot.com<br />Twitter –...
Agenda<br />Introduction to FAST Search Server 2010 for developers<br />FAST Search Server 2010 – common developer tasks<b...
About Fast Search for SharePoint<br />April 2008<br />Microsoft acquires Norwegian Enterprise Search Solution Fast Search ...
Microsoft Enterprise Search - Productivity<br /><ul><li> Common UI Framework
 Social search features and integration
 SharePoint platform integration
 End user and site administrator enablement
Common Connector Framework (BDC)
 Object Model, APIs and developer XP
 Admin & deployment capabilities
 Operations advantages (SCOM, scripting)</li></ul>Common across the product line<br />
DEMO OOTB FAST Search<br />
Visual, conversational search<br />Promote / Demote Results<br />Sorting on any property<br />7<br />Scrolling PowerPoint<...
Didyouknow?<br />Thumbnail and preview feature possibletoimplementfor SharePoint Server as well – check out http://techmik...
Contextual Relevancy Tuning<br />Kevin Kennedy<br />Healthcare Sales<br />”What’s the latest product news for productivity...
FAST Search Differentiators<br />The features above and beyond SharePoint Search<br />Conversational<br />User Experience<...
Visual Best Bets</li></ul>Exploration<br /><ul><li>Deep refiners
Similarity Search
Multilevel Sorting
…on any property</li></ul>Context-Based Results<br /><ul><li>Promote/Demote
User Context </li></ul>Relevance Control<br /><ul><li>Multiple profiles
Word/Term control
Custom/Extensibility</li></ul>Property extraction <br /><ul><li>Prebuilt
Custom/Extensibility</li></ul>Content coverage<br /><ul><li>400+ document types
82 languages
Advanced Linguistics
Offensive content filter</li></ul>Extreme scale <br /><ul><li>in 3 dimensions
at best footprint</li></ul>Query Expressiveness (FQL)<br /><ul><li>Relevance and sorting
Symbol &  proximity search</li></ul>Features<br />Provide the best, most productive, user experience<br />Maximize product...
FAST Extends Capabilities of SharePoint Server<br />This is the out of the box SharePoint implementation<br />FAST builds ...
FAST Extends Capabilities of SharePoint Server<br />Content search<br />FAST Search <br />for SharePoint<br />People searc...
FAST Search for SharePoint<br />Summary of architectural elements<br />Administration and Schema Object Model<br />Content...
 Lotus Notes</li></ul>Search <br />Query and <br />Result <br />Processing<br />Query Web Service<br />Content<br />Federa...
Content Processing<br />A new level of search quality<br />Content  Processing  Pipeline<br />…<br />…<br />End Users<br /...
Content Processing CapabilitiesLeverage existing metadata, use property extraction to add structure<br />The Content Pipel...
82 languages detected
45 languages with advanced linguistics features
Spell checking & synonyms improve search experience
Unique offensive content filtering
Configurable content pipeline
Transform and process content automatically
Index over 400 document types
Property Extraction creates metadata
Upcoming SlideShare
Loading in...5
×

MSDN Live Meeting - Introduction to FAST Search Server for SharePoint Server 2010

2,858

Published on

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,858
On Slideshare
0
From Embeds
0
Number of Embeds
10
Actions
Shares
0
Downloads
62
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Elements in green are part of the Query SSA – the ones in purple are part of the Content SSAElements in blue are part of the SharePoint general infrastructureElements in purple are part of the FAST Content SSA
  • Transcript of "MSDN Live Meeting - Introduction to FAST Search Server for SharePoint Server 2010"

    1. 1. FAST Search Server 2010 for SharePoint: a developers walkthrough <br />MSDN Live Meeting<br />24/05/2010<br />Joris Poelmans, ECM Unit manager<br />
    2. 2. About Me<br />ECM Unit Manager @ RealDolmen<br />SharePoint Server MVP<br />Blog – http://jopx.blogspot.com<br />Twitter – jopxtwits <br />Co-founder BIWUG – www.biwug.be<br />Co-author<br />Real World SharePoint 2010 (November 2010, Wrox)<br />Real World SharePoint 2007 (August 2007, Wrox)<br />SharePoint 2007, The definitive guide (September 2007, O’Reilly)<br />
    3. 3. Agenda<br />Introduction to FAST Search Server 2010 for developers<br />FAST Search Server 2010 – common developer tasks<br />
    4. 4. About Fast Search for SharePoint<br />April 2008<br />Microsoft acquires Norwegian Enterprise Search Solution Fast Search & Transfer<br />Overall Vision<br />To provide a market leading enterprise search platform that integrates with your existing infrastructure<br />Leader in the Gartner Magic Quadrant around Information Access<br />Gartner MQ<br />4<br />
    5. 5. Microsoft Enterprise Search - Productivity<br /><ul><li> Common UI Framework
    6. 6. Social search features and integration
    7. 7. SharePoint platform integration
    8. 8. End user and site administrator enablement
    9. 9. Common Connector Framework (BDC)
    10. 10. Object Model, APIs and developer XP
    11. 11. Admin & deployment capabilities
    12. 12. Operations advantages (SCOM, scripting)</li></ul>Common across the product line<br />
    13. 13. DEMO OOTB FAST Search<br />
    14. 14. Visual, conversational search<br />Promote / Demote Results<br />Sorting on any property<br />7<br />Scrolling PowerPoint<br />Previews<br />Visual Best Bets<br />Thumbnails<br />Similarity Search<br />Deep refinement with counts<br />on any property<br />Extractors to generate metadata<br />
    15. 15. Didyouknow?<br />Thumbnail and preview feature possibletoimplementfor SharePoint Server as well – check out http://techmikael.blogspot.com/2011/05/document-thumbnails-and-powerpoint.html#more<br />
    16. 16. Contextual Relevancy Tuning<br />Kevin Kennedy<br />Healthcare Sales<br />”What’s the latest product news for productivity”<br />Alan Brewer<br />Financial Services Sales<br />”What’s the latest product news for productivity”<br />
    17. 17. FAST Search Differentiators<br />The features above and beyond SharePoint Search<br />Conversational<br />User Experience<br />Precise Control<br />Content Processing<br />Platform<br />Visual Cues<br /><ul><li>Thumbnails & Previews
    18. 18. Visual Best Bets</li></ul>Exploration<br /><ul><li>Deep refiners
    19. 19. Similarity Search
    20. 20. Multilevel Sorting
    21. 21. …on any property</li></ul>Context-Based Results<br /><ul><li>Promote/Demote
    22. 22. User Context </li></ul>Relevance Control<br /><ul><li>Multiple profiles
    23. 23. Word/Term control
    24. 24. Custom/Extensibility</li></ul>Property extraction <br /><ul><li>Prebuilt
    25. 25. Custom/Extensibility</li></ul>Content coverage<br /><ul><li>400+ document types
    26. 26. 82 languages
    27. 27. Advanced Linguistics
    28. 28. Offensive content filter</li></ul>Extreme scale <br /><ul><li>in 3 dimensions
    29. 29. at best footprint</li></ul>Query Expressiveness (FQL)<br /><ul><li>Relevance and sorting
    30. 30. Symbol & proximity search</li></ul>Features<br />Provide the best, most productive, user experience<br />Maximize productivity through control<br />Make the most of all your content<br />Tackle the most demanding search challenges<br />Benefit<br />
    31. 31. FAST Extends Capabilities of SharePoint Server<br />This is the out of the box SharePoint implementation<br />FAST builds on top of this<br />Content search<br />People search<br />SharePoint Server<br />End <br />Users<br />Content + <br />Profiles <br />
    32. 32. FAST Extends Capabilities of SharePoint Server<br />Content search<br />FAST Search <br />for SharePoint<br />People search<br />Unique Social Search from SharePoint Server<br />SharePoint Server<br />Common developer experience and IT Pro Foundation<br />
    33. 33. FAST Search for SharePoint<br />Summary of architectural elements<br />Administration and Schema Object Model<br />Content<br /> Processing<br />And <br />Linguistics<br />Connectors:<br />- SharePoint<br />- BDC<br />- Exchange<br />Indexing<br />FAST Search <br />Authorization<br />SharePoint <br />Front-end<br />Content<br />Content<br />Query Object Model<br />Custom <br />front-end<br />Connectors:<br />- Web Crawler<br /><ul><li> JDBC
    34. 34. Lotus Notes</li></ul>Search <br />Query and <br />Result <br />Processing<br />Query Web Service<br />Content<br />Federation <br />Object Model<br />Monitoring Services<br />OpenSearch or other Sources<br />People Search<br />
    35. 35. Content Processing<br />A new level of search quality<br />Content Processing Pipeline<br />…<br />…<br />End Users<br />Format<br />Conversion<br />Lemmatization<br />Language<br />Detection<br />EntityExtraction<br />Mapper<br />OpenSearch Source<br />Content<br />Content Processor<br />Crawler<br />Indexer<br />Query Processor<br />Federation<br />Index Partition<br />Search Center <br />Profiles<br />Metadata<br />Relevance<br />Control<br />User<br />Context<br />Indexing<br />Connectivity<br />
    36. 36. Content Processing CapabilitiesLeverage existing metadata, use property extraction to add structure<br />The Content Pipeline<br />Processing & refinement<br /><ul><li>Strong linguistic coverage
    37. 37. 82 languages detected
    38. 38. 45 languages with advanced linguistics features
    39. 39. Spell checking & synonyms improve search experience
    40. 40. Unique offensive content filtering
    41. 41. Configurable content pipeline
    42. 42. Transform and process content automatically
    43. 43. Index over 400 document types
    44. 44. Property Extraction creates metadata
    45. 45. Prebuilt extractors: Person, Location, Company, E-mail, Date, Time
    46. 46. Generic extractors for extension</li></ul>Location<br />Amount<br />Date<br />Company<br />REDMOND, Wash., andOSLO, Norway — Jan. 8, 2008<br />Microsoft Corp. (Nasdaq “MSFT”) today announced that it will make an offer to acquire Fast Search & Transfer ASA (OSE: “FAST”), a leading provider of enterprise search solutions, through a cash tender offer for 19.00 Norwegian kroner (NOK) per share. This offer represents a 42 percent premium to the closing share priceon<br />Jan. 4, 2008 (the last trading day prior to this announcement), and values the fully diluted equity of FAST at 6.6 billion NOK (or approximately $1.2 billion U.S. ). FAST’s board of directors has unanimously recommended that its shareholders accept the offer.<br />Mapper<br />…<br />Configurable<br />Stages<br />EntityExtraction<br />Language<br />Detection<br />Format<br />Conversion<br />
    47. 47. Content Processing pipeline configuration<br />
    48. 48. The Power of FQL – FAST Query Language<br />Used to perform exact search and narrow the scope of search to a field<br />Check out – FQL Syntax reference on MSDN –<br />http://msdn.microsoft.com/en-us/library/ff394606.aspx<br />Two modes:<br />Fast Query Language (FQL)<br />FQL Simple Query Language<br />Standard web parts use the FQL simple query language<br />You cannot use FQL directly from OOB search box in SharePoint<br />
    49. 49. The Power of FQL -Full FQL Operators<br />
    50. 50. Using XRANK and FQL<br />Boost all documents that contain the name<br />Dianne<br />Tibbott<br />Boost all documents that contain the name<br />Mary<br />Baker<br />Or, in the FAST Query Language: <br />Single (documents containing either Mary, Diane or both gets a boost of 5000): Xrank(string(”performance”), or(person:string(”dianetibbott”), person:string(”mary baker”)), boost=5000)) <br />Accumulative (documents with both Mary and Diane gets a boost of 10000): Xrank(Xrank(string(”performance”), person:string(”dianetibbott”), boost=5000), person:string(”mary baker”), boost=5000) <br />
    51. 51. Result<br />Content<br />Processing<br />Search/Index<br />Query<br />External data<br />Sort results by distance from end-user location<br />(50,100)<br />Index<br />Geo specific processing<br />ABC<br />XYZ<br />Geo<br />123<br />Pos_1<br />Pos_2<br />Geo data<br />Lat<br />Lon<br />Lon<br />Lat<br />Using Location Awareness and FQLGeo-search using sortformula<br />Formula sorting allows complete control of distance calculations (standard or ‘warped’ geometries) <br />Distance(from 50,100) =(50−latitude)2+(100−longitude)2 <br /> <br />query=hotel&sortby=+[formula:sqrt(pow(50-latitude,2)+pow(100-longitude,2))]<br />
    52. 52. The Power of FQL - Toolset<br />FAST Search for SharePoint MOSS 2010 Query Tool - http://fastforsharepoint.codeplex.com/<br />FS4SP2010 Query logger - http://fs4splogger.codeplex.com/<br />
    53. 53. Demo FAST Helper Tools from Codeplex<br />
    54. 54. Agenda<br />Introduction to FAST Search Server 2010 for developers<br />FAST Search Server 2010 – common developer tasks<br />
    55. 55. Top Customization Scenarios<br /><ul><li>Add new Refinement category
    56. 56. Show results from federated location
    57. 57. Modify the look and feel of OOB end user experience
    58. 58. Enable sorting by custom metadata
    59. 59. Add visual Best Bet for upcoming sales event
    60. 60. Configure different ranking for HR vs. Engineering department</li></ul>Modify the OOB End User Experience<br /><ul><li>Create new visual elements
    61. 61. Show Location refinement on Chart/Maps
    62. 62. Show tags in tag cloud
    63. 63. Enable export results to Spread Sheet
    64. 64. Summarize Financial Information from customers in Graphs</li></li></ul><li>Top Customization Scenarios (Ctd.)<br /><ul><li>Query & Indexing Shims
    65. 65. Show email results from personal mailbox on Exchange Server through the EWS
    66. 66. Index content from custom repositories like Documentum
    67. 67. Create content processing plug-ins to create new metadata
    68. 68. Create new Search Driven Applications
    69. 69. Create new customer search experience
    70. 70. Indexing content
    71. 71. Define content for search
    72. 72. Design search experience
    73. 73. Create new Audio/Video/Image search experience</li></li></ul><li>Top Customization Scenarios (Ctd.)<br /><ul><li>Expand query terms based on synonyms defined in Term Store
    74. 74. Augment customer results with project information
    75. 75. Show popular customers/people inline with search results
    76. 76. Show people results from other sources
    77. 77. Query & Result Pipeline Plug-ins
    78. 78. create a new customer page that shows:
    79. 79. Customer Contact Details
    80. 80. Customer Project Details
    81. 81. Customer Contacts
    82. 82. Internal Experts
    83. 83. Customer related documents
    84. 84. Create a new Search Verticals</li></li></ul><li>Common development scenarios – 3 scenarios explained<br />Modify the OOB End User experience<br />Configure FAST Search webparts using additional search refiners<br />Create new visual elements<br />Create new Extend Search UI with extra webparts leveraging the SharePoint object model<br />Query & Indexing Shims<br />Create content processing plugins to create new metadata<br />
    85. 85. Common development scenarios – 3 scenarios explained<br />Modify the OOB End User experience<br />Configure FAST Search webparts using additional search refiners<br />Create new visual elements<br />Create new Extend Search UI with extra webparts leveraging the SharePoint object model<br />Query & Indexing Shims<br />Create content processing plugins to create new metadata<br />
    86. 86. Modify the OOTB end user experience<br />Adding refiners<br /> Refiners will use Managed Properties<br />Refinement webpart uses specific XML syntax see http://msdn.microsoft.com/en-us/library/ff625183.aspx<br />Important fields<br />Type: TaxonomyFilterGenerator, ManagedPropertyFilterGenerator,RankingModelFilterGenerator,CustomFilterGenerator<br />MappedProperty: defines the name of the managed property in the service application which will be used as search refiner.<br />
    87. 87. Using Location and Person search refiners<br />
    88. 88. Common development scenarios – 3 scenarios explained<br />Modify the OOB End User experience<br />Configure FAST Search webparts using additional search refiners<br />Create new visual elements<br />Create new Extend Search UI with extra webparts leveraging the SharePoint object model<br />Query & Indexing Shims<br />Create content processing plugins to create new metadata<br />
    89. 89. Extend Search UI using SharedQueryManager class<br />All search web parts use SharedQueryManager class<br />One shared instance of the SharedQueryManager per search page<br />At least one search results web part needs to be on the page <br />Use SharedQueryManager to access other classes of the Federation Object Model<br />SharedQueryManager.GetInstance(this.Page).QueryManager<br />
    90. 90. Build a Search result Driven Tag Cloud webpart using fast document vectors<br />
    91. 91. Common development scenarios – 3 scenarios explained<br />Modify the OOB End User experience<br />Configure FAST Search webparts using additional search refiners<br />Create new visual elements<br />Create new Extend Search UI with extra webparts leveraging the SharePoint object model<br />Query & Indexing Shims<br />Create content processing plugins to create new metadata<br />
    92. 92. Content Pipeline Stages<br />Default<br />Optional (sleeper stages)<br />Format Conversion<br />iFilters, OutSideIn<br />Language and encoding detection<br />Lemmatizer<br /> Linguistics normalization<br />Tokenizer<br /> Word breaking<br />Entity Extraction<br /> Companies, locations<br />DateTimeNormalizer<br /> Date normalization<br />Vectorizer<br /> Create document vector for similarity searching<br />WebAnalyzer<br /> Anchor text and link cardinality analysis<br />PropertiesMapper<br /> Map to crawled properties<br />PropertiesReporter<br /> Report detected properties<br />XML Properties mapper<br />Offensive Content Filter<br />Verbatim (wholeword) extractor<br />Loads dictionary for custom extraction, e.g product names<br />Field Collapsing<br />Entity Extraction<br />Persons<br />…<br />…<br />Format<br />Conversion<br />Lemmatization<br />Language<br />Detection<br />EntityExtraction<br />Mapper<br /> The different plug-ins can either be configured from UI or from config files<br /> Extensibility options to add custom processing modules / 3rd party SW<br />
    93. 93. Creating content processing plugins to create new metadata<br />Extending the content processing pipeline<br />Configure entity extraction (companies, people, location)<br />Standard property extractors available in FAST for Location, Company and Person<br />Person property extractor – default not enabled – modify optionalprocessing.xml<br />Whole word extraction<br />Add custom property extractors using code<br />
    94. 94. Pipeline Extensibility API<br />Motivation<br />Straightforward way to add text analysis functionality<br />Flexibility and supportability<br />Example uses<br />Sentiment analysis<br />Translation<br />Auto-Classification<br />Mechanism<br />Just before Mapper<br />“any” binary<br />Runs in sandbox with timeout<br />Mapper<br />Extensibility<br />…<br />Standard processing<br />
    95. 95. Whole word extractionSentiment analysis using Custom property Extractor<br />
    96. 96. Summary<br />FAST provides building blocks for search applications such as:<br />Research portals for R&D teams<br />Call center portals with 360° view on customer<br />Employee self service using social search and conversational search<br />...<br />
    97. 97. Resources<br />
    98. 98. Recommended Resources<br />FAST Search Top Blogs:<br />On the Search - http://blogs.msdn.com/b/arnts/<br />Microsoft Enterprise Search Blog - http://blogs.msdn.com/b/enterprisesearch/<br />Search Unleashed - http://searchunleashed.wordpress.com<br />Tech and Me (Mikael Svenson) - http://techmikael.blogspot.com/<br />Knut Brandrud - http://blogs.msdn.com/b/knutbran/<br />
    99. 99. Recommended Resources (Ctd)<br />SharePoint Server 2010 Virtual Labs (incl. FAST) - http://msdn.microsoft.com/en-us/cc707678.aspx<br />SPS 2010 IW Trial Virtual Image (incl. FAST) - http://www.microsoft.com/downloads/en/details.aspx?FamilyID=751fa0d1-356c-4002-9c60-d539896c66ce&displaylang=en<br />TechNet Survival Guide – FAST Search Server 2010 for SharePoint http://social.technet.microsoft.com/wiki/contents/articles/2149.aspx<br />
    100. 100. Thank you<br />
    101. 101. Stay up to date with MSDN Belux<br />Register for our newsletters and stay up to date:http://www.msdn-newsletters.be<br />Technical updates<br />Event announcements and registration<br />Top downloads<br />Follow our bloghttp://blogs.msdn.com/belux<br />Join us on Facebookhttp://www.facebook.com/msdnbehttp://www.facebook.com/msdnbelux<br />LinkedIn: http://linkd.in/msdnbelux/<br />Twitter: @msdnbelux<br />DownloadMSDN/TechNet Desktop Gadgethttp://bit.ly/msdntngadget<br />
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×