This document summarizes a presentation about an enterprise search implementation at EPAM. It discusses deploying connectors to integrate over 100 systems, tuning the relevancy model through query logs and user feedback, and efforts to educate departments on search best practices like basic SEO. Manual tuning techniques included authoritative pages, query rules, synonyms, and the new Query Builder tool in SharePoint 2013.

1. Enterprise Search
• Best Practices
• Connector Framework
• Relevancy overview
Sharepoint User Group
2013, March 26, Minsk
Confidential 1

2. EPAM has more than 100
systems
knowledgebase.epam.com trainings.epam.co
???????
HR file shares
Information.epam.com
XXX.epam.com
Bla.bla.bla.epam.co
YYY.epam.com Jira.epam.com
Confidential 2

3. Confidential 3

4. Little homework
Confidential 4

5. We started POC in September 2012
Confidential 5

6. Available as search.epam.com in November 2012
• Sharepoint 2010
• FAST Search for Sharepoint
• Branded Search Center
• Custom connectors
• Fine-tuned relevance to reflect EPAM
landscape
Confidential 6

7. Confidential 7

9. We become stronger every day…
• 550 000 searchable
items
• 30+ content sources
• 400+ daily searches
• Exposed to internet
Confidential 9

10. … to help you search
Confidential 10

11. What we’ve learned
1. Deploy “painkiller” project as soon as possible
2. Connect as much systems as possible (Cap O. speaking)
3. Analyze
• Watch search logs
• Connect external analytics
• Speak with users
• Feedback forms sucks
4. Tune relevancy
• hot-fix using bugs using best-bets
5. Work with departments to adopt their content
• Basic SEO
Confidential 12

12. Search Connectors in SP2010/2013
Search Connectors
Protocol Handers BCS
Lotus
File Share Exchange Custom BCS
Notes
SharePoint Database
WebSite WebService
People .NET

13. BCS Connectors in SP 2010/2013
Stereotyped Operations
• Get IDs
• Get By ID
• Describe Security
• Read Stream

14. EPAM Data Import Framework
Tree DescribeTree() • Altassian Confluence
ISource Node DownloadData(Node) • SVN
• PMC
Workflow
1. Source to build tree
IImporter 2. Destination to build tree
3. Diff trees
4. Destination to import diff (add, remove) Timer Job
Tree DescribeTree() • SharePoint Library
IDestination void Import(Tree) • File System

15. BCS vs DataImport Comparison
Data Import BCS
Effort to build the same
+ +
Document Previews
+ -
Indexing Speed
+ +/-
Customizable
+ -
Storage Space
- +
Unit Testing
+ +/-
Incremental crawl
+ +/-

16. RELEVANCY

17. Search is a two step process
0. User submits query
1. Get candidates: all docs that match query
2. Predict relevancy
• Query terms importance
• Proximity of query terms
• Hit location (mp) importance
• Freshness
• Clicks
• User rating
•…
Confidential 18

18. Relevancy in FAST Search
• Linear combination of features
• RankProfile
• Weights are configured via Powershell
• Easy to understand via RankLog
• Easy tuning
– Content Source
– Managed Property
Confidential 19

19. RankLog example (QueryLogger @codeplex)
Confidential 20

20. Relevancy in Sharepoint
Confidential

21. Relevancy in Sharepoint
• Nonlinear combination of features. Two Neural Networks.
• Ranking Model Schema described
• http://www.google.com/patents/US8296292
• http://www.google.com/patents/US7840569
• Cmdlets to import/export
• Default Ranking Model Features:
Type Instance
BM25 BM25
Static UrlDepth
BucketedStatic InternalFileType
BucketedStatic Language
Static ClickDistance
Static QueryLogClicks
Static QueryLogSkips
Static LastClicks
Static EventRate
MinSpan - soft Title
MinSpan - soft Title
MinSpan - soft Title
MinSpan - soft Content
Confidential 22

22. ExplainRank page
• Google for “explain rank sharepoint”
• Parses RankDetail managed Property
Confidential 23

23. Ranking Model Tuning
Confidential 24

24. Ranking Model Tuning
Approach described by Microsoft
– http://msdn.microsoft.com/en-us/library/bb499682(v=office.12).aspx
1. Collect Query Judgements
2. Use Machine Learning to train Neural Network
• namespace Microsoft.Office.Server.Search.RankerTuning
• Wait for tuning tool
Confidential 25

25. Query Judgment framework
Confidential 26

26. Manual relevancy tuning in Sharepoint
• Authoritative Pages
• QueryRules
– Best Bets
– Understanding User Intent
• Synonyms (cmdlets)
• Entity Extractors
• Spelling Corrections
• Query Suggestions
• ManagedMetadata
• (!) Query Builder
Confidential 27

27. Manual relevancy tuning in Sharepoint
28

28. Manual relevancy tuning in Sharepoint
29

29. SP 2013 REST Query tool
• http://sp2013searchtool.codeplex.com/
Confidential 30

30. Alexey Kozhemiakin
Solution Architect, Enterprise Search
Confidential
31