Roberto MasieroADP Innovation Labs
2011 –ADP #872011 - Rank #720102010 & 2011PINNACLE AWARDS 2011Global Outsourcing ServicesProvider of the YearADP #6Financi...
ADP Innovation Labs
ADP Innovation Labs
Research and Incubation…9Current Major Research AreasPersonalCloudBig Data/ Analytics& SearchGlobalSORMobilitySocialPlatfo...
1010© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.10
National EmploymentAnalytics11  Insights to US economicactivity  500,000+ companies  Several dimensions  ‘Large’ Data + R©...
Innovation: ADP Intelligence & Analytics© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.12  User Frien...
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.13Behavioral Intelligence•  Using BigData to create an...
141414© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.14
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: The RequirementsEnterprise Search...
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic SearchHIRE = task/verbJOHN Doe= object/no...
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: The StackDataIndexQueryUserMetaDa...
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: The Flow
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: Simple APIsGET /v1_0/search/warmu...
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: SOLR Out-of-the-box vs Custom Fea...
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.User Experience: Changing our Mental ModelStart Here
© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.User Experience: The Design Conversation has two aspec...
“The most profound technologies arethose that disappear. They weavethemselves into the fabric of everydaylife until they a...
Semantic search in the cloud
Semantic search in the cloud
Semantic search in the cloud
Semantic search in the cloud
Upcoming SlideShare
Loading in …5
×

Semantic search in the cloud

1,185 views
1,005 views

Published on

Presented by Roberto Masiero, Vice President ADP Innovation Lab, ADP

In this presentation we will cover ADP's Semantic Search strategy and implementation. From the use cases to the design to support semantic searches on a vast set of data, to crawling data from hundreds of data sources. We will also cover our architecture to scale the search service on a multi-tenant SaaS environment.

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,185
On SlideShare
0
From Embeds
0
Number of Embeds
442
Actions
Shares
0
Downloads
26
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Semantic search in the cloud

  1. 1. Roberto MasieroADP Innovation Labs
  2. 2. 2011 –ADP #872011 - Rank #720102010 & 2011PINNACLE AWARDS 2011Global Outsourcing ServicesProvider of the YearADP #6FinancialDataServicesRank #2  >300,000 SaaS clients  >18 Million users  81 countries & expanding  Widest breadth of HCM solutions  BPO/Service offerings extend reachbeyond traditional SaaSADP is the Largest Global SaaS Provider ofCloud-based Enterprise Software2
  3. 3. ADP Innovation Labs
  4. 4. ADP Innovation Labs
  5. 5. Research and Incubation…9Current Major Research AreasPersonalCloudBig Data/ Analytics& SearchGlobalSORMobilitySocialPlatform© Copyright 2012 ADP, Inc. Proprietary Information.
  6. 6. 1010© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.10
  7. 7. National EmploymentAnalytics11  Insights to US economicactivity  500,000+ companies  Several dimensions  ‘Large’ Data + R© Copyright 2013 ADP, Inc. Proprietary Information.
  8. 8. Innovation: ADP Intelligence & Analytics© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.12  User Friendly Analytics  Embedded andContextualized Content  Benchmarks byIndustry/Location
  9. 9. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.13Behavioral Intelligence•  Using BigData to create an unparalleleduser experience•  Driving performance using in-memory data•  3Vs (Volume, Velocity and Variety)U i Bi D t t tPayroll – Heat map time sliceBigData - allow us to learn from dataimpressions(map)al Int(reduce)ggMary will probably check her Payroll and 401ktoday at 9:10AMPre-Cache (in-memory) payStatements andretirementPlan objects
  10. 10. 141414© Copyright 2013 ADP, Inc. Proprietary and Confidential Information.14
  11. 11. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: The RequirementsEnterprise Search GoalsSearch as a service across multiple ADP products and clientsSearch as the primary navigation toolSemantic Search: verbs and nounsKey Search Architecture ElementsMulti-TenancyMulti-DatacenterLarge # of sourcesSearch High-AvailabilityCrawling and Indexing HADisaster Recovery (Active-Active)Key Functional Design ElementsInstant Search across all object typesPartial text and phrase matchHighlightingFaceting by document typesQuery suggestionsUser’s click historyAccess control
  12. 12. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic SearchHIRE = task/verbJOHN Doe= object/nounapplies toCANDIDATE objectis there a candidate named John Doe?invoke action ONBOARDJOHN DOEJust ask the appA new navigation paradigmFoundation for voice commandSimpler/Faster algorithm than NLPSearch objects (nouns) and tasks (verbs) to create (actions)User behavior feeds taxonomy/relevance on both positive and negative searches
  13. 13. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: The StackDataIndexQueryUserMetaDataUsing Lucene/Solr as search indexfor both data and meta data
  14. 14. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: The Flow
  15. 15. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: Simple APIsGET /v1_0/search/warmupHeader: Realm, Org OID, Associate OID, LocaleParams: NoneResult: Language-specific labels JSON GET /v1_0/searchHeader: Realm, Org OID, Associate OID, LocaleParams: q=<query text>, groupValue=<Document type to filter on>Result: Search Results if q is non-empty. Click history if q is empty. POST /v1_0/search/clicks/{canonicalURI}Header: Realm, Org OID, Associate OID, LocaleResult: Status OK (200)
  16. 16. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search: SOLR Out-of-the-box vs Custom FeaturesOut-of-the-Box •  Text search using invertedindex•  REST APIs w/ JSONOutput•  Track query execution time•  Fuzzy search using Ngramsand Phonetics•  Result Grouping andFaceting •  Result highlighting•  Indexed vs. Stored fields•  Multi-lingual Search (UTF-8) Custom Features•  Multi-tenancy (enforced via predicates)•  Access Control (enforced viapredicates)•  Instant Search (regular search from Solrviewpoint)•  Dynamic relevance (via custompredicates built in Proxy)•  Synonym enrichment (via meta index)•  Smart actions via Task-Object mapping(via meta •  Index)•  Semantic Search (via custompredicates built in Proxy)•  Click-history based personalized resultboosting (via custom predicates basedon captured clicks)
  17. 17. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.ADP Semantic Search
  18. 18. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.User Experience: Changing our Mental ModelStart Here
  19. 19. © Copyright 2013 ADP, Inc. Proprietary and Confidential Information.User Experience: The Design Conversation has two aspectsIntuitiveComplexInsecurityConfidenceOverlySimplisticSpecialistsRequiredNotUser-friendlyEngaging
  20. 20. “The most profound technologies arethose that disappear. They weavethemselves into the fabric of everydaylife until they are indistinguishable.”- Mark Weiser@masieror

×