Darío Garigliotti, profile picture
Uploaded byDarío Garigliotti
PDF, PPTX60 views

Task-Based Support in Search Engines

The document explores task-based support in search engines, focusing on entity retrieval and user intent identification. It discusses the importance of structured knowledge, type-aware entity retrieval, and methods for identifying target entity types to improve search efficiency. Additionally, it presents approaches for generating query suggestions and building a knowledge base to enhance user experience during complex search tasks.

Science◦
Related topics:
Information Retrieval•

Embed presentation

Download as PDF, PPTX
1 / 141
2 / 141
3 / 141
4 / 141
5 / 141
6 / 141
7 / 141
8 / 141
9 / 141
10 / 141
11 / 141
12 / 141
13 / 141
14 / 141
15 / 141
16 / 141
17 / 141
18 / 141
19 / 141
20 / 141
21 / 141
22 / 141
23 / 141
24 / 141
25 / 141
26 / 141
27 / 141
28 / 141
29 / 141
30 / 141
31 / 141
32 / 141
33 / 141
34 / 141
35 / 141
36 / 141
37 / 141
38 / 141
39 / 141
40 / 141
41 / 141
42 / 141
43 / 141
44 / 141
45 / 141
46 / 141
47 / 141
48 / 141
49 / 141
50 / 141
51 / 141
52 / 141
53 / 141
54 / 141
55 / 141
56 / 141
57 / 141
58 / 141
59 / 141
60 / 141
61 / 141
62 / 141
63 / 141
64 / 141
65 / 141
66 / 141
67 / 141
68 / 141
69 / 141
70 / 141
71 / 141
72 / 141
73 / 141
74 / 141
75 / 141
76 / 141
77 / 141
78 / 141
79 / 141
80 / 141
81 / 141
82 / 141
83 / 141
84 / 141
85 / 141
86 / 141
87 / 141
88 / 141
89 / 141
90 / 141
91 / 141
92 / 141
93 / 141
94 / 141
95 / 141
96 / 141
97 / 141
98 / 141
99 / 141
100 / 141
101 / 141
102 / 141
103 / 141
104 / 141
105 / 141
106 / 141
107 / 141
108 / 141
109 / 141
110 / 141
111 / 141
112 / 141
113 / 141
114 / 141
115 / 141
116 / 141
117 / 141
118 / 141
119 / 141
120 / 141
121 / 141
122 / 141
123 / 141
124 / 141
125 / 141
126 / 141
127 / 141
128 / 141
129 / 141
130 / 141
131 / 141
132 / 141
133 / 141
134 / 141
135 / 141
136 / 141
137 / 141
138 / 141
139 / 141
140 / 141
141 / 141
Task-Based Support in Search Engines Darío Garigliotti University of Stavanger, Norway
Outline • Motivation • Type-Aware Entity Retrieval • Target Entity Type Identification • Entity-Oriented Search Intents • Task-Based Query Suggestions • Task Recommendations • Conclusions and Future Directions 2
Motivation
Motivation • Today's web search experience aims to understand the user query 4
Motivation • Today's web search experience aims to understand the user query 5
Motivation • Today's web search experience aims to understand the user query 6
Motivation • Today's web search experience aims to understand the user query • A way to organize information is via structured knowledge centered around entities • Large knowledge repositories and knowledge bases have become available 7
Motivation 8
Motivation 9
Motivation 10
Motivation 11
• Underlying search goal is often a complex and knowledge-intensive task Motivation 12
Motivation 13
Motivation 14
• Underlying search goal is often a complex and knowledge-intensive task • For example, to plan a travel - How to get there? - Where to stay? - What to do? • Task completion would provide support for the user when accomplishing complex search tasks Motivation 15
Roadmap Type-Aware Entity Retrieval Task-Based Search Entity-Oriented Search Intents 16
Type-Aware Entity Retrieval
An example • Searching for wedding cakes cake shops Konditoriet i Sandnes Olja's Kake Boutique Baker Corner Lura 18
An example • Searching for wedding cakes wedding cake shops Stavanger Conditori Olja's Kake Boutique Gjestalveien Conditori 19
• Entity retrieval is the task of obtaining a ranked list of entities relevant to a search query • We investigate the utilization of entity type information for entity retrieval Entity Retrieval 20
… Shop … …… Company Organization … Stavanger Conditori Bank Law Firm … Entity types • A characteristic property of entities is that they are typed • Types are organized in hierarchies (or taxonomies) 21
… Shop … …… Company Organization … cake shopscake shops Bank Law Firm … • Target types: types of entities sought by the query Target entity types 22
Type-aware Entity Retrieval • Type information is known to improve entity retrieval • Yet it is a multifaceted problem query entity wedding cake shops target types Stavanger Conditori term-based similarity type-based similarity … … entity types 23
How can entity type information be utilized in ad-hoc entity retrieval? 24
• We assume oracle-given type information Type-aware Entity Retrieval … Shop … …… Company Organization … cake shopscake shops Bank Law Firm … 25
• We assume oracle-given type information • We identify dimensions in utilizing entity type information - Type taxonomy - Type representation - Retrieval model Type-aware Entity Retrieval 26
• Which type taxonomy to use? - DBpedia Ontology (7 levels, 600 types) - Freebase Types (2 levels, 2K types) - Wikipedia Categories (34 levels, 600K types) - YAGO Taxonomy (19 levels, 500K types) • These vary a lot in terms of hierarchical structure and in how entity-type assignments are recorded Type-aware Entity Retrieval 27
• How to represent the hierarchical information? Type-aware Entity Retrieval 28
• How to use type information into entity retrieval? • Retrieval task is defined in a generative probabilistic framework P(q | e) • Both query and entity are considered in the term space as well as in the type space Type-aware Entity Retrieval 29
• (Strict) Filtering model Type-aware Entity Retrieval 30
• (Soft) Filtering model Type-aware Entity Retrieval 31
• Interpolation model Type-aware Entity Retrieval 32
• We assume oracle-given type information • We conduct an evaluation of dimensions in utilizing entity type information - Type taxonomy - Type representation - Retrieval model • We use a strong text-based baseline • We test with the DBpedia Entity collection v2 Type-aware Entity Retrieval 33
• Wikipedia, in combination with the most specific type representation, performs best • Hierarchical relationships from ancestor types improve retrieval effectiveness, but most specific types provide the best performance • Results regarding most effective type-aware retrieval model vary across configurations Type-aware Entity Retrieval 34
Roadmap Type-Aware Entity Retrieval Utilizing Entity Type Information 35
Target Entity Type Identification
Target Type Identification • "We assume oracle-given type information" 37
Target Type Identification • "We assume oracle-given type information" 38
Target Type Identification • "We assume oracle-given type information" - How to identify target entity types? - How do these target types automatically identified perform for type-aware entity retrieval? 39
How can we automatically identify target entity types? 40
Target Type Identification • We revisit the task of hierarchical target type identification • Task: to find the main target types of a query, from a type taxonomy, such that these are the most specific category of entities that are relevant to the query. If no matching type can be found in the taxonomy then the query is assigned a special NIL-type 41
Target Type Identification • We develop a Learning-to-Rank approach • We evaluate it using a purpose-built test collection 42
Target Type Identification 43 • Our method combines baseline, knowledge base, and type label features
• We also conduct an evaluation utilizing, rather than a target types oracle, target entity types automatically identified 44 Automatic types for Entity Retrieval
Automatic types for Entity Retrieval 45
We identify and evaluate dimensions in utilizing target entity type information for ad-hoc entity retrieval. We build a test collection for target entity type identification, and develop and evaluate a Learning-to-Rank approach for this problem. SUMMARY 46
Roadmap Type-Aware Entity Retrieval Utilizing Entity Type Information Identifying Target Entity Type Information 47
Entity-Oriented Search Intents
Entity-Oriented Search Intents • Intent: the underlying user need in a entity- oriented search query - For example, the intent of booking a hotel room • Refiner: a way to express an intent in an entity-oriented query - For example, for booking a hotel room: "booking", "book", "reservation", "rooms" 49
• Searching about a fashion designer An example 50
vivienne westwood age An example 51
vivienne westwood age An example 78 years April 8, 1941 52
vivienne westwood age An example 78 years April 8, 1941 53
An example 54
vivienne westwood instagram An example 55
vivienne westwood instagram An example instagram.com/viviennewestwood/ 56
vivienne westwood instagram An example instagram.com/viviennewestwood/ 57
An example 58
vivienne westwood customer care An example 59
vivienne westwood customer care An example 60
What do entity-oriented queries ask for, and how can they be fulfilled? 61
<fashion designer> instagram Understanding entity- oriented search intents • We obtain a collection of type-level query patterns stella mccartney instagram vivienne westwood instagram 62
Understanding entity- oriented search intents • We obtain a collection of type-level query patterns • Pick a Freebase type if it covers 100+ prominent entities • Get query suggestions for top 1000- entities per type • For each query, replace entity by type • Aggregate all frequencies for each (type, refiner) pair • Filter out all type-level refiners with frequency of 4- • Select 50 representative types by stratified sampling 63
Understanding entity- oriented search intents • We define a scheme of intent categories 64
Understanding entity- oriented search intents • We define a scheme of intent categories Website 65
Understanding entity- oriented search intents • We define a scheme of intent categories PropertyWebsite 66
Understanding entity- oriented search intents • We define a scheme of intent categories PropertyWebsite Service 67
Understanding entity- oriented search intents • We define a scheme of intent categories PropertyWebsite Service Other68
Understanding entity- oriented search intents • We define a scheme of intent categories - Website, Property, Service, Other => Website => Property => Service vivienne westwood age vivienne westwood instagram vivienne westwood customer care 69
Understanding entity- oriented search intents • We annotate 2.3K+ unique type-level refiners with intent category via crowdsourcing • We observe the proportions of refiners in each category Property: 28.6% Service: 54.06% Website: 5.34% Other: 12.08% 70
Understanding entity- oriented search intents 71 organization business operation chemical compound film location event food hotel disease restaurant travel destination 0 50 100 150 200 250 university house person newspaper airport basketball player album professional sports team game artwork 0 50 100 150 200 railway human language tv station political party amusement park exhibition venue chef programming language academic institution netflix genre 0 20 40 60 80 100 120 war currency blogger hobby football match sports championship star muscle olympic sport company 0 10 20 30 40 50 WroSicaO cycOone kingdoP PedicaO sSeciaOWy coPic book SubOisher oiO fieOd Wower beer counWry region eOecWion asWeroid beOief 0 10 20 30 40 50 3roSerWy WebsiWe Service 2Wher
We propose a scheme of entity-oriented search intent categories. We annotate a collection of query refiners using the scheme, and observe that there is a large proportion of service-oriented intents. SUMMARY 72
Roadmap Type-Aware Entity Retrieval Entity-Oriented Search Intents Utilizing Entity Type Information Identifying Target Entity Type Information Understanding Entity- Oriented Search Intents 73
How can we build a knowledge base of entity-oriented search intents? 74
1. Intents searched for a type of entities paris map, sydney map => [city] map 2. Categories assigned to refiners vivienne westwood instagram => Website vivienne westwood age => Property vivienne westwood customer care => Service 3. Multiple refiners expressing an intent "booking", "book", "make a reservation", "rooms" 75 A knowledge base of entity- oriented search intents
1. Intents searched for a type of entities paris map, sydney map => [city] map • (intent ID, searchedForType, entity type, confidence) 2. Categories assigned to refiners vivienne westwood instagram => Website vivienne westwood age => Property vivienne westwood customer care => Service 3. Multiple refiners expressing an intent "booking", "book", "make a reservation", "rooms" 76 A knowledge base of entity- oriented search intents
1. Intents searched for a type of entities paris map, sydney map => [city] map • (intent ID, searchedForType, entity type, confidence) 2. Categories assigned to refiners vivienne westwood instagram => Website vivienne westwood age => Property vivienne westwood customer care => Service • (intent ID, ofCategory, intent category, confidence) 3. Multiple refiners expressing an intent "booking", "book", "make a reservation", "rooms" 77 A knowledge base of entity- oriented search intents
1. Intents searched for a type of entities paris map, sydney map => [city] map • (intent ID, searchedForType, entity type, confidence) 2. Categories assigned to refiners vivienne westwood instagram => Website vivienne westwood age => Property vivienne westwood customer care => Service • (intent ID, ofCategory, intent category, confidence) 3. Multiple refiners expressing an intent "booking", "book", "make a reservation", "rooms" • (intent ID, expressedBy, refiner, confidence) A knowledge base of entity- oriented search intents 78
Approach Refiners acquisition Refiners categorization Intents discovery [hotel] airport [hotel] spa [hotel] booking ... [hotel] airport: Service [hotel] address: Property [hotel] expedia: Website ... taxi arrive Hotel_Arrivingbooking make a reservation Hotel_Booking address Hotel_Address KB construction Intent ID Predicate Object Confidence Hotel_Booking searchedForType [hotel] c1 Hotel_Booking ofCategory Service c2 Hotel_Booking expressedBy "booking" c3 Hotel_Booking expressedBy "make a reservation" c4 Hotel_Booking expressedBy "rooms" c5 79
Approach Refiners acquisition Refiners categorization Intents discovery [hotel] airport [hotel] spa [hotel] booking ... [hotel] airport: Service [hotel] address: Property [hotel] expedia: Website ... taxi arrive Hotel_Arrivingbooking make a reservation Hotel_Booking address Hotel_Address Intent profile { KB construction Intent ID Predicate Object Confidence Hotel_Booking searchedForType [hotel] c1 Hotel_Booking ofCategory Service c2 Hotel_Booking expressedBy "booking" c3 Hotel_Booking expressedBy "make a reservation" c4 Hotel_Booking expressedBy "rooms" c5 80
Knowledge base construction • Application of the pipeline to extract all quadruples from 581 unseen types • 155K quadruples, 31K intent profiles - Excerpt of the KB, for intent ID <aviation.airline-65-customer_service> 81
Experimental evaluation • Experts judge correctness, ignoring confidence, of around 1.29% of IntentsKB 82 [0, 0.87) [0.87, 0.88) [0.88, 0.9) [0.9, 0.93) [0.93, 1] Confidence intervals according to the splitting percentiles 0% 20% 40% 60% 80% 100% Proportionoftriples 6,337 6,370 6,335 6,368 6,314 Correct Incorrect, OFCATEGORY Incorrect, EXPRESSEDBY
We design and build a knowledge base of entity- oriented search intents. We evaluate each component in our approach, as well as the correctness of the obtained knowledge base. SUMMARY 83
Roadmap Type-Aware Entity Retrieval Entity-Oriented Search Intents Utilizing Entity Type Information Identifying Target Entity Type Information Understanding Entity- Oriented Search Intents Modeling Entity- Oriented Search Intents 84
Task-Based Query Suggestions
An example • Planning your wedding 86
An example 87
low wedding budget An example 88
Cheap wedding cake low wedding budget An example 89
Cheap wedding cake Make your own invitations low wedding budget An example 90
An example Cheap wedding cake Make your own invitations Buy a used wedding gown low wedding budget 91
Cheap wedding cake Make your own invitations Buy a used wedding gown low wedding budget An example 92
Cheap wedding cake Make your own invitations Buy a used wedding gownExcerpt from TREC Tasks test dataset low wedding budget 1 low budget wedding dresses 0 low wedding budget cars 1 find a gown ... 0 wedding flowers 1 cup cake wedding 1 wedding cakes ... 2 wedding invitation 1 find wedding invitation templates 0 designer dresses wedding ... An example 93
Cheap wedding cake Make your own invitations Buy a used wedding gownExcerpt from TREC Tasks test dataset } low wedding budget 1 low budget wedding dresses 0 low wedding budget cars 1 find a gown ... 0 wedding flowers 1 cup cake wedding 1 wedding cakes ... 2 wedding invitation 1 find wedding invitation templates 0 designer dresses wedding ... An example 94
Cheap wedding cake Make your own invitations Buy a used wedding gownExcerpt from TREC Tasks test dataset } } low wedding budget 1 low budget wedding dresses 0 low wedding budget cars 1 find a gown ... 0 wedding flowers 1 cup cake wedding 1 wedding cakes ... 2 wedding invitation 1 find wedding invitation templates 0 designer dresses wedding ... An example 95
An example Cheap wedding cake Make your own invitations Buy a used wedding gownExcerpt from TREC Tasks test dataset } } } low wedding budget 1 low budget wedding dresses 0 low wedding budget cars 1 find a gown ... 0 wedding flowers 1 cup cake wedding 1 wedding cakes ... 2 wedding invitation 1 find wedding invitation templates 0 designer dresses wedding ... 96
How can we generate query suggestions for supporting task-based search? 97
• Given an initial query, Suggesting queries to support task-based search wedding cake wedding cake gallery wedding cake recipes wedding cake flavors 98
• Given an initial query, to get a ranked list of query suggestions that cover all the possible subtasks related to the task that the user is trying to achieve. Suggesting queries to support task-based search wedding cake wedding cake gallery wedding cake recipes wedding cake flavors 99
• Given an initial query, to get a ranked list of query suggestions that cover all the possible subtasks related to the task that the user is trying to achieve. Suggesting queries to support task-based search wedding cake wedding cake gallery wedding cake recipes wedding cake flavors • This is the task understanding problem 100
Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model • We exploit different information sources 101
Suggesting queries to support task-based search 102 Web snippets Web documents
Suggesting queries to support task-based search 103 Query suggestions from search engines
Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model 104
• Components: q0 Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model 105
• Components: • Source importance q0 API SUGGS. WEB SNIPPETS WEB DOCS. WH Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model 106
• Components: • Source importance • Document importance q0 API SUGGS. WEB SNIPPETS WEB DOCS. WH Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model 107
• Components: • Source importance • Document importance • Keyphrase relevance q0 Keyphrases API SUGGS. WEB SNIPPETS WEB DOCS. WH Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model 108
• Components: • Source importance • Document importance • Keyphrase relevance • Query suggestion • We propose an end-to-end generative probabilistic model Query suggestions q0 Keyphrases API SUGGS. WEB SNIPPETS WEB DOCS. WH Suggesting queries to support task-based search 109
• We make use of the 2015 and 2016 TREC Tasks track datasets for the task understanding problem • We conduct a principled estimation of the components, and analyze the best performing estimators per component Suggesting queries to support task-based search 110
Suggesting queries to support task-based search 111 • We observe a heavy reliance on query suggestions from suggestion APIs
Generating suggestion candidates Query completion Query refinement wedding cake wedding cake gallery wedding cake recipes wedding cake flavors wedding cake beautiful wedding cakes unique wedding cake designs simple wedding cake • Two query suggestion modes 112
• How to jointly generate query suggestions in query completion and refinement modes? - Can we do it without relying on log data / API? • We consider a two-step pipeline: - Candidate generation - Candidate ranking • And focus on the first component Generating suggestion candidates 113
• We study alternative generation methods and information sources - Methods: popular suffix, neural language, sequence- to-sequence - Sources: AOL query log, KnowHow, WikiAnswers • We build a test collection of query suggestion candidates Generating suggestion candidates 114
• End-to-end is still the best method overall, but limited as it depends on API suggestions • Log data is the most useful information source, but the other sources provide valuable suggestions too • Different method-source configurations contribute unique suggestions in both modes Generating suggestion candidates 115
We propose and evaluate a generative probabilistic model for task-based query suggestions. We further study alternative methods and information sources for suggestion candidate generation, and build a test collection. SUMMARY 116
Roadmap Type-Aware Entity Retrieval Task-Based Search Entity-Oriented Search Intents Utilizing Entity Type Information Identifying Target Entity Type Information Understanding Entity- Oriented Search Intents Modeling Entity- Oriented Search Intents Suggesting Queries 117
Task Recommendation
Task Recommendation • The underlying search goal is often a complex and knowledge-intensive task • We propose to recommend specific tasks to users, based on their search queries 119
An example • Planning a wedding reception wedding reception Plan a wedding reception Recommended Tasks: Plan your wedding reception exit Announce the bridal party at a reception Throw a Hawaiian wedding reception Choose wedding reception activities 120
How can we recommend tasks based on search queries and missions? 121
Task Recommendation • Some terminology: - Task repository: a catalog of task descriptions - Task description: a semi-structured document that explains the steps involved in how to complete a given task - Search mission: a set of queries that all share the same underlying task 122
Task Recommendation • We introduce two problems: 1. Query-based task recommendation Given a query, to return a ranked list of tasks that correspond to the task behind the query 2. Mission-based task recommendation Given a search mission, to return a ranked list of recommended tasks, corresponding to the queries in the mission 123
Task Recommendation • We use a collection of WikiHow articles as our task repository 124 How to Make a Wedding Cake Co-authored by wikiHow Staff ✔ You can make a wedding cake for a customer if you bake for a living, or you might make a cake for loved one’s wedding to help them save money. If you love to bake, then you might even want to make your own wedding cake! Steps 1 Decide on the number and shape of the cake’s layers. Consider how many layers and what shape you want the cake to have. 2 Preheat the oven to the temperature indicated by your recipe. Many recipes call for the oven to be pre-heated to 350 °F (177 °C). 3 Prepare the cake batter according to your recipe’s instructions. Choose a recipe to create the cake batter for your cake. 4 Pour the batter into a greased, parchment-lined cake pan. Spray your cake pan with non-stick cooking spray. Explanation Main Act Detailed Act Title
Task Recommendation • We focus on a subset of tasks, the procedural tasks • Procedural task: a search task that can be accomplished by following a sequence of specific actions or subtasks 125
Task Recommendation • From a corpus of search queries and missions, we obtain a set of procedural search missions 126
Task Recommendation • We build a test collection for task recommendation 127
Query-based task recommendation • We propose a Learning-to-Rank method for query-based task recommendation, that combines a text-based ranking technique with continuous semantic representations • We experiment with different word embeddings and word function sets according to POS-tag 128
129 Query-based task recommendation
130 Query-based task recommendation
• To address mission-based task recommendation, we propose methods that aggregate the individual query-based recommendations for each query into mission- level recommended tasks 131 Mission-based task recommendation
132 Mission-based task recommendation
We introduce the problems of query-based and mission-based task recommendation. We develop a test collection for task recommendation, and propose and evaluate approaches for these problems. SUMMARY 133
Roadmap Type-Aware Entity Retrieval Task-Based Search Entity-Oriented Search Intents Utilizing Entity Type Information Identifying Target Entity Type Information Understanding Entity- Oriented Search Intents Modeling Entity- Oriented Search Intents Suggesting Queries Recommending Tasks 134
Conclusions and Future Directions
Conclusions 136 wedding cake Stavanger Conditori Olja's Kake Boutique Gjestalveien Conditori Cake shops > Wedding cake shops Recommended tasks Make a Chocolate Cake Basic Chocolate Cake Moist & Fluffy Chocolate Cake Bake an Easy Applesauce Cake See ingredients See steps Address: Gjesdalveien 27, 4306 Sandnes Hours Today: 9AM-5PM Address: Godesetdalen 10, 4034 Stavanger CALL CALL CALL Decorate a Cake Working with Fondant Adding Quick Decorations Queries suggested for wedding cake wedding cake recipes for beginners best wedding cake recipes wedding cake recipes video chocolate wedding cake recipes homemade wedding cake recipes from scratch
Conclusions 137 wedding cake Stavanger Conditori Olja's Kake Boutique Gjestalveien Conditori Cake shops > Wedding cake shops Recommended tasks Make a Chocolate Cake Basic Chocolate Cake Moist & Fluffy Chocolate Cake Bake an Easy Applesauce Cake See ingredients See steps Address: Gjesdalveien 27, 4306 Sandnes Hours Today: 9AM-5PM Address: Godesetdalen 10, 4034 Stavanger CALL CALL CALL Decorate a Cake Working with Fondant Adding Quick Decorations Queries suggested for wedding cake wedding cake recipes for beginners best wedding cake recipes wedding cake recipes video chocolate wedding cake recipes homemade wedding cake recipes from scratch Type-Aware Entity Retrieval Entity-Oriented Search Intents Task-Based Query Suggestions Task Recommendations
138 Future Directions
Future Directions 139 wedding venue Det Stavangerske Klubselskab 120,000 NOK RESERVE Olavskleivå 26 Time: Date: 19:00 Saturday June 27, 2020 Number of guests: 50-100 Outdoors? Number of cars: Up to 20 Parking?✔ Rosenkildehuset AS Strandkaien 6 Strømvik allotments Strømvikveien 1 120,000 NOK RESERVE 105,000 NOK RESERVE Input parameters in service intents
Future Directions Semantics-aware query suggestions Mission-based task recommendation 140 invitation cards Make Homemade Wedding Cards Print Your Own Wedding Invitations Include a Dress Code on a Wedding Invitation Queries suggested for invitation cards invitation card online invitation card maker free invitation cards for whatsapp see-through invitation card create invitation card with photo free Recommended tasks
Thank you!

More Related Content

PDF
A Semantic Search Approach to Task-Completion Engines
byDarío Garigliotti
 
PDF
Task-Based Information Retrieval
byDarío Garigliotti
 
PDF
Type-Aware Entity Retrieval
byDarío Garigliotti
 
PDF
Entity Retrieval (WWW 2013 tutorial)
bykrisztianbalog
 
PDF
A Knowledge Base of Entity-Oriented Search Intents
byDarío Garigliotti
 
PDF
Type-Aware Entity Retrieval
byDarío Garigliotti
 
PDF
Type-Aware Entity Retrieval
byDarío Garigliotti
 
PDF
Personalizing Search
byCognizant
 
A Semantic Search Approach to Task-Completion Engines
byDarío Garigliotti
 
Task-Based Information Retrieval
byDarío Garigliotti
 
Type-Aware Entity Retrieval
byDarío Garigliotti
 
Entity Retrieval (WWW 2013 tutorial)
bykrisztianbalog
 
A Knowledge Base of Entity-Oriented Search Intents
byDarío Garigliotti
 
Type-Aware Entity Retrieval
byDarío Garigliotti
 
Type-Aware Entity Retrieval
byDarío Garigliotti
 
Personalizing Search
byCognizant
 

Similar to Task-Based Support in Search Engines

PDF
Entity Retrieval (SIGIR 2013 tutorial)
bykrisztianbalog
 
PDF
Multi-language Content Discovery Through Entity Driven Search: Presented by A...
byLucidworks
 
PPTX
Exploiting web search engines to search structured
byNita Pawar
 
PPTX
Understanding Queries through Entities
byPeter Mika
 
PPTX
TRank ISWC2013
byeXascale Infolab
 
PDF
Ranking in Google Since The Advent of The Knowledge Graph
byBill Slawski
 
PDF
Type-Aware Entity Retrieval
byDarío Garigliotti
 
PDF
Entity Retrieval (WSDM 2014 tutorial)
bykrisztianbalog
 
PDF
Entity Search Engine
byDRTC Indian Statistical Institute Bangalore
 
PPTX
Semtech bizsemanticsearchtutorial
byBarbara Starr
 
PDF
Line,,NATIONAL SEMINAR ORGANIZED BY KULISAA 15.01.2015
byDRTC Indian Statistical Institute Bangalore
 
PDF
Multi-language Content Discovery Through Entity Driven Search
byAlessandro Benedetti
 
PDF
ECIR-2014: Multilanguage Content Discovery Through Entity Driven Search
byAntonio David Pérez Morales
 
PDF
Content Discovery Through Entity Driven Search
byAlessandro Benedetti
 
PDF
On Type-Aware Entity Retrieval
byDarío Garigliotti
 
PDF
Entity-Centric Data Management
byeXascale Infolab
 
PPTX
Entity centric data_management_2013
byeXascale Infolab
 
PPTX
Semantic Search keynote at CORIA 2015
byPeter Mika
 
PDF
Learning-to-Rank Target Types for Entity-Bearing Queries
byDarío Garigliotti
 
PPTX
Semantic Search at Yahoo
byPeter Mika
 
Entity Retrieval (SIGIR 2013 tutorial)
bykrisztianbalog
 
Multi-language Content Discovery Through Entity Driven Search: Presented by A...
byLucidworks
 
Exploiting web search engines to search structured
byNita Pawar
 
Understanding Queries through Entities
byPeter Mika
 
TRank ISWC2013
byeXascale Infolab
 
Ranking in Google Since The Advent of The Knowledge Graph
byBill Slawski
 
Type-Aware Entity Retrieval
byDarío Garigliotti
 
Entity Retrieval (WSDM 2014 tutorial)
bykrisztianbalog
 
Entity Search Engine
byDRTC Indian Statistical Institute Bangalore
 
Semtech bizsemanticsearchtutorial
byBarbara Starr
 
Line,,NATIONAL SEMINAR ORGANIZED BY KULISAA 15.01.2015
byDRTC Indian Statistical Institute Bangalore
 
Multi-language Content Discovery Through Entity Driven Search
byAlessandro Benedetti
 
ECIR-2014: Multilanguage Content Discovery Through Entity Driven Search
byAntonio David Pérez Morales
 
Content Discovery Through Entity Driven Search
byAlessandro Benedetti
 
On Type-Aware Entity Retrieval
byDarío Garigliotti
 
Entity-Centric Data Management
byeXascale Infolab
 
Entity centric data_management_2013
byeXascale Infolab
 
Semantic Search keynote at CORIA 2015
byPeter Mika
 
Learning-to-Rank Target Types for Entity-Bearing Queries
byDarío Garigliotti
 
Semantic Search at Yahoo
byPeter Mika
 

More from Darío Garigliotti

PDF
Task Recommendation
byDarío Garigliotti
 
PDF
About "Towards Better Text Understanding and Retrieval through Kernel Entity ...
byDarío Garigliotti
 
PDF
A Summary of ECIR'18
byDarío Garigliotti
 
PDF
A Semantic Search Approach to Task-Completion Engines
byDarío Garigliotti
 
PDF
Type Information in Entity Retrieval
byDarío Garigliotti
 
PDF
Dive into Deep Learning
byDarío Garigliotti
 
PDF
If this is the answer, what was the question?
byDarío Garigliotti
 
PDF
Semi-supervised Learning for Word Sense Disambiguation
byDarío Garigliotti
 
PDF
Semi-supervised Learning for Word Sense Disambiguation
byDarío Garigliotti
 
PDF
Semi-supervised Learning for Word Sense Disambiguation
byDarío Garigliotti
 
PDF
FACT-IR. Fairness, Accountability, Confidentiality and Transparency in Inform...
byDarío Garigliotti
 
PDF
Machine Learning - Clustering
byDarío Garigliotti
 
PDF
Machine Learning - Classification (ctd.)
byDarío Garigliotti
 
PDF
Machine Learning - Classification
byDarío Garigliotti
 
PDF
Data Mining - Exploring Data
byDarío Garigliotti
 
PDF
Data Mining - Introduction and Data
byDarío Garigliotti
 
PDF
Predicate Logic
byDarío Garigliotti
 
PDF
Patterns, Automata and Regular Expressions
byDarío Garigliotti
 
PDF
The List Data Model
byDarío Garigliotti
 
Task Recommendation
byDarío Garigliotti
 
About "Towards Better Text Understanding and Retrieval through Kernel Entity ...
byDarío Garigliotti
 
A Summary of ECIR'18
byDarío Garigliotti
 
A Semantic Search Approach to Task-Completion Engines
byDarío Garigliotti
 
Type Information in Entity Retrieval
byDarío Garigliotti
 
Dive into Deep Learning
byDarío Garigliotti
 
If this is the answer, what was the question?
byDarío Garigliotti
 
Semi-supervised Learning for Word Sense Disambiguation
byDarío Garigliotti
 
Semi-supervised Learning for Word Sense Disambiguation
byDarío Garigliotti
 
Semi-supervised Learning for Word Sense Disambiguation
byDarío Garigliotti
 
FACT-IR. Fairness, Accountability, Confidentiality and Transparency in Inform...
byDarío Garigliotti
 
Machine Learning - Clustering
byDarío Garigliotti
 
Machine Learning - Classification (ctd.)
byDarío Garigliotti
 
Machine Learning - Classification
byDarío Garigliotti
 
Data Mining - Exploring Data
byDarío Garigliotti
 
Data Mining - Introduction and Data
byDarío Garigliotti
 
Predicate Logic
byDarío Garigliotti
 
Patterns, Automata and Regular Expressions
byDarío Garigliotti
 
The List Data Model
byDarío Garigliotti
 

Recently uploaded

PPTX
Sedimentary basins by Team Maverick.pptx
byolonabasit
 
PPTX
ORGANIC CHEMISTRY PRESENTATION WEEK 3 and 4
byJohnRenier1
 
PPTX
PRE NATAL GROWTH OF MAXILLA in orthodontics.pptx
byharanip03
 
PDF
Origin Of Life & Evolution || BIOLOGY || CBSE & CHSE
byVivek Kola
 
PPTX
The Internal anatomy of Poultry Chicken.pptx
byFRANKLINBARNACHEA
 
PPTX
CAM pathway in plants (unique pathway found in Xerophytes).pptx
byRashmiMG2
 
PDF
Sciences of Europe No 180 (2025)
bySciences of Europe
 
PPTX
DNA Structure, Damage and Repair Mechanism- Avinesh Shrestha
byAvinesh Shrestha
 
PDF
Animal Classification - Grade of Organisation, Symmetry, Coelom, Embryogeny ...
byWorld of Wisdom
 
PPTX
Data Collection and data types Chapter 2.pptx
byModern College Shivajinagar, Pune-5
 
PPTX
INTELLECTUAL PROPERTY RIGHTS FOR HORTICULTURAL CROPS PPT.pptx
byRaghu490065
 
PPTX
Plant Physiology-Key words by Stuti Farmer.pptx
bystutifarmer
 
PDF
Understanding the Metabolism of Proteolysis Targeting Chimeras (PROTACs): The...
byVirat Ojha
 
PDF
Hematology-1-Lesson_About_Hematopoiesis_and_erythropoetin
byyunahilnaya
 
PPTX
Ianalumab_ITP_Journal_Presentation_FULL.pptx
bysandiponroy342
 
PPTX
Natural Hazards, Mitigation,and Adaptation.pptx
byWorrelThomas1
 
PPTX
Annual Report of CMC filed in the USFDA for NDA & ANDA
byPHARMA IQ EDUCATION
 
PPTX
Psychopathology and mental Disorders.pptx
byMax Annani-Akollor
 
PPTX
Travis Hills of Minnesota Championing a Greener Future Through AI-Driven Pyro...
byTravis Hills MN
 
PDF
HND Networking and Cloud Computing (NCC).pdf
byssuser8dcccc
 
Sedimentary basins by Team Maverick.pptx
byolonabasit
 
ORGANIC CHEMISTRY PRESENTATION WEEK 3 and 4
byJohnRenier1
 
PRE NATAL GROWTH OF MAXILLA in orthodontics.pptx
byharanip03
 
Origin Of Life & Evolution || BIOLOGY || CBSE & CHSE
byVivek Kola
 
The Internal anatomy of Poultry Chicken.pptx
byFRANKLINBARNACHEA
 
CAM pathway in plants (unique pathway found in Xerophytes).pptx
byRashmiMG2
 
Sciences of Europe No 180 (2025)
bySciences of Europe
 
DNA Structure, Damage and Repair Mechanism- Avinesh Shrestha
byAvinesh Shrestha
 
Animal Classification - Grade of Organisation, Symmetry, Coelom, Embryogeny ...
byWorld of Wisdom
 
Data Collection and data types Chapter 2.pptx
byModern College Shivajinagar, Pune-5
 
INTELLECTUAL PROPERTY RIGHTS FOR HORTICULTURAL CROPS PPT.pptx
byRaghu490065
 
Plant Physiology-Key words by Stuti Farmer.pptx
bystutifarmer
 
Understanding the Metabolism of Proteolysis Targeting Chimeras (PROTACs): The...
byVirat Ojha
 
Hematology-1-Lesson_About_Hematopoiesis_and_erythropoetin
byyunahilnaya
 
Ianalumab_ITP_Journal_Presentation_FULL.pptx
bysandiponroy342
 
Natural Hazards, Mitigation,and Adaptation.pptx
byWorrelThomas1
 
Annual Report of CMC filed in the USFDA for NDA & ANDA
byPHARMA IQ EDUCATION
 
Psychopathology and mental Disorders.pptx
byMax Annani-Akollor
 
Travis Hills of Minnesota Championing a Greener Future Through AI-Driven Pyro...
byTravis Hills MN
 
HND Networking and Cloud Computing (NCC).pdf
byssuser8dcccc
 

Task-Based Support in Search Engines

  • 1.
    Task-Based Support in SearchEngines Darío Garigliotti University of Stavanger, Norway
  • 2.
    Outline • Motivation • Type-AwareEntity Retrieval • Target Entity Type Identification • Entity-Oriented Search Intents • Task-Based Query Suggestions • Task Recommendations • Conclusions and Future Directions 2
  • 3.
  • 4.
    Motivation • Today's websearch experience aims to understand the user query 4
  • 5.
    Motivation • Today's websearch experience aims to understand the user query 5
  • 6.
    Motivation • Today's websearch experience aims to understand the user query 6
  • 7.
    Motivation • Today's websearch experience aims to understand the user query • A way to organize information is via structured knowledge centered around entities • Large knowledge repositories and knowledge bases have become available 7
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
    • Underlying searchgoal is often a complex and knowledge-intensive task Motivation 12
  • 13.
  • 14.
  • 15.
    • Underlying searchgoal is often a complex and knowledge-intensive task • For example, to plan a travel - How to get there? - Where to stay? - What to do? • Task completion would provide support for the user when accomplishing complex search tasks Motivation 15
  • 16.
  • 17.
  • 18.
    An example • Searchingfor wedding cakes cake shops Konditoriet i Sandnes Olja's Kake Boutique Baker Corner Lura 18
  • 19.
    An example • Searchingfor wedding cakes wedding cake shops Stavanger Conditori Olja's Kake Boutique Gjestalveien Conditori 19
  • 20.
    • Entity retrievalis the task of obtaining a ranked list of entities relevant to a search query • We investigate the utilization of entity type information for entity retrieval Entity Retrieval 20
  • 21.
    … Shop … …… Company Organization … Stavanger Conditori Bank LawFirm … Entity types • A characteristic property of entities is that they are typed • Types are organized in hierarchies (or taxonomies) 21
  • 22.
    … Shop … …… Company Organization … cakeshopscake shops Bank Law Firm … • Target types: types of entities sought by the query Target entity types 22
  • 23.
    Type-aware Entity Retrieval •Type information is known to improve entity retrieval • Yet it is a multifaceted problem query entity wedding cake shops target types Stavanger Conditori term-based similarity type-based similarity … … entity types 23
  • 24.
    How can entitytype information be utilized in ad-hoc entity retrieval? 24
  • 25.
    • We assumeoracle-given type information Type-aware Entity Retrieval … Shop … …… Company Organization … cake shopscake shops Bank Law Firm … 25
  • 26.
    • We assumeoracle-given type information • We identify dimensions in utilizing entity type information - Type taxonomy - Type representation - Retrieval model Type-aware Entity Retrieval 26
  • 27.
    • Which typetaxonomy to use? - DBpedia Ontology (7 levels, 600 types) - Freebase Types (2 levels, 2K types) - Wikipedia Categories (34 levels, 600K types) - YAGO Taxonomy (19 levels, 500K types) • These vary a lot in terms of hierarchical structure and in how entity-type assignments are recorded Type-aware Entity Retrieval 27
  • 28.
    • How torepresent the hierarchical information? Type-aware Entity Retrieval 28
  • 29.
    • How touse type information into entity retrieval? • Retrieval task is defined in a generative probabilistic framework P(q | e) • Both query and entity are considered in the term space as well as in the type space Type-aware Entity Retrieval 29
  • 30.
    • (Strict) Filteringmodel Type-aware Entity Retrieval 30
  • 31.
    • (Soft) Filteringmodel Type-aware Entity Retrieval 31
  • 32.
  • 33.
    • We assumeoracle-given type information • We conduct an evaluation of dimensions in utilizing entity type information - Type taxonomy - Type representation - Retrieval model • We use a strong text-based baseline • We test with the DBpedia Entity collection v2 Type-aware Entity Retrieval 33
  • 34.
    • Wikipedia, incombination with the most specific type representation, performs best • Hierarchical relationships from ancestor types improve retrieval effectiveness, but most specific types provide the best performance • Results regarding most effective type-aware retrieval model vary across configurations Type-aware Entity Retrieval 34
  • 35.
  • 36.
  • 37.
    Target Type Identification •"We assume oracle-given type information" 37
  • 38.
    Target Type Identification •"We assume oracle-given type information" 38
  • 39.
    Target Type Identification •"We assume oracle-given type information" - How to identify target entity types? - How do these target types automatically identified perform for type-aware entity retrieval? 39
  • 40.
    How can weautomatically identify target entity types? 40
  • 41.
    Target Type Identification •We revisit the task of hierarchical target type identification • Task: to find the main target types of a query, from a type taxonomy, such that these are the most specific category of entities that are relevant to the query. If no matching type can be found in the taxonomy then the query is assigned a special NIL-type 41
  • 42.
    Target Type Identification •We develop a Learning-to-Rank approach • We evaluate it using a purpose-built test collection 42
  • 43.
    Target Type Identification 43 •Our method combines baseline, knowledge base, and type label features
  • 44.
    • We alsoconduct an evaluation utilizing, rather than a target types oracle, target entity types automatically identified 44 Automatic types for Entity Retrieval
  • 45.
    Automatic types forEntity Retrieval 45
  • 46.
    We identify andevaluate dimensions in utilizing target entity type information for ad-hoc entity retrieval. We build a test collection for target entity type identification, and develop and evaluate a Learning-to-Rank approach for this problem. SUMMARY 46
  • 47.
  • 48.
  • 49.
    Entity-Oriented Search Intents • Intent:the underlying user need in a entity- oriented search query - For example, the intent of booking a hotel room • Refiner: a way to express an intent in an entity-oriented query - For example, for booking a hotel room: "booking", "book", "reservation", "rooms" 49
  • 50.
    • Searching abouta fashion designer An example 50
  • 51.
  • 52.
    vivienne westwood age Anexample 78 years April 8, 1941 52
  • 53.
    vivienne westwood age Anexample 78 years April 8, 1941 53
  • 54.
  • 55.
  • 56.
    vivienne westwood instagram Anexample instagram.com/viviennewestwood/ 56
  • 57.
    vivienne westwood instagram Anexample instagram.com/viviennewestwood/ 57
  • 58.
  • 59.
    vivienne westwood customercare An example 59
  • 60.
    vivienne westwood customercare An example 60
  • 61.
    What do entity-orientedqueries ask for, and how can they be fulfilled? 61
  • 62.
    <fashion designer> instagram Understandingentity- oriented search intents • We obtain a collection of type-level query patterns stella mccartney instagram vivienne westwood instagram 62
  • 63.
    Understanding entity- oriented searchintents • We obtain a collection of type-level query patterns • Pick a Freebase type if it covers 100+ prominent entities • Get query suggestions for top 1000- entities per type • For each query, replace entity by type • Aggregate all frequencies for each (type, refiner) pair • Filter out all type-level refiners with frequency of 4- • Select 50 representative types by stratified sampling 63
  • 64.
    Understanding entity- oriented searchintents • We define a scheme of intent categories 64
  • 65.
    Understanding entity- oriented searchintents • We define a scheme of intent categories Website 65
  • 66.
    Understanding entity- oriented searchintents • We define a scheme of intent categories PropertyWebsite 66
  • 67.
    Understanding entity- oriented searchintents • We define a scheme of intent categories PropertyWebsite Service 67
  • 68.
    Understanding entity- oriented searchintents • We define a scheme of intent categories PropertyWebsite Service Other68
  • 69.
    Understanding entity- oriented searchintents • We define a scheme of intent categories - Website, Property, Service, Other => Website => Property => Service vivienne westwood age vivienne westwood instagram vivienne westwood customer care 69
  • 70.
    Understanding entity- oriented searchintents • We annotate 2.3K+ unique type-level refiners with intent category via crowdsourcing • We observe the proportions of refiners in each category Property: 28.6% Service: 54.06% Website: 5.34% Other: 12.08% 70
  • 71.
    Understanding entity- oriented searchintents 71 organization business operation chemical compound film location event food hotel disease restaurant travel destination 0 50 100 150 200 250 university house person newspaper airport basketball player album professional sports team game artwork 0 50 100 150 200 railway human language tv station political party amusement park exhibition venue chef programming language academic institution netflix genre 0 20 40 60 80 100 120 war currency blogger hobby football match sports championship star muscle olympic sport company 0 10 20 30 40 50 WroSicaO cycOone kingdoP PedicaO sSeciaOWy coPic book SubOisher oiO fieOd Wower beer counWry region eOecWion asWeroid beOief 0 10 20 30 40 50 3roSerWy WebsiWe Service 2Wher
  • 72.
    We propose ascheme of entity-oriented search intent categories. We annotate a collection of query refiners using the scheme, and observe that there is a large proportion of service-oriented intents. SUMMARY 72
  • 73.
    Roadmap Type-Aware Entity Retrieval Entity-Oriented Search Intents Utilizing Entity Type Information IdentifyingTarget Entity Type Information Understanding Entity- Oriented Search Intents 73
  • 74.
    How can webuild a knowledge base of entity-oriented search intents? 74
  • 75.
    1. Intents searchedfor a type of entities paris map, sydney map => [city] map 2. Categories assigned to refiners vivienne westwood instagram => Website vivienne westwood age => Property vivienne westwood customer care => Service 3. Multiple refiners expressing an intent "booking", "book", "make a reservation", "rooms" 75 A knowledge base of entity- oriented search intents
  • 76.
    1. Intents searchedfor a type of entities paris map, sydney map => [city] map • (intent ID, searchedForType, entity type, confidence) 2. Categories assigned to refiners vivienne westwood instagram => Website vivienne westwood age => Property vivienne westwood customer care => Service 3. Multiple refiners expressing an intent "booking", "book", "make a reservation", "rooms" 76 A knowledge base of entity- oriented search intents
  • 77.
    1. Intents searchedfor a type of entities paris map, sydney map => [city] map • (intent ID, searchedForType, entity type, confidence) 2. Categories assigned to refiners vivienne westwood instagram => Website vivienne westwood age => Property vivienne westwood customer care => Service • (intent ID, ofCategory, intent category, confidence) 3. Multiple refiners expressing an intent "booking", "book", "make a reservation", "rooms" 77 A knowledge base of entity- oriented search intents
  • 78.
    1. Intents searchedfor a type of entities paris map, sydney map => [city] map • (intent ID, searchedForType, entity type, confidence) 2. Categories assigned to refiners vivienne westwood instagram => Website vivienne westwood age => Property vivienne westwood customer care => Service • (intent ID, ofCategory, intent category, confidence) 3. Multiple refiners expressing an intent "booking", "book", "make a reservation", "rooms" • (intent ID, expressedBy, refiner, confidence) A knowledge base of entity- oriented search intents 78
  • 79.
    Approach Refiners acquisition Refiners categorization Intents discovery [hotel] airport [hotel] spa [hotel]booking ... [hotel] airport: Service [hotel] address: Property [hotel] expedia: Website ... taxi arrive Hotel_Arrivingbooking make a reservation Hotel_Booking address Hotel_Address KB construction Intent ID Predicate Object Confidence Hotel_Booking searchedForType [hotel] c1 Hotel_Booking ofCategory Service c2 Hotel_Booking expressedBy "booking" c3 Hotel_Booking expressedBy "make a reservation" c4 Hotel_Booking expressedBy "rooms" c5 79
  • 80.
    Approach Refiners acquisition Refiners categorization Intents discovery [hotel] airport [hotel] spa [hotel]booking ... [hotel] airport: Service [hotel] address: Property [hotel] expedia: Website ... taxi arrive Hotel_Arrivingbooking make a reservation Hotel_Booking address Hotel_Address Intent profile { KB construction Intent ID Predicate Object Confidence Hotel_Booking searchedForType [hotel] c1 Hotel_Booking ofCategory Service c2 Hotel_Booking expressedBy "booking" c3 Hotel_Booking expressedBy "make a reservation" c4 Hotel_Booking expressedBy "rooms" c5 80
  • 81.
    Knowledge base construction •Application of the pipeline to extract all quadruples from 581 unseen types • 155K quadruples, 31K intent profiles - Excerpt of the KB, for intent ID <aviation.airline-65-customer_service> 81
  • 82.
    Experimental evaluation • Expertsjudge correctness, ignoring confidence, of around 1.29% of IntentsKB 82 [0, 0.87) [0.87, 0.88) [0.88, 0.9) [0.9, 0.93) [0.93, 1] Confidence intervals according to the splitting percentiles 0% 20% 40% 60% 80% 100% Proportionoftriples 6,337 6,370 6,335 6,368 6,314 Correct Incorrect, OFCATEGORY Incorrect, EXPRESSEDBY
  • 83.
    We design andbuild a knowledge base of entity- oriented search intents. We evaluate each component in our approach, as well as the correctness of the obtained knowledge base. SUMMARY 83
  • 84.
    Roadmap Type-Aware Entity Retrieval Entity-Oriented Search Intents Utilizing Entity Type Information IdentifyingTarget Entity Type Information Understanding Entity- Oriented Search Intents Modeling Entity- Oriented Search Intents 84
  • 85.
  • 86.
    An example • Planningyour wedding 86
  • 87.
  • 88.
  • 89.
    Cheap wedding cake lowwedding budget An example 89
  • 90.
    Cheap wedding cakeMake your own invitations low wedding budget An example 90
  • 91.
    An example Cheap weddingcake Make your own invitations Buy a used wedding gown low wedding budget 91
  • 92.
    Cheap wedding cake Make yourown invitations Buy a used wedding gown low wedding budget An example 92
  • 93.
    Cheap wedding cake Make yourown invitations Buy a used wedding gownExcerpt from TREC Tasks test dataset low wedding budget 1 low budget wedding dresses 0 low wedding budget cars 1 find a gown ... 0 wedding flowers 1 cup cake wedding 1 wedding cakes ... 2 wedding invitation 1 find wedding invitation templates 0 designer dresses wedding ... An example 93
  • 94.
    Cheap wedding cake Make yourown invitations Buy a used wedding gownExcerpt from TREC Tasks test dataset } low wedding budget 1 low budget wedding dresses 0 low wedding budget cars 1 find a gown ... 0 wedding flowers 1 cup cake wedding 1 wedding cakes ... 2 wedding invitation 1 find wedding invitation templates 0 designer dresses wedding ... An example 94
  • 95.
    Cheap wedding cake Make yourown invitations Buy a used wedding gownExcerpt from TREC Tasks test dataset } } low wedding budget 1 low budget wedding dresses 0 low wedding budget cars 1 find a gown ... 0 wedding flowers 1 cup cake wedding 1 wedding cakes ... 2 wedding invitation 1 find wedding invitation templates 0 designer dresses wedding ... An example 95
  • 96.
    An example Cheap wedding cake Makeyour own invitations Buy a used wedding gownExcerpt from TREC Tasks test dataset } } } low wedding budget 1 low budget wedding dresses 0 low wedding budget cars 1 find a gown ... 0 wedding flowers 1 cup cake wedding 1 wedding cakes ... 2 wedding invitation 1 find wedding invitation templates 0 designer dresses wedding ... 96
  • 97.
    How can wegenerate query suggestions for supporting task-based search? 97
  • 98.
    • Given aninitial query, Suggesting queries to support task-based search wedding cake wedding cake gallery wedding cake recipes wedding cake flavors 98
  • 99.
    • Given aninitial query, to get a ranked list of query suggestions that cover all the possible subtasks related to the task that the user is trying to achieve. Suggesting queries to support task-based search wedding cake wedding cake gallery wedding cake recipes wedding cake flavors 99
  • 100.
    • Given aninitial query, to get a ranked list of query suggestions that cover all the possible subtasks related to the task that the user is trying to achieve. Suggesting queries to support task-based search wedding cake wedding cake gallery wedding cake recipes wedding cake flavors • This is the task understanding problem 100
  • 101.
    Suggesting queries to supporttask-based search • We propose an end-to-end generative probabilistic model • We exploit different information sources 101
  • 102.
    Suggesting queries to supporttask-based search 102 Web snippets Web documents
  • 103.
    Suggesting queries to supporttask-based search 103 Query suggestions from search engines
  • 104.
    Suggesting queries to supporttask-based search • We propose an end-to-end generative probabilistic model 104
  • 105.
    • Components: q0 Suggesting queriesto support task-based search • We propose an end-to-end generative probabilistic model 105
  • 106.
    • Components: • Sourceimportance q0 API SUGGS. WEB SNIPPETS WEB DOCS. WH Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model 106
  • 107.
    • Components: • Sourceimportance • Document importance q0 API SUGGS. WEB SNIPPETS WEB DOCS. WH Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model 107
  • 108.
    • Components: • Sourceimportance • Document importance • Keyphrase relevance q0 Keyphrases API SUGGS. WEB SNIPPETS WEB DOCS. WH Suggesting queries to support task-based search • We propose an end-to-end generative probabilistic model 108
  • 109.
    • Components: • Sourceimportance • Document importance • Keyphrase relevance • Query suggestion • We propose an end-to-end generative probabilistic model Query suggestions q0 Keyphrases API SUGGS. WEB SNIPPETS WEB DOCS. WH Suggesting queries to support task-based search 109
  • 110.
    • We makeuse of the 2015 and 2016 TREC Tasks track datasets for the task understanding problem • We conduct a principled estimation of the components, and analyze the best performing estimators per component Suggesting queries to support task-based search 110
  • 111.
    Suggesting queries to supporttask-based search 111 • We observe a heavy reliance on query suggestions from suggestion APIs
  • 112.
    Generating suggestion candidates Query completionQuery refinement wedding cake wedding cake gallery wedding cake recipes wedding cake flavors wedding cake beautiful wedding cakes unique wedding cake designs simple wedding cake • Two query suggestion modes 112
  • 113.
    • How tojointly generate query suggestions in query completion and refinement modes? - Can we do it without relying on log data / API? • We consider a two-step pipeline: - Candidate generation - Candidate ranking • And focus on the first component Generating suggestion candidates 113
  • 114.
    • We studyalternative generation methods and information sources - Methods: popular suffix, neural language, sequence- to-sequence - Sources: AOL query log, KnowHow, WikiAnswers • We build a test collection of query suggestion candidates Generating suggestion candidates 114
  • 115.
    • End-to-end isstill the best method overall, but limited as it depends on API suggestions • Log data is the most useful information source, but the other sources provide valuable suggestions too • Different method-source configurations contribute unique suggestions in both modes Generating suggestion candidates 115
  • 116.
    We propose andevaluate a generative probabilistic model for task-based query suggestions. We further study alternative methods and information sources for suggestion candidate generation, and build a test collection. SUMMARY 116
  • 117.
    Roadmap Type-Aware Entity Retrieval Task-Based Search Entity-Oriented Search Intents Utilizing Entity Type Information IdentifyingTarget Entity Type Information Understanding Entity- Oriented Search Intents Modeling Entity- Oriented Search Intents Suggesting Queries 117
  • 118.
  • 119.
    Task Recommendation • Theunderlying search goal is often a complex and knowledge-intensive task • We propose to recommend specific tasks to users, based on their search queries 119
  • 120.
    An example • Planninga wedding reception wedding reception Plan a wedding reception Recommended Tasks: Plan your wedding reception exit Announce the bridal party at a reception Throw a Hawaiian wedding reception Choose wedding reception activities 120
  • 121.
    How can werecommend tasks based on search queries and missions? 121
  • 122.
    Task Recommendation • Someterminology: - Task repository: a catalog of task descriptions - Task description: a semi-structured document that explains the steps involved in how to complete a given task - Search mission: a set of queries that all share the same underlying task 122
  • 123.
    Task Recommendation • Weintroduce two problems: 1. Query-based task recommendation Given a query, to return a ranked list of tasks that correspond to the task behind the query 2. Mission-based task recommendation Given a search mission, to return a ranked list of recommended tasks, corresponding to the queries in the mission 123
  • 124.
    Task Recommendation • Weuse a collection of WikiHow articles as our task repository 124 How to Make a Wedding Cake Co-authored by wikiHow Staff ✔ You can make a wedding cake for a customer if you bake for a living, or you might make a cake for loved one’s wedding to help them save money. If you love to bake, then you might even want to make your own wedding cake! Steps 1 Decide on the number and shape of the cake’s layers. Consider how many layers and what shape you want the cake to have. 2 Preheat the oven to the temperature indicated by your recipe. Many recipes call for the oven to be pre-heated to 350 °F (177 °C). 3 Prepare the cake batter according to your recipe’s instructions. Choose a recipe to create the cake batter for your cake. 4 Pour the batter into a greased, parchment-lined cake pan. Spray your cake pan with non-stick cooking spray. Explanation Main Act Detailed Act Title
  • 125.
    Task Recommendation • Wefocus on a subset of tasks, the procedural tasks • Procedural task: a search task that can be accomplished by following a sequence of specific actions or subtasks 125
  • 126.
    Task Recommendation • Froma corpus of search queries and missions, we obtain a set of procedural search missions 126
  • 127.
    Task Recommendation • Webuild a test collection for task recommendation 127
  • 128.
    Query-based task recommendation • Wepropose a Learning-to-Rank method for query-based task recommendation, that combines a text-based ranking technique with continuous semantic representations • We experiment with different word embeddings and word function sets according to POS-tag 128
  • 129.
  • 130.
  • 131.
    • To addressmission-based task recommendation, we propose methods that aggregate the individual query-based recommendations for each query into mission- level recommended tasks 131 Mission-based task recommendation
  • 132.
  • 133.
    We introduce theproblems of query-based and mission-based task recommendation. We develop a test collection for task recommendation, and propose and evaluate approaches for these problems. SUMMARY 133
  • 134.
    Roadmap Type-Aware Entity Retrieval Task-Based Search Entity-Oriented Search Intents Utilizing Entity Type Information IdentifyingTarget Entity Type Information Understanding Entity- Oriented Search Intents Modeling Entity- Oriented Search Intents Suggesting Queries Recommending Tasks 134
  • 135.
  • 136.
    Conclusions 136 wedding cake Stavanger Conditori Olja's Kake Boutique Gjestalveien Conditori Cakeshops > Wedding cake shops Recommended tasks Make a Chocolate Cake Basic Chocolate Cake Moist & Fluffy Chocolate Cake Bake an Easy Applesauce Cake See ingredients See steps Address: Gjesdalveien 27, 4306 Sandnes Hours Today: 9AM-5PM Address: Godesetdalen 10, 4034 Stavanger CALL CALL CALL Decorate a Cake Working with Fondant Adding Quick Decorations Queries suggested for wedding cake wedding cake recipes for beginners best wedding cake recipes wedding cake recipes video chocolate wedding cake recipes homemade wedding cake recipes from scratch
  • 137.
    Conclusions 137 wedding cake Stavanger Conditori Olja's Kake Boutique Gjestalveien Conditori Cakeshops > Wedding cake shops Recommended tasks Make a Chocolate Cake Basic Chocolate Cake Moist & Fluffy Chocolate Cake Bake an Easy Applesauce Cake See ingredients See steps Address: Gjesdalveien 27, 4306 Sandnes Hours Today: 9AM-5PM Address: Godesetdalen 10, 4034 Stavanger CALL CALL CALL Decorate a Cake Working with Fondant Adding Quick Decorations Queries suggested for wedding cake wedding cake recipes for beginners best wedding cake recipes wedding cake recipes video chocolate wedding cake recipes homemade wedding cake recipes from scratch Type-Aware Entity Retrieval Entity-Oriented Search Intents Task-Based Query Suggestions Task Recommendations
  • 138.
  • 139.
    Future Directions 139 wedding venue DetStavangerske Klubselskab 120,000 NOK RESERVE Olavskleivå 26 Time: Date: 19:00 Saturday June 27, 2020 Number of guests: 50-100 Outdoors? Number of cars: Up to 20 Parking?✔ Rosenkildehuset AS Strandkaien 6 Strømvik allotments Strømvikveien 1 120,000 NOK RESERVE 105,000 NOK RESERVE Input parameters in service intents
  • 140.
    Future Directions Semantics-aware query suggestions Mission-basedtask recommendation 140 invitation cards Make Homemade Wedding Cards Print Your Own Wedding Invitations Include a Dress Code on a Wedding Invitation Queries suggested for invitation cards invitation card online invitation card maker free invitation cards for whatsapp see-through invitation card create invitation card with photo free Recommended tasks
  • 141.