1.
Project
PageZero
Smart Search
Antonio Gulli

2.
Search transformed
the way we look at
the world

3.
Search box:
Looking at the
world through a
window

4.
Satori: Entering the
World of Entities

5.
Words are
ambiguous

6.
Sites

7.
Bing uses the world of entities
as soon as you type. Not only
for refining search results

8.
Smart Search
Windows 8.1
World Wide

9.
SkyDrive
Xbox
Web

10.
Local
Files
Personalized Results
Email Skype
Web

11.
Learning to Personalize Query AutoCompletion
Milad Shokouhi
Microsoft

12.
Relevance Labelling for Contextual Search
• For learning we need labels.
• Relevance labelling for contextual (personalized) search
(auto-completion) is not trivial.
• Previous work on personalized search [Fox et al., 2005]
• Samples search impressions from the logs
• Documents with SAT clicks are annotated with relevant labels
• The goal is to learn a re-ranking model that improves the
ranking of those relevant documents given the context.

13.
Analogy: Auto-Completion Labels
34

14.
Experimental Settings
• Ranker: Lambda-Mart [Burges et al., 2011]
• AOL testbed
• 657K users (Mar-May 2006)
• 128,620 queries in the prefix-tree
• Userid, query, timestamp
• Bing testbed
• 196K logged in users with Microsoft LiveID (Jan-2013)
• 699,862 queries in the prefix-tree
• Userid, query, timestamp, age, gender, zip code
• Training & testing on different sets of users

15.
Personalized Ranking Features
• Demographics
• Age (5 groups)
• Gender (2 groups)
• Zip-code (10 groups)
• Search history
• Short (session)
• Long (all past queries)

16.
Personalization by Age
The effectiveness of auto-completion personalization according to
the user’s age in terms of MRR. All differences are statistically
significant (P < 0.01)
Testbed
Baseline
Personalized
MRR (Gain/Loss)
Bing (age)
-
-
+3.80%
Frequently promoted suggestions for different age groups
Below 20
21-30
31-40
41-50
Above 50

17.
Results Summary
Features
Short history
Long history
Age
Gender
Location
All
AOL
+1.95%
+4.45%
+6.45%
Bing
0.91%
5.57%
3.80%
+3.59%
+4.58%
+9.42%

18.
London
Twitter: @gulliantonio