SlideShare a Scribd company logo
1 of 22
Download to read offline
Social Query
A Query Routing System for Twitter

Cleyton Souza
Jonathas Magalhães, Evandro Costa, and Joseana Fechine
Laboratory of Artificial Intelligence – LIA
Federal University of Campina Grande - UFCG
Introduction
• Query Routing (QR) is the process of directing
questions to appropriate responders
– Community Question and Answering Services (CQA)
– Online Social Networks (OSN)

• We are proposing an Expertise Finding System
to automatically routing questions on Social
Networks

Cleyton Souza - ICIW 2013

2
Introduction
• Our goal is to present the Social Query System
• How does it work?
• How does the usual Q&A process is affected?

• Talk about our preliminary results
• Talk about our planning for the future

Cleyton Souza - ICIW 2013

3
Agenda
•
•
•
•
•
•

Introduction
Related Work & Background
Usual Q&A
Social Query System: How it works
Evaluation & Results
Future Work

Cleyton Souza - ICIW 2013

4
Related Work & Background
• The differential of our research
– We are proposing a Query Routing to an OSN context
• Previous work usually focused on CQA context
• We are proposing a solution to a pre-existent and popular
context: Twitter
• Most part of questions asked on Twitter are not answered
(more than 80%) [Paul et al. 2012]

– We lead with the recommendation as multi-criteria
decision making problem
• Previous work usually apply probabilistic or Information
Retrieval-based models;
Cleyton Souza - ICIW 2013

5
Usual Q&A on OSN
• Sharing a public question

Fig. 1: Sharing a Public Question

Cleyton Souza - ICIW 2013

6
Q&A on OSN
• Directing the question

Fig. 2: Directing the Question

Cleyton Souza - ICIW 2013

7
Q&A on OSN
• Routing the question

Fig. 3: Routing the Question

Cleyton Souza - ICIW 2013

8
Social Query System
• Works outside Twitter
– Questioner’s Followers are Expert Candidates
– Questions and Answers without size limitations

Fig. 4: SocialCleyton Souza - ICIW 2013
Query System’s Homepage

9
“New Question” Page
• Three text fields, two mandatory

Fig. 5: “New Question” Page
Cleyton Souza - ICIW 2013

10
“Recommendation List” Page
• Questioner chooses who will “receive” the
question

Fig. 6: “Recommendation List” Page
Cleyton Souza - ICIW 2013

11
Question’s Tweet
• Questioner tweets the following message

Fig. 7: Question’s Tweet

Cleyton Souza - ICIW 2013

12
“New Answer” Page
• Three options of answer

Fig. 8: “New Answer” Page
Cleyton Souza - ICIW 2013

13
“I don’t Know” & “I know Someone”

Fig. 9: “I don’t know” Tweet

Fig. 10: “I know someone” Tweet
Cleyton Souza - ICIW 2013

14
I want answer
• When the expert clicks on the “I want answer”
button

Fig. 11: “I want answer” Page
Cleyton Souza - ICIW 2013

15
Tweeting about the Answer

Fig. 12: “I just answered” Tweet

Cleyton Souza - ICIW 2013

16
“New Evaluation” Page

Fig. 12: “New Evaluation” `Page
Cleyton Souza - ICIW 2013

17
How does it work?
• (1) The questioner accesses our System and (2)
informs his question;
• (3) The System recommends potential responders
and (4) the questioner chooses to whom direct
the question;
• (5) Those chosen access our System, (6) answers
the question, (7) and informs the questioner
about his answer;
• (8) The questioner access our System, (9) see the
answer, and (10) evaluates it.
Cleyton Souza - ICIW 2013

18
Evaluation
• Nine Volunteers evaluated ten recommendations
for a couple of questions
a)
b)

Looking for a new band to listen during weekend, does anyone
have an indication?
Going to the movie theater after years LOL. What is the best
movie in theaters?

• Each recommendation was labeled as good
(relevance 1), neutral (relevance 0) and bad
(relevance 0).
• These labels reflect the opinion of the volunteers
about the recommendation
Cleyton Souza - ICIW 2013

19
Results
Cases
Best case for Question “a”

Amount of
Followers
192

% of good

%of bad

nDCG

50%

10%

0.63

Worst case for Question “a”

129

30%

60%

0.25

Best case for Question “b”

121

60%

0%

0.74

Worst case for Question “b”

68

30%

0%

0.18

Average for Question “a”

110

41%

28%

0.41

Average for Question “b”

110

50%

20%

0.51

Cleyton Souza - ICIW 2013

20
Future Work
• Where are we?
• Mobile App
• Volunteer’s feedback
– Follow Back Filter
– Thesaurus

• Real case study

Cleyton Souza - ICIW 2013

21
Social Query System
A System for Query Routing on Twitter

Thank You!

Lia TIPS
Laboratory of Artificial
Intelligence

Group of Intelligent Social and
Customizable Technologies

Cleyton Souza
Jonathas Magalhães, Evandro Costa, and Joseana Fechine
Laboratory of Artificial Intelligence – LIA
Federal University of Campina Grande - UFCG

More Related Content

Similar to Social Query: A Query Routing System for Twitter

Detecting Good Abandonment in Mobile Search
Detecting Good Abandonment in Mobile SearchDetecting Good Abandonment in Mobile Search
Detecting Good Abandonment in Mobile Search
Julia Kiseleva
 

Similar to Social Query: A Query Routing System for Twitter (20)

Surveys that work: training course for Rosenfeld Media, day 3
Surveys that work: training course for Rosenfeld Media, day 3 Surveys that work: training course for Rosenfeld Media, day 3
Surveys that work: training course for Rosenfeld Media, day 3
 
Surveys that work: training course for Rosenfeld media, day 2
Surveys that work: training course for Rosenfeld media, day 2Surveys that work: training course for Rosenfeld media, day 2
Surveys that work: training course for Rosenfeld media, day 2
 
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
 
Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023
 
Surveys that work: an introduction to using Total Survey Error for the UX Ins...
Surveys that work: an introduction to using Total Survey Error for the UX Ins...Surveys that work: an introduction to using Total Survey Error for the UX Ins...
Surveys that work: an introduction to using Total Survey Error for the UX Ins...
 
Surveys that Work 2020: training course for HMRC user researchers 2020
Surveys that Work 2020: training course for HMRC user researchers 2020Surveys that Work 2020: training course for HMRC user researchers 2020
Surveys that Work 2020: training course for HMRC user researchers 2020
 
Survey that work LibDesign2016 @cjforms
Survey that work LibDesign2016 @cjformsSurvey that work LibDesign2016 @cjforms
Survey that work LibDesign2016 @cjforms
 
Surveys that work: a webinar for FocusVision 2021
Surveys that work: a webinar for FocusVision 2021Surveys that work: a webinar for FocusVision 2021
Surveys that work: a webinar for FocusVision 2021
 
Design tips for surveys UIE 2012
Design tips for surveys UIE 2012Design tips for surveys UIE 2012
Design tips for surveys UIE 2012
 
Plain language to improve your survey houston 2022
Plain language to improve your survey houston 2022Plain language to improve your survey houston 2022
Plain language to improve your survey houston 2022
 
Culture & km survey.aqs.rev.10.8.14
Culture & km survey.aqs.rev.10.8.14Culture & km survey.aqs.rev.10.8.14
Culture & km survey.aqs.rev.10.8.14
 
How to get better results from a survey: Meet the Survey Octopus
How to get better results from a survey: Meet the Survey OctopusHow to get better results from a survey: Meet the Survey Octopus
How to get better results from a survey: Meet the Survey Octopus
 
Using surveys to uncover audience insights
Using surveys to uncover audience insightsUsing surveys to uncover audience insights
Using surveys to uncover audience insights
 
Two ways to improve your survey, webinar for Delib 2023.pptx
Two ways to improve your survey, webinar for Delib 2023.pptxTwo ways to improve your survey, webinar for Delib 2023.pptx
Two ways to improve your survey, webinar for Delib 2023.pptx
 
Detecting Good Abandonment in Mobile Search
Detecting Good Abandonment in Mobile SearchDetecting Good Abandonment in Mobile Search
Detecting Good Abandonment in Mobile Search
 
Engaging with Users on Public Social Media
Engaging with Users on Public Social MediaEngaging with Users on Public Social Media
Engaging with Users on Public Social Media
 
A Query Routing Model to Rank Expertcandidates on Twitter
A Query Routing Model to Rank Expertcandidates on TwitterA Query Routing Model to Rank Expertcandidates on Twitter
A Query Routing Model to Rank Expertcandidates on Twitter
 
Survey octopus uxnz2015 @cjforms
Survey octopus uxnz2015 @cjformsSurvey octopus uxnz2015 @cjforms
Survey octopus uxnz2015 @cjforms
 
THE SURVEY OCTOPUS: GETTING VALID DATA FROM SURVEYS
THE SURVEY OCTOPUS: GETTING VALID DATA FROM SURVEYSTHE SURVEY OCTOPUS: GETTING VALID DATA FROM SURVEYS
THE SURVEY OCTOPUS: GETTING VALID DATA FROM SURVEYS
 
Surveys that work EBI_2017
Surveys that work EBI_2017Surveys that work EBI_2017
Surveys that work EBI_2017
 

More from Jonathas Magalhães

More from Jonathas Magalhães (12)

Enhancing the Status Message Question Asking Process on Facebook
Enhancing the Status Message Question Asking Process on FacebookEnhancing the Status Message Question Asking Process on Facebook
Enhancing the Status Message Question Asking Process on Facebook
 
Recommending Scientific Papers: Investigating the User Curriculum
Recommending Scientific Papers: Investigating the User CurriculumRecommending Scientific Papers: Investigating the User Curriculum
Recommending Scientific Papers: Investigating the User Curriculum
 
Sistemas de Recomendação: Conceitos, Técnicas, Ferramentas e Aplicações
Sistemas de Recomendação: Conceitos, Técnicas, Ferramentas e AplicaçõesSistemas de Recomendação: Conceitos, Técnicas, Ferramentas e Aplicações
Sistemas de Recomendação: Conceitos, Técnicas, Ferramentas e Aplicações
 
Redes Bayesianas
Redes BayesianasRedes Bayesianas
Redes Bayesianas
 
Probabilidade
ProbabilidadeProbabilidade
Probabilidade
 
An Ontology Based Approach for Sharing Distributed Educational
An Ontology Based Approach for Sharing Distributed EducationalAn Ontology Based Approach for Sharing Distributed Educational
An Ontology Based Approach for Sharing Distributed Educational
 
A Recommender System for Predicting User Engagement in Twitter
A Recommender System for Predicting User Engagement in TwitterA Recommender System for Predicting User Engagement in Twitter
A Recommender System for Predicting User Engagement in Twitter
 
K-Nearest Neighbor
K-Nearest NeighborK-Nearest Neighbor
K-Nearest Neighbor
 
Naive Bayes
Naive BayesNaive Bayes
Naive Bayes
 
Predicting Potential Responders in Twitter: A Query Routing Algorithm
Predicting Potential Responders in Twitter: A Query Routing AlgorithmPredicting Potential Responders in Twitter: A Query Routing Algorithm
Predicting Potential Responders in Twitter: A Query Routing Algorithm
 
An Open and Inspectable Learner Modeling with a Negotiation Mechanism to Solv...
An Open and Inspectable Learner Modeling with a Negotiation Mechanism to Solv...An Open and Inspectable Learner Modeling with a Negotiation Mechanism to Solv...
An Open and Inspectable Learner Modeling with a Negotiation Mechanism to Solv...
 
Improving a Recommender System Through Integration of User Profiles: a Semant...
Improving a Recommender System Through Integration of User Profiles: a Semant...Improving a Recommender System Through Integration of User Profiles: a Semant...
Improving a Recommender System Through Integration of User Profiles: a Semant...
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Decarbonising Commercial Real Estate: The Role of Operational Performance
Decarbonising Commercial Real Estate: The Role of Operational PerformanceDecarbonising Commercial Real Estate: The Role of Operational Performance
Decarbonising Commercial Real Estate: The Role of Operational Performance
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 

Social Query: A Query Routing System for Twitter

  • 1. Social Query A Query Routing System for Twitter Cleyton Souza Jonathas Magalhães, Evandro Costa, and Joseana Fechine Laboratory of Artificial Intelligence – LIA Federal University of Campina Grande - UFCG
  • 2. Introduction • Query Routing (QR) is the process of directing questions to appropriate responders – Community Question and Answering Services (CQA) – Online Social Networks (OSN) • We are proposing an Expertise Finding System to automatically routing questions on Social Networks Cleyton Souza - ICIW 2013 2
  • 3. Introduction • Our goal is to present the Social Query System • How does it work? • How does the usual Q&A process is affected? • Talk about our preliminary results • Talk about our planning for the future Cleyton Souza - ICIW 2013 3
  • 4. Agenda • • • • • • Introduction Related Work & Background Usual Q&A Social Query System: How it works Evaluation & Results Future Work Cleyton Souza - ICIW 2013 4
  • 5. Related Work & Background • The differential of our research – We are proposing a Query Routing to an OSN context • Previous work usually focused on CQA context • We are proposing a solution to a pre-existent and popular context: Twitter • Most part of questions asked on Twitter are not answered (more than 80%) [Paul et al. 2012] – We lead with the recommendation as multi-criteria decision making problem • Previous work usually apply probabilistic or Information Retrieval-based models; Cleyton Souza - ICIW 2013 5
  • 6. Usual Q&A on OSN • Sharing a public question Fig. 1: Sharing a Public Question Cleyton Souza - ICIW 2013 6
  • 7. Q&A on OSN • Directing the question Fig. 2: Directing the Question Cleyton Souza - ICIW 2013 7
  • 8. Q&A on OSN • Routing the question Fig. 3: Routing the Question Cleyton Souza - ICIW 2013 8
  • 9. Social Query System • Works outside Twitter – Questioner’s Followers are Expert Candidates – Questions and Answers without size limitations Fig. 4: SocialCleyton Souza - ICIW 2013 Query System’s Homepage 9
  • 10. “New Question” Page • Three text fields, two mandatory Fig. 5: “New Question” Page Cleyton Souza - ICIW 2013 10
  • 11. “Recommendation List” Page • Questioner chooses who will “receive” the question Fig. 6: “Recommendation List” Page Cleyton Souza - ICIW 2013 11
  • 12. Question’s Tweet • Questioner tweets the following message Fig. 7: Question’s Tweet Cleyton Souza - ICIW 2013 12
  • 13. “New Answer” Page • Three options of answer Fig. 8: “New Answer” Page Cleyton Souza - ICIW 2013 13
  • 14. “I don’t Know” & “I know Someone” Fig. 9: “I don’t know” Tweet Fig. 10: “I know someone” Tweet Cleyton Souza - ICIW 2013 14
  • 15. I want answer • When the expert clicks on the “I want answer” button Fig. 11: “I want answer” Page Cleyton Souza - ICIW 2013 15
  • 16. Tweeting about the Answer Fig. 12: “I just answered” Tweet Cleyton Souza - ICIW 2013 16
  • 17. “New Evaluation” Page Fig. 12: “New Evaluation” `Page Cleyton Souza - ICIW 2013 17
  • 18. How does it work? • (1) The questioner accesses our System and (2) informs his question; • (3) The System recommends potential responders and (4) the questioner chooses to whom direct the question; • (5) Those chosen access our System, (6) answers the question, (7) and informs the questioner about his answer; • (8) The questioner access our System, (9) see the answer, and (10) evaluates it. Cleyton Souza - ICIW 2013 18
  • 19. Evaluation • Nine Volunteers evaluated ten recommendations for a couple of questions a) b) Looking for a new band to listen during weekend, does anyone have an indication? Going to the movie theater after years LOL. What is the best movie in theaters? • Each recommendation was labeled as good (relevance 1), neutral (relevance 0) and bad (relevance 0). • These labels reflect the opinion of the volunteers about the recommendation Cleyton Souza - ICIW 2013 19
  • 20. Results Cases Best case for Question “a” Amount of Followers 192 % of good %of bad nDCG 50% 10% 0.63 Worst case for Question “a” 129 30% 60% 0.25 Best case for Question “b” 121 60% 0% 0.74 Worst case for Question “b” 68 30% 0% 0.18 Average for Question “a” 110 41% 28% 0.41 Average for Question “b” 110 50% 20% 0.51 Cleyton Souza - ICIW 2013 20
  • 21. Future Work • Where are we? • Mobile App • Volunteer’s feedback – Follow Back Filter – Thesaurus • Real case study Cleyton Souza - ICIW 2013 21
  • 22. Social Query System A System for Query Routing on Twitter Thank You! Lia TIPS Laboratory of Artificial Intelligence Group of Intelligent Social and Customizable Technologies Cleyton Souza Jonathas Magalhães, Evandro Costa, and Joseana Fechine Laboratory of Artificial Intelligence – LIA Federal University of Campina Grande - UFCG