Exploring the Future Potential of AI-Enabled Smartphone Processors
Crowdsourcing is for the tail
1. Crowdsourcing is for the tail
Gianluca Demartini
eXascale Infolab
University of Fribourg, Switzerland
gianlucademartini.net
exascale.info
2. Crowdsourced Data Curation
• Enforce quality and coverage in KBs
• To curate tail entity structured representation
• Leveraging the diversity of the crowd
• Targeted Crowdsourcing
8. Push Crowdsourcing
• Pick-A-Crowd: A system architecture that uses
Task-to-Worker matching:
– The worker’s social profile
– The task context
• Workers can provide higher quality answers
on tasks they relate to
8
Djellel Eddine Difallah, Gianluca Demartini, and Philippe Cudré-Mauroux. Pick-A-Crowd: Tell Me
What You Like, and I'll Tell You What to Do. In: 22nd International Conference on World Wide
Web (WWW 2013), Rio de Janeiro, Brazil, May 2013.
11. OpenTurk
• Yet another a platform? Build on top of Mturk!
• Chrome Extension for push / notification
• 400+ users
• http://bit.ly/openturk-extension
• Open source:
https://github.com/openturk/extension
Gianluca Demartini 11
13. Transactive Search
• Transactive Memories
• Transactive Search:
– Memory reconstructed by a group of people
– Need to target the right people
– A form Targeted Crowdsourcing
• “Who attended the ISWC 2013 conference?”
14. Transactive Search
• Machines: Harvest the Web + Data Mining
• Crowd: Search twitter, look at event pictures
• Transactive Memories: Remember who I met
Gianluca Demartini 14
Michele Catasta, Alberto Tonon, Djellel Eddine Difallah, Gianluca Demartini, Karl Aberer, and
Philippe Cudré-Mauroux. Hippocampus: Answering Memory Queries using Transactive Search.
In: 23rd International Conference on World Wide Web (WWW 2014), Web Science Track. Seoul,
South Korea, April 2014.
16. Conclusions
• Crowdsourcing For Tail Entities
• Focusing on the difficult part of the KB
– The tail is long!
• Challenges
– Which tail entities are valuable?
– Who is the right worker?
– Focus on passion rather than monetary incentives