Your SlideShare is downloading. ×
Human computation and the Semantic Web (examples)
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Human computation and the Semantic Web (examples)

306
views

Published on

Part 5 of a joint tutorial with Maribel Acosta and Gianluca Demartini at ESWC2013, Montpellier, France.

Part 5 of a joint tutorial with Maribel Acosta and Gianluca Demartini at ESWC2013, Montpellier, France.

Published in: Education, Technology

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
306
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
10
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. HUMAN COMPUTATION AND THE SEMANTIC WEB ELENA SIMPERL UNIVERSITY OF SOUTHAMPTON, UK 7/18/2013 Tutorial@ESWC2013 1
  • 2. WHAT IS DIFFERENT ABOUT SEMANTIC SYSTEMS? Semantic Web tools vs. applications • Intelligent (specialized) Web sites (portals) with improved (local) search based on vocabularies and ontologies • X2X integration (often combined with Web services) • Knowledge representation, communication and exchange 7/18/2013 Tutorial@ESWC2013
  • 3. WHAT DO YOU WANT YOUR USERS TO DO? • Semantic applications • Context of the actual application • Need to involve users in knowledge acquisition and engineering tasks? • Incentives are related to organizational and social factors • Seamless integration of new features • Semantic tools (e.g., Linked Data publishing, ontology editing) • Game mechanics • Paid crowdsourcing (integrated) • Using results of games with a purpose 7/18/2013 Tutorial@ESWC2013
  • 4. THE LEVEL OF TASKS FOUND IN METHODOLOGIES NEEDS FURTHER REFINEMENT Crowdsource very specific tasks that are (highly) divisible • Labeling (in different languages) • Finding relationships • Populating the ontology • Aligning and interlinking • Ontology-based annotation • Validating the results of automatic methods • … Think about the context of the application (social structure) and about how to hide tasks behind existing practices and tools 4 7/18/2013 Tutorial@ESWC2013
  • 5. INTERPLAY OF INCENTIVES AND MOTIVATION ACHIEVES MAXIMAL RESULTS Focus on the actual goal and incentivize related actions • Write posts, create graphics, annotate pictures, reply to customers in a given time… Build a community around the intended actions • Reward helping each other in performing the task and interaction • Reward recruiting new contributors Reward repeated actions • Actions become part of the daily routine
  • 6. TASTE IT! TRY IT! • Restaurant review Android app developed in the Insemtives project • Uses Dbpedia concepts to generate structured reviews • Uses mechanism design/gamification to configure incentives • User study • 2274 reviews by 180 reviewers referring to 900 restaurants, using 5667 Dbpedia concepts 7/18/2013 Tutorial@ESWC2013 6 https://play.google.com/store/apps/details?id=insemtives.android&hl=en 0 500 1000 1500 2000 2500 CAFE FASTFOOD PUB RESTAURANT Numer of reviews Number of semantic annotations (type of cuisine) Number of semantic annotations (dishes)
  • 7. SOCIABILITY DESIGN ASPECTS 7/18/2013 Tutorial@ESWC2013 7
  • 8. MECHANISM DESIGN EXPERIMENTS Two experiments: 150 and 30 students • Points vs. badges • No information about others vs. information about others (neighborhood, median, full leaderboard) Findings • Presenting information on performance of peers helps to increase the number of reviews • Within the treatments with badges individuals tend to contribute more compared to treatments without assignment of badges 7/18/2013 Tutorial@ESWC2013 8
  • 9. LODREFINE 7/18/2013 Tutorial@ESWC2013 9 Extension of LODRefine to enhance automatic data reconciliation algorithms using CrowdFlower
  • 10. LODREFINE (2) 7/18/2013 Tutorial@ESWC2013 10 http://research.zemanta.com/crowds-to-the-rescue/
  • 11. DBPEDIA CURATION 7/18/2013 Tutorial@ESWC2013 11 http://aksw.org/Projects/TripleCheckMate.html
  • 12. ONTOGY BUILDING 7/18/2013 www.insemtives.eu 12
  • 13. RELATIONSHIP FINDING
  • 14. www.insemtives.eu MULTIMEDIA INTERLINKING 7/18/2013 14
  • 15. LINKED DATA CURATION 7/18/2013 Tutorial@ESWC2013 15
  • 16. ENTITY SUMMARIZATION 7/18/2013 Tutorial@ESWC2013 16
  • 17. REUSING CROWDSOURCING RESULTS • Ongoing work: • Vocabulary to describe and exchange crowdsourcing results • Including • Type of crowdsourcing approach • Crowd • Inputs and outputs • Confidence values • Quality assurance method applied • ... 7/18/2013 Tutorial@ESWC2013 17