CrowdSem 2013
1st International Workshop on
“Crowdsourcing the Semantic Web”
Sydney, Australia
21 October 2013
Follow us on Twitter: @crowdsem
Spread the news from today: #crowdsem2013
Monday, October 21, 13

Who are we
Maribel Acosta, Institute AIFB, Karlsruhe Institute of
Technology, Germany
Lora Aroyo, VU University Amsterdam, the Netherlands
Abraham Bernstein, University of Zurich, Switzerland
Jens Lehmann, University of Leipzig, Germany
Natasha Noy, Stanford University, US
Elena Simperl, University of Southampton, United Kingdom
Monday, October 21, 13

Workshop Program
“Dr. Detective”: combining gamification techniques and crowdsourcing to create a gold standard in medical
text, Anca Dumitrache, Lora Aroyo, Chris Welty, Robert-Jan Sips and Anthony Levas , (Discussant: Natasha
Noy)
11:00 – 11:30 Crowdsourced Semantics with Semantic Tagging: “Don’t just tag it, LexiTag it!”, Csaba
Veres, (Discussant: Lora Aroyo)
11: 30 – 12:00 SLUA: Towards Semantic Linking of Users with Actions in Crowdsourcing, Umair Ul Hassan,
Sean O’Riain and Edward Curry, (Discussant: Maribel Acosta)
12:00 – 12:30 Experiment paper: Crowdsourced Entity Markup, Lili Jiang, Yafang Wang, Johannes Hoffart
and Gerhard Weikum, (Discussant: Abraham Bernstein)
12:30 – 12:45 Position paper: A Role for Provenance in Social Computation, Milan Markovic, Peter Edwards
and David Corsar, (Discussant: Lora Aroyo)
Monday, October 21, 13

Workshop Program
1:45 – 2:15 Experiment paper: Frame Semantics Annotation Made Easy with DBpedia, Marco Fossati, Sara
Tonelli and Claudio Giuliano, (Discussant: Maribel Acosta)
2:15 – 2:45 Experiment paper: Developing Crowdsourced Ontology Engineering Tasks: An iterative
process, Jonathan Mortensen, Mark Musen and Natasha F. Noy, (Discussant: Elena Simperl)
2:45 – 3:15 Content and Behaviour Based Metrics for Crowd Truth, Guillermo Soberon, Lora Aroyo, Chris
Welty, Oana Inel, Manfred Overmeen and Hui Lin, (Discussant: Abraham Bernstein)
3:15 – 3:30 Position paper: Information Reputation, Peter Davis and Salman Haq, (Discussant: Elena
Simperl)
Papers accessible at: http://ceur-ws.org/Vol-1030/
Monday, October 21, 13

Invited Talk
4:00 – 5:00 Big Data meets Big Social: Social Machines and the Semantic Web
David De Roure, University of Oxford
This talk will discuss this opportunity for Semantic Web approaches to underpin the design
and construction of future Social Machines against a backdrop of increasing scale and
increasing automation.
David De Roure is Professor of e-Research at University of Oxford and
Director of the Oxford e-Research Centre. Throughout his career he has
worked closely in and across multiple disciplines to foster innovation in
digital methods and scholarship. His current projects range from Web
Science (Social Machines and Web Observatories) to Digital
Humanities (computational musicology). He has a coordinating role in
Digital Humanities at Oxford and is a UK strategic adviser for data
resources in social media.
Monday, October 21, 13

Crowdsourcing Exercise
Task: Gather structured information about the three keynotes at ISWC2013, e.g.
find pictures
find research interests
find publications
etc.
Form groups of experienced and novices in practical crowdsourcing experience
Choose whether you would want to run the task on CrowdFlower or AMT
Create a simple design of the task (20 mins)
One group member presents the design to the whole workshop (5 mins)
Selected tasks will be performed on either AMT or CrowdFlower and we will discuss the
results at the wrap-up session
Monday, October 21, 13

Initial Designs ...
Monday, October 21, 13

Initial Designs ...
Monday, October 21, 13

Initial Designs ...
Monday, October 21, 13

Stay tuned on Twitter
for the results
Follow us on Twitter: @crowdsem
Spread the news from today: #crowdsem2013
Monday, October 21, 13