Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

CrowdTruth Games @NLeSc eHumanities day 2015

1,449 views

Published on

I presented our work on games with purpose within the context of CrowdTruth.org, with specific focus on medical and biology domain

Published in: Technology
  • Be the first to comment

  • Be the first to like this

CrowdTruth Games @NLeSc eHumanities day 2015

  1. 1. The Wisdom of the Crowd through Gamification Lora Aroyo, Merel van Empel & Carlos Martinez Ortiz http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
  2. 2. massive  digital  content  online  …   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
  3. 3. needs  massive  resources  to  process  …   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
  4. 4. crowdsourcing  –  interpreta5on  at  scale  …   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
  5. 5. http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo paid  crowdsourcing  solves  only  part  …  
  6. 6. there  are  massive  niches  of  experts  online  …   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
  7. 7. but  they  need  to  be  engaged  …   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
  8. 8. gamifica5on  is  the  answer  …   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
  9. 9. •  entertaining   •  compe--ve   •  quick   •  s-cky   •  targeted  campaigns   •  effec-ve  engagement   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo games  with  a  purpose  (GWAP)  
  10. 10. Winner EuroITV Competition Best Archives on the Web Award h7p://waisda.nl   Video Tagging – time-stamped tags
  11. 11. Image Tagging – understanding & training crowds
  12. 12. h7p://annotate.accurator.nl   Nichesourcing domain expertise
  13. 13. diversity  of  opinions  from  the  crowd   mul-tude  of  contexts   collected  in  a  decentralized  way   independent  interpreta5ons   aggregated  view  –  the  big  picture   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo understanding  perspec5ves  
  14. 14. a  new  approach  to  understanding  seman5cs   harnessing  the  power  &  diversity  of  the  crowd     harnessing  disagreement   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo CrowdTruth.org  
  15. 15. informs  a  vector  space  model  of  truth     instead  of  a  boolean,  fuzzy  or  sta-s-cal  model     disagreement  is  signal   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo CrowdTruth.org  
  16. 16. http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo CrowdTruth.org http://game.CrowdTruth.org
  17. 17. h7p://game.crowdtruth.org    
  18. 18. h7p://game.crowdtruth.org    
  19. 19. h7p://game.crowdtruth.org    
  20. 20. h7p://game.crowdtruth.org    
  21. 21. h7p://game.crowdtruth.org    
  22. 22. h7p://game.crowdtruth.org    
  23. 23. h7p://game.crowdtruth.org    
  24. 24. h7p://game.crowdtruth.org    
  25. 25. h7p://game.crowdtruth.org    
  26. 26. h7p://game.crowdtruth.org     •  Games engage niche crowds - effective in filling the gap of expert annotations in traditional crowdsourcing •  Annotator disagreement is signal, not noise: •  indicative of the variation in human semantic interpretation of signs •  can indicate ambiguity, vagueness, similarity, over- generality, etc, as well as quality •  Data analysis challenges Take Home Message
  27. 27. h7p://game.crowdtruth.org    
  28. 28. CrowdTruth  Team:  Lora  Aroyo,  Chris  Welty    Robert-­‐Jan  Sips,  Carlos   Mar5nez  Or5z,  Anca  Dumitrache,  Oana  Inel,  Benjamin  Timmermans,   Susanna  van  de  Ven,  Merel  van  Empel,  Jelle  v.d.  Ploeg,  Ta-ana  Cristea,   Khalid  Khamkham,  Harrië7e  Smook,  Rens  van  Honschooten,  Arne  Rutjes   CrowdTruth.org github.com/CrowdTruth
  29. 29. http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo CrowdTruth.org http://game.CrowdTruth.org
  30. 30. massive  crowdsourcing  in  cultural  heritage  …   http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

×