Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Semantic Games

664 views

Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Semantic Games

  1. 1. Semantic Games<br />Year 2 Review 2011<br />Katharina Siorpaes, UIBK<br />www.insemtives.eu<br />http://blog.insemtives.eu<br />
  2. 2. Agenda<br />Introduction<br />The OntoGame series<br />Lessonslearnt<br />Gaming API<br />www.semanticgames.org<br />4/13/11<br />www.insemtives.eu<br />2<br />
  3. 3. Introduction<br />4/13/11<br />www.insemtives.eu<br />3<br />
  4. 4. Problem<br />4/13/11<br />www.insemtives.eu<br />4<br />4<br />
  5. 5. Games<br />4/13/11<br />www.insemtives.eu<br />5<br />> 300million downloads1<br />They are fun…<br />200 million <br />people play casual games2<br />>15 million daily active players3<br />Casual Games Market Report, 2007<br />http://www.casualgamesassociation.org/news.php<br />Facebook application statistics, Feb 2011<br />5<br />
  6. 6. Casual games<br />Steep learning curve<br />Fast game play: little time effort required <br />Simple implementation (simple interface and graphics)<br />Low hardware efforts (usually browser or mobile app)<br />Low bandwidth requirements<br />Mass audience<br />www.insemtives.eu<br />6<br />4/13/11<br />
  7. 7. The ontogameseries<br />4/13/11<br />www.insemtives.eu<br />7<br />
  8. 8. 8<br />http://www.ontogame.org<br />http://apps.facebook.com/ontogame<br />
  9. 9. OntoPronto and OntoTube<br />4/13/11<br />www.insemtives.eu<br />9<br />
  10. 10. OntoGame<br />Players paired randomly and anonymously<br />Best strategy to get points: truthful answers<br />2 player live mode or<br />Community matching mode<br />Skip<br />Limited amount of time<br />Cheating: <br />Anonymity<br />Pre-recorded challenges<br />Generic gaming platform <br />Derive formal representations of the data<br />All data exported as linked data <br />www.insemtives.eu<br />10<br />4/13/11<br />
  11. 11. SpotTheLink: ontologymatching<br />Players: 2 (anonymouslypaired)<br />Time: 2 minutes<br />Type: Online casualgame (browser)<br />Task: <br />Describingrelationshipsbetween 2 concepts.<br />Input ontologies in thisexample: DBPedia and Proton.<br />Input: 2 ontologies, SKOS concepts. <br />Output: Alignmentsbetween 2 ontologies. <br />www.insemtives.eu<br />11<br />4/13/11<br />
  12. 12. SpotTheLink: ontologymatching<br />www.insemtives.eu<br />12<br />4/13/11<br />
  13. 13. SpotTheLink: ontologymatching<br />www.insemtives.eu<br />13<br />4/13/11<br />
  14. 14. www.insemtives.eu<br />SpotTheLink – Data generation and results<br /><ul><li>Align DBpedia concepts with ProtonT concepts using SKOS
  15. 15. 77.84% consensual answers, 80% valid alignments </li></ul>PROTON<br />4/13/11<br />14<br />
  16. 16. SEAFISH: image annotation<br />Players: 2 (anonymouslypaired)<br />Time: 2 minutes<br />Type: Online casualgame (browser)<br />Task: Sortingrelated and unrelatedimages. <br />Input: DBPediaimages, Google images. <br />Output: Improved image annotations. <br />www.insemtives.eu<br />15<br />4/13/11<br />
  17. 17. SEAFISH<br />www.insemtives.eu<br />16<br />4/13/11<br />
  18. 18. www.insemtives.eu<br />SEAFish – Annotating images (1/2)<br />4/13/11<br />17<br />
  19. 19. www.insemtives.eu<br />SEAFish– Annotating images (2/2)<br />4/13/11<br />18<br />
  20. 20. SeaFish – Collected Data<br />3 Different data sets<br />An online survey<br />Feedback from Siegen, Trento <br />14456 Modeling decisions <br />931 Game rounds <br />548 Generated annotations<br />4/13/11<br />www.insemtives.eu<br />19<br />
  21. 21. SeaFish evaluation<br />4/13/11<br />www.insemtives.eu<br />20<br />96% of the players understood the game’s goal.<br />
  22. 22. Tubelink: videointerlinking<br />Players: 2 (anonymouslypaired)<br />Time: TBD<br />Type: Online casualgame (browser)<br />Task: Choosingnodesfrom LOD forvideos. <br />Selectingdatasets, <br />Selectingnodes. <br />Input: YouTubevideos, LOD (DBPedia). <br />Output: AnnotationsforYouTubeusing LOD. <br />www.insemtives.eu<br />21<br />4/13/11<br />
  23. 23. Tubelink<br />www.insemtives.eu<br />22<br />4/13/11<br />
  24. 24. Tubelink<br />www.insemtives.eu<br />23<br />4/13/11<br />
  25. 25. Lessonslearnt<br />4/13/11<br />www.insemtives.eu<br />24<br />
  26. 26. Lessonslearnt<br />Task selection<br />Not too easy nor too difficult, suitable for a broad audience, not too many game rounds (3-5)<br />Simple challenges (nottoomanystages, etc.)<br />Limitedspace of choice<br />Allow fast gameplay<br />Game fun: user interface and social factor<br />Compromise: usability and appealing design<br />It isnot trivial to make an interesting user interface<br />Competition and reputation<br />Ranking is a good motivator<br />Sociability<br />Playing against other people ismotivating<br />Partner!<br />Knowledge corpora<br />Interesting domain, structure and size of the corpora<br />www.insemtives.eu<br />25<br />4/13/11<br />
  27. 27. GAMING Api<br />4/13/11<br />www.insemtives.eu<br />26<br />
  28. 28. OntoGame API<br />API that provides several methods that are shared by the OntoGame games, such as: <br />Different agreement types, e.g. Selection Agreement<br />Input matching (e.g. majority)<br />Game modes (double player, single player) <br />Player reliability evaluation. <br />Player matching, e.g. finding the optimal partner to play.<br />Resource( = data needed for games) management.<br />Semantic data extraction of stored game data.<br />http://insemtives.svn.sourceforge.net/viewvc/insemtives/generic-gaming-toolkit<br />www.insemtives.eu<br />27<br />4/13/11<br />
  29. 29. www.semanticgames.org<br />4/13/11<br />www.insemtives.eu<br />28<br />
  30. 30. 4/13/11<br />www.insemtives.eu<br />29<br />
  31. 31. 4/13/11<br />www.insemtives.eu<br />30<br />
  32. 32. Summary<br />Games<br />www.ontogame.org<br />SPARQL endpoint<br />http://ontogame.sti2.at:8080/openrdf-workbench/repositories/onto-game/<br />Communityportal<br />www.semanticgames.org<br />Gamessurvey<br />http://www.insemtives.eu/games.php<br />Interlinking survey<br />http://www.sti-innsbruck.at/results/browse/technical-reports/details/?uid=62<br />4/13/11<br />www.insemtives.eu<br />31<br />
  33. 33. References<br />Luis von Ahn. Games With A Purpose. IEEE Computer Magazine, June 2006. pp 96-98.<br />Luis von Ahn and Laura Dabbish. Designing games with a purpose. Communications of the ACM, 2008.<br />Katharina Siorpaes and Elena Simperl: Human Intelligence in the Process of Semantic Content Creation, World Wide Web Journal (WWW), Volume 13, Issue 1-2, March 2010.<br />Katharina Siorpaes and Martin Hepp: Games with a Purpose for the Semantic Web. IEEE Intelligent Systems, Vol. 23, No. 3, pp. 50-60, May/June 2008.<br />CasualGame Association White Paper: http://www.casualgamesassociation.org<br />List of games: http://www.insemtives.eu/games.php<br />www.insemtives.eu<br />32<br />4/13/11<br />
  34. 34. BACKUP<br />4/13/11<br />www.insemtives.eu<br />33<br />
  35. 35. Tasks and deliverables<br />All tools are available on http://sourceforge.net/projects/insemtives/<br />Information about tools is provided on http://insemtives.eu/community/tools<br />4/13/11<br />www.insemtives.eu<br />34<br />
  36. 36. Work plan view<br />Months<br />24<br />12<br />18<br />30<br />36<br />6<br />0<br />Tasks <br />SEMANTIC GAMES<br />D4.1.1 Requirements and Design of a Generic Gaming Toolkit and API<br />D4.1.2 Generic Gaming Toolkit and API implementation<br />D4.1.3 Games<br />Task 4.1 Genericgaming toolkit<br />UIBK <br />WEB SERVICE ANNOTATION CHALLENGE<br />D4.2.2 Human‐driven annotation tools for Web services<br />D4.2.1 Human‐driven annotation tools for Web services<br />Task 4.2 Human‐driven Annotation Tools<br />SEEKDA/ONTO<br />D4.2.4 Human‐driven media annotation tools<br />BOOTSTRAPPING TOOL AND L!NKS SEMI AUTOMATIC IMAGE ANNOTATION<br />D4.2.3 Human‐driven media annotation tools<br />D4.3.2 Bootstrapping tools for image files<br />Task 4.3 Bootstrapping Tools<br />UNITN<br />D4.3.1 Bootstrapping tools for image files<br />L!NKS MANUAL IMAGE ANNOTATION AND SEARCH<br />D4.4.2 Search and Navigation tools<br />Task 4.4 Search and Navigation Tools<br />ONTO<br />D4.4.1 Search and Navigation tools<br />
  37. 37. Guidelines<br />Timed response<br />Score keeping<br />Player skill level<br />High score lists<br />Randomness<br />Random player pairing<br />Player testing<br />Repetition<br />Taboo outputs<br />www.insemtives.eu<br />36<br />Luis von Ahn. Games With A Purpose. IEEE Computer Magazine, June 2006. pp 96-98.<br />4/13/11<br />
  38. 38. How to design your own game<br />Specify output<br />Identify input<br />Choose type of game and define game play<br />Based on previous decisions, define game play and adapt underlying game ontology<br />Adapt or define export algorithm<br />Evaluate output<br />www.insemtives.eu<br />37<br />4/13/11<br />
  39. 39. OntoTube: designflaws<br />Consensus findinghard: toomanyoptions to choosefrom. <br />Gameplaycomplex: toomany different stages (8 questions). <br />Toocomplexinterfaces: playershave to choosefromwidelyvaryingUis in different stages of the samegame. <br />Videos toolong: for a fast gameplay, usersshouldnotberequired to watch the completevideo. <br />Socialfactor: the interactionwith the partneristoolow – players do notenjoy the gamebecause the emphasis on the socialcomponentismissing. <br />www.insemtives.eu<br />38<br />4/13/11<br />
  40. 40. Challenges<br />Identifying suitable tasks in semantic content creation<br />Designing games<br />Designing a usable, attractive interface <br />Identifying suitable knowledge corpora <br />Preventing cheating<br />Defusing typical pitfalls of conceptual modeling<br />Distribution of labor<br />Fostering user participation<br />Deriving formal representations <br />Scalability and performance<br />www.insemtives.eu<br />39<br />4/13/11<br />
  41. 41. Evaluation<br /><ul><li>2 resource data sets:
  42. 42. Game logs
  43. 43. Questionaire about the game
  44. 44. 16 players, mostly male and computer scientists
  45. 45. ~ 300 minutes played game time, 380 game rounds, 882 inputs recorded</li></ul>4/13/11<br />40<br />www.insemtives.eu<br />
  46. 46. Evaluation results<br />4/13/11<br />41<br />www.insemtives.eu<br />
  47. 47. SpotTheLinkResults<br />www.insemtives.eu<br />42<br />4/13/11<br />

×