Augmented Participation to Live Events through Social Network Content Enrichment with ECSTASYS

422 views

Published on

My presentation at the AI Mashup Challenge 2014 @ESWC 2014

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
422
On SlideShare
0
From Embeds
0
Number of Embeds
15
Actions
Shares
0
Downloads
2
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Augmented Participation to Live Events through Social Network Content Enrichment with ECSTASYS

  1. 1. Dipartimento di Elettronica, Informazione e Bioingegneria Augmented Participation to Live Events through Social Network Content Enrichment with ECSTASYS Marco Brambilla, Daniele Dell’Aglio, Emanuele Della Valle, Andrea Mauri and Riccardo Volonterio
  2. 2. Dipartimento di Elettronica, Informazione e Bioingegneria Problem  Conferences (but also exhibitions, sports or fashion happenings) are complex events – They are composed by parallel and dislocated sub- events (talks, workshops, tutorials)   27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 2
  3. 3. Dipartimento di Elettronica, Informazione e Bioingegneria Problem  Conferences (but also exhibitions, sports or fashion happenings) are complex events – They are composed by parallel and dislocated sub- events (talks, workshops, tutorials)  Participants, organisers and interested people are interested in having an holistic view on the event  27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 2
  4. 4. Dipartimento di Elettronica, Informazione e Bioingegneria Problem  Conferences (but also exhibitions, sports or fashion happenings) are complex events – They are composed by parallel and dislocated sub- events (talks, workshops, tutorials)  Participants, organisers and interested people are interested in having an holistic view on the event  It is hard to have a clear vision of what is happening – Attendees have a partial view of the event (they know what happens in the place where they are) 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 2
  5. 5. Dipartimento di Elettronica, Informazione e Bioingegneria The solution  Attendees share opinions, recommendations, materials, and reports of the happening through social media  Let’s capture them!  27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 3
  6. 6. Dipartimento di Elettronica, Informazione e Bioingegneria The solution  Attendees share opinions, recommendations, materials, and reports of the happening through social media  Let’s capture them!  Event-Centered STream Analysis SYStem (ECSTASYS) – It caputes the the social media contents related to a live event – It enriches them in a way that makes it valuable for (local or remote) attendees. 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 3
  7. 7. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS as a whole 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 4 Retrieve the tweets
  8. 8. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS as a whole 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 4 Retrieve the tweets Filter the non-relevant ones
  9. 9. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS as a whole 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 4 Retrieve the tweets Filter the non-relevant ones Identify the conference-related entities
  10. 10. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS as a whole 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 4 Retrieve the tweets Filter the non-relevant ones Identify the conference-related entities Associate each tweet to the event it discusses
  11. 11. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS as a whole 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 4 Retrieve the tweets Filter the non-relevant ones Identify the conference-related entities Associate each tweet to the event it discusses Visualise them by event
  12. 12. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS KB Deriving the knowledge base 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 5
  13. 13. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS KB Deriving the knowledge base 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 5 DBLP SW dog food Conference schedule
  14. 14. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS KB Deriving the knowledge base 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 5 DBLP SW dog food Conference schedule • Authors • Paper at the conference • Recent papers • Schedule
  15. 15. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS KB Deriving the knowledge base 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 5 DBLP SW dog food Conference schedule SeWeb Conference Ontology SKOS ECSTASYS vocabulary • Authors • Paper at the conference • Recent papers • Schedule
  16. 16. Dipartimento di Elettronica, Informazione e Bioingegneria ECSTASYS KB Deriving the knowledge base 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 5 DBLP SW dog food Conference schedule SeWeb Conference Ontology SKOS ECSTASYS vocabulary OWLIM Lite-RL • Authors • Paper at the conference • Recent papers • Schedule
  17. 17. Dipartimento di Elettronica, Informazione e Bioingegneria Retrieve the data 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 6 Twitter Streaming API “Ingenious way to learn languages: duolingo #www2013”
  18. 18. Dipartimento di Elettronica, Informazione e Bioingegneria Retrieve the data 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 6 Twitter Streaming API By keyword #vonahn #www2013 “Ingenious way to learn languages: duolingo #www2013”
  19. 19. Dipartimento di Elettronica, Informazione e Bioingegneria Retrieve the data 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 6 Twitter Streaming API By keyword #vonahn #www2013 By geo “Ingenious way to learn languages: duolingo #www2013”
  20. 20. Dipartimento di Elettronica, Informazione e Bioingegneria By user Retrieve the data 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 6 Twitter Streaming API By keyword #vonahn #www2013 By geo “Ingenious way to learn languages: duolingo #www2013”
  21. 21. Dipartimento di Elettronica, Informazione e Bioingegneria Filter the non-relevant data 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 7 Relevance Filter Previous conf. tweets CRF Model
  22. 22. Dipartimento di Elettronica, Informazione e Bioingegneria Filter the non-relevant data 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 7 Relevance Filter Previous conf. tweets CRF Model CRF filter over a model derived by previous conference tweets
  23. 23. Dipartimento di Elettronica, Informazione e Bioingegneria Filter the non-relevant data 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 7 Relevance Filter Previous conf. tweets CRF Model CRF filter over a model derived by previous conference tweets Tweets with non-English text
  24. 24. Dipartimento di Elettronica, Informazione e Bioingegneria Filter the non-relevant data 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 7 Relevance Filter Previous conf. tweets CRF Model CRF filter over a model derived by previous conference tweets Tweets with non-English text Tweets not related to the conference
  25. 25. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the relevant entities 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 8 Entity annotator AIDA DB AIDA
  26. 26. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the relevant entities 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 8 Entity annotator AIDA DB AIDAAIDA identifies only the conference- related entities
  27. 27. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the relevant entities 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 8 Entity annotator ECSTASYS KBAIDA DB AIDA A custom dataset for AIDA is derived by the EKB AIDA identifies only the conference- related entities
  28. 28. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the relevant entities 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 8 Entity annotator ECSTASYS KBAIDA DB AIDA A custom dataset for AIDA is derived by the EKB AIDA identifies only the conference- related entities “Ingenious way to learn languages: duolingo #www2013”
  29. 29. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the relevant entities 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 8 Entity annotator ECSTASYS KBAIDA DB AIDA A custom dataset for AIDA is derived by the EKB AIDA identifies only the conference- related entities
  30. 30. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the associated event 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 9 Domain content linker ECSTASYS KB
  31. 31. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the associated event 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 9 Domain content linker ECSTASYS KB
  32. 32. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the associated event 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 9 Domain content linker Keynote ECSTASYS KB
  33. 33. Dipartimento di Elettronica, Informazione e Bioingegneria Identify the associated event 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 9 Domain content linker Keynote ECSTASYS KB
  34. 34. Dipartimento di Elettronica, Informazione e Bioingegneria Validation and disambiguation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 10 Validator and disambiguator
  35. 35. Dipartimento di Elettronica, Informazione e Bioingegneria Validation and disambiguation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 10 Validator and disambiguator Expert crowd
  36. 36. Dipartimento di Elettronica, Informazione e Bioingegneria Validation and disambiguation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 10 Validator and disambiguator Expert crowd Resolve the linkage when more options are available
  37. 37. Dipartimento di Elettronica, Informazione e Bioingegneria Validation and disambiguation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 10 Validator and disambiguator Expert crowd Resolve the linkage when more options are available
  38. 38. Dipartimento di Elettronica, Informazione e Bioingegneria Validation and disambiguation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 10 Validator and disambiguator Expert crowd
  39. 39. Dipartimento di Elettronica, Informazione e Bioingegneria Validation and disambiguation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 10 Validator and disambiguator Expert crowd Validate links
  40. 40. Dipartimento di Elettronica, Informazione e Bioingegneria Validation and disambiguation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 10 Validator and disambiguator Expert crowd Validate links
  41. 41. Dipartimento di Elettronica, Informazione e Bioingegneria Validation and disambiguation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 10 Validator and disambiguator Expert crowd
  42. 42. Dipartimento di Elettronica, Informazione e Bioingegneria Visualisation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 11
  43. 43. Dipartimento di Elettronica, Informazione e Bioingegneria Visualisation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 11 Wall view
  44. 44. Dipartimento di Elettronica, Informazione e Bioingegneria Visualisation 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 11 Wall view Wall view
  45. 45. Dipartimento di Elettronica, Informazione e Bioingegneria Conclusions  Is it a mashup? Yes! It puts together data from  Twitter (current and past tweets)  DBLP  Semantic Web Dog Food  Conference schedule  Is it intelligent? Yes! It uses:  AI to filter the non-relevant tweets  NLP for identifying the entities in the text  Semantic Web technologies to integrate data and query it  Crowdsource to validate the results and solve the ambiguous results 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 12
  46. 46. Dipartimento di Elettronica, Informazione e Bioingegneria Thank you! Questions? Augmented Participation to Live Events through Social Network Content Enrichment with ECSTASYS http://demo.search-computing.com/aimc-2014/home Marco Brambilla, Daniele Dell’Aglio, Emanuele Della Valle, Andrea Mauri, Riccardo Volonterio (DEIB, Politecnico di Milano) daniele.dellaglio@polimi.it 27 May 2014 - AI Mashup Challenge @ESWC2014 DanieleDell'Aglio-ECSTASYS 13

×