Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Design and Prototyping of a Social Media Observatory

1,418 views

Published on

Web Observatory Workshop at the International World Wide Web Conference, 2013.

  • Be the first to comment

  • Be the first to like this

Design and Prototyping of a Social Media Observatory

  1. 1. Design and Prototyping ofa Social Media ObservatoryKarissa McKelvey and Filippo MenczerCenter for Complex Networks and Systems ResearchSchool of Informatics and ComputingIndiana University, Bloomington1
  2. 2. Can we use social media aslaboratories for socialscience?truthy.indiana.edu 2
  3. 3. Political Polarization on Twitter Michael Conover, Jacob Ratkiewicz, Bruno Gonçalves, Alessandro Flammini& Filippo Menczer International Conference on Weblogs and Social Media 2011truthy.indiana.edu 3
  4. 4. Data “mine” ingtruthy.indiana.edu 4
  5. 5. Data “ours” ingtruthy.indiana.edu 5
  6. 6. truthy.indiana.edutruthy.indiana.edu 6
  7. 7. Design and Prototypingtruthy.indiana.edu 7
  8. 8. Social Mediatruthy.indiana.edu 8streamingsensitivevery largestructuredmultiple sources
  9. 9. Design ConsiderationsReliabilityReproducibilityTopic FilteringVisualizationOpen AccessLegal Compliancetruthy.indiana.edu 9
  10. 10. Design ConsiderationsReliabilityReproducibilityTopic FilteringVisualizationOpen AccessLegal Compliancetruthy.indiana.edu 10
  11. 11. Reliability• Spam and misinformationtruthy.indiana.edu 11
  12. 12. celebritiesspamastroturfpolitics12
  13. 13. Reliability• Spam and misinformation• Cleansing and tagging by social, algorithmic,or other meanstruthy.indiana.edu 13
  14. 14. truthy.indiana.edu 14
  15. 15. Reliability• Spam and misinformation• Cleansing and tagging by social, algorithmic,or other means• Sampling biastruthy.indiana.edu 15
  16. 16. Data Collection• Twitter Streaming API, random sample• August, 2010 – present• 5TB Compressed• Real-time access to data from last 9 monthsrelated to 3 themes: US Politics, SocialMovements, Newstruthy.indiana.edu 16
  17. 17. Design ConsiderationsReliabilityReproducibilityTopic FilteringVisualizationOpen AccessLegal Compliancetruthy.indiana.edu 17
  18. 18. Reproducibility• Standard ontology for the storage, reference,and transfer of these datasets between users.truthy.indiana.edu 18
  19. 19. Model• Events– Post on a social media site• Users– Actors in the post– Sender, receiver, forwarder, etc• Meme– Discernable unit of information transfer– Eg, hashtag, URL, user, phrase…truthy.indiana.edu 19
  20. 20. Meme Diffusion Networkstruthy.indiana.edu 20Retweet (forward) Mention (conversation)
  21. 21. Design ConsiderationsReliabilityReproducibilityTopic FilteringVisualizationOpen AccessLegal Compliancetruthy.indiana.edu 21
  22. 22. truthy.indiana.edu 22
  23. 23. Design ConsiderationsReliabilityReproducibilityTopic FilteringVisualizationOpen AccessLegal Compliancetruthy.indiana.edu 23
  24. 24. truthy.indiana.edu 24
  25. 25. Design ConsiderationsReliabilityReproducibilityTopic FilteringVisualizationOpen AccessLegal Compliancetruthy.indiana.edu 25
  26. 26. Open Access• A public and free -- or low-cost -- socialobservatory enables access to large-scalesocial media data analytics for non-profitendeavors.truthy.indiana.edu 26
  27. 27. API & Website• Filterable andsearchable interfaceto find memes ofinterest• Endpoints for usersto access dataprogrammatically• Visualizationstruthy.indiana.edu/apidoctruthy.indiana.edu 27
  28. 28. Design ConsiderationsReliabilityReproducibilityTopic FilteringVisualizationOpen AccessLegal Compliancetruthy.indiana.edu 28
  29. 29. Legal Compliance• Terms of Service– Tweet text– Derived datatruthy.indiana.edu 29
  30. 30. truthy.indiana.edutruthy.indiana.edu 30
  31. 31. Thanks!Papers at cnets.indiana.edu/groups/nan/truthySandro FlamminiBruno ConçalvesJacob RatkiewiczLilianWengMike ConoverJohan BollenKarissaMcKelveyPrzemek GrabowiczMark MeissAlexVespignaniAlex RudnickLucaAielloFil MenczerMohsen Jafari-AsbaghOnur VarolEmilio FerraraWednesday, September 26, 12

×