Interoperability of a Social Media Observatory

1,271 views

Published on

Presented at the Web Observatory Workshop at the World Wide Web Conference in Rio De Janiero, Brazil.

Published in: Education, Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,271
On SlideShare
0
From Embeds
0
Number of Embeds
933
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • When people communicate online, they leave digital tracesWith easy access to the data we create on social media, social scientists can study human social behavior on a larger scale than has ever been possible in human history.
  • Are there well-defined communication behaviors that characterizethe activities of influential actors?What is the role of bridging users in facilitating informationtransfer between ideologically opposed communities?Who are the opinion leaders, and how dothey engage in frame-making and agenda-setting?
  • The polarization of political communities
  • The evolution of memes
  • Meme DetectionStatic & Interactive VisualizationsData downloads
  • Bundle each event, in this case a tweet, into groups based on common features.
  • Connect the users that communicate
  • visualizations of social media communication which can show us the network topology.Each person is represented by a nodeA line represents an information transfer between those two peopleOrange lines are mentions, and blue lines are retweetsThe width of the edge is a measure of the strength of that relationship; computed by how many events of that type occurred between those two peopleWe can see different characteristics in these networks for different types of communication. A network centered around a celebrity like Barack Obama , for example, has thousands of people mentioning and retweeting that person. A meme that is propagated by spammers will look much different, for example when a few users constantly retweeteachother
  • The meme is the account in the center. A bunch of accounts collude by retweeting each other (as displayed by the thick blue edges) to promote a particular website
  • Meme DetectionStatic & Interactive VisualizationsData downloads
  • Interoperability of a Social Media Observatory

    1. 1. Interoperability of a Social Media Observatory Karissa McKelvey And Filippo Menczer Center for Complex Networks and Systems Research School of Informatics and Computing Indiana University, Bloomington 1
    2. 2. truthy.indiana.edu 2
    3. 3. Can we use social media as laboratories for social science? truthy.indiana.edu 3
    4. 4. Political Polarization on Twitter Michael Conover, Jacob Ratkiewicz, Bruno Gonçalves, Alessandro Flammini & Filippo Menczer International Conference on Weblogs and Social Media 2011 truthy.indiana.edu 4
    5. 5. Competition for attention Competitions among topics in a world with limited attention Nature Scientific Report, 2012. Lilian Weng, Alessandro Flammini, Alessandro Vespignani and Filippo Menczer. #jan25 truthy.indiana.edu 5
    6. 6. truthy.indiana.edu 6 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● 0 20 40 60 80 100 −2e+050e+002e+05 a. 2010 Tweet Share VoteMargin ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ●● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ●● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● 0 20 40 60 80 100 −2e+050e+002e+05 b. 2012 Tweet Share VoteMargin More Tweets, More Votes DiGrazia, Joseph, McKelvey, Karissa, Bollen, Johan and Rojas, Fabio. More Tweets, More Votes: Social Media as a Quantitative Indicator of Political Behavior (February 21, 2013). Available at SSRN: http://ssrn.com/abstract=2235423 or http://dx.doi.org/10.2139/ssrn.2235423
    7. 7. astroturf truthy.indiana.edu 7
    8. 8. Data “mine” ing truthy.indiana.edu 8
    9. 9. Data “ours” ing truthy.indiana.edu 9
    10. 10. truthy.indiana.edu truthy.indiana.edu 10
    11. 11. truthy.indiana.edu 11
    12. 12. Infrastructure nosql& mysql&hbase& Storage& Social& Media& Model& APIs& Toolkits/ Website& truthy.indiana.edu 12
    13. 13. Infrastructure nosql& mysql&hbase& Storage& Social& Media& Model& APIs& Toolkits/ Website& truthy.indiana.edu 13
    14. 14. Data Collection • Twitter Streaming API • August, 2010 – present • 5TB Compressed truthy.indiana.edu 14
    15. 15. Real-Time Filtering • Past 90 days • US Politics 2012, Social Movements, News • MySQL database + website truthy.indiana.edu 15
    16. 16. Infrastructure nosql& mysql&hbase& Storage& Social& Media& Model& APIs& Toolkits/ Website& truthy.indiana.edu 16
    17. 17. Model • Events – Post on a social media site • Users – Actors in the post – Sender, receiver, forwarder, etc • Meme – Discernable unit of information transfer truthy.indiana.edu 17
    18. 18. Meme Hashtag User URL Phrase truthy.indiana.edu 18
    19. 19. Building the Network truthy.indiana.edu 19 Retweet (forward) Mention (conversation)
    20. 20. celebrities spam astroturf politics 20
    21. 21. politics truthy.indiana.edu 21
    22. 22. #tcot truthy.indiana.edu 22
    23. 23. celebrities politics truthy.indiana.edu 23
    24. 24. @barackobama truthy.indiana.edu 24
    25. 25. celebrities spam astroturf politics 25
    26. 26. @bek_rt truthy.indiana.edu 26
    27. 27. Infrastructure nosql& mysql&hbase& Storage& Social& Media& Model& APIs& Toolkits/ Website& truthy.indiana.edu 27
    28. 28. truthy.indiana.edu truthy.indiana.edu 28
    29. 29. truthy.indiana.edu 29
    30. 30. Infrastructure nosql& mysql&hbase& Storage& Social& Media& Model& APIs& Toolkits/ Website& truthy.indiana.edu 30
    31. 31. API & Website • Filterable and searchable interface to find memes of interest • Endpoints for users to access data programmatically • Visualizations (saw earlier) truthy.indiana.edu 31
    32. 32. Further Thoughts • Potential uses: – Pedagogy – Prototyping – Research • Terms of Service – Tweet text – Derived Data truthy.indiana.edu 32
    33. 33. Thanks Papers at cnets.indiana.edu/groups/nan/truthy Sandro Flammini Bruno Conçalves Jacob Ratkiewicz Lilian Weng Mike Conover Johan Bollen Przemek Grabowicz Mark Meiss Alex Vespignani Alex Rudnick Luca Aiello Filippo Menczer truthy.indiana.edu 33

    ×