Social Media Dataset

Social Media DataSet UPV, Aplicaciones de la Lingüística Computacional Abril 22nd, 2010 http://www.slideshare.com/jccortizo

José Carlos Cortizo Twitter: @josek_net

Goal ‣ Understand the possibilities of Social Media for Research

Index ‣ About the Speaker ‣ Research at UEM ‣ SGP, Wipley, BrainSins ‣ Social Media statistics ‣ Social Media as research ﬁeld ‣ Applications ‣ Academic research vs Enterprise

José Carlos Cortizo 10 R&P projects, 4 workshops, 20 papers NLP, DM consultancy 2004 2005 2006 2007 2008 2009 2010

My Company SGP Videogamers Social Network 2.600 reg. users, ~10K monthly users SaaS software for SM & e-C RecSys, Social Search...

SGP Funding • €350K from CDTI (PID project) • €100K from FFF • still looking for extra €100K from BA

Web 2.0 vs. Social Web

What’s Web 2.0?

An evolution (of) and (based on) the Web...

...focused on users http://www.flickr.com/photos/cayusa/431036565

Concept introduced by “Tim O’Reilly” in 2004 http://www.flickr.com/photos/thomashawk/153656919/

Users own the Information They should manage the information

It’s not a technology, it’s a philosophical concept

Wikis (and Wikipedia), blogs, etc.

Evolution of the Web

Concepts

AJAX • Web development techniques empowering Web 2.0 • Much developers misunderstand the concept of Web 2.0 and think about AJAX

Social Web • Describe how people socialize with each othe throughout the WWW • 2 descriptions • Web 2.0 • Proposal for a future network similar to WWW

Social Media • Media designed to be disseminated through Social interaction • Internet forums, blogs, microblogging, wikis, podcasts, social networks, etc. • More info: http://www.slideshare.net/jccortizo/taller-redes- sociales-presentation

Social Media Statistics

Facebook

Facebook stats. • > 400M. active users • 50% log in to FB in any given day • > 35M u. update their status each day • > 60M. status updates per day • 3 billion photos uploaded each month • 5 billion contents shared each week

Facebook stats. • Avg. user has 130 friends on FB • Avg. user sends 8 friend req. per month • Avg. user spends > 55 min. per day • > 70% FB users are outside USA • > 500K applications

Facebook stats. • > 60M FB users use FB Connect on external websites • > 100M accessing FB though mobile • > 200 mobile operators in 60 cuntries deploying/promoting FB mobile products http://www.facebook.com/press/info.php?statistics

Twitter

Twitter stats. • > 105M. registered users • 300K users sign up every day • > 180M. unique visitors per month • 75% trafﬁc come from 3rd party apps. • > 600M search queries on Twitter/day • 37% of active users use mobile http://www.readwriteweb.com/archives/just_the_facts_statistics_from_twitter_chirp.php

SM is the New Web • Facebook trafﬁc tops Google (for USA) • FB > 7% of US trafﬁc • March 2010 • http://money.cnn.com/2010/03/16/technology/ facebook_most_visited/

SM envisioning the Future • Mobile Web • Search • Real-time search • Social search • Online identity http://www.madrimasd.org/blogs/sistemas_inteligentes/2009/01/19/111413

Mobile Web • No real mobile web until Social Media • 25% FB users and 37% Twitter users accesing from mobile devices • Trend: more mobile web users than “regular” ones within the next 5 years [1] [1] J. C. Cortizo, L. I. Diaz, F. Carrero, B. Monsalve, “On the Future of Mobile Phones as the Heart of Community Built Databases” to appear in 2011

Real-Time Search

Social Search

Online Identity • User identity is a real business • Facebook Connect, OAuth, OpenID...

Social Media as Research Field

We need Data • We need data to validate our research • Why use “non-real”/small/”non- relevant”/old-fashioned datasets • UCI • Reuters • ...

SM, Huge DataSet • Billions users • Billions contents • Textual, Multimedia (image, videos, etc.) • Billions of connections • Behaviors, preferences, trends...

SM Openness • It’s easy to get data from SM • SM based datasets • Developers APIS • Spidering the Web

Available DataSets • Social Tagging (CiteULike, Bibsonomy, MovieLens, Delicious, Flickr, Last.FM...) • http://kmi.tugraz.at/staff/markus/datasets/ • Yahoo! Firehose (750K ratings/day, 8K reviews/day, 150K comments/day, status updates, Flickr, Delicious...) • http://developer.yahoo.net/blog/archives/ 2010/04/yahoo_updates_ﬁrehose.html

Available DataSets • MySpace data (real-time data, multimedia content, ...) • http://blog.infochimps.org/2010/03/12/ announcing-bulk-redistribution-of- myspace-data/ • Spinn3r Blog Dataset/JDPA Sentiment Corpus • http://www.icwsm.org/data/

...and more • http://delicious.com/pskomoroch/ dataset

Key Beneﬁts • There’s a lot of data on SM • It’s fun! • You can work on a real-real domain • ¿Make (real) money with your research?

Where to publish? • ICSWM: AAAI Conference on Weblogs and Social Media • MSM/SMUC: Workshop on Search and Mining User generated Contents • WWW: 4 Social Networks sessions + other 15 S.M. related papers • ACM RecSys + Social Web workshop

Where to publish? • Any other ‘typical’ conference from your research area • Social web/search/mining/networks analysis workshops on almost any relevant conference

Other Research Uses Twitter Lists

http://machine-learning.blogspot.com	3717
http://machine-learning.blogspot.in	229
http://machine-learning.blogspot.ca	61
http://machine-learning.blogspot.co.uk	54
http://feeds.feedburner.com	43
http://machine-learning.blogspot.de	37
http://machine-learning.blogspot.com.es	20
http://www.slideshare.net	18
http://machine-learning.blogspot.fr	17
http://machine-learning.blogspot.com.au	17
http://machine-learning.blogspot.com.br	14
http://machine-learning.blogspot.it	14
http://machine-learning.blogspot.jp	12
http://static.slidesharecdn.com	7
http://translate.googleusercontent.com	7
http://machine-learning.blogspot.co.nz	6
http://machine-learning.blogspot.mx	6
http://machine-learning.blogspot.pt	5
http://machine-learning.blogspot.se	4
http://webcache.googleusercontent.com	3
http://machine-learning.blogspot.com.ar	3
http://www.machine-learning.blogspot.com	2
http://reader.googleusercontent.com	2
http://paper.li	1
http://machine-learning.blogspot.com.sixxs.org	1
http://machine-learning.blogspot.sg	1

Social Media Dataset

by José Carlos Cortizo Pérez on Apr 18, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

26 Embeds 4,301

Statistics

Social Media Dataset — Presentation Transcript