David A. ShammaInternet ExperiencesYahoo! ResearchA movie and a chat…http://www.flickr.com/photos/wvs/3833148925/

Internet Experiences GroupYahoo! Research(David) AymanShammaLyndon KennedyElizabeth Churchill

Traditional Video

Traditional Comments and TagsLeft in Whole, Unattached.

Some tags can be added as annotationsPost annotations don’t allow for real time commentary.This part is interesting.

Social Conversations happen around videosWell – actually people join in a session and converse afterwards.

What to Collect to measure engagement?Type of event (Zync player command or a normal chat message)Anonymous hash (uniquely identifies the sender and the receiver, without exposing personal account data)URL to the shared videoTimestamp for the eventThe player time(with respect to the specific video) at the point the event occurredThe number of characters and the number words typed (for chat messages)Emoticons used in the chat message

A Short Movie

Percent of actions over time.

Volume of actions over time.

Chat follows the video!CHAT

Core Stats (opt-in)April 1, 2009 through April 7, 2009 (inclusive).3.25 million events (URLs, chat, volumes, pause events). 24,258 users • 24,506 sessionsOf these users, 35.29% (μ=2:02, σ= 2:72,σ2= 7:40) of the users engaged in more than one session during that week76,762 URLs, 23% shared in more than one session.Over 99% of the shared videos came from YouTube.Approximately 2% of all the URLs sent within Yahoo! Messenger at-large.

Reciprocity43.6% of the sessions the invitee played at least one video back to the session’s initiator.77.7% sharing reciprocationPairs of people often exchanged more than one set of videos in a session.In the categories of Nonprofit, Technology and Shows, the invitees shared more videos to the initiator (5:4, 9:7, and 5:2 respectably).

Social Actions and Live PerformanceDJs manage three social networks through group of mediums like: MySpace, Webcasts, Twitter, Facebook, and IM.

Y!Live

Y!Live

Y!Live

Much of Social Media is about CongregationSomething we think about at CHI and CSCW and should think about at WWW and MM.(if you are so definition inclined you can enjoy the above paste)

A new form of indirect media-object annotation.中国没有Twitter

People Tweet While They Watch

@kanye dude, not cool #vmaTweeting while watching offers implicit event annotation…one in need of media reification.

CurrentTV: Hack the Debate

a TweetRT: @jowyang If you are watching the debate you’reinvited to participate in #tweetdebate Here is the 411http://tinyurl.com/3jdy67

Anatomy of a TweetRepeated (retweet) content starts with RTAddress other users with an @RT: @jowyang If you are watching the debate you’reinvited to participate in #tweetdebate Here is the 411http://tinyurl.com/3jdy67Rich Media embeds via linksTags start with #

Indirect AnnotationSept 26, 2009 18:23 ESTRT: @jowyang If you are watching the debate you’reinvited to participate in #tweetdebate Here is the 411http://tinyurl.com/3jdy67

Tweet CrawlThree hashtags: #current #debate08 #tweetdebate97 mins debate + 53 mins following = 2.5 hours total. 3,238 tweets from 1,160 people.1,824 tweets from 647 people during the debate.1,414 tweets from 738 people post debate.577 @ mentions (reciprocity!)266 mentions during the debate311 afterwards.Low RT: 24 retweetsin total6 during18 afterwards.

Volume of Tweets by MinuteCrawled from the Twitter RESTful search API.

Tweets During and After the DebatesConversation swells after the debate.

Volume of Conversation Follows the DebatePost debate

Does Conversation follow After a SegmentThink of Isaac NewtonPost Segment?

Will the roots of f’(x) find segmentation markers?

Automatic Segment DetectionWe use Newton’s Method to find extrema outside μ±σ to find candidate markers. Any marker that follows from the a marker on the previous minute is ignored.

Automatic Segment Detection with 92% AccuracyWhen compared to CSPAN’s editorialized Debate Summary ± 1 minute.

Tags As Boundary Objects

Directed Communication via @mentionsJohn Tweets: “Hey @mary, my person is winning!” Makes a directed graph from John to Mary.

Barack, NewsHour, & McCain automatically discovered.High Eigenvector Centrality Figures on Twitter from the First US Presidential Debate of 2008.

Sinks in the networkHigh in degree but poor centrality.

Tweets to TermsCommon stems in bold-italic.

Tweets are Reaction not Content

What if we look at other events?What can we find?

Argentina v England (1986 FIFA World Cup quarter-final)

Nooo! #worldcup #handEvent Onset!

July 20, 1969 Apollo 11 Moon Landing

omg! @nasarukddng? #landing #fake #moonTags as boundary objects can find communities & sets.

Godzilla attacking the Tokyo

やばい！国会議事堂をつぶしている！@radonがんばって！#gojiraTweet Content Comprehension Need Not Be Needed.

Inauguration 2009http://www.flickr.com/photos/twistedart/3212723019/

Data Mining Feed53,000 Tweets @ 600 per minutes

Drop in @conversation as onset

Drop in @conversation as onset (inaug subset)

Less @ means less chars

Terms as topicsUsing a TF/IDF window of 5 mins

Sustained InterestSome topics continue over time with a higher conversational context.

People Announce(12:05) Bastille71: OMG - Obama just messed up the oath - AWESOME! he’s human!(12:07) ryantherobot: LOL Obama messed up his inaugural oath twice! regardless, Obama is the president today! whoooo!(12:46) mattycus: RT @deelah: it wasn’t Obama that messed the oath, it was Chief Justice Roberts: http://is.gd/gAVo(12:53) dawngoldberg: @therichbrooks He flubbed the oath because Chief Justice screwed up the order of the words.

People Reply(12:05) Bastille71: OMG - Obama just messed up the oath - AWESOME! he’s human!(12:07) ryantherobot: LOL Obama messed up his inaugural oath twice! regardless, Obama is the president today! whoooo!(12:46) mattycus: RT @deelah: it wasn’t Obama that messed the oath, it was Chief Justice Roberts: http://is.gd/gAVo(12:53) dawngoldberg: @therichbrooks He flubbed the oath because Chief Justice screwed up the order of the words.

HCC and MM and Other WorkIndirect annotation through community actionUncollected Sources (read: events) are highly valuableSegmentation, Figure Identification, Term DistanceBigrams? Real Time?

Statlerhttp://bit.ly/statler

Thanks Chloe S., Ben C., Marc S., M. Cameron J., Ryan S., & NodeXLTweet the Debates: Understanding Community Annotation of Uncollected Sources David A. Shamma; Lyndon Kennedy; Elizabeth F. Churchill, ACM Multimedia, ACM, 2009Understanding the Creative Conversation: Modeling to Engagement David A. Shamma; Dan Perkel; Kurt Luther, Creativity and Cognition, ACM, 2009Spinning Online: A Case Study of Internet Broadcasting by DJs David A. Shamma; Elizabeth Churchill; Nikhil Bobb; Matt Fukuda, Communities & Technology, ACM, 2009Zync with Me: Synchronized Sharing of Video through Instant Messaging David A. Shamma; Yiming Liu; Pablo Cesar, David Geerts, KonstantinosChorianopoulos, Social Interactive Television: Immersive Shared Experiences and Perspectives, Information Science Reference, IGI Global, 2009Enhancing online personal connections through the synchronized sharing of online video Shamma, D. A.; Bastéa-Forte, M.; Joubert, N.; Liu, Y., Human Factors in Computing Systems (CHI), ACM, 2008Supporting creative acts beyond dissemination David A. Shamma; Ryan Shaw, Creativity and Cognition, ACM, 2007Watch what I watch: using community activity to understand content David A. Shamma; Ryan Shaw; Peter Shafton; Yiming Liu, ACM Multimedia Workshop on Multimedia Information Retrival (MIR), ACM, 2007Zync: the design of synchronized video sharing Yiming Liu; David A. Shamma; Peter Shafton; Jeannie Yang, Designing for User eXperiences, ACM, 2007