MIT CSAIL HCI Seminar

The Community/Individual Cycle: Extracting Knowledge, Creating Applications and Understanding Motivations in Public Photo Collections Mor Naaman Yahoo! Research Berkeley

Attraction Map of Paris ,[object Object],[object Object]

Attraction Map of Paris ,[object Object]

Social Media Cycle How? What? Why?

Talk Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Information Overload? ,[object Object]

What can we derive? ,[object Object],[object Object],Dataset: (photo_id, user_id, time, latitude, longitude) (photo_id, tag)

Issues to Tackle ,[object Object],[object Object],[object Object],[object Object],[object Object],Whatever, color, city, spectrum, santa barbara, california, usa, Lookatme, Herbert Bayer Chromatic Gate

Location-driven Modeling ,[object Object],[object Object]

Intuition ,[object Object],[object Object]

Translation into simple algorithm ,[object Object],[object Object],[object Object]

Summary of San Francisco Golden Gate Bridge TransAmerica AT&T Baseball Park Golden Gate Twin Peaks Golden Gate Bay Bridge Ocean Beach Chinatown

Tag-based Modeling ,[object Object],[object Object],[object Object]

Tag Semantics ,[object Object],[object Object],[object Object],[object Object]

Definitions ,[object Object],[object Object]

Intuition for Solution ,[object Object],[object Object],[object Object],[object Object],[object Object]

Scale-structure Identification Entropy = 1.421621 Entropy = 0.766263 Entropy = 0.555915 Entropy = 0.062760

Scale-structure Identification

Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Make it into World Explorer http://tagmaps.research.yahoo.com

ZoneTag(?) ,[object Object],[object Object],[object Object],[object Object],[object Object],“ Everything in the world exists to end up in a photograph” -- Susan Sontag

Why Cameraphones? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],(Source: Future Image Inc.)

Current Mobile Experience ,[object Object],[object Object],[object Object],[object Object],Current mobile experience?

ZoneTag Experience ,[object Object],[object Object]

Where do locations come from? ,[object Object],[object Object]

Where do tags come from? ,[object Object],[object Object],[object Object]

Where do tags come from? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Suggested Tags “ When I went to upload, there were already all these exotic tags like "Bill Graham Civic Auditorium" and "Bob dylan live" available...it sure was convenient to just select and go…”

Where do tags go? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Rotate:right Email:dad Group:zonetag Scanr:document

I’m Too Lazy (you’re not alone) ,[object Object],[object Object],(Bradley Horowitz, elatable.com) (?) (?) (?)

I’m Too Lazy (you’re not alone) ,[object Object],[object Object]

Inspiration ,[object Object],[object Object],[object Object],[object Object]

A few motivating facts ,[object Object],[object Object],[object Object],[object Object],[object Object]

A few motivating facts Average Tags, Public ZoneTag Photo: 2.2 Average Tags, Public Shozu Photo: 0.97 Average Tags, Private ZoneTag Photo: 1.85

Tag Affordances on Flickr ,[object Object],[object Object],[object Object],[object Object],[object Object]

Tags on ZoneTag ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why Tag? Bay Bridge, Fog, [San Francisco, 94105]

Why Tag? RedSox, Fenway, GreenMonster, [Boston, 02215], …

Why Tag? Horsetails, handicapped, sign, [Stanford, 94305], …

User Study ,[object Object],[object Object],[object Object]

Expected… ,[object Object],[object Object],[object Object]

Found… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],X

Motivation Taxonomy “ If I tagged ahead of time I can go back and get all my pictures of [my children]…” “… I then think “well, maybe I should tag this” so I can find it again later” “ I’m obsessive-compulsive”

Motivation Taxonomy “ I want at least one hook of association in there that can help me reconstruct…”

Motivation Taxonomy “ I tag photos with what I think might be interesting to other people, stuff I think people will like” “ I know that tagging can connect my photos to activities, and get more interest” “ I want to look at all [my neighborhood’s] tags. … That’s definitely a reason I’m putting these tags in ”

Motivation Taxonomy “… so that my friends can see what I am up to” I can tell my mom [with the tag] “look, we went to…” “ I left reviews of places – like at the airport, when my flight was delayed, I tagged “Aloha Air sucks.”

Suggested Tags ,[object Object],[object Object],[object Object],[object Object],[object Object],“ Tag suggestions were huge for me; they really cut down on typing” “ I thought: this is how I want it to work all the time!” “ This person was in my phone for a month - who is she???” “ I try to use as many suggested tags that apply. … I also use it for auto-completion – I type “s” to get San Francisco”

Tags/Contribution ,[object Object],[object Object],[object Object]

Open Questions ,[object Object],[object Object],[object Object],[object Object],[object Object]

Enough already with this stupid figure!

Final Notes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Final Notes: APIs For All ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Thanks ,[object Object],[object Object],[object Object],[object Object],[object Object]

Things We Learned ,[object Object],[object Object],[object Object],[object Object]

International Remix ,[object Object],[object Object]

Flickr Example ,[object Object],Number of photos Number of users 6 12 18 … Huh??

Case Study - Flickr ,[object Object],[object Object],Not collected Not identified Not prominent In user’s account As coming from the tagger In the interface, as “opinion” Not aggregated Can’t “vote” on tag/item pair

MIT CSAIL HCI Seminar

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (8)

Similar to MIT CSAIL HCI Seminar

Similar to MIT CSAIL HCI Seminar (20)

More from mor

More from mor (20)

Recently uploaded

Recently uploaded (20)

MIT CSAIL HCI Seminar

Editor's Notes