Photos, Mobile, Location and the Social Media Cycle

Photos, Mobile, Location and the Social Media Cycle Mor Naaman Yahoo! Research Berkeley

Attraction Map of Paris
Stanley Milgram, 1976.
Psychological Maps of Paris

Attraction Map of Paris
Y!RB, 2007.

Social Media Cycle How? What? Why?

Talk Outline
Wisdom of the tags
mining information from geo-tagged photos
Applications
World Explorer
ZoneTag
Why we tag
A user study of tagging motivations

Information Overload?
Flickr “geotagged”

What can we derive?
Location-driven model
Tag-driven model
Dataset: (photo_id, user_id, time, latitude, longitude) (photo_id, tag)

Issues to Tackle
Noisy data
Photographer biases
In locations
In Tags
Wrong data
Whatever, color, city, spectrum, santa barbara, california, usa, Lookatme, Herbert Bayer Chromatic Gate

Location-driven Modeling
Derive meaningful data about map regions
E.g., representative tags, photos

Intuition
More “activity” in a certain location indicates importance of that location
Tag that are unique to a certain location can represent the location better

Translation into simple algorithm
Clustering of photos
Scoring of tags
TF / IDF / UF

Tag Maps - Paris

Tag Maps - SF

Tag Maps - Know this place?

Summary of San Francisco Golden Gate Bridge TransAmerica AT&T Baseball Park Golden Gate Twin Peaks Golden Gate Bay Bridge Ocean Beach Chinatown

Tag-based Modeling
Derive meaningful data about individual tags
Based on the tag’s metadata patterns
E.g., Yahoo! Research Berkeley , CHI2007 .

Tag Maps - Paris - Les Blogs?

Tag Semantics
Improved image search through query semantics
Automatic place- and event-gazetteers
Association of missing time/place data based on tags
…

Definitions
Event tag: expected to exhibit significant time-based patterns
Location tag: expected to exhibit significant place-based patterns

Tag patterns

Intuition for Solution
Burstiness does not work
Data too sparse
Goodbye, traditional techniques
Scale-structure method
Examine the “structure” of the tag’s patterns in multiple scales

Scale-structure Identification Entropy = 1.421621 Entropy = 0.766263 Entropy = 0.555915 Entropy = 0.062760

Scale-structure Identification

Outline How? What? Why?

Outline
Wisdom of the tags
Applications
World Explorer
ZoneTag
Why we tag
a user study of tagging

Another Look at the Tag Map

Make it into World Explorer http://tagmaps.research.yahoo.com

ZoneTag(?)
How would we:
Create/store?
Find?
Share?
Discover?
“ Everything in the world exists to end up in a photograph” -- Susan Sontag

Why Cameraphones?
Numbers, numbers…
Programmable
Context-aware
Network-connected
Quality… it’s getting there
500,000,000
(Source: Future Image Inc.)

Current Mobile Experience
Difficult to share (or even save!)
Hard to find
No context
No semantic information
Current mobile experience?

ZoneTag Experience
2-click upload (same key!)
Photo uploaded with location and time metadata

ZoneTag Experience
Tagging made easy
Tag/annotate your photos from the phone

Where do locations come from?
Bluetooth GPS (when available)
User-contributed cell tower mapping

Where do tags come from?
Tags I used in this context (e.g., `home’)
Tags my friends used in this context (e.g., `Yahoo! Sunnyvale’)
Tags other people used in this context (`Golden Gate’, `ITP’, ‘Mor Naaman’, `This talk sucks’)

Where do tags come from?
Stuff around you:
Yahoo! Local
Upcoming.org (`Mor Naaman @ ITP’, `NYU’): USE IT!
Stuff from you (any RSS 2.0 feed):
Calendar ( G, Upcoming.org,… )
Favorite hangouts (Wayfaring, Plazes, Socialight)

Suggested Tags “ When I went to upload, there were already all these exotic tags like "Bill Graham Civic Auditorium" and "Bob dylan live" available...it sure was convenient to just select and go…”

Where do tags go?
Back to the original RSS items
Upcoming.org
Action Tags
Trigger a call to a web service
With parameters
Command line - from your phone
Rotate:right Email:dad Group:zonetag Scanr:document

I’m Too Lazy (you’re not alone)
Tagging is the means, not the goal
Benefits even if you never tagged a single image
(Bradley Horowitz, elatable.com) (?) (?) (?)

I’m Too Lazy (you’re not alone)
Tagging is the means, not the goal
What is the goal?

Outline How? What? Why?

Outline
Wisdom of the tags
Applications
World Explorer
ZoneTag
Why we tag
a user study of tagging

Inspiration
Kinberg, Spasojevic, Fleck, Sellen
Social uses of camera-phones
Nancy van House
Research methodology

A few motivating facts
ZoneTag used by 500+ users; 50,000+ photos
61% of users - at least one tag per photo on average
Some more than five
Some users only tag on phone
some never tag on phone

A few motivating facts Average Tags, Public ZoneTag Photo: 2.2 Average Tags, Public Shozu Photo: 0.97 Average Tags, Private ZoneTag Photo: 1.85

Tag Affordances on Flickr
Displayed next to photo
Can be used to search:
Your own photos
Others’ photos
Public photos

Tags on ZoneTag
By default, tags are kept from one photo to next
Tags used in a location will be suggested in that location
To you
To others
Immediate (i.e., during event)
Place name tags added automatically

Why Tag? Bay Bridge, Fog, [San Francisco, 94105]

Why Tag? RedSox, Fenway, GreenMonster, [Boston, 02215], …

Why Tag? Horsetails, handicapped, sign, [Stanford, 94305], …

User Study
13 ZoneTag users (23-45, 9m, 4f)
All “taggers” (no use to ask non-taggers why they tag)
Structured interviews

Expected…
Organization/retrieval
Creator/synthesizer/consumer
“Tagging for community”

Found…
Motivation taxonomy
No “synthesizers”
Inspired by community
Organization/retrieval
Creator/Synthesizer
“ Tagging for community”
X

Motivation Taxonomy “ If I tagged ahead of time I can go back and get all my pictures of [my children]…” “… I then think “well, maybe I should tag this” so I can find it again later” “ I’m obsessive-compulsive”

Motivation Taxonomy “ I want at least one hook of association in there that can help me reconstruct…”

Motivation Taxonomy “ I tag photos with what I think might be interesting to other people, stuff I think people will like” “ I know that tagging can connect my photos to activities, and get more interest” “ I want to look at all [my neighborhood’s] tags. … That’s definitely a reason I’m putting these tags in ”

Motivation Taxonomy “… so that my friends can see what I am up to” I can tell my mom [with the tag] “look, we went to…” “ I left reviews of places – like at the airport, when my flight was delayed, I tagged “Aloha Air sucks.”

Breakdown

Suggested Tags
Useful for entry, when they “work”
Critical mass needed
Better filtering
Inspire and give example
Overtagging may be issue
“ Tag suggestions were huge for me; they really cut down on typing” “ I thought: this is how I want it to work all the time!” “ This person was in my phone for a month - who is she???” “ I try to use as many suggested tags that apply. … I also use it for auto-completion – I type “s” to get San Francisco”

Tags/Contribution
Derived from affordances
Social engineering
HT06, tagging paper, taxonomy, Flickr, academic article, to read (HyperText 2006)

Open Questions
Those who don’t…
Better filtering, tag suggestions
Longer usage trends
Effect of community on usage
…

Enough already with this stupid figure!

Final Notes
All Flickr/ZT photos, Creative Commons or with author permission
http://www.flickr.com/photos/frozenquack/106111967/
http://www.flickr.com/photos/bryce_edwards/272002447/
http://www.flickr.com/photos/plasticbag/188818779/
http://www.flickr.com/photos/groovymother/131591824/
http://www.flickr.com/photos/deaneckles/135146357/

Final Notes: APIs For All
Everything we can do, you can do (better). Use our APIs:
Cell ID translation
Suggested Tags
TagMaps data
TagMaps Widget
Extend ZoneTag with RSS feeds, ActionTags
…
Email me

Thanks
With: Shane Ahern, Simon King, Rahul Nair, Nathan Good, Marc Davis, Morgan Ames, Dean Eckles, Alex Jaffe, Tamir Tassa, Jeannie Yang, Tye Rattenbury
Read more, follow: http://www.yahooresearchberkeley.com
Slides: http://slideshare.net/mor
What are you doing this summer?
Mor Naaman: mor@yahoo-inc.com

Things We Learned
“ Best” feature: 2-click upload
Even users that often tag
For some, last chance to annotate
Mobile tagging - not just experts, not all experts…

Things We Learned
Tagging behavior:
All over the place
More than Shozu
Connected to privacy

International Remix
Demo?
Extracting patterns

International Remix

Key Framing

Reuse Patterns

How to use?
How can Intl Remix leverage the community to help the individual?

Flickr Example
Distribution of “number of photos in account”
Number of photos Number of users 6 12 18 … Huh??

Case Study - Flickr
Nobody tags other people’s content
Why?
Not collected Not identified Not prominent In user’s account As coming from the tagger In the interface, as “opinion” Not aggregated Can’t “vote” on tag/item pair

Photos, Mobile, Location and the Social Media Cycle

by mor

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 2

Statistics

Photos, Mobile, Location and the Social Media Cycle Presentation Transcript