PARC CSL Colloquium

Eyes on the World: Putting Your Photos in Context Mor Naaman Yahoo! Research Berkeley

Attraction Map of Paris

Stanley Milgram, 1976.

Psychological Maps of Paris

Attraction Map of London

Jaffe et al, 2006.

Outline

Wisdom of the tags

mining information from geo-tagged photos

ZoneTag

your photos in context

Why we tag

a user study of tagging

Alternative Outline How? What? Why?

Information Overload?

Flickr “geotagged”

What can we derive?

Dataset:

( photo_id , user_id, latitude, longitude)

( photo_id , tag )

Given all photos from a geographic region,

find a “representative” summary set

generate a meaningful visualization

Issues to Tackle

Noisy data

Photographer biases

In locations

In Tags

Wrong data

Whatever, color, city, spectrum, santa barbara, california, usa, Lookatme, Herbert Bayer Chromatic Gate

Intuition

More “activity” in a certain location indicates importance of that location

Tag that are unique to a certain location can suggest importance of that location

(Very) Simple Example

Summary of San Francisco Golden Gate Bridge TransAmerica AT&T Baseball Park Golden Gate Twin Peaks Golden Gate Bay Bridge Ocean Beach Chinatown

Tag Maps

Outline

Wisdom of the tags

ZoneTag

Why we tag

Outline How? What? Why?

Another Look at the Tag Map

ZoneTag(?)

How would we:

Create/store?

Find?

Share?

Discover?

“ Everything in the world exists to end up in a photograph” -- Susan Sontag

Why Cameraphones?

Numbers, numbers…

Programmable

Context-aware

Network-connected

Quality… it’s getting there

500,000,000

(Source: Future Image Inc.)

Current Mobile Experience

Difficult to share (or even save!)

Hard to find

No context

No semantic information

ZoneTag Experience

2-click upload (same key!)

Photo uploaded with location and time metadata

ZoneTag Experience

Tagging made easy

Tag/annotate your photos from the phone

Where do locations come from?

Bluetooth GPS (when available)

User-contributed cell tower mapping

Where do tags come from?

Tags I used in this context (`home’)

Tags my friends used in this context (`Research Meeting’)

Tags other people used in this context (`PARC’, ‘Mor Naaman’, `This talk sucks’)

Where do tags come from?

Stuff around you:

Yahoo! Local

Upcoming.org (`Mor Naaman @ PARC’, `PARC George E. Pake Auditorium’)

Stuff from you (any RSS 2.0 feed):

Calendar ( G, Upcoming.org, Kiko ,…)

Favorite hangouts

Suggested Tags “ When I went to upload, there were already all these exotic tags like "Bill Graham Civic Auditorium" and "Bob dylan live" available...it sure was convenient to just select and go…”

Where do tags go?

Back to the original RSS items

Upcoming.org

Action Tags

Trigger a call to a web service

With parameters

Command line - from your phone

Rotate:right Email:dad Group:zonetag Scanr:document

I’m Too Lazy (you’re not alone)

Tagging is the means, not the goal

Benefits even if you never tagged a single image

(Bradley Horowitz, elatable.com) (?) (?) (?)

Things We Learned

“ Best” feature: 2-click upload

Even users that often tag

For some, last chance to annotate

Mobile tagging - not just experts, not all experts…

Things We Learned

Tagging behavior:

All over the place

More than Shozu

Connected to privacy

Outline

Wisdom of the tags

ZoneTag

Why we tag

Outline How? What? Why?

Why Tag?

What are tags?

VIDEO REMOVED

Why Tag? Bay Bridge, Fog, [San Francisco, 94105]

Why Tag? RedSox, Fenway, GreenMonster, [Boston, 02215], …

Why Tag? Liz, sunbathing, sunny, sunglasses, concrete, [Palo Alto, 94306], …

Tag Affordances on Flickr

Displayed next to photo

Can be used to search:

Your own photos

Others’ photos

Public photos

Tags on ZoneTag

By default, tags are kept from one photo to next

Tags used in a location will be suggested in that location

To you

To others

Immediate (i.e., during event)

Place name tags added automatically

User Study

13 ZoneTag users (23-45, 9m, 4f)

All “taggers” (no use to ask non-taggers why they tag)

Structured interviews

Expected…

Organization/retrieval

Creator/synthesizer

“Tagging for community”

Found…

Motivation taxonomy

No “synthesizers”

Inspired by community

Organization/retrieval

Creator/Synthesizer

“ Tagging for community”

X

Motivation Taxonomy “ If I tagged ahead of time I can go back and get all my pictures of [my children]…” “… I then think “well, maybe I should tag this” so I can find it again later” “ I’m obsessive-compulsive”

Motivation Taxonomy “ I want at least one hook of association in there that can help me reconstruct…”

Motivation Taxonomy “ I tag photos with what I think might be interesting to other people, stuff I think people will like” “ I know that tagging can connect my photos to activities, and get more interest” “ I want to look at all [my neighborhood’s] tags. … That’s definitely a reason I’m putting these tags in ” “ ...at night, by the fires all around the market, ... at each word that one man says -- such as 'wolf', 'sister', 'hidden treasure', 'battle', 'scabies', 'lovers' -- the others tell, each one, his tale of wolves, sisters, treasures, scabies, lovers, battles.” -- Italo Calvino, Invisible Cities

Motivation Taxonomy “… so that my friends can see what I am up to” I can tell my mom [with the tag] “look, we went to…” “ I left reviews of places – like at the airport, when my flight was delayed, I tagged “Aloha Air sucks.”

Breakdown

Suggested Tags

Useful for entry, when they “work”

Critical mass needed

Better filtering

Inspire and give example

Overtagging may be issue

“ Tag suggestions were huge for me; they really cut down on typing” “ I thought: this is how I want it to work all the time!” “ This person was in my phone for a month - who is she???” “ I try to use as many suggested tags that apply. … I also use it for auto-completion – I type “s” to get San Francisco”

Open Questions