Proactive Displays: Bridging the Gaps between Online Social Networks and Shared Physical Spaces

Slide 1: Proactive Displays: Bridging the Gaps between Online Social Networks and Shared Physical Spaces Joe McCarthy Principal Instigator MyStrands Labs, Seattle

Slide 2: MyStrands: social recommendation & discovery “What you play counts!”

Slide 3: Proactive Display: Definition \\(ˌ)prō-ˈak-tiv\\ adjective acting in anticipation of future problems, needs, or changes \\di-ˈsplā\\ noun a setting or presentation of something in open view

Slide 4: Proactive Displays Large visual or aural displays that can sense & respond to the people and activities taking place in their vicinity. + + = Online Physical Large Better Profiles Tokens Displays Real-world Interactions Bridging the gaps between people by bridging the gaps between the online and offline worlds

Slide 5: 1st Generation Proactive Displays MusicFX MusicFX: An Arbiter of Group Preferences for Computer-Supported Cooperative Workouts Joseph F. McCarthy and Theodore Anagnost 1998 ACM Conference on Computer-Supported Cooperative Work (CSCW ‘98) A Multi-Agent System for Meting Out Influence in an Intelligent Environment M. V. Nagendra Prasad and Joseph F. McCarthy Eleventh Innovative Applications in Artificial Intelligence Conference (IAAI ‘99)

Slide 6: 2nd Generation Proactive Displays Visual Awareness Location Tools (ActiveMap & EventManager) ActiveMap: A Visualization Tool for Location Awareness to Support Informal Interactions Joseph F. McCarthy and Eric S. Meidel First International Symposium on Handheld and Ubiquitous Computing (HUC '99) EventManager: Support for the Peripheral Awareness of Events Joseph F. McCarthy and Theodore D. Anagnost. Second International Symposium on Handheld and Ubiquitous Computing (HUC 2000)

Slide 7: 3rd Generation Proactive Displays UniCas t, OutCas t, Gro upCas t UniCast, OutCast & GroupCast: Three Steps Toward Ubiquitous Peripheral Displays Joseph F. McCarthy, Tony J. Costa and Edy S. Liongosari International Conference on Ubiquitous Computing (UbiComp 2001) Promoting Awareness of Work Activities through Peripheral Displays Elaine M. Huang, Joe Tullio, Tony J. Costa and Joseph F. McCarthy 2002 ACM Conference on Human Factors in Computer Systems (CHI 2002)

Slide 8: 4th Generation Proactive Displays AutoSpeakerID Ticket2Talk Neighborhood Window Augmenting the Social Space of an Academic Conference Joseph F. McCarthy, David W. McDonald, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM 2004 Conference on Computer Supported Cooperative Work (CSCW 2004) Proactive Displays: Supporting Awareness in Fluid Social Environments David W. McDonald, Joseph F. McCarthy, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM Transactions on Computer-Human Interactions (TOCHI), Vol. 14, No. 4, January 2008

Slide 9: 4th Generation Proactive Displays (v 2)

Slide 10: 4th Generation Proactive Displays (v 3) Prospero Ben Congleton (University of Michigan) http://mblog.lib.umich.edu/prospero/

Slide 11: 5th Generation Proactive Displays The Context, Content & Community Collage @ Nokia Research Center Palo Alto

Slide 12: The Newest Generation of Proactive Displays • Shortcomings of previous efforts • Goals of present / future efforts • Special-purpose sensors • Multi-purpose sensors (IR badges, RFID tags) (BT mobiles … NFC) • Special-purpose profiles • Multi-purpose profiles • Special-purpose installations • Multi-purpose installations

Slide 13: The Problem • Employees feel un[der]appreciated • #1 reason people leave jobs (US Labor Dept) • 2/3 of workers receive no recognition (Gallup) • Active disengagement costs US$300B / year • Employees feel disconnected • Lack of community in workplace • Us vs. them • Managers have less time, broader responsibilities • Difficult to manage frequent, sustained “personal touch”

Slide 14: Friendships at Work 30% of employees have a best friend at work (BF@W) 20% of employees dedicate time to building relationships at work Employees with a BF@W are 50% more satisfied with their company Employees with a BF@W are 7 times more likely to be engaged in their work

Slide 15: Maintaining Friendships through Social Media • ambient intimacy • “being able to keep in touch with people with a level of regularity and intimacy that you wouldn’t usually have access to” • Leisa Reichert • http://www.disambiguity.com/ambient-intimacy/ • http://www.slideshare.net/leisa/ambient-intimacy • continuous partial friendship • David Weinberger • http://www.hyperorg.com/backissues/joho-may04-07.html

Slide 16: Friendships through Social Media @ Work? @

Slide 17: The Context, Content & Community Collage: A proactive display application Opening physical windows into online content in workplace contexts to foster a greater sense of community

Slide 18: A New Generation of Proactive Displays • Goal: increase the sense of community in the workplace • Method: open windows in shared physical spaces into the social media co-workers are creating • Situated Social Software (SiSoSo) [vs. Mobile Social Software (MoSoSo)] • Hypotheses • Adding a physical dimension of audience will promote greater social media usage • Social media sharing in the workplace will enhance personal relationships • Enhanced personal relationships will lead to more productive professional relationships • Challenges • Privacy / benefit tradeoff (usability vs. security) • Sustainable engagement (after novelty factor has worn off) • How to measure the impact? (measuring community, relationships)

Slide 19: Signup / Login

Slide 20: Select / Configure Module

Slide 21: Select Bluetooth Device(s)

Slide 22: Interactions with / through the displays

Slide 23: Interactions with displays

Slide 24: The Highest Rated Content (5 up votes)

Slide 25: Edge detection http://www.snopes.com/horrors/robbery/kidney.asp

Slide 26: Everything in moderation

Slide 27: Moderation: NSFW [Not Safe For Work]

Slide 28: Moderation: SFW

Slide 29: Action Type Times Done Times/Day Image Clicked 11727 902.1 Image Moved 7210 554.6 Image Closed 611 47.0 Filter Button Clicked 189 47.3 Filter Confirmation 27 6.8 Rate Up Clicked 574 191.3 Rate Down Clicked 269 89.7

Slide 30: Number of Actions by Day of Week 7000 6000 5000 4000 3000 2000 1000 0 Sun Mon Tue Wed Thurs Fri Sat

Slide 31: Number of Actions by Hour of Day 3000 2500 2000 1500 1000 500 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Slide 33: Evaluation: interactions through displays • Context • 8 displays, deployed July 19, evaluated after 4 weeks • 75 full-time / part-time residents • 44 proactive display accounts (34 non-empty) • Perpetual alpha (location sensing, new modules, new features) • Hypotheses • Adding a physical dimension of audience will promote greater social media usage • Social media sharing in the workplace will enhance personal relationships • Enhanced personal relationships will lead to more productive professional relationships • Web-based Survey • Mix of multiple choice and open text questions • 32 responses

Slide 34: Positive / Negative Impact (Personal / Professional) 16 14 12 10 Personal 8 Professional 6 4 2 0 No impact Strong Moderate Slight Mixed Slight Moderate Strong Negative Negative Negative Impact Positive Positive Positive Impact Impact Impact Impact Impact Impact

Slide 35: A few choice comments • I was surprised by some of the photos taken by [a colleague]. I had no idea of his very diversified and, in some cases, adventurous interests, and his photos showed me a side of him I would have never realized. The photos also give you an appreciation of other people's interests and unique travels. I find the photos absolutely fascinating and a very strong method of bringing all of us closer. • I[t] was nice to see people putting up \"themes\". One person had a Star Wars theme, actually happening just by tags, but appeared to me as if a themed series of photos. • Somewhat negative: I was surprised to see a photo of my family (my husband and my two kids) with another female friend. They were all sprawled on the grass. It reminded me of a picnic we all had together. But it also made me self-conscious: what would other people think of seeing this scene. Who is the \"mystery lady\"? Positive: walking into the kitchen and spotting my daughter's happy face on the screen. It was a nice greeting! Positive: I am delighted to see other peoples pics of exotic places they visited. Negative: seeing a picture of a guy in his underwear. The face was not in the pics so I couldn't tell who it is. Somebody esle in the room \"killed\" the photo. Positive: seeing people cluster around displays. I like that!

Slide 36: Impact of Displays on Social Media Flickr Usage by Different User Groups 6.00 Average Uploads Per Day 5.00 4.00 Before May 1 3.00 May 1 - July 19 After July 19 2.00 1.00 0.00 veteran users recent users new users User Group

Slide 37: Influence of Rank & Role Members # Participants % Participants Mgmt 6 1 0.17 Lead 6 2 0.33 Principal 11 2 0.18 Member 18 7 0.39 Admin 9 3 0.33 Intern 22 12 0.55 Total 72 27 0.38

Slide 38: Influence of Team Membership Members # Participants % Participants VCUI 17 9 0.53 C3 14 9 0.64 WGCS 9 3 0.33 IR 5 0 0.00 MoBS 5 1 0.20 MISS 5 1 0.20 NRCPA 9 2 0.22 NRC 4 1 0.25 SRC 4 1 0.25 Total 72 27 0.38

Slide 39: User-Generated Module: PHD Comics #!/usr/bin/ruby require 'rss/2.0' require 'open-uri' require 'rubygems' require 'json' feed_url = \"http://www.phdcomics.com/gradfeed_justcomics.php\" print \"Content-type:text/html\\n\\n\" response = nil open(feed_url) do |http| response = http.read end result = RSS::Parser.parse(response, false) item = result.items[rand() * result.items.size] print { \"width\" => \"600\", \"height\" => 150, \"caption\" => item.title + \" - [A custom module by Ben]\", \"image\" => item.description.match(/http:\\/\\/www.phdcomics.com\\/comics\\/archive[^\\\"]+/)[0] , \"contentid\" => item.link }.to_json

Slide 40: Future Work: Algorithms • Location / Proximity detection • Near / far • Proxemics, biosemiotics • Priority queue management • People, streams • Recommender Systems • Module management • Space, time, displays

Slide 41: Future Work: Modules • Other sources of content • Other interaction modalities • Other dimensions of experience QuickTime™ and a TIFF (LZW) decompressor are needed to see this picture.

Slide 42: Future Work: Interfaces & Interactivity • Interfaces • Signup page • Display interface • Administrator interface • Interactivity • Authentication • Phones • Touchscreens • Other?

Slide 43: Future Work: Replicability and Sustainability • Deployments • Nokia: NY, Dallas, Helsinki, LA … • Academia: UMich, UMN, Stanford, … • ?: Yahoo!, Flickr, … • Mobiquitous Marketing (Mobile + Ubiquitous) • Holistic approach to engagement mktg • Co-promotional opportunities • Contextual advertising in physical world

Slide 44: Related Work: Commercial Networking / Tracking Digital Signage at Events Clear Channel + Urban Display Network + Lighthouse Technologies + Webpavement

Slide 45: Related Work: OneKeyAway / MatchlinC • OneKeyAway • Singles mixers in LA / SF Bay area; since May 2004 • Questionnaire: • 64 true-false questions about sex, religion, drug use, how you spend your spare time, etc • “I just want to get people together and talk about relationships … to discuss the questions, talk about their habits and personality traits. I think the device facilitates that.” – Edwin Duterte • MatchlinC: personality compatibility device • a mini “relationship advisor” • Infrared “zapping” • Three color codes (stoplight): red, amber, green) • Reminiscent of Lovegety, Meme Tags

Slide 46: Related Work: partyStrands (1) ht t p:/ / www.pa rt y st ra nds.com ht t p:/ / blog.my st ra nds.com/ ca t egory / pa rt y s t ra nds

Slide 47: Related Work: partyStrands (2)

Slide 48: Related Work: Research (1) • Intellibadge (UIUC) • Active RF tags + signposts + readers • Aggregate data, visualizations • Meme Tags (MIT) • Interpersonal display: display for other people • RF + LEDs + programming • Sotto Voce (PARC) • Electronic guidebook for museum visits • Enhance pairwise social interactions

Slide 49: Related Work: Research (2) • PlasmaPoster (FXPAL) • Interactive community bulletin board • Corporate, conference, café contexts • Opinionizer (Sussex) • Shared display at social events • Interaction through typed input • Dynamo (Sussex) • High school setting • Interaction via USB disk • AgentSalon (ATR) • Interaction via PalmGuides (PDAs) • Conversations mediated by animated agents Public and Situated Displays O’Hara, Perry, Churchill, Russell

Slide 50: Related Work: Alone Together Two Hours of Joint Solitude http://www.coffeegeek.com/opinions/cafestage/10-19-2005 Alone Together http://blogs.parc.com/playon/

Slide 51: Related Work: Addictive Games • Amy Jo Kim, Social Architect, Shufflebrain • “Putting the Fun in Functional: Applying Game Mechanics to Functional Software” • Incentives for games, communities • Collecting • Points • Feedback • Exchanges • Customization http://www.shufflebrain.com/etech2007.html

Slide 52: Future Work[place]: MyStrands Labs, Seattle • Themes: • Location-based & proximity-based social technology: bridging gaps between online & offline worlds • Multi-dimensional representations of identity: weaving together myriad strands of interests and passions • Sustainable business model(s): universal affiliates, all stakeholders derive value from participation • Location: • TBD ... somewhere near the University of Washington campus

Slide 53: Thanks! • For more information: • mccarthy@mystrands.com • http://interrelativity.com/joe • http://gumption.typepad.com • http://www.slideshare.net/gumption • C4 made possible by • Interns • Max Harper (U. Minnesota) • Ben Congleton (U. Michigan) • Jiang Bian (Georgia Tech) • Context, Content & Community (C3) team • All my former colleagues at Nokia [Research Center [Palo Alto]]