Your SlideShare is downloading. ×
Proactive Displays IIIA 20080627
Upcoming SlideShare
Loading in...5

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Proactive Displays IIIA 20080627


Published on

Presentation given at IIIA @ CSIC in Barcelona on 27 June 2008.

Presentation given at IIIA @ CSIC in Barcelona on 27 June 2008.

Published in: Business, Technology

1 Comment
  • Fioricet is often prescribed for tension headaches caused by contractions of the muscles in the neck and shoulder area. Buy now from and make a deal for you.
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide
  • Transcript

    • 1. Proactive Displays: Bridging the Gaps between Online Social Networks and Shared Physical Spaces Joe McCarthy Principal Instigator Strands Labs, Seattle
    • 2. Outline
      • A few shameless plugs
      • What I learned from AI
      • Overview: A brief history of Proactive Displays
      • An example: the Context, Content & Community Collage
      • Related work: commercial & academic
      • Future plans
      (Slides available online at )
    • 3. Strands: social recommendation & discovery
    • 4. Strands: social recommendation & discovery “ What you play counts!”
    • 5. Recommender System Startup Contest Deadline: 15 September 2008 ACM RecSys 2008 23-25 October Lausanne, Switzerland
    • 6. UbiComp 2008
      • 10th International Conference on Ubiquitous Computing
      • Seoul, Korea, 21-24 September 2008
      • Open participation categories (thru 27 June 2008, 23:59 PDT):
        • Workshops
        • Panels
        • Demonstrations
        • Posters
        • Doctoral Colloquium
        • Student Volunteers
      Program Co-Chairs Joe McCarthy (Strands Labs Seattle, USA) James Scott (Microsoft Research, UK) Woontack Woo (GIST, South Korea)
    • 7. My AI Background
      • A Trainable Approach to Coreference Resolution for Information Extraction
        • Ph.D. Dissertation, 1996, University of Massachusetts
        • Machine Learning, Natural Language Processing
      Conference Year Text Source Topic (Domain) MUC-1 1987 Mil. reports Fleet Operations MUC-2 1989 Mil. reports Fleet Operations MUC-3 1991 News reports Terrorist activities in Latin America MUC-4 1992 News reports Terrorist activities in Latin America MUC-5 1993 News reports Corporate Joint Ventures, Microelectronic Production MUC-6 1995 News reports Labor Disputes and Corporate Management Succession MUC-7 1997 News reports Airplane crashes, and Rocket/Missile Launches
    • 8. What I learned from AI
      • A little bit of AI goes a long way
        • Intelligence is a large problem space
        • The only way to make progress is to impose appropriate constraints
        • News articles vs. all of language
        • Small number of entities vs. all of the world
      • The same applies to ubiquitous computing
        • Ubiquitous computing = computing everywhere (“beyond the desktop”)
        • Everywhere is a large problem space
        • Certain places vs. everywhere
        • Certain activities vs. everything
      Neat vs. Scruffy Strong AI vs. Weak AI
    • 9. Proactive Displays: Definition ( ˌ )prō- ˈ ak-tiv adjective acting in anticipation of future problems, needs, or changes di- ˈ splā noun a setting or presentation of something in open view
    • 10. Proactive Displays + Online Profiles Physical Tokens + Large Displays Better Real-world Interactions Bridging the gaps between people by bridging the gaps between the online and offline worlds = Large visual or aural displays that can sense & respond to the people and activities taking place in their vicinity
    • 11. 1st Generation Proactive Displays MusicFX MusicFX: An Arbiter of Group Preferences for Computer-Supported Cooperative Workouts Joseph F. McCarthy and Theodore Anagnost 1998 ACM Conference on Computer-Supported Cooperative Work (CSCW ‘98) A Multi-Agent System for Meting Out Influence in an Intelligent Environment M. V. Nagendra Prasad and Joseph F. McCarthy Eleventh Innovative Applications in Artificial Intelligence Conference (IAAI ‘99) a fitness center environment that knows who is working out, what they like to listen to, and dynamically adjusts the music to best suit the group of exercisers at any given time.
    • 12. 2nd Generation Proactive Displays Visual Awareness Location Tools (ActiveMap & EventManager) ActiveMap: A Visualization Tool for Location Awareness to Support Informal Interactions Joseph F. McCarthy and Eric S. Meidel First International Symposium on Handheld and Ubiquitous Computing (HUC '99) EventManager: Support for the Peripheral Awareness of Events Joseph F. McCarthy and Theodore D. Anagnost. Second International Symposium on Handheld and Ubiquitous Computing (HUC 2000) a suite of tools for creating greater awareness of the location and activities of colleagues within a workgroup, with an aim to provide more opportunities for informal communication
    • 13. 3rd Generation Proactive Displays UniCast, OutCast, GroupCast: Ubiquitous Peripheral Displays UniCast, OutCast & GroupCast: Three Steps Toward Ubiquitous Peripheral Displays Joseph F. McCarthy, Tony J. Costa and Edy S. Liongosari Third International Conference on Ubiquitous Computing (UbiComp 2001) Promoting Awareness of Work Activities through Peripheral Displays Elaine M. Huang, Joe Tullio, Tony J. Costa and Joseph F. McCarthy 2002 ACM Conference on Human Factors in Computer Systems (CHI 2002)
    • 14. 4th Generation Proactive Displays AutoSpeakerID Ticket2Talk Neighborhood Window Augmenting the Social Space of an Academic Conference Joseph F. McCarthy, David W. McDonald, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM 2004 Conference on Computer Supported Cooperative Work (CSCW 2004) Proactive Displays: Supporting Awareness in Fluid Social Environments David W. McDonald, Joseph F. McCarthy, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM Transactions on Computer-Human Interactions (TOCHI), Vol. 14, No. 4, January 2008
    • 15. 4th Generation Proactive Displays (v 2)
    • 16. 5th Generation Proactive Displays The Context, Content & Community Collage @ Nokia Research Center Palo Alto The Context, Content & Community Collage: Sharing Personal Digital Media in the Physical Workplace Joseph F. McCarthy, Ben Congleton, F. Maxwell Harper To appear: ACM 2008 Conference on Computer Supported Cooperative Work (CSCW 2008)
    • 17. The Latest Generation of Proactive Displays
      • Shortcomings of previous efforts
        • Special-purpose sensors (IR badges, RFID tags)
        • Special-purpose profiles
        • Special-purpose installations
      • Goals of present / future efforts
        • Multi-purpose sensors (BT mobiles … NFC)
        • Multi-purpose profiles
        • Multi-purpose installations
    • 18. The Problem
      • Employees feel un[der]appreciated
        • #1 reason people leave jobs (US Labor Dept)
        • 2/3 of workers receive no recognition (Gallup)
        • Active disengagement costs US$300B / year
      • Employees feel disconnected
        • Lack of community in workplace
        • Us vs. them
      • Managers have less time, broader responsibilities
        • Difficult to manage frequent, sustained “personal touch”
    • 19. Friendships at Work 30% of employees have a best friend at work (BF@W) 20% of employees dedicate time to building relationships at work Employees with a BF@W are 50% more satisfied with their company Employees with a BF@W are 7 times more likely to be engaged in their work
    • 20. Maintaining Friendships through Social Media
      • ambient intimacy
        • “ being able to keep in touch with people with a level of regularity and intimacy that you wouldn’t usually have access to”
        • Leisa Reichert
      • continuous partial friendship
        • David Weinberger
    • 21. Friendships through Social Media @ Work? @
    • 22. The Context, Content & Community Collage: A proactive display application Opening physical windows into online content in workplace contexts to foster a greater sense of community
    • 23. A New Generation of Proactive Displays
      • Goal: increase the sense of community in the workplace
      • Method: open windows in shared physical spaces into the social media co-workers are creating
        • Situated Social Software (SiSoSo) [vs. Mobile Social Software (MoSoSo)]
      • Hypotheses
        • Adding a physical dimension of audience will promote greater social media usage
        • Social media sharing in the workplace will enhance personal relationships
        • Enhanced personal relationships will lead to more productive professional relationships
      • Challenges
        • Privacy / benefit tradeoff (usability vs. security)
        • Sustainable engagement (after novelty factor has worn off)
        • How to measure the impact? (measuring community, relationships)
    • 24. Signup / Login
    • 25. Select / Configure Module
    • 26. Select Bluetooth Device(s)
    • 27. Locations (mock-up)
    • 28. Hardware & Software
    • 29. Details
      • Location / proximity detection
        • Bluetooth sampling (MAC addresses, BT names)
        • Location server (separate component)
      • Priority queue management
        • New / old, near / far, 70/30
      • Display management
        • Firefox + Javascript
      • Flickr module
        • Ruby API
      • Remote administration
        • Process, power
      • Modular, flexible framework
        • Front-end (time / space sharing)
        • Back-end
    • 30.  
    • 31. Flickr API
    • 32. Interactions with / through the displays
    • 33. Interactions with displays
    • 34. The Highest Rated Content (5 up votes)
    • 35. Edge detection
    • 36. Everything in moderation
    • 37. Moderation: NSFW [ N ot S afe F or W ork]
    • 38. Moderation: SFW
    • 39.  
    • 40.  
    • 41.  
    • 42.  
    • 43. Evaluation: interactions through displays
      • Context
        • 8 displays, deployed July 19, evaluated after 4 weeks
        • 75 full-time / part-time residents
        • 44 proactive display accounts (34 non-empty)
        • Perpetual alpha (location sensing, new modules, new features)
      • Hypotheses
        • Adding a physical dimension of audience will promote greater social media usage
        • Social media sharing in the workplace will enhance personal relationships
        • Enhanced personal relationships will lead to more productive professional relationships
      • Web-based Survey
        • Mix of multiple choice and open text questions
        • 32 responses
    • 44. Positive / Negative Impact (Personal / Professional)
    • 45. A few choice comments
      • I was surprised by some of the photos taken by [a colleague]. I had no idea of his very diversified and, in some cases, adventurous interests, and his photos showed me a side of him I would have never realized. The photos also give you an appreciation of other people's interests and unique travels. I find the photos absolutely fascinating and a very strong method of bringing all of us closer.
      • I[t] was nice to see people putting up "themes". One person had a Star Wars theme, actually happening just by tags, but appeared to me as if a themed series of photos.
      • Somewhat negative: I was surprised to see a photo of my family (my husband and my two kids) with another female friend. They were all sprawled on the grass. It reminded me of a picnic we all had together. But it also made me self-conscious: what would other people think of seeing this scene. Who is the "mystery lady"? Positive: walking into the kitchen and spotting my daughter's happy face on the screen. It was a nice greeting! Positive: I am delighted to see other peoples pics of exotic places they visited. Negative: seeing a picture of a guy in his underwear. The face was not in the pics so I couldn't tell who it is. Somebody esle in the room "killed" the photo. Positive: seeing people cluster around displays. I like that!
    • 46. Impact of Displays on Social Media
    • 47. Influence of Rank & Role
    • 48. Influence of Team Membership
    • 49. Influence of competition Wii Tournaments
    • 50. Future Work: Algorithms
      • Location / Proximity detection
        • Near / far
        • Proxemics, biosemiotics
      • Priority queue management
        • People, streams
        • Recommender System
      • Module management
        • Space, time, displays
    • 51. Future Work: Modules
      • Other sources of content
      • Other interaction modalities
      • Other dimensions of experience
    • 52. Future Work: Interfaces & Interactivity
      • Interfaces
        • Signup page
        • Display interface
        • Administrator interface
      • Interactivity
        • Authentication
        • Phones
        • Touchscreens
        • Other?
    • 53. Future Work: Replicability and Sustainability
      • Deployments
        • Nokia: NY, Dallas, Helsinki, LA …
        • Academia: UMich, UMN, Stanford, …
        • ?: Yahoo!, Flickr, …
      • Mobiquitous Marketing (Mobile + Ubiquitous)
        • Holistic approach to engagement marketing
        • Co-promotional opportunities
        • Contextual advertising in physical world
    • 54. Future Work @ Strands Labs Seattle New Content Sources ( New Physical Spaces (“third places”)
    • 55. Related Work: Commercial Awareness / Interactions at Events Digital Signage Captivate TV ClearChannel, et al. RippleTV
    • 56. Related Work: OneKeyAway / MatchlinC
      • OneKeyAway
        • Singles mixers in LA / SF Bay area; since May 2004
      • Questionnaire:
        • 64 true-false questions about sex, religion, drug use, how you spend your spare time, etc
        • “ I just want to get people together and talk about relationships … to discuss the questions, talk about their habits and personality traits. I think the device facilitates that.” – Edwin Duterte
      • MatchlinC: personality compatibility device
        • a mini “relationship advisor”
        • Infrared “zapping”
        • Three color codes (stoplight): red, amber, green)
      • Reminiscent of Lock & Key, Lovegety, Meme Tags
    • 57. Related Work: partyStrands (1) New Year’s Eve Times Square, NYC Paul Van Dyk Crystal Ballroom, Portland Buda del Mar Bar Madrid
    • 58. Related Work: partyStrands (2)
    • 59. Related Work: Research (1)
      • Meme Tags (MIT)
        • Interpersonal display : display for other people
        • RF + LEDs + programming
      • CityWall (Helsinki IIT)
        • Multi-touch display in city center
        • Flickr photos tagged with “helsinki”
        • Interactions with display vs. through display
      • Twitterspaces (Indiana U)
        • Large display in campus lounge
        • Dynamic visualization of group “tweets” (Twitter)
    • 60. Related Work: Research (2)
      • PlasmaPoster (FXPAL)
        • Interactive community bulletin board
        • Corporate, conference, café contexts
      • Opinionizer (Sussex)
        • Shared display at social events
        • Interaction through typed input
      • Dynamo (Sussex)
        • High school setting
        • Interaction via USB disk
      • AgentSalon (ATR)
        • Interaction via PalmGuides (PDAs)
        • Conversations mediated by animated agents
      Public and Situated Displays O’Hara, Perry, Churchill, Russell
    • 61. Thanks!
      • For more information:
        • [email_address]
      • C4 made possible by
        • Ben Congleton (U. Mich), Max Harper (U. Minn)
        • Nokia Context, Content & Community (C3) team
        • All my former colleagues at Nokia
      • Future work being made possible by Strands [Labs [Seattle]]
      Yogi Patel Sameer Ahuja Shelly Farnham Richie Hazlewood
    • 62. Backup
    • 63. Related Work: Alone Together Two Hours of Joint Solitude Alone Together
    • 64. Related Work: Addictive Games
      • Amy Jo Kim, Social Architect, Shufflebrain
      • “ Putting the Fun in Functional: Applying Game Mechanics to Functional Software”
      • Incentives for games, communities
        • Collecting
        • Points
        • Feedback
        • Exchanges
        • Customization
    • 65. Early proactive displays Dangling String (PARC) Bus Mobile (UC Berkeley)
    • 66. Proactive Displays in the large Sunset @ 200MHz (PARC) Love Board (Hachiko Crossing)
    • 67. Proactive Displays on the road Alaris E-boards (
    • 68. Proactive displays, circa 2054