The document discusses situated computing and proactive displays as an approach to ubiquitous computing focused on specific places. It outlines the evolution of proactive displays from early context-aware research prototypes to more advanced systems that can sense people's presence and activities in a space and respond through large visual displays. As an example, it presents CoffeeStrands, a proposed system using loyalty cards, phones and WiFi to create a place-based social network on displays in a cafe, allowing users to share content and connect more effectively in the shared physical space.

1. Situated Computing vs. Ubiquitous Computing: The Importance of Place Joe McCarthy Principal Instigator, Strands Labs Seattle Co-Chair, UbiComp 2008 Program Committee Chair, UbiComp Steering Committee

2. Outline A Brief, Biased Review of Ubiquitous Computing Situated Computing Proactive Displays Future Prospects Question and Answers

3. Strands: social recommendation & discovery http://blog.strands.com Strands develops technologies to better understand people's taste and help them discover things they like and didn't know about.

4. Principal Instigator: Definition \ˈprin(t)-s(ə-)pəl adjective most important, consequential, or influential \ˈin(t)-stə-ˌgā-tər\ Noun one who goads or urges forward : provocateur Alternate: Director, Strands Lab Seattle

5. Major Trends in Computing The Three Waves of Computing, Mark Weiser, 1990

6. Major Trends in Computing Places Out of the closet , …

7. Major Trends in Computing Places Out of the closet , beyond the desktop , …

8. Major Trends in Computing Places Out of the closet , beyond the desktop , and into the office (from kraka.com)

9. Major Trends in Computing Places Out of the closet , beyond the desktop , and into the kitchen Beyond Microwave Oven (Westinghouse) NCR Microwave Bank Electrolux ScreenFridge

10. Ubiquitous Computing and Toasters Simon Hackett & John Romkey Internet Toaster InterOp 1990 & 1991 Robin Southgate Weather Toaster Brunel Univ. (UK) June 2001 Joe Klingler ToAsTOr December 2002

11. Major Trends in Computing Places Out of the closet , beyond the desktop , and into fields & streets Vineyard in Oregon Great Duck Island, Maine Phone booths in Seattle Store fronts in New York

12. Major Trends in Computing Places Out of the closet , beyond the desktop , and into … people? Mexico Attorney General Spain Beach Club Cincinnati, OH Tommy Thompson Gov WI, Sec HHS, Applied Digital John Halamka, M.D., CIO Harvard Medical School ?

13. Ubiquitous Computing: anything, anywhere, anyone Chris Oakley, The Catalogue http://www.chrisoakley.com/the_catalogue.html http://www.spychips.com

14. Everywhere vs. Certain Places ... … Ubiquitous Computing vs. Situated Computing

15. Ubiquitous vs. Situated Displays Elevators Taxis (London) Buses (Milwaukee, WI) Escalators Times Square (New York) Shibuya District (Tokyo)

16. Proactive Displays: Definition \( ˌ )prō- ˈ ak-tiv\ adjective acting in anticipation of future problems, needs, or changes \di- ˈ splā\ noun a setting or presentation of something in open view Large visual or aural displays that can sense & respond in contextually appropriate ways to the people and/or activities going on in a place

17. Early examples of proactive displays Dangling String (PARC) Bus Mobile (UC Berkeley)

18. Proactive displays in the large Sunset @ 200MHz (PARC)

19. Proactive displays on the road Alaris E-boards (www.alaris.net)

20. Proactive displays on the wall Humanlocator.org

21. Proactive Displays in a store iCapture™ iGaze™ tru-media.com

22. Proactive displays in a store, circa 2054

23. Proactive Displays + Online Profiles Physical Tokens + Large Displays Better Real-world Interactions Bridging the gaps between people by bridging the gaps between the online and offline worlds = Large visual or aural displays that can sense & respond to the people and/or activities going on in a place

24. 1st Generation Proactive Displays MUSICFX MusicFX: An Arbiter of Group Preferences for Computer-Supported Cooperative Workouts Joseph F. McCarthy and Theodore Anagnost 1998 ACM Conference on Computer-Supported Cooperative Work (CSCW ‘98) A Multi-Agent System for Meting Out Influence in an Intelligent Environment M. V. Nagendra Prasad and Joseph F. McCarthy Eleventh Innovative Applications in Artificial Intelligence Conference (IAAI ‘99) http://www.youtube.com/watch?v=WLgXLl4uGYk a group recommender system for selecting music in a fitness center

25. 2nd Generation Proactive Displays Visual Awareness Location Tools (ACTIVEMAP & EVENTMANAGER) ActiveMap: A Visualization Tool for Location Awareness to Support Informal Interactions Joseph F. McCarthy and Eric S. Meidel First International Symposium on Handheld and Ubiquitous Computing (HUC '99) EventManager: Support for the Peripheral Awareness of Events Joseph F. McCarthy and Theodore D. Anagnost. Second International Symposium on Handheld and Ubiquitous Computing (HUC 2000) promoting greater awareness of the location and activities of coworkers

26. 3rd Generation Proactive Displays UNICAST, OUTCAST, GROUPCAST: Ubiquitous Peripheral Displays UniCast, OutCast & GroupCast: Three Steps Toward Ubiquitous Peripheral Displays Joseph F. McCarthy, Tony J. Costa and Edy S. Liongosari Third International Conference on Ubiquitous Computing (UbiComp 2001) Promoting Awareness of Work Activities through Peripheral Displays Elaine M. Huang, Joe Tullio, Tony J. Costa and Joseph F. McCarthy 2002 ACM Conference on Human Factors in Computer Systems (CHI 2002) promoting awareness and interactions in the office

27. 4th Generation Proactive Displays Augmenting the Social Space of an Academic Conference Joseph F. McCarthy, David W. McDonald, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM 2004 Conference on Computer Supported Cooperative Work (CSCW 2004) Proactive Displays: Supporting Awareness in Fluid Social Environments David W. McDonald, Joseph F. McCarthy, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM Transactions on Computer-Human Interactions (TOCHI), Vol. 14, No. 4, January 2008 promoting awareness and interactions at a conference AUTOSPEAKERID, TICKET2TALK, NEIGHBORHOOD WINDOW

28. 4th Generation Proactive Displays (v 2) promoting awareness and interactions at a variety of events TICKET2TALK (@ Interrelativity)

29. 5th Generation Proactive Displays The Context, Content & Community Collage: Sharing Personal Digital Media in the Physical Workplace Joseph F. McCarthy, Ben Congleton, F. Maxwell Harper To appear: ACM 2008 Conference on Computer Supported Cooperative Work (CSCW 2008) promoting awareness and interactions in the office THE CONTEXT, CONTENT & COMMUNITY COLLAGE

30. A User-Generated Video on Proactive Displays http://www.youtube.com/watch?v=m5rU9cAiYsY

31. Creating C3 Collage Accounts

32. Interactions with displays

33. Locations (mock-up)

35. Positive / Negative Impact (Personal / Professional)

36. The Latest Generation of Proactive Displays Shortcomings of previous efforts Single sensors (Infrared, RFID, Bluetooth) Special-purpose profiles Special-purpose installations Goals of present / future efforts Multiple sensors (Cards, WiFi, SMS) Multi-purpose profiles Multi-purpose installations

37. CoffeeStrands™: A Proactive Displays in a Café Proactive displays that enable café staff and customers to share digital representations of their interests and activities in the shared physical context of the coffeehouse, using loyalty cards, Bluetooth phones, SMS messages and/or laptops

38. Why Cafés? Connection, Community & Coffeehouses

39. The dark side of cafés, technology and community Cyber-nomads are “ hollowing out ” cafés that offer WiFi, rendering them “ physcially inhabited but psychologically evacuated” leaving people “ more isolated than they would be if the café were merely empty.” -- James E. Katz, Professor of Communications, Rutgers University

40. Our goals Take what coffeehouses already have Inviting spaces for people (including customers) to hang out Large displays, posters, cork bulletin boards Internet access Coffee, music, art, people, … Promotional signage & brochures Products / services to sell Add what many people really want Connect more effectively with others, creating a stronger sense of community Facilitate awareness, interactions and relationships Bring the richness of online social networking into a physical place A Place-Based Social Networking Service

41. How? Sensing Cards Phones (BT, SMS) WiFi laptops Other … Responding: user-generated content Tap into existing social media streams (Flickr, Twitter, …) Open physical, real-time channel (partyStrands, Wiffiti, …

42. Which Café?: Trabant Coffee & Chai Lounge

43. Location matters

44. CoffeeStrands: System Architecture Display (Community Collage, or CoCo™) 3D dynamic collage of content Presence Detector(s) Loyalty card reader, Bluetooth, SMS, WiFi Web interface User profile maintenance & viewing Voting, commenting, flagging, messaging Admin: café content, moderation Database User profiles (contact info, media) History of content shown on display Metadata (votes, etc.) Web server Connects / controls all of the above Content selection algorithm

45. CoffeeStrands: Welcome

46. CoffeeStrands: Stream (history)

47. CoffeeStrands: People

48. CoffeeStrands: My Profile

49. CoffeeStrands: My Profile (edit)

50. CoffeeStrands: My Stuff

51. CoCo in situ

52. CoffeeStrands: CoCo™ (Community Collage) display

53. CoffeeStrands, CoCo display: 3D semi-random pan

54. CoffeeStrands, CoCo display: greeting

55. CoffeeStrands, CoCo display: direct message

56. CoCo: Current Stats Feature Count (10-Sep-2008) Users 86 Items 1175 Comments 581 Votes 237 Check-ins 222

57. CoCo: Future Work Presence Detection: SMS check-in Other devices: Chumby, iPhone, CoffeeCam Multiple locations Incentives / Promotions Funtivities New visualization(s) Media linking Augmented profiles Favoriting / following Facebook integration Integration with Strands.com Ongoing challenge: how much of online social networking services to re-create

58. Conclusion Ubiquitous Computing holds great promise Situated Computing – ubiquitous computing in specific places - can increase benefits while decreasing risks Proactive Displays – a class of situated computing applications – can sense & respond to people in contextually appropriate ways, providing place-based social networking services in a variety of places: Workplaces Conferences Cafés The greatest promise for the future of ubiquitous computing is to open up new portals between the online and offline worlds , in ways that provide benefits for all stakeholders .

59. Acknowledgements / Contact info For more information: http://labs.strands.com/seattle http://gumption.typepad.com/blog/strands http://interrelativity.com/joe [email_address] Yogi Patel Innovation Engineer Sameer Ahuja Former Intern (Virginia Tech) Shelly Farnham Researcher Richie Hazlewood Intern (Indiana Univ.) Josh Lind Designer/ Developer Dan Norman Designer Thanks! Questions?