SocialSense: A System For Social Environment Awareness Robert S. Brewer, Samuel R. H. Joseph, Guanghong Yang, Neil Scott, Daniel Suthers University of Hawaii at Manoa Department of Information and Computer Sciences Laboratory for Interactive Learning Technologies Ubiquitous Wireless Applications Group Devices that Alter Perception Workshop 9/20/2008

Introduction We pass by others throughout our day Walking around campus Conferences Restaurants and bars Sometimes we want more interaction w/others Hypothesis: Unfamiliarity is barrier to interaction Learning about others could increase interaction

We pass by others throughout our day

Walking around campus

Conferences

Restaurants and bars

Sometimes we want more interaction w/others

Hypothesis:

Unfamiliarity is barrier to interaction

Learning about others could increase interaction

SocialSense Explore profiles of nearby users Sense proximity by Bluetooth, WiFi Match sensor data to user profile Display status information (Twitter) Users choose to link profile with devices Unobtrusive display and input Obtrusive system would hamper interaction

Explore profiles of nearby users

Sense proximity by Bluetooth, WiFi

Match sensor data to user profile

Display status information (Twitter)

Users choose to link profile with devices

Unobtrusive display and input

Obtrusive system would hamper interaction

Wearable Implementation Scans for nearby Bluetooth devices Only devices in discoverable mode User interface HMD for constant viewing “Magic Ring” for unobtrusive input Displays nearby devices Select device to see owner’s profile & status

Scans for nearby Bluetooth devices

Only devices in discoverable mode

User interface

HMD for constant viewing

“Magic Ring” for unobtrusive input

Displays nearby devices

Select device to see owner’s profile & status

Wearable App Demo

Wearable Results System is obtrusive Attracts stares walking around campus HMD displays are still too obvious Switch to mobile phone platform Devices are ubiquitous and unobtrusive Now awareness is the problem

System is obtrusive

Attracts stares walking around campus

HMD displays are still too obvious

Switch to mobile phone platform

Devices are ubiquitous and unobtrusive

Now awareness is the problem

Phone Implementation Runs on iPhone No Bluetooth access Switch to WiFi sensing on shared access pt Displays profile data Profile pulled from LinkedIn social network Still working on awareness iPhone doesn’t allow background processes Requires sensed user to also run SocialSense

Runs on iPhone

No Bluetooth access

Switch to WiFi sensing on shared access pt

Displays profile data

Profile pulled from LinkedIn social network

Still working on awareness

iPhone doesn’t allow background processes

Requires sensed user to also run SocialSense

Phone screenshots

Future Work Evaluation methods Looking for ideas to test original hypothesis Other sensing methods Working on face recognition from photo Privacy Need to prevent stalking Notify those being detected?

Evaluation methods

Looking for ideas to test original hypothesis

Other sensing methods

Working on face recognition from photo

Privacy

Need to prevent stalking

Notify those being detected?

Mahalo (Thank You) Contact Author: Robert Brewer Research Assistant [email_address] University of Hawaii at Manoa Dept. of Information and Computer Sciences Laboratory for Interactive Learning Technologies (LILT) Ubiquitous Wireless Applications Group

Contact Author:

Robert Brewer

Research Assistant

[email_address]

University of Hawaii at Manoa

Dept. of Information and Computer Sciences

Laboratory for Interactive Learning Technologies (LILT)

Ubiquitous Wireless Applications Group

Extra Augmented reality Registering profile information on image

Augmented reality

Registering profile information on image