The Design and Evaluation of Prototype Eco-Feedback Displays for Fixture-Level Water Usage Data
1. The Design and Evaluation of Prototype Eco-Feedback
Displays for Fixture-Level Water Usage Data
Jon Froehlich1,2, Leah Findlater1,2, Marilyn Ostergren1, Solai Ramanathan1, Josh Peterson1,
Inness Wragg1, Eric Larson1, Fabia Fu1, Mazhengmin Bai1, Shwetak N. Patel1, James A. Landay1
design: UNIVERSITY of
use:
build: WASHINGTON
2. This talk is about eco-feedback displays
for water usage in the home
6. This talk is also about the design process for eco-feedback visualizations
persuasive technology
personal informatics
quantified self
9. Brackish
Polar Ice 1% Drinkable
1.7%
Water
0.8%
Ocean
96.5%
[Glennon, Unquenchable: America’s water crisis and what to do about it, 2009; Gleick,World Policy Journal, 2009]
10. The amount of water on earth is not changing
but its location, quality and
amount per person is changing
11. The amount of water on earth is not changing
but its location, quality and
amount per person is changing
12. As the ‘s climate changes…
precipitation patterns glacial and ice snowpack surface water availability
[Gleick, World Policy Journal, 2009]
44. Key Questions
1 What are the key gaps in water usage understanding?
2 What aspects of disaggregated data are potential users
interested in and what sort of reactions do the
visualizations provoke?
3 How might these visualizations impact behavior?
45. Key Questions
1 What are the key gaps in water usage understanding?
2 What aspects of disaggregated data are potential users
interested in and what sort of reactions do the
visualizations provoke?
3 How might these visualizations impact behavior?
46. Two sets of designs:
1 Design Dimensions
Isolate eco-feedback design dimensions in the context of water usage
2 Design Probes
Meant to elicit reactions about how displays would fit within a household
and investigate issues such as privacy, competition, family dynamics.
47. Informal interviews with water experts (e.g., SPU, Amy Vickers)
UW Environmental Practicum on water
Literature review of water resource management, environmental psychology
Our own online survey of water usage attitudes & knowledge (N=656 respondents)
Data Ideation / Pilot Evaluation
Ideation Refinement
Gathering Sketch Studies
48. Respondents (N=651) dramatically underestimated the
amount of water used in common everyday activities.
underestimate
toilet : by 15%
shower : by 30%
bath : by 55%
low-flow shower : by 60%
outdoor yard watering : by 83% to 95%
[Froehlich, UW PhD Dissertation, 2011]
49. Informal interviews with water experts (e.g., SPU, Amy Vickers)
UW Environmental Practicum on water
Literature review of water resource management, environmental psychology
Our own online survey of water usage attitudes & knowledge (N=656 respondents)
Data Ideation / Pilot Formative
Ideation Refinement
Gathering Sketch Studies Evaluation
50. Informal interviews with water experts (e.g., SPU, Amy Vickers)
UW Environmental Practicum on water
Literature review of water resource management, environmental psychology
Our own online survey of water usage attitudes & knowledge (N=656 respondents)
Data Ideation / Pilot Formative
Ideation Refinement
Gathering Sketch Studies Evaluation
Informed by gathered data
Guided by eco-feedback design space
52. Informal interviews with water experts (e.g., SPU, Amy Vickers)
UW Environmental Practicum on water
Literature review of water resource management, environmental psychology
Our own online survey of water usage attitudes & knowledge (N=656 respondents)
Design critique sessions with team
Three sets of pilot studies
Data Ideation / Pilot Formative
Ideation Refinement
Gathering Sketch Studies Evaluation
Informed by gathered data
Guided by eco-feedback design space
53. Informal interviews with water experts (e.g., SPU, Amy Vickers)
UW Environmental Practicum on water
Literature review of water resource management, environmental psychology
Our own online survey of water usage attitudes & knowledge (N=656 respondents)
Design critique sessions with team
Three sets of pilot studies
Data Ideation / Pilot Formative
Ideation Refinement
Gathering Sketch Studies Evaluation
Informed by gathered data
Guided by eco-feedback design space
Online interactive survey of designs (N=651 respondents)
In-home interviews (10 households, 20 adults)
55. How does one go about the process of
designing interfaces for eco-feedback?
56. Eco-Feedback Design Space
INFORMATION ACCESS DATA REPRESENTATION COMPARISON
update aesthetic comparison
frequency real-time monthly or less user poll pragmatic artistic target self social goal
spatial proximity time comparison by
to behavior co-located remote window <hour >year time past projected
attentional temporal social-comp.
demand glanceable high attention grouping ≤sec by hour by day by week by month ≥year geographically demographically selected
target proximal similar social network
effort to data goal-setting
access low high granularity coarse-grain fine-grain strategy self-set system-set externally-set
INTERACTIVITY visual difficulty to reach
complexity simple complex comparison target easy hard
degree of
interactivity none high primary visual comparison variables statistic computation
encoding textual graphical time window
interface raw value @ this time [yest, last wk, mo, yr]
customizability none high measurement time granularity average [hrly, daily, wkly, monthly, yrly]
unit resource cost environmental activity time metaphor data grouping median over past [X] days
impact mode
user data granularity this day type [weekday, weekend]
additions user annotations user corrections primary other this day of week (e.g., mondays)
measurement unit
view temporal spatial categorical
DISPLAY MEDIUM
manifestation data
grouping by by by by by by consumption SOCIAL ASPECTS
webpage mobile wearable custom in-home resource person time space activity category
phone app interface display display target
person household community state country
ambience MOTIVATIONAL/PERSUASIVE STRATEGIES
not-ambient ambient private/
persuasive tactics from persuasive tactics include:
public private public
size psychology and applied social rewards goal-setting
small large psychology disciplines: data
punishment narrative
ACTIONABILITY/UTILITY persuasive design
public commitment likeability sharing none everyone
written commitment reputation
persuasive technology social-
degree of loss aversion competition (see COMPARISON)
behavioral science/economics comparison available unavailable
actionability low high kairos social proof
environmental psychology
encouragement authority
decision game design
suggests suggests anomaly descriptive norms emotional appeals
support actions social marketing
purchase decisions alerts scarcity principle door-in-face
health behavior change
personal- framing unlock features
ization no personalization highly personalized anchoring bias endowment effect
defaults collection building
information
intent Informs one action informs many actions
automation/
control no control system controls resource use [Froehlich et al., HCIC2009; CHI2010; UW PhD Dissertation 2011]
57. My own experiences Existing frameworks Psychology
(in persuasive tech and infovis) (particularly behavioral
economics and environ. psych)
58. Eco-Feedback Design Space
INFORMATION ACCESS DATA REPRESENTATION COMPARISON
update aesthetic comparison
frequency real-time monthly or less user poll pragmatic artistic target self social goal
spatial proximity time comparison by
to behavior co-located remote window <hour >year time past projected
attentional temporal social-comp.
demand glanceable high attention grouping ≤sec by hour by day by week by month ≥year geographically demographically selected
target proximal similar social network
effort to data goal-setting
access low high granularity coarse-grain fine-grain strategy self-set system-set externally-set
INTERACTIVITY visual difficulty to reach
complexity simple complex comparison target easy hard
degree of
interactivity none high primary visual comparison variables statistic computation
encoding textual graphical time window
interface raw value @ this time [yest, last wk, mo, yr]
customizability none high measurement time granularity average [hrly, daily, wkly, monthly, yrly]
unit resource cost environmental activity time metaphor data grouping median over past [X] days
impact mode
user data granularity this day type [weekday, weekend]
additions user annotations user corrections primary other this day of week (e.g., mondays)
measurement unit
view temporal spatial categorical
DISPLAY MEDIUM
manifestation data
grouping by by by by by by consumption SOCIAL ASPECTS
webpage mobile wearable custom in-home resource person time space activity category
phone app interface display display target
person household community state country
ambience MOTIVATIONAL/PERSUASIVE STRATEGIES
not-ambient ambient private/
persuasive tactics from persuasive tactics include:
public private public
size psychology and applied social rewards goal-setting
small large psychology disciplines: data
punishment narrative
ACTIONABILITY/UTILITY persuasive design
public commitment likeability sharing none everyone
written commitment reputation
persuasive technology social-
degree of loss aversion competition (see COMPARISON)
behavioral science/economics comparison available unavailable
actionability low high kairos social proof
environmental psychology
encouragement authority
decision game design
suggests suggests anomaly descriptive norms emotional appeals
support actions social marketing
purchase decisions alerts scarcity principle door-in-face
health behavior change
personal- framing unlock features
ization no personalization highly personalized anchoring bias endowment effect
defaults collection building
information
intent Informs one action informs many actions
automation/
control no control system controls resource use [Froehlich et al., HCIC2009; CHI2010; UW PhD Dissertation 2011]
59. data information
representation access
inputs display
medium
the
behavioral
eco-feedback
design space comparison
models
social actionability
motivational
strategies
60. data information
representation access
inputs display
medium
the
behavioral
eco-feedback
design space comparison
models
social actionability
motivational
strategies
61. data information
representation access
inputs display
medium
the
behavioral
eco-feedback
design space comparison
models
social actionability
motivational
strategies
62. data information
representation access
inputs display
medium
the
behavioral
eco-feedback
design space comparison
models
social actionability
motivational
strategies
63. data information
representation access
inputs display
medium
the
behavioral
eco-feedback
design space comparison
models
social actionability
motivational
strategies
64. Two sets of designs:
1 Design Dimensions
Isolate eco-feedback design dimensions in the context of water usage
2 Design Probes
Meant to elicit reactions about how displays would fit within a household
and investigate issues such as privacy, competition, family dynamics.
65. DESIGN SET 1: ISOLATING DESIGN DIMENSIONS
Design Dimensions Explored
1 Data Granularity Part of “Data
Representation” in
2 Time Granularity the eco-feedback
design space
3 Measurement Unit
4 Comparison
66. data information
representation access
inputs display
medium
the
behavioral
eco-feedback
design space comparison
models
social actionability
motivational
strategies
67. data information
representation access
inputs display
medium
the
behavioral
eco-feedback
design space comparison
models
social actionability
motivational
strategies
68. data
representation
tion
s
aesthetic
pragmatic artistic
visual complexity
simple complex
time granularity
< hour > year
data granularity coarse-grain fine-grain
measurement unit
resource cost environmental time activity metaphor
impact
primary view
temporal spatial categorical
69. data
representation
tion
s
aesthetic
pragmatic artistic
visual complexity
simple complex
time granularity
< hour > year
data granularity coarse-grain fine-grain
measurement unit
resource cost environmental time activity metaphor
impact
primary view
temporal spatial categorical
70. DESIGN SET 1: ISOLATING DESIGN DIMENSIONS
Data Granularity
coarse-grain fine-grain
≥neighbor- home room activity fixture fixture ≤ valve
hood category
75. DESIGN SET 1: ISOLATING DESIGN DIMENSIONS
Time Granularity
≤ hour day week month ≥ year
76. DESIGN SET 1: ISOLATING DESIGN DIMENSIONS
Measurement Unit
resource rate of cost time activity metaphor
consumption
36 gallons 3 gpm 9 cents 12 minutes 1 shower
of water
80. DESIGN SET 1: ISOLATING DESIGN DIMENSIONS
data
representation
tion
s
aesthetic
pragmatic artistic
visual complexity
simple complex
time window
< hour > year
data granularity coarse-grain fine-grain
measurement unit
resource cost environmental time activity metaphor
impact
primary view
temporal spatial categorical
81. DESIGN SET 1: ISOLATING DESIGN DIMENSIONS
data
representation
tion
s
82. DESIGN SET 1: ISOLATING DESIGN DIMENSIONS
comparison
ity
comparison
target self social goal
comparison by
time past projected
social comparison
target geographically demographically selected social
proximal similar network
goal-setting
strategy self-set system-set externally set
difficulty to reach
comparison target easy hard
83. comparison
ity
comparison
target self social goal
comparison by
time past projected
social comparison
target geographically demographically selected social
proximal similar network
goal-setting
strategy self-set system-set externally set
difficulty to reach
comparison target easy hard
84. DESIGN SET 1: ISOLATING DESIGN DIMENSIONS
Design Dimensions Explored
Data
Granularity
Individual Fixture Fixture Category Activity Hot and Cold
Time
Granularity
So Far Today So Far This Week So Far This Month
Comparison
Self Comparison To Others To A Goal Social/Self
Measurement
Unit
In Gallons In Dollars Dollars / Gallons Including Sewage
85. Two sets of designs:
1 Design Dimensions
Isolate eco-feedback design dimensions in the context of water usage
2 Design Probes
Meant to elicit reactions about how displays would fit within a household
and investigate issues such as privacy, competition, family dynamics.
86. DESIGN SET 2: DESIGN PROBES
Design Probes Explored
Time- Aquatic
Series Eco-system
Spatial Rainflow
Per- Other
Occupant
87. DESIGN SET 2: DESIGN PROBES
Design Probes Explored
Time- Aquatic
Series Eco-system
Spatial Rainflow
Per- Other
Occupant
88. Daily Patterns of Water Usage
Washing Machine
Shower
Bath
Faucets
Toilets
Gallons
[Adapted from Butler, Building and Environment, 1993]
94. DESIGN SET 2: DESIGN PROBES
Design Probes Explored
Time- Aquatic
Series Eco-system
Spatial Rainflow
Per- Other
Occupant
95. DESIGN SET 2: DESIGN PROBES
Aquatic Ecosystem Design Influences
ubifit
Consolvo et al., CHI2008
ubigreen
Froehlich et al., CHI 2009
Consolvo et al., UbiComp2008
96. DESIGN SET 2: DESIGN PROBES
Aquatic Ecosystem View Movie
Water savings
New water “Frank” the fish
water savings met met
goal goal meets his mate
savings
tracker
display is also
“Frank” interactive so
the fish fish respond
to touch
Frank and his
mate have
children
and so on…
97. DESIGN SET 2: DESIGN PROBES
Design Probes Explored
Time- Aquatic
Series Eco-system
Spatial Rainflow
Per- Other
Occupant
103. Informal interviews with water experts (e.g., SPU, Amy Vickers)
UW Environmental Practicum on water
Literature review of water resource management, environmental psychology
Our own online survey of water usage attitudes & knowledge (N=656 respondents)
Design critique sessions with team
Three sets of pilot studies
Data Ideation / Pilot Formative
Ideation Refinement
Gathering Sketch Studies Evaluation
Informed by gathered data
Guided by eco-feedback design space
Online interactive survey of designs (N=651 respondents)
In-home interviews (10 households, 20 adults)
104. Online Survey
Recruitment
o Online postings and word-of-mouth
Survey Design
o 63 questions (10 optional)
o Question and answer order
randomized when possible
Collected Data
o 712 completed surveys
(651 from US or Canada)
o Nearly 6,000 qualitative responses
107. In-Home Interviews
Recruitment
o Online postings and word-of-mouth
o Specifically recruited families
Interview Method
o Semi-structured with two researchers
o 90-minutes, 3-phases
o Data coded by two researchers into themes
Participants
o 10 households (20 adults)
o 11 female/9 male
o Diff. socio-economic backgrounds & occupations
o 18 had college degrees
110. For both the survey and interviews, 90% of
participants indicated an interest in conserving water
Average morning shower
uses 400 gallons of water
112. Data Granularity
coarse-grain fine-grain
≥neighbor- home room activity fixture fixture ≤ valve
hood category
This display lets
you more easily
identify the specific
areas that need
attention
R536 Majority preferred the Individual Fixture Display
113. Data Granularity
coarse-grain fine-grain
≥neighbor- home room activity fixture fixture ≤ valve
hood category
This display lets
you more easily
identify the specific
areas that need
attention
R536 Majority preferred the Individual Fixture Display
114. Data Granularity
coarse-grain fine-grain
≥neighbor- home room activity fixture fixture ≤ valve
hood category
20% preferred the Activity Display
115. Measurement Unit
resource rate of cost time activity metaphor
consumption
71% of respondents preferred to see both gallons and cost
Seeing the gallon amount triggers the ‘save the
environment’ impulse to conserve, while the dollar
amount is helpful because almost everyone is
motivated by money to some extent
R143 I don't think very well in ‘thousands of gallons’, but
$20 I can understand. That’s a case of beer down
the drain, if you will
R48
116. Time Granularity
≤ hour day week month ≥ year
Majority of respondents wanted ability to
switch between different time granularities
117. Comparisons were the most
uniformly desired pieces of
information of all the dimensions
119. Emergent Themes
1 Competition and Cooperation
2 Accountability and Blame
3 Playfulness and Functionality
4 Sense of Privacy
5 Display Placement
120. Competition and Cooperation
“ ”
You can compare usage to others, and create friendly competition
“ ”
R220
It pits the family members against each other
rather than encouraging collaboration
“
R485
[It] sets up a ‘competitive’ environment that
we are trying not to create in our household
R493
121. Accountability and Blame
“ ”
It holds each individual accountable for water usage
“ ”
R354
There’s no reason to add an element of
‘blame’ to conservation efforts within a family
“
R98
Would seem to lead to plenty of arguments
about usage
R144
122. Playfulness and Functionality
“ ”
I like the idea of getting rewards for saving water
“
I8.2
”
It’s like unlocking badges in Foursquare. No matter how trivial it can
be to make a fish appear on this screen, you still want to do it
“
I4.1
It doesn’t appeal to me as much. I don’t do Foursquare. This distracts
me a little bit and it doesn’t make me think about my usage
I4.2
131. Primary Contributions
1 First work to design and evaluate
feedback visualizations for disaggregated
water data
2 An iterative design roadmap for others
working in the space of eco-feedback or
other behavior change technologies
135. Data Ideation / Pilot Formative
Ideation Refinement
Gathering Sketch Studies Evaluation
136. Closing Thought
Eco-feedback displays do not just visualize
consumption, they document household activities
137. The Eco-Feedback Team!
Solai Josh Inness Fabia Mazhengmin
Marilyn Eric Leah Shwetak James
Acknowledgements:
Seattle Public Utilities: Ray Hoffman, Director; Al Diettemann, Water Conservation Expert; Bob Alpers
Amy Vickers, Water Conservation Expert
Austin Polebitski, Assistant Professor of Civil and Environmental Engineering, UMass
David Hsu, Assistant Professor City and Regional Planning, UPenn
Sara Sheridan for her early design work
138. Questions?
@jonfroehlich
design: UNIVERSITY of
use:
build: WASHINGTON