SlideShare a Scribd company logo
1 of 40
Download to read offline
Diffusion of Feedback 
Perceptions and Adoption of Devices 
Beth Karlin 
School of Social Ecology 
University of California, Irvine
Underlying Assumptions 
1. Technology & new media are changing how people 
interact with our natural, built, and social worlds. 
Karlin 2012
Underlying Assumptions 
1. Technology & new media are changing how people 
interact with our natural, built, and social worlds. 
2. There are potential opportunities to leverage these 
changes for pro-social / pro-environmental benefit. 
Karlin 2012
Underlying Assumptions 
1. Technology & new media are changing how people 
interact with our natural, built, and social worlds. 
2. There are potential opportunities to leverage these 
changes for pro-social / pro-environmental benefit. 
3. Psychology provides a rich history and theoretical base 
with which to understand this potential. 
Karlin 2012
Transformational Media Lab 
Mission: 
Our lab studies how media is (and can be) used to 
transform individuals, communities, and systems. 
Karlin 2012 
Narrative 
Strategies 
Social Action 
Campaigns 
Energy 
Feedback
What is Feedback? 
“Information about the result of a process 
or action that can be used in modification 
or control of a process or system” 
Oxford English Dictionary 
Karlin 2012
What is Feedback? 
“Information about the result of a process 
or action that can be used in modification 
or control of a process or system” 
Oxford English Dictionary
Kempton & Layne, 1984
How much energy does your washer use? 
Karlin 2012
How about your whole house?
The “Behavioral Wedge” 
— “Unlocking Energy Efficiency in the US Economy” 
— $1 trillion 
— 20 gigatons of greenhouse gas 
“…but only if the nation can craft a comprehensive and innovative 
approach to unlock it.” (McKinsey & Company, 2009) 
— “Household actions can provide a behavioral wedge to rapidly 
reduce carbon emissions” 
— 5-12% reduction in 5 years 
— 9-22% reduction in 10 years 
“…without waiting for new technologies or regulations or changing 
household lifestyle.” (Dietz, Gardner, Gilligan, Stern, & Vandenbergh, 2009) 
Karlin 2012
Our Window of Opportunity 
RIP 
Traditional Meter 
Circa 1880 –2020 
Automatic transmission to utilities 
Feedback to consumers 
Karlin 2012
200+ products in the market 
Karlin 2012
Looking at past research 
— 100+ studies conducted since 1976 
— Effect sizes ranged from -.0830 to .4803 
— Mean r-effect size = .1174 (p < .001) 
— Moderating variables: 
— duration (longer = more effective) 
— Frequency (more frequent = more effective) 
— Medium (computer/device > paper) 
Karlin 2012
Limitations of Studies 
— Not naturalistic 
— Participants recruited to participate 
— May be different from “active adopters” 
— Not comparative 
— Most studies tests one type of feedback (vs. control) 
— Very few commercial products in studies 
— Not testing mediation 
— DV is energy use, but studies rarely test possible 
mediators to explain effectiveness 
Karlin 2012
Present research 
1. Identify ‘naturalistic’ users of feedback 
— Who is really using these products? 
— Purposive sampling 
2. Ask about the user experience 
— Enables comparisons between devices 
— Gain insights into usability, adoption, etc. 
3. Explore perceptions and barriers 
— Understand market beyond the “early adopters” 
— Identify potential barrier and leverage points 
Karlin 2012
But first… 
A 
(very) 
brief 
introduction 
to 
Diffusion 
of 
Innovation 
Theory 
Karlin 2012
Diffusion of Innovation 
Theory of technology adoption which explains: 
1. Social process by which an innovation spreads throughout a population 
2. Personal process by which individuals decide to adopt an innovation 
(Rogers, 1962) Karlin 2012
Diffusion of Innovation 
Theory of technology adoption which explains: 
1. Social process by which an innovation spreads throughout a population 
2. Personal process by which individuals decide to adopt an innovation 
(Rogers, 1962) Karlin 2012
Diffusion of Innovation 
Theory of technology adoption which explains: 
1. Social process by which an innovation spreads throughout a population 
2. Personal process by which individuals decide to adopt an innovation 
(Rogers, 1962) Karlin, 2012
Our Study 
Antecedent characteristics: 
1. Demographic 
2. Psychographic 
Knowledge Persuasion Decision Confirmation 
Knowledge factors: 
1. Awareness 
2. Impression 
Perceived Barriers 
1. Cost 
2. Requirements 
Sample: 836 adults who use energy in the home 
Method: 15-minute online survey on energy conservation and feedback devices 
Variables: Demographic & psychographic variables; awareness, impressions and use of 
feedback devices, willingness to pay, barriers to adoption. 
Confirmation factors: 
1. Usability 
2. Outcome 
Karlin 2012 
Did they adopt? 
Social System 
1. Adoption
Our Study 
Antecedent characteristics: 
1. Demographic 
2. Psychographic 
Knowledge Persuasion Decision Confirmation 
Karlin 2012 
Did they adopt?
Are feedback users different? 
Demographic Psychological 
Gender Environmental Motivation 
Age Environmental Concern 
Race Financial Motivation 
Marital Status Price Consciousness 
Political Affiliation Social Motivation 
Education Social Norms 
Income 
Home Type 
Homeownership 
Karlin 2012
Demographic 
Variable Feedback users Non-feedback users 
Gender*** 46% female 
54% male 
70% female 
30% male 
Age** 45.5 years 39.9 years 
Race 81.7% Caucasian 
1.2% Hispanic 
6.1% Asian 
1.2% African-American 
9.7% Other/Decline 
81.8% Caucasian 
6.7% Hispanic 
6.1% Asian 
1.6% African-American 
3.8% Other/Decline 
Marital Status* 62% married 
38% not married 
52% married 
48% not married 
Political Affiliation* 
(1 = liberal, 5 = conservative) 
2.04 2.33 
Education 17.9 years 17.4 years 
Income** $104,000 $88,000 
Home Type ** 74% detached house 
26% apartment/condo/other 
53% detached house 
47% apartment/condo/other 
Homeowner*** 82% own 
18% rent 
57% own 
43% rent 
* p < .05, ** p < .01, p < .001
Psychographic 
Variable Feedback users 
Non-feedback users 
Environmental 
- Environmental Concern*** 4.40 4.18 
- Environmental Motivation** 3.18 2.80 
Financial 
- Price Conciousness* 0.70 0.59 
- Financial Motivation** 2.67 3.07 
Social 
- Social Norms 3.04 2.92 
- Social Motivation 1.95 1.83 
* p < .05, ** p < .01, p < .001 
Karlin 2012
What variables best explain variance? 
Karlin 2012
Our Study 
Knowledge Persuasion Decision Confirmation 
Karlin 2012 
Did they adopt? 
Social System 
1. Adoption
Adoption 
Questions 
— What device/system did you use? 
— How did you find out about it? 
— Where did you get it? 
Findings 
— Social Diffusion (family/friends/colleagues) 
— 20% learned about product through friend/family 
— 14% received product from friend/family 
— Utility acquisition (21%) 
— Borrowing (13%) 
Karlin 2012
Our Study 
Knowledge Persuasion Decision Confirmation 
Karlin 2012 
Knowledge factors: 
1. Awareness 
2. Impression
Awareness 
Karlin 2012 
27% 
37% Aware of devices 
35% 
Aware, but not specific 
Not aware of feedback 
38% 
62% 
Adopted 
Not adopted 
Had no idea that these exist. The idea of it I find very appealing. 
I have never heard about this kind of mechanism 
as I have not been proactive in learning about it.
General Impression 
Karlin 2012 
10% 
48% 
42% 
Negative 
Ambivalent 
Positive 
No because I don't feel its your business to tell me 
what I can use or to monitor my opinions on the matter 
Assume they make sense since the 
utility companies are promoting them. 
A wonderful idea!
Our Study 
Knowledge Persuasion Decision Confirmation 
Karlin 2012 
Perceived Barriers 
1. Cost 
2. Requirements
Persuasion 
Reason For Not Using Feedback % 
Did not know that they existed 44% 
Do not know where to buy them 27% 
Do not know how to install/set up 18% 
Already conserving energy 16% 
Never got around to it 15% 
Too expensive 11% 
No time to install/set up 9% 
Do not see any benefit in using such a device 5% 
Conserving energy is not a priority in my life 2% 
they might not be 
available in my area 
I’m too busy to worry about 
my energy consumption 
I already keep track of many things in my life 
and do not want to add another burden
Willingness to Pay 
30% 
25% 
20% 
15% 
10% 
5% 
0% 
$0 (Not 
willing to 
pay) 
$1 - $20 $21 - $50 $51 - $100 $101 - $200 $200 + 
17% 
27% 26% 
7% 
2% 1% 
“I often recommend it, but have a hard time convincing 
others that it is worth the [money]” 
Karlin 2012 
“To induce behavior these devices have to 
be free or very low cost.”
Our Study 
Knowledge Persuasion Decision Confirmation 
Karlin 2012 
Did they adopt? 
Confirmation factors: 
1. Usability 
2. Outcome
Confirmation 
Usability 
— What do you like / dislike about the product? 
— What was your most surprising experience? 
Outcomes 
— Did knowledge, behavior, and/or energy use change? 
— Do you still use this product? 
Karlin 2012
Confirmation – positive 
Usability 
— Ease of use 
— Effective energy information 
Outcomes 
— Correct inaccurate assumptions about energy use 
— Both general and specific behavior change reported 
We installed power strips to easily power off all 
high energy items 
Karlin, 2012 
I had no idea how much energy computers used
Confirmation - negative 
“Rebound Effect” 
— 15% were surprised that they used less energy than they thought 
Diminishing utility 
“…I’ve actually wound up using more energy on some devices 
when I see how little energy they use (my laptop, for one).” 
— 48% said they do not still use the product 
— No longer in possession/borrowed 
— Do not see a need to continue using 
“it’s served it’s purpose” 
“I checked almost every device I have, so continued usage isn't 
very informative unless I start tracking usage in a spreadsheet - 
way too much work.” 
Karlin, 2012
Implications 
1. Further research into active feedback adopters could yield 
positive results for segmentation. 
2. Research into leveraging social networks to promote the use 
of feedback devices is promising. 
3. There is promise for utility-based and lending/borrowing 
programs for distribution. 
4. Integrating injunctive social norms (e.g. social comparison) 
could address rebound effect. 
5. Further research is needed into actual and perceived barriers 
of potential users. 
Karlin 2012
Closing Thoughts 
“Energy efficiency is not just low-hanging fruit; it is fruit 
that is lying on the ground.” 
Steven Chu, US Energy Secretary 
Acknowledgements 
uci@home research team 
David Kirkby, Physics Daniel Stokols, Psychology 
Nora Davis, Social Ecology Kristen Gamble, Psychology 
Haly Hererra, Engineering Angela Sanguinetti, Planning 
Contact: bkarlin@uci.edu

More Related Content

What's hot

Managing Healthcare Innovation as a Design Process
Managing Healthcare Innovation as a Design Process Managing Healthcare Innovation as a Design Process
Managing Healthcare Innovation as a Design Process designforcare
 
How can we harness digital technologies and artificial intelligence (AI) to s...
How can we harness digital technologies and artificial intelligence (AI) to s...How can we harness digital technologies and artificial intelligence (AI) to s...
How can we harness digital technologies and artificial intelligence (AI) to s...SharpBrains
 
IRJET- Technology Related Anxiety- The Deepest Contributor to Stress
IRJET- Technology Related Anxiety- The Deepest Contributor to StressIRJET- Technology Related Anxiety- The Deepest Contributor to Stress
IRJET- Technology Related Anxiety- The Deepest Contributor to StressIRJET Journal
 
Update by Mel Barsky, Director at Centre for Aging + Brain Health Innovation ...
Update by Mel Barsky, Director at Centre for Aging + Brain Health Innovation ...Update by Mel Barsky, Director at Centre for Aging + Brain Health Innovation ...
Update by Mel Barsky, Director at Centre for Aging + Brain Health Innovation ...SharpBrains
 
How to intervene early: Examples in depression, epilepsy and smoking cessation
How to intervene early: Examples in depression, epilepsy and smoking cessationHow to intervene early: Examples in depression, epilepsy and smoking cessation
How to intervene early: Examples in depression, epilepsy and smoking cessationSharpBrains
 
Blue button mashup webinar 20120719 health2.0
Blue button mashup webinar 20120719 health2.0Blue button mashup webinar 20120719 health2.0
Blue button mashup webinar 20120719 health2.0health2dev
 
What are most promising lifestyle and tech options to harness lifelong neurop...
What are most promising lifestyle and tech options to harness lifelong neurop...What are most promising lifestyle and tech options to harness lifelong neurop...
What are most promising lifestyle and tech options to harness lifelong neurop...SharpBrains
 
Expo day: Digital Artefacts (BrainBaseline), Heart­Math, Sleep Genius, The Al...
Expo day: Digital Artefacts (BrainBaseline), Heart­Math, Sleep Genius, The Al...Expo day: Digital Artefacts (BrainBaseline), Heart­Math, Sleep Genius, The Al...
Expo day: Digital Artefacts (BrainBaseline), Heart­Math, Sleep Genius, The Al...SharpBrains
 
Protect Your Organization This Hurricane Season
Protect Your Organization This Hurricane SeasonProtect Your Organization This Hurricane Season
Protect Your Organization This Hurricane SeasonAgility Recovery
 
How will the Clinicians, Patients and Consumers of the Future ensure appropri...
How will the Clinicians, Patients and Consumers of the Future ensure appropri...How will the Clinicians, Patients and Consumers of the Future ensure appropri...
How will the Clinicians, Patients and Consumers of the Future ensure appropri...SharpBrains
 

What's hot (12)

Managing Healthcare Innovation as a Design Process
Managing Healthcare Innovation as a Design Process Managing Healthcare Innovation as a Design Process
Managing Healthcare Innovation as a Design Process
 
How can we harness digital technologies and artificial intelligence (AI) to s...
How can we harness digital technologies and artificial intelligence (AI) to s...How can we harness digital technologies and artificial intelligence (AI) to s...
How can we harness digital technologies and artificial intelligence (AI) to s...
 
IRJET- Technology Related Anxiety- The Deepest Contributor to Stress
IRJET- Technology Related Anxiety- The Deepest Contributor to StressIRJET- Technology Related Anxiety- The Deepest Contributor to Stress
IRJET- Technology Related Anxiety- The Deepest Contributor to Stress
 
Update by Mel Barsky, Director at Centre for Aging + Brain Health Innovation ...
Update by Mel Barsky, Director at Centre for Aging + Brain Health Innovation ...Update by Mel Barsky, Director at Centre for Aging + Brain Health Innovation ...
Update by Mel Barsky, Director at Centre for Aging + Brain Health Innovation ...
 
How to intervene early: Examples in depression, epilepsy and smoking cessation
How to intervene early: Examples in depression, epilepsy and smoking cessationHow to intervene early: Examples in depression, epilepsy and smoking cessation
How to intervene early: Examples in depression, epilepsy and smoking cessation
 
Blue button mashup webinar 20120719 health2.0
Blue button mashup webinar 20120719 health2.0Blue button mashup webinar 20120719 health2.0
Blue button mashup webinar 20120719 health2.0
 
A Journey from Patient Needs to Health Solutions
A Journey from Patient Needs to Health SolutionsA Journey from Patient Needs to Health Solutions
A Journey from Patient Needs to Health Solutions
 
What are most promising lifestyle and tech options to harness lifelong neurop...
What are most promising lifestyle and tech options to harness lifelong neurop...What are most promising lifestyle and tech options to harness lifelong neurop...
What are most promising lifestyle and tech options to harness lifelong neurop...
 
Expo day: Digital Artefacts (BrainBaseline), Heart­Math, Sleep Genius, The Al...
Expo day: Digital Artefacts (BrainBaseline), Heart­Math, Sleep Genius, The Al...Expo day: Digital Artefacts (BrainBaseline), Heart­Math, Sleep Genius, The Al...
Expo day: Digital Artefacts (BrainBaseline), Heart­Math, Sleep Genius, The Al...
 
Panacea H4D Stanford 2019
Panacea H4D Stanford 2019Panacea H4D Stanford 2019
Panacea H4D Stanford 2019
 
Protect Your Organization This Hurricane Season
Protect Your Organization This Hurricane SeasonProtect Your Organization This Hurricane Season
Protect Your Organization This Hurricane Season
 
How will the Clinicians, Patients and Consumers of the Future ensure appropri...
How will the Clinicians, Patients and Consumers of the Future ensure appropri...How will the Clinicians, Patients and Consumers of the Future ensure appropri...
How will the Clinicians, Patients and Consumers of the Future ensure appropri...
 

Viewers also liked

Diffusion of innovations theory
Diffusion of innovations theoryDiffusion of innovations theory
Diffusion of innovations theoryGayathri Thangavel
 
Multi step flow theory
Multi step flow theoryMulti step flow theory
Multi step flow theoryV.j. Singh
 
Diffusion of Innovation (Development Communication) -ZK
Diffusion of Innovation (Development Communication) -ZKDiffusion of Innovation (Development Communication) -ZK
Diffusion of Innovation (Development Communication) -ZKZareen Khan
 

Viewers also liked (6)

Diffusion of innovations theory
Diffusion of innovations theoryDiffusion of innovations theory
Diffusion of innovations theory
 
Two step flow
Two step flowTwo step flow
Two step flow
 
Multi step flow theory
Multi step flow theoryMulti step flow theory
Multi step flow theory
 
2 Step Flow Theory
2 Step Flow Theory2 Step Flow Theory
2 Step Flow Theory
 
Diffusion of Innovation (Development Communication) -ZK
Diffusion of Innovation (Development Communication) -ZKDiffusion of Innovation (Development Communication) -ZK
Diffusion of Innovation (Development Communication) -ZK
 
Two-Step Flow Theory
Two-Step Flow TheoryTwo-Step Flow Theory
Two-Step Flow Theory
 

Similar to Diffusion of Feedback: Perceptions and Adoption of Devices

Psychological Research on Energy Feedback
Psychological Research on Energy FeedbackPsychological Research on Energy Feedback
Psychological Research on Energy FeedbackBeth Karlin
 
The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback D...
The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback D...The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback D...
The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback D...Beth Karlin
 
Exploring Deep Savings: A Toolkit for Assessing Behavior-Based Energy Interve...
Exploring Deep Savings: A Toolkit for Assessing Behavior-Based Energy Interve...Exploring Deep Savings: A Toolkit for Assessing Behavior-Based Energy Interve...
Exploring Deep Savings: A Toolkit for Assessing Behavior-Based Energy Interve...Beth Karlin
 
ACMP Pacific NW Chapter - Behavioral Insights and Neurochange - Nov 2017
ACMP Pacific NW Chapter - Behavioral Insights and Neurochange - Nov 2017ACMP Pacific NW Chapter - Behavioral Insights and Neurochange - Nov 2017
ACMP Pacific NW Chapter - Behavioral Insights and Neurochange - Nov 2017alistaln
 
Pavlin Matia Dissertation on the Value-Action Gap
Pavlin Matia Dissertation on the Value-Action GapPavlin Matia Dissertation on the Value-Action Gap
Pavlin Matia Dissertation on the Value-Action GapPavlin Matia
 
Behaviour Change lecture to the International Energy Center in Brisbane
Behaviour Change lecture to the International Energy Center in BrisbaneBehaviour Change lecture to the International Energy Center in Brisbane
Behaviour Change lecture to the International Energy Center in BrisbaneSEA - Sustainable Energy Advice Ltd
 
Utilization Based Evaluation In Mental Health
Utilization Based Evaluation In Mental HealthUtilization Based Evaluation In Mental Health
Utilization Based Evaluation In Mental HealthPaul Frankel
 
The importance of talking to YOU about complex environmental issues...
The importance of talking to YOU about complex environmental issues...The importance of talking to YOU about complex environmental issues...
The importance of talking to YOU about complex environmental issues...WelfareEmpEnergyDemand
 
The Psychology of Sustainability
The Psychology of SustainabilityThe Psychology of Sustainability
The Psychology of SustainabilityBeth Karlin
 
Against excellence
Against excellenceAgainst excellence
Against excellenceJack Stilgoe
 
Categories of Case Study
Categories of Case StudyCategories of Case Study
Categories of Case StudyRaj Shravanthi
 
Why We Do What We Do?
Why We Do What We Do?Why We Do What We Do?
Why We Do What We Do?Beth Karlin
 
Professor Geoffrey Beattie: Manufacturing a "Green Revolution" - some psychol...
Professor Geoffrey Beattie: Manufacturing a "Green Revolution" - some psychol...Professor Geoffrey Beattie: Manufacturing a "Green Revolution" - some psychol...
Professor Geoffrey Beattie: Manufacturing a "Green Revolution" - some psychol...Communicate
 
Paul C Stern: Environmentally significant behaviour and how to change it
Paul C Stern: Environmentally significant behaviour and how to change itPaul C Stern: Environmentally significant behaviour and how to change it
Paul C Stern: Environmentally significant behaviour and how to change it3 Pillars Network
 
Changing the World in Healthcare, Education, and Energy through Science, Tech...
Changing the World in Healthcare, Education, and Energy through Science, Tech...Changing the World in Healthcare, Education, and Energy through Science, Tech...
Changing the World in Healthcare, Education, and Energy through Science, Tech...Mohamed Labadi
 
Sustainable Practices in Government Agencies Survey Results Report
Sustainable Practices in Government Agencies Survey Results ReportSustainable Practices in Government Agencies Survey Results Report
Sustainable Practices in Government Agencies Survey Results Reportlschendl
 

Similar to Diffusion of Feedback: Perceptions and Adoption of Devices (20)

Psychological Research on Energy Feedback
Psychological Research on Energy FeedbackPsychological Research on Energy Feedback
Psychological Research on Energy Feedback
 
The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback D...
The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback D...The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback D...
The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback D...
 
Exploring Deep Savings: A Toolkit for Assessing Behavior-Based Energy Interve...
Exploring Deep Savings: A Toolkit for Assessing Behavior-Based Energy Interve...Exploring Deep Savings: A Toolkit for Assessing Behavior-Based Energy Interve...
Exploring Deep Savings: A Toolkit for Assessing Behavior-Based Energy Interve...
 
ACMP Pacific NW Chapter - Behavioral Insights and Neurochange - Nov 2017
ACMP Pacific NW Chapter - Behavioral Insights and Neurochange - Nov 2017ACMP Pacific NW Chapter - Behavioral Insights and Neurochange - Nov 2017
ACMP Pacific NW Chapter - Behavioral Insights and Neurochange - Nov 2017
 
Pavlin Matia Dissertation on the Value-Action Gap
Pavlin Matia Dissertation on the Value-Action GapPavlin Matia Dissertation on the Value-Action Gap
Pavlin Matia Dissertation on the Value-Action Gap
 
Behaviour Change lecture to the International Energy Center in Brisbane
Behaviour Change lecture to the International Energy Center in BrisbaneBehaviour Change lecture to the International Energy Center in Brisbane
Behaviour Change lecture to the International Energy Center in Brisbane
 
Utilization Based Evaluation In Mental Health
Utilization Based Evaluation In Mental HealthUtilization Based Evaluation In Mental Health
Utilization Based Evaluation In Mental Health
 
It isnt easy being green, or is it?
It isnt easy being green, or is it?It isnt easy being green, or is it?
It isnt easy being green, or is it?
 
The importance of talking to YOU about complex environmental issues...
The importance of talking to YOU about complex environmental issues...The importance of talking to YOU about complex environmental issues...
The importance of talking to YOU about complex environmental issues...
 
The Psychology of Sustainability
The Psychology of SustainabilityThe Psychology of Sustainability
The Psychology of Sustainability
 
1st Irish Task 24 Behaviour Changer Workshop
1st Irish Task 24 Behaviour Changer Workshop1st Irish Task 24 Behaviour Changer Workshop
1st Irish Task 24 Behaviour Changer Workshop
 
Against excellence
Against excellenceAgainst excellence
Against excellence
 
Categories of Case Study
Categories of Case StudyCategories of Case Study
Categories of Case Study
 
2nd Swedish Behaviour Changer workshop
2nd Swedish Behaviour Changer workshop2nd Swedish Behaviour Changer workshop
2nd Swedish Behaviour Changer workshop
 
Why We Do What We Do?
Why We Do What We Do?Why We Do What We Do?
Why We Do What We Do?
 
Professor Geoffrey Beattie: Manufacturing a "Green Revolution" - some psychol...
Professor Geoffrey Beattie: Manufacturing a "Green Revolution" - some psychol...Professor Geoffrey Beattie: Manufacturing a "Green Revolution" - some psychol...
Professor Geoffrey Beattie: Manufacturing a "Green Revolution" - some psychol...
 
Paul C Stern: Environmentally significant behaviour and how to change it
Paul C Stern: Environmentally significant behaviour and how to change itPaul C Stern: Environmentally significant behaviour and how to change it
Paul C Stern: Environmentally significant behaviour and how to change it
 
42 44
42 4442 44
42 44
 
Changing the World in Healthcare, Education, and Energy through Science, Tech...
Changing the World in Healthcare, Education, and Energy through Science, Tech...Changing the World in Healthcare, Education, and Energy through Science, Tech...
Changing the World in Healthcare, Education, and Energy through Science, Tech...
 
Sustainable Practices in Government Agencies Survey Results Report
Sustainable Practices in Government Agencies Survey Results ReportSustainable Practices in Government Agencies Survey Results Report
Sustainable Practices in Government Agencies Survey Results Report
 

More from Beth Karlin

From Climate Science to Climate Impacts: Exploring the Role of Film as Bound...
From Climate Science to Climate Impacts:  Exploring the Role of Film as Bound...From Climate Science to Climate Impacts:  Exploring the Role of Film as Bound...
From Climate Science to Climate Impacts: Exploring the Role of Film as Bound...Beth Karlin
 
Communicating Climate Behaviors: Framing and False Dichotomies
Communicating Climate Behaviors: Framing and False DichotomiesCommunicating Climate Behaviors: Framing and False Dichotomies
Communicating Climate Behaviors: Framing and False DichotomiesBeth Karlin
 
Transformational Media: A New Approach to Sustainability
Transformational Media: A New Approach to SustainabilityTransformational Media: A New Approach to Sustainability
Transformational Media: A New Approach to SustainabilityBeth Karlin
 
Proof That It's Working: Invisible Children in the Classroom
Proof That It's Working: Invisible Children in the ClassroomProof That It's Working: Invisible Children in the Classroom
Proof That It's Working: Invisible Children in the ClassroomBeth Karlin
 
Affect to Action: Psychological Insights for Digital Activism
Affect to Action: Psychological Insights for Digital ActivismAffect to Action: Psychological Insights for Digital Activism
Affect to Action: Psychological Insights for Digital ActivismBeth Karlin
 
Public Acceptance of Smart Meters: Integrating Psychology and Practice
Public Acceptance of Smart Meters: Integrating Psychology and PracticePublic Acceptance of Smart Meters: Integrating Psychology and Practice
Public Acceptance of Smart Meters: Integrating Psychology and PracticeBeth Karlin
 
Film and Social Change: Psychological Insights for Leveraging Impact
Film and Social Change: Psychological Insights for Leveraging ImpactFilm and Social Change: Psychological Insights for Leveraging Impact
Film and Social Change: Psychological Insights for Leveraging ImpactBeth Karlin
 

More from Beth Karlin (7)

From Climate Science to Climate Impacts: Exploring the Role of Film as Bound...
From Climate Science to Climate Impacts:  Exploring the Role of Film as Bound...From Climate Science to Climate Impacts:  Exploring the Role of Film as Bound...
From Climate Science to Climate Impacts: Exploring the Role of Film as Bound...
 
Communicating Climate Behaviors: Framing and False Dichotomies
Communicating Climate Behaviors: Framing and False DichotomiesCommunicating Climate Behaviors: Framing and False Dichotomies
Communicating Climate Behaviors: Framing and False Dichotomies
 
Transformational Media: A New Approach to Sustainability
Transformational Media: A New Approach to SustainabilityTransformational Media: A New Approach to Sustainability
Transformational Media: A New Approach to Sustainability
 
Proof That It's Working: Invisible Children in the Classroom
Proof That It's Working: Invisible Children in the ClassroomProof That It's Working: Invisible Children in the Classroom
Proof That It's Working: Invisible Children in the Classroom
 
Affect to Action: Psychological Insights for Digital Activism
Affect to Action: Psychological Insights for Digital ActivismAffect to Action: Psychological Insights for Digital Activism
Affect to Action: Psychological Insights for Digital Activism
 
Public Acceptance of Smart Meters: Integrating Psychology and Practice
Public Acceptance of Smart Meters: Integrating Psychology and PracticePublic Acceptance of Smart Meters: Integrating Psychology and Practice
Public Acceptance of Smart Meters: Integrating Psychology and Practice
 
Film and Social Change: Psychological Insights for Leveraging Impact
Film and Social Change: Psychological Insights for Leveraging ImpactFilm and Social Change: Psychological Insights for Leveraging Impact
Film and Social Change: Psychological Insights for Leveraging Impact
 

Recently uploaded

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 

Recently uploaded (20)

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 

Diffusion of Feedback: Perceptions and Adoption of Devices

  • 1. Diffusion of Feedback Perceptions and Adoption of Devices Beth Karlin School of Social Ecology University of California, Irvine
  • 2. Underlying Assumptions 1. Technology & new media are changing how people interact with our natural, built, and social worlds. Karlin 2012
  • 3. Underlying Assumptions 1. Technology & new media are changing how people interact with our natural, built, and social worlds. 2. There are potential opportunities to leverage these changes for pro-social / pro-environmental benefit. Karlin 2012
  • 4. Underlying Assumptions 1. Technology & new media are changing how people interact with our natural, built, and social worlds. 2. There are potential opportunities to leverage these changes for pro-social / pro-environmental benefit. 3. Psychology provides a rich history and theoretical base with which to understand this potential. Karlin 2012
  • 5. Transformational Media Lab Mission: Our lab studies how media is (and can be) used to transform individuals, communities, and systems. Karlin 2012 Narrative Strategies Social Action Campaigns Energy Feedback
  • 6. What is Feedback? “Information about the result of a process or action that can be used in modification or control of a process or system” Oxford English Dictionary Karlin 2012
  • 7. What is Feedback? “Information about the result of a process or action that can be used in modification or control of a process or system” Oxford English Dictionary
  • 9. How much energy does your washer use? Karlin 2012
  • 10. How about your whole house?
  • 11. The “Behavioral Wedge” — “Unlocking Energy Efficiency in the US Economy” — $1 trillion — 20 gigatons of greenhouse gas “…but only if the nation can craft a comprehensive and innovative approach to unlock it.” (McKinsey & Company, 2009) — “Household actions can provide a behavioral wedge to rapidly reduce carbon emissions” — 5-12% reduction in 5 years — 9-22% reduction in 10 years “…without waiting for new technologies or regulations or changing household lifestyle.” (Dietz, Gardner, Gilligan, Stern, & Vandenbergh, 2009) Karlin 2012
  • 12. Our Window of Opportunity RIP Traditional Meter Circa 1880 –2020 Automatic transmission to utilities Feedback to consumers Karlin 2012
  • 13. 200+ products in the market Karlin 2012
  • 14. Looking at past research — 100+ studies conducted since 1976 — Effect sizes ranged from -.0830 to .4803 — Mean r-effect size = .1174 (p < .001) — Moderating variables: — duration (longer = more effective) — Frequency (more frequent = more effective) — Medium (computer/device > paper) Karlin 2012
  • 15. Limitations of Studies — Not naturalistic — Participants recruited to participate — May be different from “active adopters” — Not comparative — Most studies tests one type of feedback (vs. control) — Very few commercial products in studies — Not testing mediation — DV is energy use, but studies rarely test possible mediators to explain effectiveness Karlin 2012
  • 16. Present research 1. Identify ‘naturalistic’ users of feedback — Who is really using these products? — Purposive sampling 2. Ask about the user experience — Enables comparisons between devices — Gain insights into usability, adoption, etc. 3. Explore perceptions and barriers — Understand market beyond the “early adopters” — Identify potential barrier and leverage points Karlin 2012
  • 17. But first… A (very) brief introduction to Diffusion of Innovation Theory Karlin 2012
  • 18. Diffusion of Innovation Theory of technology adoption which explains: 1. Social process by which an innovation spreads throughout a population 2. Personal process by which individuals decide to adopt an innovation (Rogers, 1962) Karlin 2012
  • 19. Diffusion of Innovation Theory of technology adoption which explains: 1. Social process by which an innovation spreads throughout a population 2. Personal process by which individuals decide to adopt an innovation (Rogers, 1962) Karlin 2012
  • 20. Diffusion of Innovation Theory of technology adoption which explains: 1. Social process by which an innovation spreads throughout a population 2. Personal process by which individuals decide to adopt an innovation (Rogers, 1962) Karlin, 2012
  • 21. Our Study Antecedent characteristics: 1. Demographic 2. Psychographic Knowledge Persuasion Decision Confirmation Knowledge factors: 1. Awareness 2. Impression Perceived Barriers 1. Cost 2. Requirements Sample: 836 adults who use energy in the home Method: 15-minute online survey on energy conservation and feedback devices Variables: Demographic & psychographic variables; awareness, impressions and use of feedback devices, willingness to pay, barriers to adoption. Confirmation factors: 1. Usability 2. Outcome Karlin 2012 Did they adopt? Social System 1. Adoption
  • 22. Our Study Antecedent characteristics: 1. Demographic 2. Psychographic Knowledge Persuasion Decision Confirmation Karlin 2012 Did they adopt?
  • 23. Are feedback users different? Demographic Psychological Gender Environmental Motivation Age Environmental Concern Race Financial Motivation Marital Status Price Consciousness Political Affiliation Social Motivation Education Social Norms Income Home Type Homeownership Karlin 2012
  • 24. Demographic Variable Feedback users Non-feedback users Gender*** 46% female 54% male 70% female 30% male Age** 45.5 years 39.9 years Race 81.7% Caucasian 1.2% Hispanic 6.1% Asian 1.2% African-American 9.7% Other/Decline 81.8% Caucasian 6.7% Hispanic 6.1% Asian 1.6% African-American 3.8% Other/Decline Marital Status* 62% married 38% not married 52% married 48% not married Political Affiliation* (1 = liberal, 5 = conservative) 2.04 2.33 Education 17.9 years 17.4 years Income** $104,000 $88,000 Home Type ** 74% detached house 26% apartment/condo/other 53% detached house 47% apartment/condo/other Homeowner*** 82% own 18% rent 57% own 43% rent * p < .05, ** p < .01, p < .001
  • 25. Psychographic Variable Feedback users Non-feedback users Environmental - Environmental Concern*** 4.40 4.18 - Environmental Motivation** 3.18 2.80 Financial - Price Conciousness* 0.70 0.59 - Financial Motivation** 2.67 3.07 Social - Social Norms 3.04 2.92 - Social Motivation 1.95 1.83 * p < .05, ** p < .01, p < .001 Karlin 2012
  • 26. What variables best explain variance? Karlin 2012
  • 27. Our Study Knowledge Persuasion Decision Confirmation Karlin 2012 Did they adopt? Social System 1. Adoption
  • 28. Adoption Questions — What device/system did you use? — How did you find out about it? — Where did you get it? Findings — Social Diffusion (family/friends/colleagues) — 20% learned about product through friend/family — 14% received product from friend/family — Utility acquisition (21%) — Borrowing (13%) Karlin 2012
  • 29. Our Study Knowledge Persuasion Decision Confirmation Karlin 2012 Knowledge factors: 1. Awareness 2. Impression
  • 30. Awareness Karlin 2012 27% 37% Aware of devices 35% Aware, but not specific Not aware of feedback 38% 62% Adopted Not adopted Had no idea that these exist. The idea of it I find very appealing. I have never heard about this kind of mechanism as I have not been proactive in learning about it.
  • 31. General Impression Karlin 2012 10% 48% 42% Negative Ambivalent Positive No because I don't feel its your business to tell me what I can use or to monitor my opinions on the matter Assume they make sense since the utility companies are promoting them. A wonderful idea!
  • 32. Our Study Knowledge Persuasion Decision Confirmation Karlin 2012 Perceived Barriers 1. Cost 2. Requirements
  • 33. Persuasion Reason For Not Using Feedback % Did not know that they existed 44% Do not know where to buy them 27% Do not know how to install/set up 18% Already conserving energy 16% Never got around to it 15% Too expensive 11% No time to install/set up 9% Do not see any benefit in using such a device 5% Conserving energy is not a priority in my life 2% they might not be available in my area I’m too busy to worry about my energy consumption I already keep track of many things in my life and do not want to add another burden
  • 34. Willingness to Pay 30% 25% 20% 15% 10% 5% 0% $0 (Not willing to pay) $1 - $20 $21 - $50 $51 - $100 $101 - $200 $200 + 17% 27% 26% 7% 2% 1% “I often recommend it, but have a hard time convincing others that it is worth the [money]” Karlin 2012 “To induce behavior these devices have to be free or very low cost.”
  • 35. Our Study Knowledge Persuasion Decision Confirmation Karlin 2012 Did they adopt? Confirmation factors: 1. Usability 2. Outcome
  • 36. Confirmation Usability — What do you like / dislike about the product? — What was your most surprising experience? Outcomes — Did knowledge, behavior, and/or energy use change? — Do you still use this product? Karlin 2012
  • 37. Confirmation – positive Usability — Ease of use — Effective energy information Outcomes — Correct inaccurate assumptions about energy use — Both general and specific behavior change reported We installed power strips to easily power off all high energy items Karlin, 2012 I had no idea how much energy computers used
  • 38. Confirmation - negative “Rebound Effect” — 15% were surprised that they used less energy than they thought Diminishing utility “…I’ve actually wound up using more energy on some devices when I see how little energy they use (my laptop, for one).” — 48% said they do not still use the product — No longer in possession/borrowed — Do not see a need to continue using “it’s served it’s purpose” “I checked almost every device I have, so continued usage isn't very informative unless I start tracking usage in a spreadsheet - way too much work.” Karlin, 2012
  • 39. Implications 1. Further research into active feedback adopters could yield positive results for segmentation. 2. Research into leveraging social networks to promote the use of feedback devices is promising. 3. There is promise for utility-based and lending/borrowing programs for distribution. 4. Integrating injunctive social norms (e.g. social comparison) could address rebound effect. 5. Further research is needed into actual and perceived barriers of potential users. Karlin 2012
  • 40. Closing Thoughts “Energy efficiency is not just low-hanging fruit; it is fruit that is lying on the ground.” Steven Chu, US Energy Secretary Acknowledgements uci@home research team David Kirkby, Physics Daniel Stokols, Psychology Nora Davis, Social Ecology Kristen Gamble, Psychology Haly Hererra, Engineering Angela Sanguinetti, Planning Contact: bkarlin@uci.edu