SlideShare a Scribd company logo
1 of 39
Translating effective sustainability conversation
into network design
SIKM Leaders Discussion: Spapshot of an NLP journey
Katrina Pugh, Columbia University, U Maine
April 20, 2021
Agenda
Rationale and problem statement
Research questions
Research design
References
Rationale and problem statement
Aquaculture industry tensions are high
Source: โ€œWith aquaculture booming, itโ€™s time to talk about its future in Maine,โ€ Portland Press Herald, April 13, 2021
https://www.pressherald.com/2021/04/13/with-aquaculture-booming-its-time-to-talk-about-its-future-in-maine/
โ€œThere is something wrong when you canโ€™t even
have a conversation in Maine without sending
people into an uproar...
There are a number of [Aquaculture lease] criteria โ€“
navigation, competition and others... โ€œunreasonable
interferenceโ€โ€ฆunde๏ฌned, ambiguousโ€ฆ
...We are now faced with con๏ฌ‚ict up and down the
coast.โ€
Rationale and problem statement:
Aquaculture Social Ecological System...what we think
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
Diverse stakeholders
(Farmers, Fishers,
Boaters, Riparian
Landowners,
Regulators,
Legislators, NGOs)
Interaction:
Meetings, Hearings
Local town halls,
Participatory Action
Research
Efficiency
Innovation
Participation
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria
Action Situation:
Lease scoping mtg.
Lease Hearings
Outcome: Approval
(yes/no) for lease
Rationale and problem statement:
Aquaculture Social Ecological System...de facto!
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
4. Wealth
disparities
5. National
polarization
Diverse stakeholders
Lobbyists
Lawyers
PR agencies
Facilitators
NGO overlaps
Interaction: Meetings,
hearings
Local town halls (some
with bias, certainty,
conflict)
Participatory Action
Research
- Letters to the editors,
Soc media
Yes or no to
Aquaculture lease
approval
- Cost (of lobbying,
investigation)
- Spillover effects
- Time elapse
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria?
Action situation:
Lease scoping mtg.
Lease Hearings
Publishing, Press
Outcome: Approval
(yes/no) for lease
- Community
discord, cost
Rationale and problem statement:
Aquaculture Social Ecological System...reframed
1. Climate change/
warming waters
2. Diminished
traditional fishing,
near monoculture
3. Depts of Marine
Res, Fish & Wildlife
processes
4. Wealth disparities
5. National
conversation
Diverse stakeholders
Lobbyists
Lawyers
PR agencies
Facilitators
NGO overlaps
Interaction: Meetings
Local town halls (some with
bias, certainty)
PAR
- Letters to editors, SM
Productive
Conversation
Yes or no to
Aquaculture lease
approval
+ Individual
conversation skills
+ Network/
community
resilience
Exogenous
variables
Action
Arena
Interaction &
Outcome
Evaluative
Criteria?
Action situation:
Lease scoping mtg.
Lease Hearings
Publishing, Press
Lease Approval (yes/no)
+ Options-Generation,
+ Relationships
+ Bias for Action
Rationale and problem statement:
Focus and research question
โ€œHow does conversation in๏ฌ‚uence
our collective impact on
sustainability?
With this in mind, how can we
(re)design networks for better
conversation?โ€
Research Design
Research Design:
Significant authors
SES and
Sustainability
Science
Ostrom
Agarwal
Clark
Partelow
Cash
Johnson
Silka, Hart,
McGreavy
Dialogue, Facilitation
Schein
Weick
Isaacs
Dixon
Edmondson
Wilkinson
Danescu-Nikulesu-Mizil
See et al
Skifstad & Pugh
Complex
spreading
phenomena,
Org. learning,
knowledge NWs
Pugh & Prusak
Pentland& Malone
Watts
Centola and Macy
RARE.org
Soc Ecol. Systems Cooperation Conversation/AI Network strategy
Behavioral Insight,
Diversity, Reciprocity
Trivers
Nowak
Galinsky
Page
Thaler and Sustein
Hoffman, Rand &
Yoeli
Titus and Stasser
Source: Pugh, 2020, and Skifstad and Pugh, 2014.
Research Design:
What makes good conversation? (4 Discussion Disciplines)
10
Inclusion
Translation
Integrity
Courtesy
Asking clean
questions, making
statements with
data Respecting
participants,
respecting the
forum
Reaching out and
bringing in; not
โ€œexcludingโ€ through
acronyms, terms of art,
in-language
Synthesizing,
sensemaking,
up-levelling into
actions
Derived from Dialogue practices Derived from Facilitation practices
Research Design:
Research process
0. Observe
Sustaina-
bility
conversa-
tions
1. Code
transcripts,
start
interviews
2. Develop
AI/ML
(NLP)
Algorithm
3. Generate
Conver-sati
on
Signatures
5. Design
Capacity
building &
Network,
test with
focus
group
4. Validate
AI/ML
Algorithm,
productize
6.
Launch
Spring-Summer 2021 Fall, 2021-Spring 2022
Fall 2020-Spring 2021
See A1: Research process detail
12
Integrity
Courtesy
Inclusion
Translation
Weโ€™ve been farming under a limited permit
aquaculture [LPA] lease. This has allowed us to
experiment. Next we moved to the public input part.
Thatโ€™s todayโ€™s lease scoping meeting.
We want to minimize the impact as
much as possible.
Iโ€™ll follow up with you. I want your
opinion.
To clarify: aquaculture is a multitude of different
organisms, a multitude of different activities.
Source: Aquaculture Lease scoping meeting for Farmer #4. See appendix A2 for more examples.
Research Design:
Aquaculture Examples of Four Discussion Disciplines
M/F Item Comment Discipline Rationale
Farmer 24 This is the point where we listen and talk and
hear what you have to say.
Inclusion Open / include
n/a 25 10 seconds Inclusion Open / include
Harbor-
master
26 I have not been on one of these [scoping
meetings]. I heard [person of authority] signed
off. I was shocked. Itโ€™s bigger than I thought.
Anti-Courtesy Word "shocked" is trigger word.
Defensive
Harbor-
master
27 I was seeing the same materials as before. Integrity Statement of fact. Assume he saw
previous lease or earlier version.
Harbor-
master
28 That lobster trap needs to go. Thereโ€™s no hauling
in the town of [town name].
Integrity Statement of fact.
Farmer 29 [Relative to the experimental lease] some
changes to the species. No change to the gear.
Translation Wrapping up, recapping.
Harbor-
master
30 Iโ€™m good with everything you said. Courtesy Positivity
Research Design:
Aquaculture lease Scoping meeting excerpt showing identity issues, aquaculture context
complexity
Injects doubt. Could
have derailed the
meeting here
(common pattern)
Sides with
farmer and
refers to reg
policy or lack of
reg policy
(common fisher
pattern)
Farmer is not
defensive
(previously: โ€œwe
want to be a
good neighborโ€)
โ€œPivotal junctureโ€
opened inquiry
(40 more moves)
Research Design:
Six lease scoping meeting transcripts from Oct โ€˜20-March โ€˜21 (approximately 550 moves)
Integrity
dominates, with
Courtesy and
Integrity-Q next
Female % of
utterances
approx, 20%*
Contribute fewer
โ€œantiโ€ comments
*Except with female farmer leading scoping meeting. .
Research Design:
Percent of moves, by discussion discipline, by aquaculture lease scoping meeting
Relationship-Building, Intent to act
Relationship-Building
Options Generation, Relationship Building
Options Generation, Intent to Act
Intent to act
Relationship-Building, Intent to act
Research Design:
Six lease scoping meeting transcripts from Oct โ€˜20-March โ€˜21 (approximately 550 moves)
Options
Generation
Relationship-
building Intent to Act
Integrity (+) (+) (+)
Integrity-Q +
Courtesy +
Inclusion +
Translation (Weak)
Anti (courtesy,
integrity, inclusion)
(-)
Outcomes observed
Above-avg.
discussion
discipline
Research Design:
AI/ML Natural Language Processing: Using Cornellโ€™s Convokit
Parsing
language
snippets
(pre-processi
ng and
feature
abstraction)
Ingesting
conversa-ti
on
transcripts
Cluster
analysis/m
atching to
four
discussion
disciplines
Testing on
โ€œvirginโ€
transcripts,
generate
conversation
assessment
utility
Research Design:
AI/ML Natural Language Processing: Using Cornellโ€™s Convokit
2. Separate
common
combination of
words that
have direction
(e.g.,
before-after,
parent-child)
3. Collect
those
directed word
combinations
that are
similar
4. Cluster
those motifs
together as
rhetorical
intentions
(questions,
answers,
provocations)
5. Identify
PromptTypes
โ€™ Clusters
that most
correspond
to the four
discussion
disciplines.
6. Validate on
virgin
transcripts and
prepare for
statistical
analysis
1. Ingest
text from
transcripts
(raw
training
data)
Clean text
up
โ€œCorpusโ€
compiled.
โ€œStop
wordsโ€
removed.
โ€œTextClea
nerโ€
applied
โ€œTextToArc
produces
ArcTypes,โ€
which are like
vectors -
directional
relationships
between words
โ€œPhrasingMotifsโ€
are frequently-
occurring sets of
dependency-
parsed arcs
Use analyses,
1. graphs
2. rankings Propttypes
closest to the middle
(centroid) for that
cluster. Doing
stepwise, e.g., first
assign Integrity.
โ€œPromptTypesโ€ are
vector
representation
based on how they
are responded to --
as well as types of
rhetorical intentions
TF*IDF and SVD
Parsing language snippets (pre-processing and
feature abstraction)
Ingesting text Analysis/Matching to
discussion disciplines
Explanation
ConvoKit
Transformation
Research Design:
TF*IDF Vectorizer Matrix: From Phrasing motifs to Prompt Types
Phrasing
Motif 1
Phrasing
Motif 2
Phrasing
Motif 3
... Phrasing
Motif Z
Utteranc
e 1
1 0 1 ... 3
Utteranc
e 2
0 2 1 ... 0
Utteranc
e N
1 5 0 ... 7
Totals for each Phrasing Motif, for each
utterance, is then fed into SVD (Single Value
Decomposition) Matrix
https://scikit-learn.org/stable/modules/gener
ated/sklearn.decomposition.TruncatedSVD.h
tml
Overview: https://www.onely.com/blog/what-is-tf-idf/
SciKit-Learn Approach:
https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text
.TfidfVectorizer.html
For a Phasing Motif t in Utterance d, the weight Wt,d of
term t in document d is given by:
Wt,d = TFt,d log (N/DFt)
Where:
โ— TFt,d is the number of occurrences of t in Utterance
d.
โ— DFt is the number of Utterances containing the term
t.
โ— N is the total number of utterances in the corpus.
For SEO one would want a LOW TF*IDF. (Phrasing Motif
is rare). But for us, we would want a HIGH TF*IDF
(Phrasing Motif is not rare).
This is the frequency that this phrasing
motif occurs in the utterance (row).
The column Total X is the total
number of the phrasing Motif in the
CorpuS, with N utterances.
Total 1 Total 2 Total 3 Total ... Total Z
โ€œTextToArc produces
ArcTypes,โ€ which are
like vectors -
directional
relationships between
words in a sentence
Research Design:
Using Convokit
2. Separate common
combination of words
that have direction
(e.g., before-after,
parent-child)
3. Collect those
directed word
combinations that
are similar
3a: Politeness
strategies
4. Cluster those motifs
together as rhetorical
intentions (questions,
answers, provocations)
5. Identify
PromptTypesโ€™
Clusters that most
correspond to the
four discussion
disciplines.
6. Validate on virgin
transcripts and prepare
for statistical analysis
1. Ingest text from
transcripts (raw
training data)
Clean text up.
โ€œCorpusโ€
compiled. โ€œStop
wordsโ€
removed.
โ€œTextCleanerโ€
applied
โ€œPhrasingMotifsโ€ are
frequently- occurring
sets of dependency-
parsed arcs
Use analyses,
1. graphs
2. rankings of prompttypes
closest to the middle
(centroid) for that cluster. May
do stepwise, to first assign
Integrity.
โ€œPromptTypesโ€ are vector
representation based on how
they are responded to -- as well
as types of rhetorical intentions
(clusters 0-7)
Parsing language snippets (pre-processing and feature abstraction)
Ingesting text Analysis/Matching to discussion disciplines
Explanation
ConvoKit
Transformation
'There is a guy
who whips
through there
in a Boston
whaler. Iโ€™m
pretty sure he
cut up my line
once.'
['a_* boston_* guy_* guy_a guy_whips in_*
in_whaler is_* is_guy is_there there>* there_*
through_* through_there whaler_* whaler_a
whaler_boston whips_* whips_in whips_through
whips_who who_*', "'m_* 'm_i 'm_sure cut_*
cut_he cut_line cut_once cut_up he_* i>* i_* line_*
line_my my_* once_* pretty_* sure_* sure_cut
sure_pretty up_*"]
['',
"'ll_* have_*__have_i__i>*__i_*
i>*__i_*",
'my_* the_*',
"'ll_* in_* the_*",
'a_* have_*__have_i__i>*__i_*
i>*__i_*']
[0.29997174
0.95394809]
(PromptTypes
Coordinates)
Example
Prompt Designation Response Designation
1
Motifs as input
field, utterances
may be
represented as
both prompt and
response. Pretty
noisy, some
trends: courtesy
mapping close
to prompt
centroid 4.
Research Design:
Influences on conversation outcomes (bold are observable in our data
as explanatory variables)
1. Conversation moves (discussion disciplines and
anti-disciplines)
2. Conversation movesโ€™ sequence (e.g., time and type of
climax)
3. Gender (pertains to social sensitivity, and could be
captured by the โ€œCourtesyโ€ moves. Could also be related
to bias) (Woolley et al, 2010)
4. Region/Geography of lease (relates to wealth,
development, gentrification, environmental quality
5. Type of lease (e.g., duration up to 20 years, species,
equipment, relates to property rights)
6. Type of aquaculture tech (e.g., oyster, mussel rings)
7. Relationship history/costly signals (Grattan et al, 2007 on
โ€œheritage relationships. May be captured by the
Region/Geography variable.)
8. Physical movement (Body language, pitch, cadence) (Pentland,
et al 2007)
9. History of the region (number of recent lease applications or
wins) (Ostrom, Partelow)
10. History of the conflict (nature of previous interactions across
the community, especially public or litigious actions) (ditto)
11. Regulation (governance systems) (ditto)
Likely to be available in the
conversations and publicly
available sources
More difficult to acquire with
current resources, and more
difficult to translate into
resources for sustainability
networks
Research Design:
Statistical analysis: What impact do the conversation attributes have
on outcomes, and is it statistically significant?
Explanatory variables Dependent variable: Outcomes
โ— X1 Signature (categorical variable determined by clustering: e.g.,
โ—‹ Sig 1 could be โ€œabove average inclusion, above average
integrity-Q,โ€
โ—‹ Sig 2 could be โ€œbelow average inclusion, below average
integrity Q, above average translationโ€)
โ— X2 Sequence (categorical variable: climax type, such as early,
followed by loading) [Could also be part of X1]
โ— X3 Gender proportion
โ— X4 Region (proxy for costly signals, envtal qual, gentrification)
โ— X5 Type of Lease
1. Options generation
(innovation)
2. Intent to act (closure)
3. Relationship building
(Can be either positive or
negative)
Research Design:
Intervention: Accelerate the learning curve for productive conversation
1. Capacity-Building
โ— Training in Four Discussion
Disciplines (NLP research for
targeted impacts)
โ— Spreading boundary objects, like
pocket cards
โ— Collaborating with existing teams
(e.g., Maine Sea Grant,
Aquaculture in Shared Waters
training, DMR training)
2. Network Weaving
โ— Designing networks as โ€œcradle for
conversation.โ€
โ— Incorporate behavioral models, social
norming
โ— Leveraging existing networks (e.g.,
FocusMaine, Maine Aquaculture
Association)
โ— Propose random controlled trials
Research Design:
Knowledge Network Effectiveness Framework (read right to left)
25
What are the impacts?
1. Learning / innovation
(tangible products)
2. Horizontal
Coordination (scale,
buying power)
3. Member Support
(trusted advice)
4. Translation/ Local
Adaptation
(sense-making)
What behaviors do we see?
โ€ขPeople identify with the
network out loud
โ€ขPeople share contacts,
knowledge even before
being asked
โ€ขPeople speak up, even
across hierarchy or political
divides
What dynamics play out?
โ€ข โ€œif I contribute routinely, I
will, in turn, get value from
the networkโ€
โ€ข โ€œIf I make mistakes, I will
learn in a community of
learners.โ€
โ€ข โ€œIf members identify with
the network, they
reciprocate.โ€
โ€ข โ€œIf leaders role-model
vulnerability, members will
take appropriate risks.โ€
What levers do we pull?
8 Design Dimensions:
Strategic
1.Leadersโ€™ shared theory of change
2.Objectives/Outcomes/ Purpose
3. Expert-Learner balance
(psychological safety)
4. Inclusion/Participation
Structural
5. Operating model
6. Convening structures & infrastructures
7. Facilitation and social norm
development
Tactical
8. Measurement, feedback and incentives
Increasing leverage
KNEF on a page 210202
โ€œProducts,
negotia-tio
nsโ€
โ€œRelation-
ships,
trustโ€
Source: Pugh & Prusak (2013) โ€œDesigning
Effective Knowledge Networks,โ€ MIT Sloan
Management REview
Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
+
-
-
-
+
-
+
B
B
Current: โ€œConflict is masked,
conversation skills atrophyโ€
investment in
Conversation
Capacity
Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
Conflict in
sustainability
interactions
Desirability of
engagement
Credibility of
conversation
model
+
-
-
-
+
-
+
-
-
+
+
R
B
B
Current: โ€œConflict is masked,
conversation skills atrophyโ€
Goal: โ€œNetworks and practice support
productive conversationโ€
investment in
Conversation
Capacity
Research Design:
Bringing it all together: Conceptual Model
Conflict in
sustainability
interactions
Outside
facilitation
Investment in
Conversation
Capacity
building
Depen-
dency on
outside
facilitation
Conflict in
sustainability
interactions
Desirability of
engagement
Credibility of
conversation
model
Network
convening
Empirical
evidence of
conversation
driving impact
Data science
and network
design
programs
+
-
-
-
+
-
+
-
-
+
+
+
+
+
+
R
B
B
Current: โ€œConflict is masked,
conversation skills atrophyโ€
Goal: โ€œNetworks and practice support
productive conversationโ€
Out beyond ideas of wrongdoing and rightdoing,
there is a ๏ฌeld. Iโ€™ll meet you there.
When the soul lies down in that grass,
the world is too full to talk about.
Ideas, language, even the phrase โ€˜each otherโ€™
doesnโ€™t make any sense.
Jalal ad-Din Mohammad Rumi
13th Century Persian scholar, theologian, poet
Words of hope...
Recognitions
Thank you to my Doctoral Committee, research team, and mentors!
โ— Teresa Johnson, PhD., UMaine, Doctoral Advisor
โ— Nancy Dixon, PhD., Columbia University, committee member
โ— Mohamad Musavi, PhD., UMaine, committee member
โ— Linda Silka, PhD. UMaine, committee member
โ— Erez Yoeli, PhD., MIT, committee member
โ— Emily Currie โ€˜22, research team
โ— Peter van Walsum, PhD., mentor
โ— David Hart, PhD., mentor
โ— Keith Evans, PhD., mentor
โ— Larry Prusak, Columbia University, mentor
โ— Christine Beitl and the whole ANT 560 Research Methods Class
Appendix
0. Sustainability
conversation
1.
Manual
coding
2. AI/ML
Algorithm
development
3. Signature
generation
5. Designs for
Capacity building &
Network
Aquaculture
stakeholder in
conversation
Research
team
performing
linguistic
analysis
Research
team
performing
statistical
analysis
Supplemental
data (e.g.,
BERT libraries)
Programmer,
using NLP
libraries
0a. Lease
scoping or
hearing
0b. Record.
0c. Transcribe
Parse into
utterances
1a. Classify for
4DDs, gender,
sequence,
outcome.
1b. Perform basic
statistics, pivot
tables to find
patterns
1c. Generate
infographics.
2a. Parse new conversation and
supplement. Gen. training data (HITL)
2b. Gen. and test algorithms for 4DDs,
gender, impacts
2c. Acquire more
conversation data as 4DD
examples
3a. Do statistical analysis
(e.g., regress composition
of moves, sequence of
moves, gender, etc. on
outcome.) draft
signatures
4. AI/ML Algorithm
Validation,
productization
4d. Revise algorithm to detect
4DDs, gender, sequence, and,
signature on new data
4e. Create new libraries wishlist
4b. Record.
4c. Transcribe
Parse into
utterances
5a. Draft,
improvements
to networks to
include skillful
conversation
5b. Focus
groups
1c. Interviews
to determine
outcomes
6. Launch
6a.
Develop
training,
toolkits
6c S/H
Training
4a. Lease
scoping or
hearing
Research
Process
ECE 598 Research Process and Roles
Spring-Summer 2021 Fall, 2021 -Spring 2022
Fall 2020-Spring 2021
Partial Bibliography (1 of 7)
โ— Anderies, & Janssen. (2016). Sustaining the Commons (2nd ed., Vol. 2). Creative Commons.
โ— Buchanan, M., & Pentland, A. (2007). The Science of Subtle Signals. Strategy & Business.
โ— Cash, D. W., Borck, J. C., & Patt, A. G. (2006). Countering the loading-dock approach to linking
science and decision making: Comparative analysis of El Niรฑo/Southern Oscillation (ENSO)
forecasting systems. Science Technology and Human Values, 31(4), 465โ€“494.
https://doi.org/10.1177/0162243906287547
โ— Caviglia, F., Dalsgaard, C., Delfino, M., & Pedersen, A. Y. (2017). Dialogic literacy: Contexts,
competences and dispositions. L1 Educational Studies in Language and Literature, 17(2017), 1โ€“38.
https://doi.org/10.17239/L1ESLL-2017.17.01.05
โ— Chang, J. P., Chiam, C., Fu, L., Wang, A. Z., Zhang, J., & Danescu-Niculescu-Mizil, C. (2020).
ConvoKit: A Toolkit for the Analysis of Conversations. ArXiv. http://arxiv.org/abs/2005.04246
โ— Cinner, J. (2018). How behavioral science can help conservation. In Science (Vol. 362, Issue 6417,
pp. 889โ€“890). American Association for the Advancement of Science.
https://doi.org/10.1126/science.aau6028
โ— Clark, W. C., & Harley, A. G. (2020). Sustainability Science: Toward a Synthesis. Annual Review of
Environment and Resources, 45(1). https://doi.org/10.1146/annurev-environ-012420-043621
โ— Clarke, H., & Barton, W. (2019). Putting Dialogue to Work in the Virginia Department of Corrections.
In The World Needs Dialogue! (pp. 1โ€“11).
Partial Bibliography (2 of 7)
โ— Deloitte. (2020). Open Source Compass: A new way to glean insights on the trajectory of open source
development for emerging technologies. Open Source Compass. https://opensourcecompass.io/
โ— Dietz, T., Dolลกak, N., Ostrom, E., & Stern, P. C. (2002). The Drama of the Commons. In National
Academies Press.
โ— Dixon, N. (2018). Speaking Up 101. Ivey Business Journal, September/October 2018.
https://iveybusinessjournal.com/speaking-up-101/
โ— Dixon, N. M. (2021). Conversation Matters Blog: Posts on Conversation. Conversaion Matters.
https://www.nancydixonblog.com/conversation/
โ— Druschke, C. G., & McGreavy, B. (2016). Why rhetoric matters for ecology. Frontiers in Ecology and
the Environment, 14(1), 46โ€“52. https://doi.org/10.1002/16-0113.1
โ— Edmondson, A. C., & Lei, Z. (2014). Psychological Safety: The History, Renaissance, and Future of
an Interpersonal Construct. Annual Review of Organizational Psychology and Organizational
Behavior, 1, 23โ€“43. https://doi.org/10.1146/annurev-orgpsych-031413-091305
โ— Galinsky, A. D., Todd, A. R., Homan, A. C., Phillips, K. W., Apfelbaum, E. P., Sasaki, S. J., Richeson,
J. A., Olayon, J. B., & Maddux, W. W. (2015). Maximizing the Gains and Minimizing the Pains of
Diversity: A Policy Perspective. Perspectives on Psychological Science.
https://doi.org/10.1177/1745691615598513
Partial Bibliography (3 of 7)
โ— Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design
Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2).
http://iris.cs.aau.dk/tl_files/volumes/Volume 29/
โ— Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019.
โ— Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning
Research With Societal Needs. Issues in Science and Technology, 23(3).
https://issues.org/aligning-research-with-societal-needs/
โ— Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate
coordination. 1โ€“15.
โ— Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what people
think and not just what they do. Proceedings of the National Academy of Sciences of the United
States of America, 112(6), 1727โ€“1732. https://doi.org/10.1073/pnas.1417904112
โ— Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press.
https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999
โ— Isaacs, W. (2016). Trim-Tab Dialoguesโ€‰: Transformative Vision and Action in South Asia. In The World
Needs Dialogue! (Issue February, pp. 1โ€“19).
Partial Bibliography (4 of 7)
โ— Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design
Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2).
http://iris.cs.aau.dk/tl_files/volumes/Volume 29/
โ— Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019.
โ— Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning
Research With Societal Needs. Issues in Science and Technology, 23(3).
https://issues.org/aligning-research-with-societal-needs/
โ— Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate
coordination. 1โ€“15.
โ— Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what
people think and not just what they do. Proceedings of the National Academy of Sciences of
the United States of America, 112(6), 1727โ€“1732. https://doi.org/10.1073/pnas.1417904112
โ— Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press.
https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999
โ— Isaacs, W. (2016). Trim-Tab Dialoguesโ€‰: Transformative Vision and Action in South Asia. In The
World Needs Dialogue! (Issue February, pp. 1โ€“19).
Partial Bibliography (5 of 7)
โ— Johnson, T., Beard, K., Brady, D., Byron, C., Cleaver, C., Duffy, K., Keeney, N., Kimble, M., Miller, M., Moeykens, S.,
Teisl, M., van Walsum, G., & Yuan, J. (2019). A Social-Ecological System Framework for Marine Aquaculture
Research. Sustainability, 11(9), 2522. https://doi.org/10.3390/su11092522
โ— Johnson, T. R. (2020). Reflecting on Maine โ€™ s Changing Productive Coastal Region. Maine Policy Review, 29(2),
91โ€“97.
โ— Johnson, T. R., & Hanes, S. P. (2017). Marine Aquaculture in Restructuring Regions: Understanding the Key Coastal
Sustainability Transition. Quarterly Magazine of the Regional Studies Association, 308(Autumn), 13โ€“15.
โ— McCardle-Keurentjes, M., & Rouwette, E. A. J. A. (2018). Asking Questions: A Sine Qua Non of Facilitation in Decision
Support? Group Decision and Negotiation, 27(5), 757โ€“788. https://doi.org/10.1007/s10726-018-9573-y
โ— McGinnis, M. D., & Ostrom, E. (2014). Social-ecological system framework: initial changes and continuing challenges.
Ecology and Society, 19(2), art30. https://doi.org/10.5751/ES-06387-190230
โ— Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. In Science (Vol. 325,
Issue 5939, pp. 419โ€“422). https://doi.org/10.1126/science.1172133
โ— Ostrom, E., Bravo, G., Janssen, M., Levin, S., Myint, T., Pahl-Wostl, C., & Walker, J. (2008). Workshop in Political
Theory and Policy Analysis BUILDING TRUST TO SOLVE COMMONS DILEMMAS: TAKING SMALL STEPS TO
TEST AN EVOLVING THEORY OF COLLECTIVE ACTION. www.indiana.edu/~workshopW08-239/22/08
Partial Bibliography (6 of 7)
โ— Page, S. (2007). The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools and Societies -
New Edition. Princeton Press.
https://www.amazon.com/Difference-Diversity-Creates-Schools-Societies/dp/0691138540
โ— Page, S. E. (2017). The Diversity Bonus: How Great Teams Pay Off in the Knowledge Economy. Princeton Press.
https://www.amazon.com/Diversity-Bonus-Knowledge-Compelling-Interests-ebook/dp/B07JDTSZVR/?pldnSite=1
โ— Partelow, S. (2016). Coevolving Ostromโ€™s socialโ€“ecological systems (SES) framework and sustainability science: four
key co-benefits. Sustainability Science, 11(3), 399โ€“410. https://doi.org/10.1007/s11625-015-0351-3
โ— Plamondon, K. M., Bottorff, J. L., & Cole, D. C. (2015). Analyzing Data Generated Through Deliberative Dialogue.
Qualitative Health Research, 25(11), 1529โ€“1539. https://doi.org/10.1177/1049732315581603
โ— Pugh, K. (2016). Four Discussion Disciplines to Drive Effective Online Collaboration. Columbia SPS.
https://sps.columbia.edu/news/four-discussion-disciplines-drive-effective-online-collaboration
โ— Pugh, K. (2019). Conversational AI and AI for Conversation: Our Role as KMโ€™ers?
โ— Pugh, K., & Prusak, L. (2013). Designing Effective Knowledge Networks. MIT Sloan Management Review.
โ— Rand, D. G., Yoeli, E., & Hoffman, M. (2014). Harnessing Reciprocity to Promote Cooperation and the Provisioning of
Public Goods. Policy Insights from the Behavioral and Brain Sciences, 1(1), 263โ€“269.
https://doi.org/10.1177/2372732214548426
โ— Schein, E. H. (1978). The Role of the Consultant: Content Expert or Process Facilitator? The Personnel and Guidance
Journal, 56(6). https://doi.org/10.1002/j.2164-4918.1978.tb04644.x
Partial Bibliography (7 of 7)
โ— Schein, E. H. (1993). On dialogue, culture, and organizational learning. Organizational Dynamics, 22(2), 40โ€“51.
https://doi.org/10.1016/0090-2616(93)90052-3
โ— See, A., Roller, S., Kiela, D., & Weston, J. (2019). What makes a good conversation? How controllable attributes affect human judgments. Facebook
Research and Stanford University. https://parl.ai/projects/
โ— Silka, L. (2013). โ€œSilosโ€ in the Democratization of Science. International Journal of Deliberative Mechanisms in Science, 2(1), 1.
https://doi.org/10.4471/demesci.2013.06
โ— Silka, L., Glover, R., Hutchins, K., Lindenfeld, L., Blackstone, A., Elliott, C., Ladenheim, M., & Sullivan, C. (2013). Moving Beyond the Single
Disciplineโ€‰: Building a Scholarship of Engagement that Permeates Higher Education. Tamara - Journal for Critical Organization Inquiry, 11(4), 41โ€“52.
โ— Silka, L., McGreavy, B., & Hart, D. (2019). Breaking boundaries Chapter: Health, the Environment, and Sustainability: Emergent Communication
Lessons Across Highly Diverse Public Participation Activities. In State University of New York Press, Albany.
โ— Skifstad, S., & Pugh, K. (2014). Smarter Innovation: Beyond Netiquette (Chapter 8). In Smarter Innovation. Ark Group.
โ— Stasser, G., & Titus, W. (2003). Hidden Profiles: A Brief History. Psychological Inquiry, 14(3โ€“4), 304โ€“313.
https://doi.org/10.1080/1047840x.2003.9682897
โ— Wilkinson, M. (2012). The Secrets of Facilitation: The SMART Guide to Getting Results with Groups. Jossey-Bass/Wiley.
https://www.amazon.com/Secrets-Facilitation-Getting-Results-Groups-ebook/dp/B00DBOZPI4
โ— Willison, J. B., Rossman, S., Bieler, S., & Innes, C. (2017). Creating and Measuring a Healing Environment in the Virginia Department of
Corrections. In The World Needs Dialogue! https://www.urban.org/sites/default/files/publication/91411/nm_wave_2_brief_createmeasure_hei.pdf
โ— Woolley, A., Malone, T. W., & Chabris, C. F. (2015). GRAY MATTER. New York Times.
https://www.nytimes.com/2015/01/18/opinion/sunday/why-some-teams-are-smarter-than-others.html
โ— Woolley, A. W., Chabris, C. F., Pentland, A., Hashmi, N., & Malone, T. (2010). Evidence for a Collective Intelligence Factor in the Performance of
Human Groups. Science, 330(6004), 683โ€“686. https://doi.org/10.1126/science.1190483

More Related Content

Similar to Sikm pugh sustainability conversations for impact snapshot 210420

Discourse Analysis for Social Research
Discourse Analysis for Social ResearchDiscourse Analysis for Social Research
Discourse Analysis for Social ResearchDominik Lukes
ย 
Project-Based Learning - USD 340
Project-Based Learning - USD 340Project-Based Learning - USD 340
Project-Based Learning - USD 340Doug Adams
ย 
Webquest Elk Populations
Webquest  Elk PopulationsWebquest  Elk Populations
Webquest Elk Populationssciencestar
ย 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of UnderstandingPeter Morville
ย 
Patterns for collaborative creativity
Patterns for collaborative creativityPatterns for collaborative creativity
Patterns for collaborative creativityJohn Thomas
ย 
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...St. Petersburg College
ย 
S4. qualitative 2019
S4. qualitative 2019S4. qualitative 2019
S4. qualitative 2019collierdr709
ย 
Lecture Polimi April2021
Lecture Polimi April2021Lecture Polimi April2021
Lecture Polimi April2021Anna De Liddo
ย 
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...Allison Jai O'Dell
ย 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of UnderstandingPeter Morville
ย 
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...Seth Grimes
ย 
The Ins and Outs of Preposition Semantics:โ€จ Challenges in Comprehensive Corpu...
The Ins and Outs of Preposition Semantics:โ€จ Challenges in Comprehensive Corpu...The Ins and Outs of Preposition Semantics:โ€จ Challenges in Comprehensive Corpu...
The Ins and Outs of Preposition Semantics:โ€จ Challenges in Comprehensive Corpu...Seth Grimes
ย 
S4. qualitative 2019
S4. qualitative 2019S4. qualitative 2019
S4. qualitative 2019collierdr709
ย 
Text Analytics for Semantic Computing
Text Analytics for Semantic ComputingText Analytics for Semantic Computing
Text Analytics for Semantic ComputingMeena Nagarajan
ย 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of UnderstandingPeter Morville
ย 
Writing Essay Papers
Writing Essay PapersWriting Essay Papers
Writing Essay PapersAshley Bonham
ย 
STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University Darci the STEM Mom
ย 

Similar to Sikm pugh sustainability conversations for impact snapshot 210420 (20)

Discourse Analysis for Social Research
Discourse Analysis for Social ResearchDiscourse Analysis for Social Research
Discourse Analysis for Social Research
ย 
Project-Based Learning - USD 340
Project-Based Learning - USD 340Project-Based Learning - USD 340
Project-Based Learning - USD 340
ย 
Webquest Elk Populations
Webquest  Elk PopulationsWebquest  Elk Populations
Webquest Elk Populations
ย 
20100427 Earthster Core Ontology
20100427 Earthster Core Ontology20100427 Earthster Core Ontology
20100427 Earthster Core Ontology
ย 
Carolyn Rosรฉ - WESST - From Data to Design of Dynamic Support for Collaborati...
Carolyn Rosรฉ - WESST - From Data to Design of Dynamic Support for Collaborati...Carolyn Rosรฉ - WESST - From Data to Design of Dynamic Support for Collaborati...
Carolyn Rosรฉ - WESST - From Data to Design of Dynamic Support for Collaborati...
ย 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of Understanding
ย 
Advances In Wsd Acl 2005
Advances In Wsd Acl 2005Advances In Wsd Acl 2005
Advances In Wsd Acl 2005
ย 
Patterns for collaborative creativity
Patterns for collaborative creativityPatterns for collaborative creativity
Patterns for collaborative creativity
ย 
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
Information Fluency Strategies and Practices to Help Enhance Critical Thinkin...
ย 
S4. qualitative 2019
S4. qualitative 2019S4. qualitative 2019
S4. qualitative 2019
ย 
Lecture Polimi April2021
Lecture Polimi April2021Lecture Polimi April2021
Lecture Polimi April2021
ย 
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
Special Collections, Special Thesauri: Managing and Publishing Local Vocabula...
ย 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of Understanding
ย 
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
Preposition Semantics: Challenges in Comprehensive Corpus Annotation and Auto...
ย 
The Ins and Outs of Preposition Semantics:โ€จ Challenges in Comprehensive Corpu...
The Ins and Outs of Preposition Semantics:โ€จ Challenges in Comprehensive Corpu...The Ins and Outs of Preposition Semantics:โ€จ Challenges in Comprehensive Corpu...
The Ins and Outs of Preposition Semantics:โ€จ Challenges in Comprehensive Corpu...
ย 
S4. qualitative 2019
S4. qualitative 2019S4. qualitative 2019
S4. qualitative 2019
ย 
Text Analytics for Semantic Computing
Text Analytics for Semantic ComputingText Analytics for Semantic Computing
Text Analytics for Semantic Computing
ย 
The Architecture of Understanding
The Architecture of UnderstandingThe Architecture of Understanding
The Architecture of Understanding
ย 
Writing Essay Papers
Writing Essay PapersWriting Essay Papers
Writing Essay Papers
ย 
STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University STEM Mom Speaks to Teachers at Princeton University
STEM Mom Speaks to Teachers at Princeton University
ย 

More from Katrina (Kate) Pugh

Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
Building muscles to improve innovation networks pugh skifstad may 2020 final (1)Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
Building muscles to improve innovation networks pugh skifstad may 2020 final (1)Katrina (Kate) Pugh
ย 
Midwest km pugh conversational ai and ai for conversation 190809
Midwest km pugh conversational ai and ai for conversation 190809Midwest km pugh conversational ai and ai for conversation 190809
Midwest km pugh conversational ai and ai for conversation 190809Katrina (Kate) Pugh
ย 
Pugh sikm leaders conversational ai 190618
Pugh sikm leaders conversational ai 190618Pugh sikm leaders conversational ai 190618
Pugh sikm leaders conversational ai 190618Katrina (Kate) Pugh
ย 
Pugh collaboration and four discussion disciplines for sikm 171017
Pugh collaboration and four discussion disciplines for sikm 171017Pugh collaboration and four discussion disciplines for sikm 171017
Pugh collaboration and four discussion disciplines for sikm 171017Katrina (Kate) Pugh
ย 
Pugh how great KMers are innovation conveners 150217
Pugh how great KMers are innovation conveners 150217Pugh how great KMers are innovation conveners 150217
Pugh how great KMers are innovation conveners 150217Katrina (Kate) Pugh
ย 
Tacit knowledge elicitation_and_transfer_140315
Tacit knowledge elicitation_and_transfer_140315Tacit knowledge elicitation_and_transfer_140315
Tacit knowledge elicitation_and_transfer_140315Katrina (Kate) Pugh
ย 
Channeling insight into action for km world 111103 v2
Channeling insight into action for km world 111103 v2Channeling insight into action for km world 111103 v2
Channeling insight into action for km world 111103 v2Katrina (Kate) Pugh
ย 
Being the convener for sikm 110816.v6
Being the convener for sikm 110816.v6Being the convener for sikm 110816.v6
Being the convener for sikm 110816.v6Katrina (Kate) Pugh
ย 
Knowledge jam for chicago km 110208
Knowledge jam for chicago km 110208Knowledge jam for chicago km 110208
Knowledge jam for chicago km 110208Katrina (Kate) Pugh
ย 
IT Offshoring with Intention (Pugh, Wadhera) 100406
IT Offshoring with Intention (Pugh, Wadhera) 100406IT Offshoring with Intention (Pugh, Wadhera) 100406
IT Offshoring with Intention (Pugh, Wadhera) 100406Katrina (Kate) Pugh
ย 
Sikm knowledge jam (katrina pugh) 100615
Sikm knowledge jam (katrina pugh) 100615Sikm knowledge jam (katrina pugh) 100615
Sikm knowledge jam (katrina pugh) 100615Katrina (Kate) Pugh
ย 

More from Katrina (Kate) Pugh (11)

Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
Building muscles to improve innovation networks pugh skifstad may 2020 final (1)Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
Building muscles to improve innovation networks pugh skifstad may 2020 final (1)
ย 
Midwest km pugh conversational ai and ai for conversation 190809
Midwest km pugh conversational ai and ai for conversation 190809Midwest km pugh conversational ai and ai for conversation 190809
Midwest km pugh conversational ai and ai for conversation 190809
ย 
Pugh sikm leaders conversational ai 190618
Pugh sikm leaders conversational ai 190618Pugh sikm leaders conversational ai 190618
Pugh sikm leaders conversational ai 190618
ย 
Pugh collaboration and four discussion disciplines for sikm 171017
Pugh collaboration and four discussion disciplines for sikm 171017Pugh collaboration and four discussion disciplines for sikm 171017
Pugh collaboration and four discussion disciplines for sikm 171017
ย 
Pugh how great KMers are innovation conveners 150217
Pugh how great KMers are innovation conveners 150217Pugh how great KMers are innovation conveners 150217
Pugh how great KMers are innovation conveners 150217
ย 
Tacit knowledge elicitation_and_transfer_140315
Tacit knowledge elicitation_and_transfer_140315Tacit knowledge elicitation_and_transfer_140315
Tacit knowledge elicitation_and_transfer_140315
ย 
Channeling insight into action for km world 111103 v2
Channeling insight into action for km world 111103 v2Channeling insight into action for km world 111103 v2
Channeling insight into action for km world 111103 v2
ย 
Being the convener for sikm 110816.v6
Being the convener for sikm 110816.v6Being the convener for sikm 110816.v6
Being the convener for sikm 110816.v6
ย 
Knowledge jam for chicago km 110208
Knowledge jam for chicago km 110208Knowledge jam for chicago km 110208
Knowledge jam for chicago km 110208
ย 
IT Offshoring with Intention (Pugh, Wadhera) 100406
IT Offshoring with Intention (Pugh, Wadhera) 100406IT Offshoring with Intention (Pugh, Wadhera) 100406
IT Offshoring with Intention (Pugh, Wadhera) 100406
ย 
Sikm knowledge jam (katrina pugh) 100615
Sikm knowledge jam (katrina pugh) 100615Sikm knowledge jam (katrina pugh) 100615
Sikm knowledge jam (katrina pugh) 100615
ย 

Recently uploaded

Call Girls Talegaon Dabhade Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Talegaon Dabhade Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Talegaon Dabhade Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Talegaon Dabhade Call Me 7737669865 Budget Friendly No Advance Boo...roncy bisnoi
ย 
Cheap Call Girls in Dubai %(+971524965298 )# Dubai Call Girl Service By Rus...
Cheap Call Girls  in Dubai %(+971524965298 )#  Dubai Call Girl Service By Rus...Cheap Call Girls  in Dubai %(+971524965298 )#  Dubai Call Girl Service By Rus...
Cheap Call Girls in Dubai %(+971524965298 )# Dubai Call Girl Service By Rus...Escorts Call Girls
ย 
Hot Call Girls ๐Ÿซค Malviya Nagar โžก๏ธ 9711199171 โžก๏ธ Delhi ๐Ÿซฆ Whatsapp Number
Hot Call Girls ๐Ÿซค Malviya Nagar โžก๏ธ 9711199171 โžก๏ธ Delhi ๐Ÿซฆ Whatsapp NumberHot Call Girls ๐Ÿซค Malviya Nagar โžก๏ธ 9711199171 โžก๏ธ Delhi ๐Ÿซฆ Whatsapp Number
Hot Call Girls ๐Ÿซค Malviya Nagar โžก๏ธ 9711199171 โžก๏ธ Delhi ๐Ÿซฆ Whatsapp Numberkumarajju5765
ย 
Call Girls in Sakinaka Agency, { 9892124323 } Mumbai Vashi Call Girls Serivce...
Call Girls in Sakinaka Agency, { 9892124323 } Mumbai Vashi Call Girls Serivce...Call Girls in Sakinaka Agency, { 9892124323 } Mumbai Vashi Call Girls Serivce...
Call Girls in Sakinaka Agency, { 9892124323 } Mumbai Vashi Call Girls Serivce...Pooja Nehwal
ย 
Book Sex Workers Available Pune Call Girls Kondhwa 6297143586 Call Hot India...
Book Sex Workers Available Pune Call Girls Kondhwa  6297143586 Call Hot India...Book Sex Workers Available Pune Call Girls Kondhwa  6297143586 Call Hot India...
Book Sex Workers Available Pune Call Girls Kondhwa 6297143586 Call Hot India...Call Girls in Nagpur High Profile
ย 
Call Now โ˜Ž Russian Call Girls Connaught Place @ 9899900591 # Russian Escorts ...
Call Now โ˜Ž Russian Call Girls Connaught Place @ 9899900591 # Russian Escorts ...Call Now โ˜Ž Russian Call Girls Connaught Place @ 9899900591 # Russian Escorts ...
Call Now โ˜Ž Russian Call Girls Connaught Place @ 9899900591 # Russian Escorts ...kauryashika82
ย 
Call Girls Jejuri Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Jejuri Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Jejuri Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Jejuri Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi
ย 
Call Now โ˜Ž๏ธ๐Ÿ” 9332606886 ๐Ÿ”ย Call Girls โค Service In Muzaffarpur Female Escorts ...
Call Now โ˜Ž๏ธ๐Ÿ” 9332606886 ๐Ÿ”ย Call Girls โค Service In Muzaffarpur Female Escorts ...Call Now โ˜Ž๏ธ๐Ÿ” 9332606886 ๐Ÿ”ย Call Girls โค Service In Muzaffarpur Female Escorts ...
Call Now โ˜Ž๏ธ๐Ÿ” 9332606886 ๐Ÿ”ย Call Girls โค Service In Muzaffarpur Female Escorts ...Anamikakaur10
ย 
Call Girls Magarpatta Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Magarpatta Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Magarpatta Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Magarpatta Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi
ย 
Call Girls Budhwar Peth Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Budhwar Peth Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Budhwar Peth Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Budhwar Peth Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi
ย 
Call On 6297143586 Pimpri Chinchwad Call Girls In All Pune 24/7 Provide Call...
Call On 6297143586  Pimpri Chinchwad Call Girls In All Pune 24/7 Provide Call...Call On 6297143586  Pimpri Chinchwad Call Girls In All Pune 24/7 Provide Call...
Call On 6297143586 Pimpri Chinchwad Call Girls In All Pune 24/7 Provide Call...tanu pandey
ย 
Verified Trusted Kalyani Nagar Call Girls 8005736733 ๐ˆ๐๐ƒ๐„๐๐„๐๐ƒ๐„๐๐“ Call ๐†๐ˆ๐‘๐‹ ๐•...
Verified Trusted Kalyani Nagar Call Girls  8005736733 ๐ˆ๐๐ƒ๐„๐๐„๐๐ƒ๐„๐๐“ Call ๐†๐ˆ๐‘๐‹ ๐•...Verified Trusted Kalyani Nagar Call Girls  8005736733 ๐ˆ๐๐ƒ๐„๐๐„๐๐ƒ๐„๐๐“ Call ๐†๐ˆ๐‘๐‹ ๐•...
Verified Trusted Kalyani Nagar Call Girls 8005736733 ๐ˆ๐๐ƒ๐„๐๐„๐๐ƒ๐„๐๐“ Call ๐†๐ˆ๐‘๐‹ ๐•...tanu pandey
ย 
(NEHA) Call Girls Navi Mumbai Call Now 8250077686 Navi Mumbai Escorts 24x7
(NEHA) Call Girls Navi Mumbai Call Now 8250077686 Navi Mumbai Escorts 24x7(NEHA) Call Girls Navi Mumbai Call Now 8250077686 Navi Mumbai Escorts 24x7
(NEHA) Call Girls Navi Mumbai Call Now 8250077686 Navi Mumbai Escorts 24x7Call Girls in Nagpur High Profile Call Girls
ย 
Booking open Available Pune Call Girls Budhwar Peth 6297143586 Call Hot Indi...
Booking open Available Pune Call Girls Budhwar Peth  6297143586 Call Hot Indi...Booking open Available Pune Call Girls Budhwar Peth  6297143586 Call Hot Indi...
Booking open Available Pune Call Girls Budhwar Peth 6297143586 Call Hot Indi...Call Girls in Nagpur High Profile
ย 
VIP Model Call Girls Hadapsar ( Pune ) Call ON 8005736733 Starting From 5K to...
VIP Model Call Girls Hadapsar ( Pune ) Call ON 8005736733 Starting From 5K to...VIP Model Call Girls Hadapsar ( Pune ) Call ON 8005736733 Starting From 5K to...
VIP Model Call Girls Hadapsar ( Pune ) Call ON 8005736733 Starting From 5K to...SUHANI PANDEY
ย 
Book Sex Workers Available Pune Call Girls Khadki 6297143586 Call Hot Indian...
Book Sex Workers Available Pune Call Girls Khadki  6297143586 Call Hot Indian...Book Sex Workers Available Pune Call Girls Khadki  6297143586 Call Hot Indian...
Book Sex Workers Available Pune Call Girls Khadki 6297143586 Call Hot Indian...Call Girls in Nagpur High Profile
ย 
Alandi Road ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready ...
Alandi Road ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready ...Alandi Road ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready ...
Alandi Road ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready ...tanu pandey
ย 
Get Premium Attur Layout Call Girls (8005736733) 24x7 Rate 15999 with A/c Roo...
Get Premium Attur Layout Call Girls (8005736733) 24x7 Rate 15999 with A/c Roo...Get Premium Attur Layout Call Girls (8005736733) 24x7 Rate 15999 with A/c Roo...
Get Premium Attur Layout Call Girls (8005736733) 24x7 Rate 15999 with A/c Roo...MOHANI PANDEY
ย 
Kondhwa ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
Kondhwa ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...Kondhwa ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...
Kondhwa ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...tanu pandey
ย 
Call Girls Ramtek Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Ramtek Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Ramtek Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Ramtek Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi
ย 

Recently uploaded (20)

Call Girls Talegaon Dabhade Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Talegaon Dabhade Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Talegaon Dabhade Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Talegaon Dabhade Call Me 7737669865 Budget Friendly No Advance Boo...
ย 
Cheap Call Girls in Dubai %(+971524965298 )# Dubai Call Girl Service By Rus...
Cheap Call Girls  in Dubai %(+971524965298 )#  Dubai Call Girl Service By Rus...Cheap Call Girls  in Dubai %(+971524965298 )#  Dubai Call Girl Service By Rus...
Cheap Call Girls in Dubai %(+971524965298 )# Dubai Call Girl Service By Rus...
ย 
Hot Call Girls ๐Ÿซค Malviya Nagar โžก๏ธ 9711199171 โžก๏ธ Delhi ๐Ÿซฆ Whatsapp Number
Hot Call Girls ๐Ÿซค Malviya Nagar โžก๏ธ 9711199171 โžก๏ธ Delhi ๐Ÿซฆ Whatsapp NumberHot Call Girls ๐Ÿซค Malviya Nagar โžก๏ธ 9711199171 โžก๏ธ Delhi ๐Ÿซฆ Whatsapp Number
Hot Call Girls ๐Ÿซค Malviya Nagar โžก๏ธ 9711199171 โžก๏ธ Delhi ๐Ÿซฆ Whatsapp Number
ย 
Call Girls in Sakinaka Agency, { 9892124323 } Mumbai Vashi Call Girls Serivce...
Call Girls in Sakinaka Agency, { 9892124323 } Mumbai Vashi Call Girls Serivce...Call Girls in Sakinaka Agency, { 9892124323 } Mumbai Vashi Call Girls Serivce...
Call Girls in Sakinaka Agency, { 9892124323 } Mumbai Vashi Call Girls Serivce...
ย 
Book Sex Workers Available Pune Call Girls Kondhwa 6297143586 Call Hot India...
Book Sex Workers Available Pune Call Girls Kondhwa  6297143586 Call Hot India...Book Sex Workers Available Pune Call Girls Kondhwa  6297143586 Call Hot India...
Book Sex Workers Available Pune Call Girls Kondhwa 6297143586 Call Hot India...
ย 
Call Now โ˜Ž Russian Call Girls Connaught Place @ 9899900591 # Russian Escorts ...
Call Now โ˜Ž Russian Call Girls Connaught Place @ 9899900591 # Russian Escorts ...Call Now โ˜Ž Russian Call Girls Connaught Place @ 9899900591 # Russian Escorts ...
Call Now โ˜Ž Russian Call Girls Connaught Place @ 9899900591 # Russian Escorts ...
ย 
Call Girls Jejuri Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Jejuri Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Jejuri Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Jejuri Call Me 7737669865 Budget Friendly No Advance Booking
ย 
Call Now โ˜Ž๏ธ๐Ÿ” 9332606886 ๐Ÿ”ย Call Girls โค Service In Muzaffarpur Female Escorts ...
Call Now โ˜Ž๏ธ๐Ÿ” 9332606886 ๐Ÿ”ย Call Girls โค Service In Muzaffarpur Female Escorts ...Call Now โ˜Ž๏ธ๐Ÿ” 9332606886 ๐Ÿ”ย Call Girls โค Service In Muzaffarpur Female Escorts ...
Call Now โ˜Ž๏ธ๐Ÿ” 9332606886 ๐Ÿ”ย Call Girls โค Service In Muzaffarpur Female Escorts ...
ย 
Call Girls Magarpatta Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Magarpatta Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Magarpatta Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Magarpatta Call Me 7737669865 Budget Friendly No Advance Booking
ย 
Call Girls Budhwar Peth Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Budhwar Peth Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Budhwar Peth Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Budhwar Peth Call Me 7737669865 Budget Friendly No Advance Booking
ย 
Call On 6297143586 Pimpri Chinchwad Call Girls In All Pune 24/7 Provide Call...
Call On 6297143586  Pimpri Chinchwad Call Girls In All Pune 24/7 Provide Call...Call On 6297143586  Pimpri Chinchwad Call Girls In All Pune 24/7 Provide Call...
Call On 6297143586 Pimpri Chinchwad Call Girls In All Pune 24/7 Provide Call...
ย 
Verified Trusted Kalyani Nagar Call Girls 8005736733 ๐ˆ๐๐ƒ๐„๐๐„๐๐ƒ๐„๐๐“ Call ๐†๐ˆ๐‘๐‹ ๐•...
Verified Trusted Kalyani Nagar Call Girls  8005736733 ๐ˆ๐๐ƒ๐„๐๐„๐๐ƒ๐„๐๐“ Call ๐†๐ˆ๐‘๐‹ ๐•...Verified Trusted Kalyani Nagar Call Girls  8005736733 ๐ˆ๐๐ƒ๐„๐๐„๐๐ƒ๐„๐๐“ Call ๐†๐ˆ๐‘๐‹ ๐•...
Verified Trusted Kalyani Nagar Call Girls 8005736733 ๐ˆ๐๐ƒ๐„๐๐„๐๐ƒ๐„๐๐“ Call ๐†๐ˆ๐‘๐‹ ๐•...
ย 
(NEHA) Call Girls Navi Mumbai Call Now 8250077686 Navi Mumbai Escorts 24x7
(NEHA) Call Girls Navi Mumbai Call Now 8250077686 Navi Mumbai Escorts 24x7(NEHA) Call Girls Navi Mumbai Call Now 8250077686 Navi Mumbai Escorts 24x7
(NEHA) Call Girls Navi Mumbai Call Now 8250077686 Navi Mumbai Escorts 24x7
ย 
Booking open Available Pune Call Girls Budhwar Peth 6297143586 Call Hot Indi...
Booking open Available Pune Call Girls Budhwar Peth  6297143586 Call Hot Indi...Booking open Available Pune Call Girls Budhwar Peth  6297143586 Call Hot Indi...
Booking open Available Pune Call Girls Budhwar Peth 6297143586 Call Hot Indi...
ย 
VIP Model Call Girls Hadapsar ( Pune ) Call ON 8005736733 Starting From 5K to...
VIP Model Call Girls Hadapsar ( Pune ) Call ON 8005736733 Starting From 5K to...VIP Model Call Girls Hadapsar ( Pune ) Call ON 8005736733 Starting From 5K to...
VIP Model Call Girls Hadapsar ( Pune ) Call ON 8005736733 Starting From 5K to...
ย 
Book Sex Workers Available Pune Call Girls Khadki 6297143586 Call Hot Indian...
Book Sex Workers Available Pune Call Girls Khadki  6297143586 Call Hot Indian...Book Sex Workers Available Pune Call Girls Khadki  6297143586 Call Hot Indian...
Book Sex Workers Available Pune Call Girls Khadki 6297143586 Call Hot Indian...
ย 
Alandi Road ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready ...
Alandi Road ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready ...Alandi Road ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready ...
Alandi Road ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready ...
ย 
Get Premium Attur Layout Call Girls (8005736733) 24x7 Rate 15999 with A/c Roo...
Get Premium Attur Layout Call Girls (8005736733) 24x7 Rate 15999 with A/c Roo...Get Premium Attur Layout Call Girls (8005736733) 24x7 Rate 15999 with A/c Roo...
Get Premium Attur Layout Call Girls (8005736733) 24x7 Rate 15999 with A/c Roo...
ย 
Kondhwa ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
Kondhwa ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...Kondhwa ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...
Kondhwa ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
ย 
Call Girls Ramtek Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Ramtek Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Ramtek Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Ramtek Call Me 7737669865 Budget Friendly No Advance Booking
ย 

Sikm pugh sustainability conversations for impact snapshot 210420

  • 1. Translating effective sustainability conversation into network design SIKM Leaders Discussion: Spapshot of an NLP journey Katrina Pugh, Columbia University, U Maine April 20, 2021
  • 2. Agenda Rationale and problem statement Research questions Research design References
  • 3. Rationale and problem statement Aquaculture industry tensions are high Source: โ€œWith aquaculture booming, itโ€™s time to talk about its future in Maine,โ€ Portland Press Herald, April 13, 2021 https://www.pressherald.com/2021/04/13/with-aquaculture-booming-its-time-to-talk-about-its-future-in-maine/ โ€œThere is something wrong when you canโ€™t even have a conversation in Maine without sending people into an uproar... There are a number of [Aquaculture lease] criteria โ€“ navigation, competition and others... โ€œunreasonable interferenceโ€โ€ฆunde๏ฌned, ambiguousโ€ฆ ...We are now faced with con๏ฌ‚ict up and down the coast.โ€
  • 4. Rationale and problem statement: Aquaculture Social Ecological System...what we think 1. Climate change/ warming waters 2. Diminished traditional fishing, near monoculture 3. Depts of Marine Res, Fish & Wildlife processes Diverse stakeholders (Farmers, Fishers, Boaters, Riparian Landowners, Regulators, Legislators, NGOs) Interaction: Meetings, Hearings Local town halls, Participatory Action Research Efficiency Innovation Participation Exogenous variables Action Arena Interaction & Outcome Evaluative Criteria Action Situation: Lease scoping mtg. Lease Hearings Outcome: Approval (yes/no) for lease
  • 5. Rationale and problem statement: Aquaculture Social Ecological System...de facto! 1. Climate change/ warming waters 2. Diminished traditional fishing, near monoculture 3. Depts of Marine Res, Fish & Wildlife processes 4. Wealth disparities 5. National polarization Diverse stakeholders Lobbyists Lawyers PR agencies Facilitators NGO overlaps Interaction: Meetings, hearings Local town halls (some with bias, certainty, conflict) Participatory Action Research - Letters to the editors, Soc media Yes or no to Aquaculture lease approval - Cost (of lobbying, investigation) - Spillover effects - Time elapse Exogenous variables Action Arena Interaction & Outcome Evaluative Criteria? Action situation: Lease scoping mtg. Lease Hearings Publishing, Press Outcome: Approval (yes/no) for lease - Community discord, cost
  • 6. Rationale and problem statement: Aquaculture Social Ecological System...reframed 1. Climate change/ warming waters 2. Diminished traditional fishing, near monoculture 3. Depts of Marine Res, Fish & Wildlife processes 4. Wealth disparities 5. National conversation Diverse stakeholders Lobbyists Lawyers PR agencies Facilitators NGO overlaps Interaction: Meetings Local town halls (some with bias, certainty) PAR - Letters to editors, SM Productive Conversation Yes or no to Aquaculture lease approval + Individual conversation skills + Network/ community resilience Exogenous variables Action Arena Interaction & Outcome Evaluative Criteria? Action situation: Lease scoping mtg. Lease Hearings Publishing, Press Lease Approval (yes/no) + Options-Generation, + Relationships + Bias for Action
  • 7. Rationale and problem statement: Focus and research question โ€œHow does conversation in๏ฌ‚uence our collective impact on sustainability? With this in mind, how can we (re)design networks for better conversation?โ€
  • 9. Research Design: Significant authors SES and Sustainability Science Ostrom Agarwal Clark Partelow Cash Johnson Silka, Hart, McGreavy Dialogue, Facilitation Schein Weick Isaacs Dixon Edmondson Wilkinson Danescu-Nikulesu-Mizil See et al Skifstad & Pugh Complex spreading phenomena, Org. learning, knowledge NWs Pugh & Prusak Pentland& Malone Watts Centola and Macy RARE.org Soc Ecol. Systems Cooperation Conversation/AI Network strategy Behavioral Insight, Diversity, Reciprocity Trivers Nowak Galinsky Page Thaler and Sustein Hoffman, Rand & Yoeli Titus and Stasser
  • 10. Source: Pugh, 2020, and Skifstad and Pugh, 2014. Research Design: What makes good conversation? (4 Discussion Disciplines) 10 Inclusion Translation Integrity Courtesy Asking clean questions, making statements with data Respecting participants, respecting the forum Reaching out and bringing in; not โ€œexcludingโ€ through acronyms, terms of art, in-language Synthesizing, sensemaking, up-levelling into actions Derived from Dialogue practices Derived from Facilitation practices
  • 11. Research Design: Research process 0. Observe Sustaina- bility conversa- tions 1. Code transcripts, start interviews 2. Develop AI/ML (NLP) Algorithm 3. Generate Conver-sati on Signatures 5. Design Capacity building & Network, test with focus group 4. Validate AI/ML Algorithm, productize 6. Launch Spring-Summer 2021 Fall, 2021-Spring 2022 Fall 2020-Spring 2021 See A1: Research process detail
  • 12. 12 Integrity Courtesy Inclusion Translation Weโ€™ve been farming under a limited permit aquaculture [LPA] lease. This has allowed us to experiment. Next we moved to the public input part. Thatโ€™s todayโ€™s lease scoping meeting. We want to minimize the impact as much as possible. Iโ€™ll follow up with you. I want your opinion. To clarify: aquaculture is a multitude of different organisms, a multitude of different activities. Source: Aquaculture Lease scoping meeting for Farmer #4. See appendix A2 for more examples. Research Design: Aquaculture Examples of Four Discussion Disciplines
  • 13. M/F Item Comment Discipline Rationale Farmer 24 This is the point where we listen and talk and hear what you have to say. Inclusion Open / include n/a 25 10 seconds Inclusion Open / include Harbor- master 26 I have not been on one of these [scoping meetings]. I heard [person of authority] signed off. I was shocked. Itโ€™s bigger than I thought. Anti-Courtesy Word "shocked" is trigger word. Defensive Harbor- master 27 I was seeing the same materials as before. Integrity Statement of fact. Assume he saw previous lease or earlier version. Harbor- master 28 That lobster trap needs to go. Thereโ€™s no hauling in the town of [town name]. Integrity Statement of fact. Farmer 29 [Relative to the experimental lease] some changes to the species. No change to the gear. Translation Wrapping up, recapping. Harbor- master 30 Iโ€™m good with everything you said. Courtesy Positivity Research Design: Aquaculture lease Scoping meeting excerpt showing identity issues, aquaculture context complexity Injects doubt. Could have derailed the meeting here (common pattern) Sides with farmer and refers to reg policy or lack of reg policy (common fisher pattern) Farmer is not defensive (previously: โ€œwe want to be a good neighborโ€) โ€œPivotal junctureโ€ opened inquiry (40 more moves)
  • 14. Research Design: Six lease scoping meeting transcripts from Oct โ€˜20-March โ€˜21 (approximately 550 moves) Integrity dominates, with Courtesy and Integrity-Q next Female % of utterances approx, 20%* Contribute fewer โ€œantiโ€ comments *Except with female farmer leading scoping meeting. .
  • 15. Research Design: Percent of moves, by discussion discipline, by aquaculture lease scoping meeting Relationship-Building, Intent to act Relationship-Building Options Generation, Relationship Building Options Generation, Intent to Act Intent to act Relationship-Building, Intent to act
  • 16. Research Design: Six lease scoping meeting transcripts from Oct โ€˜20-March โ€˜21 (approximately 550 moves) Options Generation Relationship- building Intent to Act Integrity (+) (+) (+) Integrity-Q + Courtesy + Inclusion + Translation (Weak) Anti (courtesy, integrity, inclusion) (-) Outcomes observed Above-avg. discussion discipline
  • 17. Research Design: AI/ML Natural Language Processing: Using Cornellโ€™s Convokit Parsing language snippets (pre-processi ng and feature abstraction) Ingesting conversa-ti on transcripts Cluster analysis/m atching to four discussion disciplines Testing on โ€œvirginโ€ transcripts, generate conversation assessment utility
  • 18. Research Design: AI/ML Natural Language Processing: Using Cornellโ€™s Convokit 2. Separate common combination of words that have direction (e.g., before-after, parent-child) 3. Collect those directed word combinations that are similar 4. Cluster those motifs together as rhetorical intentions (questions, answers, provocations) 5. Identify PromptTypes โ€™ Clusters that most correspond to the four discussion disciplines. 6. Validate on virgin transcripts and prepare for statistical analysis 1. Ingest text from transcripts (raw training data) Clean text up โ€œCorpusโ€ compiled. โ€œStop wordsโ€ removed. โ€œTextClea nerโ€ applied โ€œTextToArc produces ArcTypes,โ€ which are like vectors - directional relationships between words โ€œPhrasingMotifsโ€ are frequently- occurring sets of dependency- parsed arcs Use analyses, 1. graphs 2. rankings Propttypes closest to the middle (centroid) for that cluster. Doing stepwise, e.g., first assign Integrity. โ€œPromptTypesโ€ are vector representation based on how they are responded to -- as well as types of rhetorical intentions TF*IDF and SVD Parsing language snippets (pre-processing and feature abstraction) Ingesting text Analysis/Matching to discussion disciplines Explanation ConvoKit Transformation
  • 19. Research Design: TF*IDF Vectorizer Matrix: From Phrasing motifs to Prompt Types Phrasing Motif 1 Phrasing Motif 2 Phrasing Motif 3 ... Phrasing Motif Z Utteranc e 1 1 0 1 ... 3 Utteranc e 2 0 2 1 ... 0 Utteranc e N 1 5 0 ... 7 Totals for each Phrasing Motif, for each utterance, is then fed into SVD (Single Value Decomposition) Matrix https://scikit-learn.org/stable/modules/gener ated/sklearn.decomposition.TruncatedSVD.h tml Overview: https://www.onely.com/blog/what-is-tf-idf/ SciKit-Learn Approach: https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text .TfidfVectorizer.html For a Phasing Motif t in Utterance d, the weight Wt,d of term t in document d is given by: Wt,d = TFt,d log (N/DFt) Where: โ— TFt,d is the number of occurrences of t in Utterance d. โ— DFt is the number of Utterances containing the term t. โ— N is the total number of utterances in the corpus. For SEO one would want a LOW TF*IDF. (Phrasing Motif is rare). But for us, we would want a HIGH TF*IDF (Phrasing Motif is not rare). This is the frequency that this phrasing motif occurs in the utterance (row). The column Total X is the total number of the phrasing Motif in the CorpuS, with N utterances. Total 1 Total 2 Total 3 Total ... Total Z
  • 20. โ€œTextToArc produces ArcTypes,โ€ which are like vectors - directional relationships between words in a sentence Research Design: Using Convokit 2. Separate common combination of words that have direction (e.g., before-after, parent-child) 3. Collect those directed word combinations that are similar 3a: Politeness strategies 4. Cluster those motifs together as rhetorical intentions (questions, answers, provocations) 5. Identify PromptTypesโ€™ Clusters that most correspond to the four discussion disciplines. 6. Validate on virgin transcripts and prepare for statistical analysis 1. Ingest text from transcripts (raw training data) Clean text up. โ€œCorpusโ€ compiled. โ€œStop wordsโ€ removed. โ€œTextCleanerโ€ applied โ€œPhrasingMotifsโ€ are frequently- occurring sets of dependency- parsed arcs Use analyses, 1. graphs 2. rankings of prompttypes closest to the middle (centroid) for that cluster. May do stepwise, to first assign Integrity. โ€œPromptTypesโ€ are vector representation based on how they are responded to -- as well as types of rhetorical intentions (clusters 0-7) Parsing language snippets (pre-processing and feature abstraction) Ingesting text Analysis/Matching to discussion disciplines Explanation ConvoKit Transformation 'There is a guy who whips through there in a Boston whaler. Iโ€™m pretty sure he cut up my line once.' ['a_* boston_* guy_* guy_a guy_whips in_* in_whaler is_* is_guy is_there there>* there_* through_* through_there whaler_* whaler_a whaler_boston whips_* whips_in whips_through whips_who who_*', "'m_* 'm_i 'm_sure cut_* cut_he cut_line cut_once cut_up he_* i>* i_* line_* line_my my_* once_* pretty_* sure_* sure_cut sure_pretty up_*"] ['', "'ll_* have_*__have_i__i>*__i_* i>*__i_*", 'my_* the_*', "'ll_* in_* the_*", 'a_* have_*__have_i__i>*__i_* i>*__i_*'] [0.29997174 0.95394809] (PromptTypes Coordinates) Example
  • 21. Prompt Designation Response Designation 1 Motifs as input field, utterances may be represented as both prompt and response. Pretty noisy, some trends: courtesy mapping close to prompt centroid 4.
  • 22. Research Design: Influences on conversation outcomes (bold are observable in our data as explanatory variables) 1. Conversation moves (discussion disciplines and anti-disciplines) 2. Conversation movesโ€™ sequence (e.g., time and type of climax) 3. Gender (pertains to social sensitivity, and could be captured by the โ€œCourtesyโ€ moves. Could also be related to bias) (Woolley et al, 2010) 4. Region/Geography of lease (relates to wealth, development, gentrification, environmental quality 5. Type of lease (e.g., duration up to 20 years, species, equipment, relates to property rights) 6. Type of aquaculture tech (e.g., oyster, mussel rings) 7. Relationship history/costly signals (Grattan et al, 2007 on โ€œheritage relationships. May be captured by the Region/Geography variable.) 8. Physical movement (Body language, pitch, cadence) (Pentland, et al 2007) 9. History of the region (number of recent lease applications or wins) (Ostrom, Partelow) 10. History of the conflict (nature of previous interactions across the community, especially public or litigious actions) (ditto) 11. Regulation (governance systems) (ditto) Likely to be available in the conversations and publicly available sources More difficult to acquire with current resources, and more difficult to translate into resources for sustainability networks
  • 23. Research Design: Statistical analysis: What impact do the conversation attributes have on outcomes, and is it statistically significant? Explanatory variables Dependent variable: Outcomes โ— X1 Signature (categorical variable determined by clustering: e.g., โ—‹ Sig 1 could be โ€œabove average inclusion, above average integrity-Q,โ€ โ—‹ Sig 2 could be โ€œbelow average inclusion, below average integrity Q, above average translationโ€) โ— X2 Sequence (categorical variable: climax type, such as early, followed by loading) [Could also be part of X1] โ— X3 Gender proportion โ— X4 Region (proxy for costly signals, envtal qual, gentrification) โ— X5 Type of Lease 1. Options generation (innovation) 2. Intent to act (closure) 3. Relationship building (Can be either positive or negative)
  • 24. Research Design: Intervention: Accelerate the learning curve for productive conversation 1. Capacity-Building โ— Training in Four Discussion Disciplines (NLP research for targeted impacts) โ— Spreading boundary objects, like pocket cards โ— Collaborating with existing teams (e.g., Maine Sea Grant, Aquaculture in Shared Waters training, DMR training) 2. Network Weaving โ— Designing networks as โ€œcradle for conversation.โ€ โ— Incorporate behavioral models, social norming โ— Leveraging existing networks (e.g., FocusMaine, Maine Aquaculture Association) โ— Propose random controlled trials
  • 25. Research Design: Knowledge Network Effectiveness Framework (read right to left) 25 What are the impacts? 1. Learning / innovation (tangible products) 2. Horizontal Coordination (scale, buying power) 3. Member Support (trusted advice) 4. Translation/ Local Adaptation (sense-making) What behaviors do we see? โ€ขPeople identify with the network out loud โ€ขPeople share contacts, knowledge even before being asked โ€ขPeople speak up, even across hierarchy or political divides What dynamics play out? โ€ข โ€œif I contribute routinely, I will, in turn, get value from the networkโ€ โ€ข โ€œIf I make mistakes, I will learn in a community of learners.โ€ โ€ข โ€œIf members identify with the network, they reciprocate.โ€ โ€ข โ€œIf leaders role-model vulnerability, members will take appropriate risks.โ€ What levers do we pull? 8 Design Dimensions: Strategic 1.Leadersโ€™ shared theory of change 2.Objectives/Outcomes/ Purpose 3. Expert-Learner balance (psychological safety) 4. Inclusion/Participation Structural 5. Operating model 6. Convening structures & infrastructures 7. Facilitation and social norm development Tactical 8. Measurement, feedback and incentives Increasing leverage KNEF on a page 210202 โ€œProducts, negotia-tio nsโ€ โ€œRelation- ships, trustโ€ Source: Pugh & Prusak (2013) โ€œDesigning Effective Knowledge Networks,โ€ MIT Sloan Management REview
  • 26. Research Design: Bringing it all together: Conceptual Model Conflict in sustainability interactions Outside facilitation Investment in Conversation Capacity building Depen- dency on outside facilitation + - - - + - + B B Current: โ€œConflict is masked, conversation skills atrophyโ€
  • 27. investment in Conversation Capacity Research Design: Bringing it all together: Conceptual Model Conflict in sustainability interactions Outside facilitation Investment in Conversation Capacity building Depen- dency on outside facilitation Conflict in sustainability interactions Desirability of engagement Credibility of conversation model + - - - + - + - - + + R B B Current: โ€œConflict is masked, conversation skills atrophyโ€ Goal: โ€œNetworks and practice support productive conversationโ€
  • 28. investment in Conversation Capacity Research Design: Bringing it all together: Conceptual Model Conflict in sustainability interactions Outside facilitation Investment in Conversation Capacity building Depen- dency on outside facilitation Conflict in sustainability interactions Desirability of engagement Credibility of conversation model Network convening Empirical evidence of conversation driving impact Data science and network design programs + - - - + - + - - + + + + + + R B B Current: โ€œConflict is masked, conversation skills atrophyโ€ Goal: โ€œNetworks and practice support productive conversationโ€
  • 29. Out beyond ideas of wrongdoing and rightdoing, there is a ๏ฌeld. Iโ€™ll meet you there. When the soul lies down in that grass, the world is too full to talk about. Ideas, language, even the phrase โ€˜each otherโ€™ doesnโ€™t make any sense. Jalal ad-Din Mohammad Rumi 13th Century Persian scholar, theologian, poet Words of hope...
  • 30. Recognitions Thank you to my Doctoral Committee, research team, and mentors! โ— Teresa Johnson, PhD., UMaine, Doctoral Advisor โ— Nancy Dixon, PhD., Columbia University, committee member โ— Mohamad Musavi, PhD., UMaine, committee member โ— Linda Silka, PhD. UMaine, committee member โ— Erez Yoeli, PhD., MIT, committee member โ— Emily Currie โ€˜22, research team โ— Peter van Walsum, PhD., mentor โ— David Hart, PhD., mentor โ— Keith Evans, PhD., mentor โ— Larry Prusak, Columbia University, mentor โ— Christine Beitl and the whole ANT 560 Research Methods Class
  • 32. 0. Sustainability conversation 1. Manual coding 2. AI/ML Algorithm development 3. Signature generation 5. Designs for Capacity building & Network Aquaculture stakeholder in conversation Research team performing linguistic analysis Research team performing statistical analysis Supplemental data (e.g., BERT libraries) Programmer, using NLP libraries 0a. Lease scoping or hearing 0b. Record. 0c. Transcribe Parse into utterances 1a. Classify for 4DDs, gender, sequence, outcome. 1b. Perform basic statistics, pivot tables to find patterns 1c. Generate infographics. 2a. Parse new conversation and supplement. Gen. training data (HITL) 2b. Gen. and test algorithms for 4DDs, gender, impacts 2c. Acquire more conversation data as 4DD examples 3a. Do statistical analysis (e.g., regress composition of moves, sequence of moves, gender, etc. on outcome.) draft signatures 4. AI/ML Algorithm Validation, productization 4d. Revise algorithm to detect 4DDs, gender, sequence, and, signature on new data 4e. Create new libraries wishlist 4b. Record. 4c. Transcribe Parse into utterances 5a. Draft, improvements to networks to include skillful conversation 5b. Focus groups 1c. Interviews to determine outcomes 6. Launch 6a. Develop training, toolkits 6c S/H Training 4a. Lease scoping or hearing Research Process ECE 598 Research Process and Roles Spring-Summer 2021 Fall, 2021 -Spring 2022 Fall 2020-Spring 2021
  • 33. Partial Bibliography (1 of 7) โ— Anderies, & Janssen. (2016). Sustaining the Commons (2nd ed., Vol. 2). Creative Commons. โ— Buchanan, M., & Pentland, A. (2007). The Science of Subtle Signals. Strategy & Business. โ— Cash, D. W., Borck, J. C., & Patt, A. G. (2006). Countering the loading-dock approach to linking science and decision making: Comparative analysis of El Niรฑo/Southern Oscillation (ENSO) forecasting systems. Science Technology and Human Values, 31(4), 465โ€“494. https://doi.org/10.1177/0162243906287547 โ— Caviglia, F., Dalsgaard, C., Delfino, M., & Pedersen, A. Y. (2017). Dialogic literacy: Contexts, competences and dispositions. L1 Educational Studies in Language and Literature, 17(2017), 1โ€“38. https://doi.org/10.17239/L1ESLL-2017.17.01.05 โ— Chang, J. P., Chiam, C., Fu, L., Wang, A. Z., Zhang, J., & Danescu-Niculescu-Mizil, C. (2020). ConvoKit: A Toolkit for the Analysis of Conversations. ArXiv. http://arxiv.org/abs/2005.04246 โ— Cinner, J. (2018). How behavioral science can help conservation. In Science (Vol. 362, Issue 6417, pp. 889โ€“890). American Association for the Advancement of Science. https://doi.org/10.1126/science.aau6028 โ— Clark, W. C., & Harley, A. G. (2020). Sustainability Science: Toward a Synthesis. Annual Review of Environment and Resources, 45(1). https://doi.org/10.1146/annurev-environ-012420-043621 โ— Clarke, H., & Barton, W. (2019). Putting Dialogue to Work in the Virginia Department of Corrections. In The World Needs Dialogue! (pp. 1โ€“11).
  • 34. Partial Bibliography (2 of 7) โ— Deloitte. (2020). Open Source Compass: A new way to glean insights on the trajectory of open source development for emerging technologies. Open Source Compass. https://opensourcecompass.io/ โ— Dietz, T., Dolลกak, N., Ostrom, E., & Stern, P. C. (2002). The Drama of the Commons. In National Academies Press. โ— Dixon, N. (2018). Speaking Up 101. Ivey Business Journal, September/October 2018. https://iveybusinessjournal.com/speaking-up-101/ โ— Dixon, N. M. (2021). Conversation Matters Blog: Posts on Conversation. Conversaion Matters. https://www.nancydixonblog.com/conversation/ โ— Druschke, C. G., & McGreavy, B. (2016). Why rhetoric matters for ecology. Frontiers in Ecology and the Environment, 14(1), 46โ€“52. https://doi.org/10.1002/16-0113.1 โ— Edmondson, A. C., & Lei, Z. (2014). Psychological Safety: The History, Renaissance, and Future of an Interpersonal Construct. Annual Review of Organizational Psychology and Organizational Behavior, 1, 23โ€“43. https://doi.org/10.1146/annurev-orgpsych-031413-091305 โ— Galinsky, A. D., Todd, A. R., Homan, A. C., Phillips, K. W., Apfelbaum, E. P., Sasaki, S. J., Richeson, J. A., Olayon, J. B., & Maddux, W. W. (2015). Maximizing the Gains and Minimizing the Pains of Diversity: A Policy Perspective. Perspectives on Psychological Science. https://doi.org/10.1177/1745691615598513
  • 35. Partial Bibliography (3 of 7) โ— Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2). http://iris.cs.aau.dk/tl_files/volumes/Volume 29/ โ— Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019. โ— Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning Research With Societal Needs. Issues in Science and Technology, 23(3). https://issues.org/aligning-research-with-societal-needs/ โ— Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate coordination. 1โ€“15. โ— Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what people think and not just what they do. Proceedings of the National Academy of Sciences of the United States of America, 112(6), 1727โ€“1732. https://doi.org/10.1073/pnas.1417904112 โ— Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press. https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999 โ— Isaacs, W. (2016). Trim-Tab Dialoguesโ€‰: Transformative Vision and Action in South Asia. In The World Needs Dialogue! (Issue February, pp. 1โ€“19).
  • 36. Partial Bibliography (4 of 7) โ— Hansen, M. R. P., & Pries-Heje, J. (2017). Value Creation in Knowledge Networks: Five Design Principles. In Scandinavian Journal of Information Systems (Vol. 29, Issue 2). http://iris.cs.aau.dk/tl_files/volumes/Volume 29/ โ— Hart, D. (2019). Organizational innovation research-Mitchell Ctr Mar 2019. โ— Hart, D., & Linda Silka. (2020). Rebuilding the Ivory Tower: A Bottom-Up Experiment in Aligning Research With Societal Needs. Issues in Science and Technology, 23(3). https://issues.org/aligning-research-with-societal-needs/ โ— Hoffman, M., Yoeli, E., Dalkiran, N. A., & Nowak, M. A. (n.d.). Categorical distinctions facilitate coordination. 1โ€“15. โ— Hoffman, M., Yoeli, E., & Nowak, M. A. (2015). Cooperate without looking: Why we care what people think and not just what they do. Proceedings of the National Academy of Sciences of the United States of America, 112(6), 1727โ€“1732. https://doi.org/10.1073/pnas.1417904112 โ— Isaacs, W. (1999). Dialogue and the Art of Thinking Together. Princeton Press. https://www.amazon.com/Dialogue-Thinking-Together-William-Isaacs/dp/0385479999 โ— Isaacs, W. (2016). Trim-Tab Dialoguesโ€‰: Transformative Vision and Action in South Asia. In The World Needs Dialogue! (Issue February, pp. 1โ€“19).
  • 37. Partial Bibliography (5 of 7) โ— Johnson, T., Beard, K., Brady, D., Byron, C., Cleaver, C., Duffy, K., Keeney, N., Kimble, M., Miller, M., Moeykens, S., Teisl, M., van Walsum, G., & Yuan, J. (2019). A Social-Ecological System Framework for Marine Aquaculture Research. Sustainability, 11(9), 2522. https://doi.org/10.3390/su11092522 โ— Johnson, T. R. (2020). Reflecting on Maine โ€™ s Changing Productive Coastal Region. Maine Policy Review, 29(2), 91โ€“97. โ— Johnson, T. R., & Hanes, S. P. (2017). Marine Aquaculture in Restructuring Regions: Understanding the Key Coastal Sustainability Transition. Quarterly Magazine of the Regional Studies Association, 308(Autumn), 13โ€“15. โ— McCardle-Keurentjes, M., & Rouwette, E. A. J. A. (2018). Asking Questions: A Sine Qua Non of Facilitation in Decision Support? Group Decision and Negotiation, 27(5), 757โ€“788. https://doi.org/10.1007/s10726-018-9573-y โ— McGinnis, M. D., & Ostrom, E. (2014). Social-ecological system framework: initial changes and continuing challenges. Ecology and Society, 19(2), art30. https://doi.org/10.5751/ES-06387-190230 โ— Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. In Science (Vol. 325, Issue 5939, pp. 419โ€“422). https://doi.org/10.1126/science.1172133 โ— Ostrom, E., Bravo, G., Janssen, M., Levin, S., Myint, T., Pahl-Wostl, C., & Walker, J. (2008). Workshop in Political Theory and Policy Analysis BUILDING TRUST TO SOLVE COMMONS DILEMMAS: TAKING SMALL STEPS TO TEST AN EVOLVING THEORY OF COLLECTIVE ACTION. www.indiana.edu/~workshopW08-239/22/08
  • 38. Partial Bibliography (6 of 7) โ— Page, S. (2007). The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools and Societies - New Edition. Princeton Press. https://www.amazon.com/Difference-Diversity-Creates-Schools-Societies/dp/0691138540 โ— Page, S. E. (2017). The Diversity Bonus: How Great Teams Pay Off in the Knowledge Economy. Princeton Press. https://www.amazon.com/Diversity-Bonus-Knowledge-Compelling-Interests-ebook/dp/B07JDTSZVR/?pldnSite=1 โ— Partelow, S. (2016). Coevolving Ostromโ€™s socialโ€“ecological systems (SES) framework and sustainability science: four key co-benefits. Sustainability Science, 11(3), 399โ€“410. https://doi.org/10.1007/s11625-015-0351-3 โ— Plamondon, K. M., Bottorff, J. L., & Cole, D. C. (2015). Analyzing Data Generated Through Deliberative Dialogue. Qualitative Health Research, 25(11), 1529โ€“1539. https://doi.org/10.1177/1049732315581603 โ— Pugh, K. (2016). Four Discussion Disciplines to Drive Effective Online Collaboration. Columbia SPS. https://sps.columbia.edu/news/four-discussion-disciplines-drive-effective-online-collaboration โ— Pugh, K. (2019). Conversational AI and AI for Conversation: Our Role as KMโ€™ers? โ— Pugh, K., & Prusak, L. (2013). Designing Effective Knowledge Networks. MIT Sloan Management Review. โ— Rand, D. G., Yoeli, E., & Hoffman, M. (2014). Harnessing Reciprocity to Promote Cooperation and the Provisioning of Public Goods. Policy Insights from the Behavioral and Brain Sciences, 1(1), 263โ€“269. https://doi.org/10.1177/2372732214548426 โ— Schein, E. H. (1978). The Role of the Consultant: Content Expert or Process Facilitator? The Personnel and Guidance Journal, 56(6). https://doi.org/10.1002/j.2164-4918.1978.tb04644.x
  • 39. Partial Bibliography (7 of 7) โ— Schein, E. H. (1993). On dialogue, culture, and organizational learning. Organizational Dynamics, 22(2), 40โ€“51. https://doi.org/10.1016/0090-2616(93)90052-3 โ— See, A., Roller, S., Kiela, D., & Weston, J. (2019). What makes a good conversation? How controllable attributes affect human judgments. Facebook Research and Stanford University. https://parl.ai/projects/ โ— Silka, L. (2013). โ€œSilosโ€ in the Democratization of Science. International Journal of Deliberative Mechanisms in Science, 2(1), 1. https://doi.org/10.4471/demesci.2013.06 โ— Silka, L., Glover, R., Hutchins, K., Lindenfeld, L., Blackstone, A., Elliott, C., Ladenheim, M., & Sullivan, C. (2013). Moving Beyond the Single Disciplineโ€‰: Building a Scholarship of Engagement that Permeates Higher Education. Tamara - Journal for Critical Organization Inquiry, 11(4), 41โ€“52. โ— Silka, L., McGreavy, B., & Hart, D. (2019). Breaking boundaries Chapter: Health, the Environment, and Sustainability: Emergent Communication Lessons Across Highly Diverse Public Participation Activities. In State University of New York Press, Albany. โ— Skifstad, S., & Pugh, K. (2014). Smarter Innovation: Beyond Netiquette (Chapter 8). In Smarter Innovation. Ark Group. โ— Stasser, G., & Titus, W. (2003). Hidden Profiles: A Brief History. Psychological Inquiry, 14(3โ€“4), 304โ€“313. https://doi.org/10.1080/1047840x.2003.9682897 โ— Wilkinson, M. (2012). The Secrets of Facilitation: The SMART Guide to Getting Results with Groups. Jossey-Bass/Wiley. https://www.amazon.com/Secrets-Facilitation-Getting-Results-Groups-ebook/dp/B00DBOZPI4 โ— Willison, J. B., Rossman, S., Bieler, S., & Innes, C. (2017). Creating and Measuring a Healing Environment in the Virginia Department of Corrections. In The World Needs Dialogue! https://www.urban.org/sites/default/files/publication/91411/nm_wave_2_brief_createmeasure_hei.pdf โ— Woolley, A., Malone, T. W., & Chabris, C. F. (2015). GRAY MATTER. New York Times. https://www.nytimes.com/2015/01/18/opinion/sunday/why-some-teams-are-smarter-than-others.html โ— Woolley, A. W., Chabris, C. F., Pentland, A., Hashmi, N., & Malone, T. (2010). Evidence for a Collective Intelligence Factor in the Performance of Human Groups. Science, 330(6004), 683โ€“686. https://doi.org/10.1126/science.1190483