SlideShare a Scribd company logo
1
The Pain of Complexity
Dmitry Zinoviev
Suffolk University, Boston
2
“Complexity” is one of those fuzzy concepts
that everyone seems to understand
differently. Other examples: sustainability,
resilience, success...
What Is Complexity?
3
Let's Ask the Mechanical Turk!
● Question: “Enter three nouns
(please, nouns only!) that, to
the best of your understanding,
are associated with complexity.
These words could be
synonyms, descriptors,
attributes of complexity, actions
or any other related words.”
● Ask 100 mTurk workers, pay a
nominal fee for an answer
● Reject non-nouns; stem* and
aggregate nouns
*We tried both “Porter” and “Lancaster” stemmers; “Porter” is less
aggressive, it produced more stems (“motifs”); some manual tweaking
was needed
4
Direct Survey Results
● The stems that were mentioned at least twice (in the order of
decreasing frequency):
– Most frequently mentioned (23+ times): COMPLIC*, DIFFICULTI*,
INTRICACI*
– Less frequently mentioned (2–9 times): PROBLEM*, ELABOR*,
ENTANGL*, PUZZL*, MULTIPL*, COMPLEX*, COMPUT*,
CONVOLUT*, HARD*, RAMIF*, SOPHIST*, CHALLENG*,
HUMAN*, INVOLV*, LIFE*, POLIT*, RIDDL*, SCIENC*,
COMPOSIT*, CONFUS*, DEPTH*, DESIGN*, DIVERS*,
LABYRINTH*, LANGUAG*, MATH*, MAZE*, OBSCUR*,
PHYSIC*, QUALITI*, RELATIONSHIP*, SPACE*,
STRUCTURE*, TEST*, TRICKI*, TROUBL*, VARIABL*,
VARIETI*
– The highlighted stems bear strong emotional load—though, no pain
yet!
5
Use Indirect Data
● Don't tell me who you are. “Tell me who your friends are, and I will tell
you who you are.”
● Instead of asking people what they think “complexity” is, let's collect
abundant implicit markers off the Internet.
6
Indirect Data: Possible Sources
● EBSCO keywords or subject tags (subscription and harvesting
software required; we haz it, but the results may be too academic!)
● Blogging sites like LiveJournal (LJ)
– LJ has individual blogs and community blogs (like forums)
– Both types of blogs can and do have user- or moderator-declared
interests
– The interests are usually carefully chosen to reflect the
blogger's/community's online identity
– Free access, easy-to-write harvester
7
Raw Data
● All LiveJournal communities that list at least one of the following
interests:
– “complexity”
– “complex systems”
– “complexity theory”
– “complexity theories”
● Found 59 communities, such as mixedtype, abstractthought,
ivygreenfanclub, pdmi_logic, investors, gifted_teens, etc.
● Many more individual bloggers—we ignored them, their interest lists
are way too broad!
● Selected 374 most frequently declared interests (the corpus)
8
Example: “Ecologists” community
● Community ecologists.livejournal.com
● 150 self-declared (by the moderator(s)) interests
● Includes “complexity,” but also many other keywords; are
they relevant? Let's assume they are.
9
Term Vector Model
● Treat communities as documents and interests as words
● Calculate generalized similarity between words (and between
communities—but why?) using Kovacs (2010) algorithm:
– Two words are similar if they belong to similar documents
– Two documents are similar if the consist of similar words
● Remark: generalized similarity, as defined by Kovacs, is essentially
Pearson correlation in an oblique Cartesian coordinate space
●
For any two words W and V from the corpus, -1 ≤ d(W,V) ≤ 1 is the
similarity between the words; for any two communities C and D, -1 ≤
d(C,D) ≤ 1 is the similarity between the communities (a by-product,
not needed)
10
Network Construction (1)
● Treat words as nodes in a
network
● Treat similarities as edges if
they are above T0
=0.65
(“slicing”); the choice of T0
is
tricky and arbitrary:
– If T0
is too high, the
network is complete
and not interesting
– If T0
is too low, the
network is sparse and
disconnected
● Gephi it!
11
“Complexity Dragon” (a.k.a. the
Mindscape of Complexity)
12
Modular Structure
Modularity=0.56
(not great, but
still visible)
psychology, chaos,
science, mathematics,
complexity theory, ...
philosophy, life,
imagination, self-expression,
knowledge, ...
complexity, honesty, music, simplicity,
love, poetry, creativity,
empathy, humor, hate, ...
writing, art, books,
romance, drawing, ...
13
What Is the Meaning of Modules?
● We could just stare at the
modules and try to come up
with a suitable name—
● —or we could use
crowdsourcing through Amazon
Mechanical Turk again!
Fragment of the “fireball”
14
Let's Ask the Mechanical Turk!
● Question: “Describe the
following group of 50* words
with a single most suitable word
or a two-word or three-word
phrase: ...”
*There are only 36 terms in the lower
left module.
● Ask 100 mTurk workers, pay a
nominal fee for an answer
● Reject non-nouns; stem and
aggregate nouns
● The nouns are module
descriptors (“motifs”)
15
Network Construction (2)
● Treat original modules as documents and motifs as words
● Calculate generalized similarity
● Do slicing
● Build a network of stems
● Gephi it!
16
The Three Shades of Complexity
● The new network has a simple,
but not trivial, structure, and is
highly modular
● The Three Shades of
Complexity:
– Science/Technology
– Society/Mind
– Creativity/Emotions
● Connections:
– via education
– via life/humanities
There are lines here, they
are just too thin...
17
Semantic Spectrography
mTurk for motif
extraction and clustering
Term source for
mindscape construction
Analysis term
selection
18
Spectrography vs Direct Survey
Direct Survey: 37
Spectrography: 382
4 9 4
104 111 113 37
24
19
Comparison Summary
● Positive:
– Spectrography is much more detailed: it catches 41% of direct
survey terms; direct survey catches only 4.5% of spectrography
terms
– Spectrography reveals structure
● Negative:
– Spectrography requires a source (or sources) of terms
20
Successfully Used Elsewhere
● D. Zinoviev, D. Stefanescu, L. Swenson, and G. Fireman, “Semantic
Networks of Interests in Online NSSI* Communities,” in Proc.
Workshop “Words and Networks,” Evanston, IL, June 2012,
published online (also submitted to Social Networks in 2013)
● D. Zinoviev and Z. Zhu, “Conceptual Structure of Sustainability:
Social and Scholarly Perspectives,” Sunbelt XXXIV Social Networks
Conference, St.-Pete Beach, FL, February 2014 (also submitted to
Social Networks in 2014)
*Non-Suicidal Self Injury—a common and
epidemically spreading activity among adolescents
and young adults
21
But Where Is the Pain?
● SE corner of the emotional module full of NSSI-specific terminology
● Communities: artificial_joy, humans_being (sic), the_addicted
● Complexity and creativity as attributes of human nature
22
Thank-You!

More Related Content

Similar to The Pain of Complexity

Mesoscale Structures in Networks
Mesoscale Structures in NetworksMesoscale Structures in Networks
Mesoscale Structures in Networks
Mason Porter
 
Social Networks & Memes
Social Networks & MemesSocial Networks & Memes
Social Networks & Memes
morganjbruce
 
Social Complexity
Social ComplexitySocial Complexity
Social Complexity
Bruce Edmonds
 
SC01_IntroductionSC-Unit-I.ppt
SC01_IntroductionSC-Unit-I.pptSC01_IntroductionSC-Unit-I.ppt
SC01_IntroductionSC-Unit-I.ppt
Ramya Nellutla
 
How to map networks
How to map networks How to map networks
How to map networks
Ulises S. Aguila Ledezma
 
How to map networks
How to map networks How to map networks
How to map networks
Ulises S. Aguila Ledezma
 
The P4 of Networkacy
The P4 of NetworkacyThe P4 of Networkacy
The P4 of Networkacy
Dmitry Zinoviev
 
The Science Of Social Networks
The Science Of Social NetworksThe Science Of Social Networks
The Science Of Social Networks
Ehren Foss
 
Core Methods In Educational Data Mining
Core Methods In Educational Data MiningCore Methods In Educational Data Mining
Core Methods In Educational Data Mining
ebelani
 
NLP and personality analysis
NLP and personality analysisNLP and personality analysis
NLP and personality analysis
David Rostcheck
 
Three networks walk into a bar...
Three networks walk into a bar...Three networks walk into a bar...
Three networks walk into a bar...
Clay Spinuzzi
 
Using construction grammar in conversational systems
Using construction grammar in conversational systemsUsing construction grammar in conversational systems
Using construction grammar in conversational systems
CJ Jenkins
 
M1. sem web & ontology introd
M1. sem web & ontology introdM1. sem web & ontology introd
M1. sem web & ontology introdMichele Missikoff
 
Applied Science - Engineering Systems
Applied Science - Engineering SystemsApplied Science - Engineering Systems
Applied Science - Engineering Systems
University of Hertfordshire
 
01 Introduction to Networks Methods and Measures
01 Introduction to Networks Methods and Measures01 Introduction to Networks Methods and Measures
01 Introduction to Networks Methods and Measures
dnac
 
01 Introduction to Networks Methods and Measures (2016)
01 Introduction to Networks Methods and Measures (2016)01 Introduction to Networks Methods and Measures (2016)
01 Introduction to Networks Methods and Measures (2016)
Duke Network Analysis Center
 
Objective Fiction, i-semantics keynote
Objective Fiction, i-semantics keynoteObjective Fiction, i-semantics keynote
Objective Fiction, i-semantics keynote
Aldo Gangemi
 
20111123 mwa2011-marc smith
20111123 mwa2011-marc smith20111123 mwa2011-marc smith
20111123 mwa2011-marc smith
Marc Smith
 
chatcptkk.ppt
chatcptkk.pptchatcptkk.ppt

Similar to The Pain of Complexity (20)

Mesoscale Structures in Networks
Mesoscale Structures in NetworksMesoscale Structures in Networks
Mesoscale Structures in Networks
 
Social Networks & Memes
Social Networks & MemesSocial Networks & Memes
Social Networks & Memes
 
Social Complexity
Social ComplexitySocial Complexity
Social Complexity
 
SC01_IntroductionSC-Unit-I.ppt
SC01_IntroductionSC-Unit-I.pptSC01_IntroductionSC-Unit-I.ppt
SC01_IntroductionSC-Unit-I.ppt
 
How to map networks
How to map networks How to map networks
How to map networks
 
How to map networks
How to map networks How to map networks
How to map networks
 
Scits 2014
Scits 2014Scits 2014
Scits 2014
 
The P4 of Networkacy
The P4 of NetworkacyThe P4 of Networkacy
The P4 of Networkacy
 
The Science Of Social Networks
The Science Of Social NetworksThe Science Of Social Networks
The Science Of Social Networks
 
Core Methods In Educational Data Mining
Core Methods In Educational Data MiningCore Methods In Educational Data Mining
Core Methods In Educational Data Mining
 
NLP and personality analysis
NLP and personality analysisNLP and personality analysis
NLP and personality analysis
 
Three networks walk into a bar...
Three networks walk into a bar...Three networks walk into a bar...
Three networks walk into a bar...
 
Using construction grammar in conversational systems
Using construction grammar in conversational systemsUsing construction grammar in conversational systems
Using construction grammar in conversational systems
 
M1. sem web & ontology introd
M1. sem web & ontology introdM1. sem web & ontology introd
M1. sem web & ontology introd
 
Applied Science - Engineering Systems
Applied Science - Engineering SystemsApplied Science - Engineering Systems
Applied Science - Engineering Systems
 
01 Introduction to Networks Methods and Measures
01 Introduction to Networks Methods and Measures01 Introduction to Networks Methods and Measures
01 Introduction to Networks Methods and Measures
 
01 Introduction to Networks Methods and Measures (2016)
01 Introduction to Networks Methods and Measures (2016)01 Introduction to Networks Methods and Measures (2016)
01 Introduction to Networks Methods and Measures (2016)
 
Objective Fiction, i-semantics keynote
Objective Fiction, i-semantics keynoteObjective Fiction, i-semantics keynote
Objective Fiction, i-semantics keynote
 
20111123 mwa2011-marc smith
20111123 mwa2011-marc smith20111123 mwa2011-marc smith
20111123 mwa2011-marc smith
 
chatcptkk.ppt
chatcptkk.pptchatcptkk.ppt
chatcptkk.ppt
 

More from Dmitry Zinoviev

Machine Learning Basics for Dummies (no math!)
Machine Learning Basics for Dummies (no math!)Machine Learning Basics for Dummies (no math!)
Machine Learning Basics for Dummies (no math!)
Dmitry Zinoviev
 
WHat is star discourse in post-Soviet film journals?
WHat is star discourse in post-Soviet film journals?WHat is star discourse in post-Soviet film journals?
WHat is star discourse in post-Soviet film journals?
Dmitry Zinoviev
 
The “Musk” Effect at Twitter
The “Musk” Effect at TwitterThe “Musk” Effect at Twitter
The “Musk” Effect at Twitter
Dmitry Zinoviev
 
Are Twitter Networks of Regional Entrepreneurs Gendered?
Are Twitter Networks of Regional Entrepreneurs Gendered?Are Twitter Networks of Regional Entrepreneurs Gendered?
Are Twitter Networks of Regional Entrepreneurs Gendered?
Dmitry Zinoviev
 
Using Complex Network Analysis for Periodization
Using Complex Network Analysis for PeriodizationUsing Complex Network Analysis for Periodization
Using Complex Network Analysis for Periodization
Dmitry Zinoviev
 
Algorithms
AlgorithmsAlgorithms
Algorithms
Dmitry Zinoviev
 
Text analysis of The Book Club Play
Text analysis of The Book Club PlayText analysis of The Book Club Play
Text analysis of The Book Club Play
Dmitry Zinoviev
 
Exploring the History of Mental Stigma
Exploring the History of Mental StigmaExploring the History of Mental Stigma
Exploring the History of Mental Stigma
Dmitry Zinoviev
 
Roles and Words in a massive NSSI-Related Interaction Network
Roles and Words in a massive NSSI-Related Interaction NetworkRoles and Words in a massive NSSI-Related Interaction Network
Roles and Words in a massive NSSI-Related Interaction Network
Dmitry Zinoviev
 
“A Quaint and Curious Volume of Forgotten Lore,” or an Exercise in Digital Hu...
“A Quaint and Curious Volume of Forgotten Lore,” or an Exercise in Digital Hu...“A Quaint and Curious Volume of Forgotten Lore,” or an Exercise in Digital Hu...
“A Quaint and Curious Volume of Forgotten Lore,” or an Exercise in Digital Hu...
Dmitry Zinoviev
 
Network analysis of the 2016 USA presidential campaign tweets
Network analysis of the 2016 USA presidential campaign tweetsNetwork analysis of the 2016 USA presidential campaign tweets
Network analysis of the 2016 USA presidential campaign tweets
Dmitry Zinoviev
 
Network Analysis of The Shining
Network Analysis of The ShiningNetwork Analysis of The Shining
Network Analysis of The Shining
Dmitry Zinoviev
 
The Lord of the Ring. A Network Analysis
The Lord of the Ring. A Network AnalysisThe Lord of the Ring. A Network Analysis
The Lord of the Ring. A Network Analysis
Dmitry Zinoviev
 
Pickling and CSV
Pickling and CSVPickling and CSV
Pickling and CSV
Dmitry Zinoviev
 
Python overview
Python overviewPython overview
Python overview
Dmitry Zinoviev
 
Welcome to CS310!
Welcome to CS310!Welcome to CS310!
Welcome to CS310!
Dmitry Zinoviev
 
Programming languages
Programming languagesProgramming languages
Programming languages
Dmitry Zinoviev
 
DaVinci Code. Network Analysis
DaVinci Code. Network AnalysisDaVinci Code. Network Analysis
DaVinci Code. Network Analysis
Dmitry Zinoviev
 
Soviet Popular Music Landscape: Community Structure and Success Predictors
Soviet Popular Music Landscape: Community Structure and Success PredictorsSoviet Popular Music Landscape: Community Structure and Success Predictors
Soviet Popular Music Landscape: Community Structure and Success Predictors
Dmitry Zinoviev
 
C for Java programmers (part 2)
C for Java programmers (part 2)C for Java programmers (part 2)
C for Java programmers (part 2)
Dmitry Zinoviev
 

More from Dmitry Zinoviev (20)

Machine Learning Basics for Dummies (no math!)
Machine Learning Basics for Dummies (no math!)Machine Learning Basics for Dummies (no math!)
Machine Learning Basics for Dummies (no math!)
 
WHat is star discourse in post-Soviet film journals?
WHat is star discourse in post-Soviet film journals?WHat is star discourse in post-Soviet film journals?
WHat is star discourse in post-Soviet film journals?
 
The “Musk” Effect at Twitter
The “Musk” Effect at TwitterThe “Musk” Effect at Twitter
The “Musk” Effect at Twitter
 
Are Twitter Networks of Regional Entrepreneurs Gendered?
Are Twitter Networks of Regional Entrepreneurs Gendered?Are Twitter Networks of Regional Entrepreneurs Gendered?
Are Twitter Networks of Regional Entrepreneurs Gendered?
 
Using Complex Network Analysis for Periodization
Using Complex Network Analysis for PeriodizationUsing Complex Network Analysis for Periodization
Using Complex Network Analysis for Periodization
 
Algorithms
AlgorithmsAlgorithms
Algorithms
 
Text analysis of The Book Club Play
Text analysis of The Book Club PlayText analysis of The Book Club Play
Text analysis of The Book Club Play
 
Exploring the History of Mental Stigma
Exploring the History of Mental StigmaExploring the History of Mental Stigma
Exploring the History of Mental Stigma
 
Roles and Words in a massive NSSI-Related Interaction Network
Roles and Words in a massive NSSI-Related Interaction NetworkRoles and Words in a massive NSSI-Related Interaction Network
Roles and Words in a massive NSSI-Related Interaction Network
 
“A Quaint and Curious Volume of Forgotten Lore,” or an Exercise in Digital Hu...
“A Quaint and Curious Volume of Forgotten Lore,” or an Exercise in Digital Hu...“A Quaint and Curious Volume of Forgotten Lore,” or an Exercise in Digital Hu...
“A Quaint and Curious Volume of Forgotten Lore,” or an Exercise in Digital Hu...
 
Network analysis of the 2016 USA presidential campaign tweets
Network analysis of the 2016 USA presidential campaign tweetsNetwork analysis of the 2016 USA presidential campaign tweets
Network analysis of the 2016 USA presidential campaign tweets
 
Network Analysis of The Shining
Network Analysis of The ShiningNetwork Analysis of The Shining
Network Analysis of The Shining
 
The Lord of the Ring. A Network Analysis
The Lord of the Ring. A Network AnalysisThe Lord of the Ring. A Network Analysis
The Lord of the Ring. A Network Analysis
 
Pickling and CSV
Pickling and CSVPickling and CSV
Pickling and CSV
 
Python overview
Python overviewPython overview
Python overview
 
Welcome to CS310!
Welcome to CS310!Welcome to CS310!
Welcome to CS310!
 
Programming languages
Programming languagesProgramming languages
Programming languages
 
DaVinci Code. Network Analysis
DaVinci Code. Network AnalysisDaVinci Code. Network Analysis
DaVinci Code. Network Analysis
 
Soviet Popular Music Landscape: Community Structure and Success Predictors
Soviet Popular Music Landscape: Community Structure and Success PredictorsSoviet Popular Music Landscape: Community Structure and Success Predictors
Soviet Popular Music Landscape: Community Structure and Success Predictors
 
C for Java programmers (part 2)
C for Java programmers (part 2)C for Java programmers (part 2)
C for Java programmers (part 2)
 

Recently uploaded

ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptxANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
RASHMI M G
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
frank0071
 
Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...
Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...
Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...
Sérgio Sacani
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
yqqaatn0
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
fafyfskhan251kmf
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
yqqaatn0
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
University of Maribor
 
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Studia Poinsotiana
 
Chapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisisChapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisis
tonzsalvador2222
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Ana Luísa Pinho
 
Toxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and ArsenicToxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and Arsenic
sanjana502982
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
SAMIR PANDA
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
Richard Gill
 
nodule formation by alisha dewangan.pptx
nodule formation by alisha dewangan.pptxnodule formation by alisha dewangan.pptx
nodule formation by alisha dewangan.pptx
alishadewangan1
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills MN
 
Orion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWSOrion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWS
Columbia Weather Systems
 
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Sérgio Sacani
 
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
Wasswaderrick3
 
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptxThe use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
MAGOTI ERNEST
 
Leaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdfLeaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdf
RenuJangid3
 

Recently uploaded (20)

ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptxANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptx
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
 
Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...
Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...
Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
 
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
 
Chapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisisChapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisis
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
 
Toxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and ArsenicToxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and Arsenic
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
 
nodule formation by alisha dewangan.pptx
nodule formation by alisha dewangan.pptxnodule formation by alisha dewangan.pptx
nodule formation by alisha dewangan.pptx
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
 
Orion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWSOrion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWS
 
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
 
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...
 
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptxThe use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptx
 
Leaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdfLeaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdf
 

The Pain of Complexity

  • 1. 1 The Pain of Complexity Dmitry Zinoviev Suffolk University, Boston
  • 2. 2 “Complexity” is one of those fuzzy concepts that everyone seems to understand differently. Other examples: sustainability, resilience, success... What Is Complexity?
  • 3. 3 Let's Ask the Mechanical Turk! ● Question: “Enter three nouns (please, nouns only!) that, to the best of your understanding, are associated with complexity. These words could be synonyms, descriptors, attributes of complexity, actions or any other related words.” ● Ask 100 mTurk workers, pay a nominal fee for an answer ● Reject non-nouns; stem* and aggregate nouns *We tried both “Porter” and “Lancaster” stemmers; “Porter” is less aggressive, it produced more stems (“motifs”); some manual tweaking was needed
  • 4. 4 Direct Survey Results ● The stems that were mentioned at least twice (in the order of decreasing frequency): – Most frequently mentioned (23+ times): COMPLIC*, DIFFICULTI*, INTRICACI* – Less frequently mentioned (2–9 times): PROBLEM*, ELABOR*, ENTANGL*, PUZZL*, MULTIPL*, COMPLEX*, COMPUT*, CONVOLUT*, HARD*, RAMIF*, SOPHIST*, CHALLENG*, HUMAN*, INVOLV*, LIFE*, POLIT*, RIDDL*, SCIENC*, COMPOSIT*, CONFUS*, DEPTH*, DESIGN*, DIVERS*, LABYRINTH*, LANGUAG*, MATH*, MAZE*, OBSCUR*, PHYSIC*, QUALITI*, RELATIONSHIP*, SPACE*, STRUCTURE*, TEST*, TRICKI*, TROUBL*, VARIABL*, VARIETI* – The highlighted stems bear strong emotional load—though, no pain yet!
  • 5. 5 Use Indirect Data ● Don't tell me who you are. “Tell me who your friends are, and I will tell you who you are.” ● Instead of asking people what they think “complexity” is, let's collect abundant implicit markers off the Internet.
  • 6. 6 Indirect Data: Possible Sources ● EBSCO keywords or subject tags (subscription and harvesting software required; we haz it, but the results may be too academic!) ● Blogging sites like LiveJournal (LJ) – LJ has individual blogs and community blogs (like forums) – Both types of blogs can and do have user- or moderator-declared interests – The interests are usually carefully chosen to reflect the blogger's/community's online identity – Free access, easy-to-write harvester
  • 7. 7 Raw Data ● All LiveJournal communities that list at least one of the following interests: – “complexity” – “complex systems” – “complexity theory” – “complexity theories” ● Found 59 communities, such as mixedtype, abstractthought, ivygreenfanclub, pdmi_logic, investors, gifted_teens, etc. ● Many more individual bloggers—we ignored them, their interest lists are way too broad! ● Selected 374 most frequently declared interests (the corpus)
  • 8. 8 Example: “Ecologists” community ● Community ecologists.livejournal.com ● 150 self-declared (by the moderator(s)) interests ● Includes “complexity,” but also many other keywords; are they relevant? Let's assume they are.
  • 9. 9 Term Vector Model ● Treat communities as documents and interests as words ● Calculate generalized similarity between words (and between communities—but why?) using Kovacs (2010) algorithm: – Two words are similar if they belong to similar documents – Two documents are similar if the consist of similar words ● Remark: generalized similarity, as defined by Kovacs, is essentially Pearson correlation in an oblique Cartesian coordinate space ● For any two words W and V from the corpus, -1 ≤ d(W,V) ≤ 1 is the similarity between the words; for any two communities C and D, -1 ≤ d(C,D) ≤ 1 is the similarity between the communities (a by-product, not needed)
  • 10. 10 Network Construction (1) ● Treat words as nodes in a network ● Treat similarities as edges if they are above T0 =0.65 (“slicing”); the choice of T0 is tricky and arbitrary: – If T0 is too high, the network is complete and not interesting – If T0 is too low, the network is sparse and disconnected ● Gephi it!
  • 11. 11 “Complexity Dragon” (a.k.a. the Mindscape of Complexity)
  • 12. 12 Modular Structure Modularity=0.56 (not great, but still visible) psychology, chaos, science, mathematics, complexity theory, ... philosophy, life, imagination, self-expression, knowledge, ... complexity, honesty, music, simplicity, love, poetry, creativity, empathy, humor, hate, ... writing, art, books, romance, drawing, ...
  • 13. 13 What Is the Meaning of Modules? ● We could just stare at the modules and try to come up with a suitable name— ● —or we could use crowdsourcing through Amazon Mechanical Turk again! Fragment of the “fireball”
  • 14. 14 Let's Ask the Mechanical Turk! ● Question: “Describe the following group of 50* words with a single most suitable word or a two-word or three-word phrase: ...” *There are only 36 terms in the lower left module. ● Ask 100 mTurk workers, pay a nominal fee for an answer ● Reject non-nouns; stem and aggregate nouns ● The nouns are module descriptors (“motifs”)
  • 15. 15 Network Construction (2) ● Treat original modules as documents and motifs as words ● Calculate generalized similarity ● Do slicing ● Build a network of stems ● Gephi it!
  • 16. 16 The Three Shades of Complexity ● The new network has a simple, but not trivial, structure, and is highly modular ● The Three Shades of Complexity: – Science/Technology – Society/Mind – Creativity/Emotions ● Connections: – via education – via life/humanities There are lines here, they are just too thin...
  • 17. 17 Semantic Spectrography mTurk for motif extraction and clustering Term source for mindscape construction Analysis term selection
  • 18. 18 Spectrography vs Direct Survey Direct Survey: 37 Spectrography: 382 4 9 4 104 111 113 37 24
  • 19. 19 Comparison Summary ● Positive: – Spectrography is much more detailed: it catches 41% of direct survey terms; direct survey catches only 4.5% of spectrography terms – Spectrography reveals structure ● Negative: – Spectrography requires a source (or sources) of terms
  • 20. 20 Successfully Used Elsewhere ● D. Zinoviev, D. Stefanescu, L. Swenson, and G. Fireman, “Semantic Networks of Interests in Online NSSI* Communities,” in Proc. Workshop “Words and Networks,” Evanston, IL, June 2012, published online (also submitted to Social Networks in 2013) ● D. Zinoviev and Z. Zhu, “Conceptual Structure of Sustainability: Social and Scholarly Perspectives,” Sunbelt XXXIV Social Networks Conference, St.-Pete Beach, FL, February 2014 (also submitted to Social Networks in 2014) *Non-Suicidal Self Injury—a common and epidemically spreading activity among adolescents and young adults
  • 21. 21 But Where Is the Pain? ● SE corner of the emotional module full of NSSI-specific terminology ● Communities: artificial_joy, humans_being (sic), the_addicted ● Complexity and creativity as attributes of human nature