SlideShare a Scribd company logo
1 of 36
Download to read offline
Social and Economic
Network Analysis
UNIT – III
SOCIAL NETWORK ANALYSIS
Overview
Strength of Weak
Ties
Community
Detection
20-04-2021 VANI KANDHASAMY, PSGTECH 2
Summary
20-04-2021 VANI KANDHASAMY, PSGTECH 3
Strength of Weak Ties
NETWORKS, CROWDS AND MARKETS - CHAPTER 3
20-04-2021 VANI KANDHASAMY, PSGTECH 4
Granovetter’s experiment
▪How do people find out about new jobs?
Ans: People find the information through personal contacts
▪But contacts were often acquaintances rather than close friends
Why is it that acquaintances are
most helpful?
20-04-2021 VANI KANDHASAMY, PSGTECH 5
Triadic Closure
Reasons for triadic closure:
If B and C have a friend D in common,
then:
▪B is more likely to meet C
(since they both spend time with D)
▪B and C trust each other
(since they have a friend in common)
▪D has incentive to bring B and C together
(since it is hard for D to maintain two disjoint
relationships)
20-04-2021 VANI KANDHASAMY, PSGTECH 6
Bridge Vs Local Bridge
20-04-2021 VANI KANDHASAMY, PSGTECH 7
Local Bridge – Global property
An edge joining two nodes A and B in a
graph is a local bridge if its endpoints A
and B have no friends in common –
deleting the edge would increase the
distance between A and B to a value
strictly more than 2.
▪Span of a local bridge is the distance
its endpoints would be from each
other if the edge were deleted
▪An edge is a local bridge when it does
not form the side of any triangle in the
graph
▪Brings new information / trend
20-04-2021 VANI KANDHASAMY, PSGTECH 8
Strong and Weak Ties – Local property
Friend–Acquaintance
dichotomy
Strong – Weak ties
20-04-2021 VANI KANDHASAMY, PSGTECH 9
Strong Triadic Closure property
▪If the node has strong ties to two neighbors, then these neighbors must have at
least a weak tie between them
20-04-2021 VANI KANDHASAMY, PSGTECH 10
Local Bridge & Weak Ties
If a node A in a network satisfies the Strong Triadic Closure property and is
involved in at least two strong ties, then any local bridge it is involved in must be
a weak tie
20-04-2021 VANI KANDHASAMY, PSGTECH 11
Strength of Weak Ties
Answer
Two perspectives on links/friendships:
▪Structural: Friendships span different
parts of the network
▪Interpersonal: Friendship between
two people is either strong or weak
Explanation
▪Structure: Local bridges spanning
different parts of the network are
socially weak
▪Information: Local bridge allow you to
gather information from different parts
of the network
20-04-2021 VANI KANDHASAMY, PSGTECH 12
Granovetter’s experiment
Granovetter’s theory leads to the following
conceptual picture of networks
▪Networks are composed of tightly connected
sets of nodes
▪Sets of nodes with lots of internal connections
and few external ones
▪ Communities
▪ Clusters
▪ Groups
▪ Modules
20-04-2021 VANI KANDHASAMY, PSGTECH 13
How to find network communities?
20-04-2021 VANI KANDHASAMY, PSGTECH 14
Community Detection
NETWORKS, CROWDS AND MARKETS - CHAPTER 3
20-04-2021 VANI KANDHASAMY, PSGTECH 15
Graph Partitioning
Input: Undirected graph 𝐺(𝑉, 𝐸)
Bi-partitioning task:
Output: Divide vertices into two disjoint groups 𝑨, 𝑩
Questions:
◦ How can we define a “good” partition of 𝑮?
◦ How can we efficiently identify such a partition?
1
3
2
5
4 6
A B
1
3
2
5
4
6
20-04-2021 VANI KANDHASAMY, PSGTECH 16
Graph Partitioning
What makes a good partition?
▪ Maximize the number of within-group
connections
▪ Minimize the number of between-group
connections
How to identify good partition?
▪Divisive methods – top down
approach
▪Agglomerative methods – bottom up
approach
17
1
3
2
5
4
6
A B
20-04-2021 VANI KANDHASAMY, PSGTECH
20-04-2021 VANI KANDHASAMY, PSGTECH 18
Community Detection – Divisive
Approach
2. What principles lead us to remove the 7-8
edge first?
1. Which edge will be removed first?
20-04-2021 VANI KANDHASAMY, PSGTECH 19
Community Detection – Divisive
Approach
Edge betweenness: Number of shortest paths passing over the edge
20-04-2021 VANI KANDHASAMY, PSGTECH 20
Community Detection – Divisive
Approach
20-04-2021 VANI KANDHASAMY, PSGTECH 21
Community Detection – Divisive
Approach
20-04-2021 VANI KANDHASAMY, PSGTECH 22
Community Detection – Divisive
Approach
20-04-2021 VANI KANDHASAMY, PSGTECH 23
20-04-2021 VANI KANDHASAMY, PSGTECH 24
Girvan-Newman Algorithm
▪Divisive hierarchical clustering based on the notion of edge betweenness
▪Undirected unweighted networks
▪Algorithm:
• Repeat until no edges are left:
o Calculate betweenness of edges
o Remove edges with highest betweenness
▪ Connected components are communities
▪ Gives a hierarchical decomposition of the network
[Girvan-Newman ‘02]
20-04-2021 VANI KANDHASAMY, PSGTECH 25
Step 1: Step 2:
Step 3: Hierarchical network decomposition:
20-04-2021 VANI KANDHASAMY, PSGTECH 26
Girvan-Newman Algorithm
Zachary’s Karate club:
Hierarchical decomposition
20-04-2021 VANI KANDHASAMY, PSGTECH 27
We need to resolve 2
questions
1. HOW TO COMPUTE BETWEENNESS?
2. HOW TO SELECT THE NUMBER OF CLUSTERS?
20-04-2021 VANI KANDHASAMY, PSGTECH 28
How to Compute Betweenness?
Want to compute
betweenness of paths
starting at node 𝐴
Step 1: Breath first
search starting from 𝐴
0
1
2
3
4
20-04-2021 VANI KANDHASAMY, PSGTECH 29
How to Compute Betweenness?
Step 2: Count the number of shortest paths from 𝐴 to all other nodes of the network:
20-04-2021 VANI KANDHASAMY, PSGTECH 30
How to Compute Betweenness?
1 path to K.
Split evenly
1+0.5 paths to J
Split 1:2
1+1 paths to H
Split evenly
Algorithm:
•Add edge flows:
-- node flow = 1+∑child edges
-- split the flow up based on the parent value
• Repeat the BFS procedure for each starting node
𝑈
Step 3: Determine the amount of flow from A to all other nodes that use each edge
20-04-2021 VANI KANDHASAMY, PSGTECH 31
How to select the number of clusters?
Define: Modularity 𝑸
A measure of how well a network is partitioned into communities
Given a partitioning of the network into groups 𝒔  𝑺:
Q  ∑s S [ (# edges within group s) – (expected # edges within group s) ]
Null / Erdos-Renyi model
20-04-2021 VANI KANDHASAMY, PSGTECH 32
Modularity values take range [−1,1]
0.3-0.7<Q means significant community structure
20-04-2021 VANI KANDHASAMY, PSGTECH 33
Modularity: Number of clusters
Q
20-04-2021 VANI KANDHASAMY, PSGTECH 34
Community Detection – Agglomerative
Approach
▪Modularity optimization is NP Hard
▪Greedy Heuristic - Trivial clustering with each node in its own cluster
▪Repeat:
▪ Merge the two clusters that will increase the modularity by the largest amount
▪ Stop when all merges would reduce the modularity
20-04-2021 VANI KANDHASAMY, PSGTECH 35
Step 1: Step 2:
Step 3: Step 4:
20-04-2021 VANI KANDHASAMY, PSGTECH 36

More Related Content

Similar to Community detection-Part1

Clique-based Network Clustering
Clique-based Network ClusteringClique-based Network Clustering
Clique-based Network Clustering
Guang Ouyang
 
Abhishek presentation october 2013
Abhishek presentation october 2013Abhishek presentation october 2013
Abhishek presentation october 2013
Pratik Narang
 
Combining a co-occurrence-based and a semantic measure for entity linking
Combining a co-occurrence-based and a semantic measure for entity linkingCombining a co-occurrence-based and a semantic measure for entity linking
Combining a co-occurrence-based and a semantic measure for entity linking
Besnik Fetahu
 
A Proposed Algorithm to Detect the Largest Community Based On Depth Level
A Proposed Algorithm to Detect the Largest Community Based On Depth LevelA Proposed Algorithm to Detect the Largest Community Based On Depth Level
A Proposed Algorithm to Detect the Largest Community Based On Depth Level
Eswar Publications
 
An Algorithm for Bayesian Network Construction from Data
An Algorithm for Bayesian Network Construction from DataAn Algorithm for Bayesian Network Construction from Data
An Algorithm for Bayesian Network Construction from Data
butest
 

Similar to Community detection-Part1 (20)

Esa2020
Esa2020Esa2020
Esa2020
 
Avi-newmans_fast_community_detection.pptx
Avi-newmans_fast_community_detection.pptxAvi-newmans_fast_community_detection.pptx
Avi-newmans_fast_community_detection.pptx
 
Clique-based Network Clustering
Clique-based Network ClusteringClique-based Network Clustering
Clique-based Network Clustering
 
community Detection.pptx
community Detection.pptxcommunity Detection.pptx
community Detection.pptx
 
Content-based link prediction
Content-based link predictionContent-based link prediction
Content-based link prediction
 
Abhishek presentation october 2013
Abhishek presentation october 2013Abhishek presentation october 2013
Abhishek presentation october 2013
 
Fundamentals of network performance engineering
Fundamentals of network performance engineeringFundamentals of network performance engineering
Fundamentals of network performance engineering
 
What Is the Added Value of Negative Links in Online Social Networks?
What Is the Added Value of Negative Links in Online Social Networks?What Is the Added Value of Negative Links in Online Social Networks?
What Is the Added Value of Negative Links in Online Social Networks?
 
Graph Data Science DEMO for fraud analysis
Graph Data Science DEMO for fraud analysisGraph Data Science DEMO for fraud analysis
Graph Data Science DEMO for fraud analysis
 
Combining a co-occurrence-based and a semantic measure for entity linking
Combining a co-occurrence-based and a semantic measure for entity linkingCombining a co-occurrence-based and a semantic measure for entity linking
Combining a co-occurrence-based and a semantic measure for entity linking
 
Higher-order clustering coefficients
Higher-order clustering coefficientsHigher-order clustering coefficients
Higher-order clustering coefficients
 
Social Network Analysis: What It Is, Why We Should Care, and What We Can Lear...
Social Network Analysis: What It Is, Why We Should Care, and What We Can Lear...Social Network Analysis: What It Is, Why We Should Care, and What We Can Lear...
Social Network Analysis: What It Is, Why We Should Care, and What We Can Lear...
 
IRJET - Exploring Agglomerative Spectral Clustering Technique Employed for...
IRJET - 	  Exploring Agglomerative Spectral Clustering Technique Employed for...IRJET - 	  Exploring Agglomerative Spectral Clustering Technique Employed for...
IRJET - Exploring Agglomerative Spectral Clustering Technique Employed for...
 
A New VNE Method for More Responsive Networking in Many-to-Many Groups
A New VNE Method for More Responsive Networking in Many-to-Many GroupsA New VNE Method for More Responsive Networking in Many-to-Many Groups
A New VNE Method for More Responsive Networking in Many-to-Many Groups
 
Building Identity Graphs over Heterogeneous Data
Building Identity Graphs over Heterogeneous DataBuilding Identity Graphs over Heterogeneous Data
Building Identity Graphs over Heterogeneous Data
 
Community Detection with Networkx
Community Detection with NetworkxCommunity Detection with Networkx
Community Detection with Networkx
 
Challenges for BdREN in COVID Environment
Challenges for BdREN in COVID EnvironmentChallenges for BdREN in COVID Environment
Challenges for BdREN in COVID Environment
 
A Proposed Algorithm to Detect the Largest Community Based On Depth Level
A Proposed Algorithm to Detect the Largest Community Based On Depth LevelA Proposed Algorithm to Detect the Largest Community Based On Depth Level
A Proposed Algorithm to Detect the Largest Community Based On Depth Level
 
An Algorithm for Bayesian Network Construction from Data
An Algorithm for Bayesian Network Construction from DataAn Algorithm for Bayesian Network Construction from Data
An Algorithm for Bayesian Network Construction from Data
 
Can a blockchain solve the trust problem?
Can a blockchain solve the trust problem?Can a blockchain solve the trust problem?
Can a blockchain solve the trust problem?
 

More from Vani Kandhasamy

More from Vani Kandhasamy (8)

Java Basics - Part2
Java Basics - Part2Java Basics - Part2
Java Basics - Part2
 
Java Basics - Part1
Java Basics - Part1Java Basics - Part1
Java Basics - Part1
 
Introduction to OOP
Introduction to OOPIntroduction to OOP
Introduction to OOP
 
Economic network analysis - Part 2
Economic network analysis - Part 2Economic network analysis - Part 2
Economic network analysis - Part 2
 
Economic network analysis - Part 1
Economic network analysis - Part 1Economic network analysis - Part 1
Economic network analysis - Part 1
 
Cascading behavior in the networks
Cascading behavior in the networksCascading behavior in the networks
Cascading behavior in the networks
 
Link Analysis
Link AnalysisLink Analysis
Link Analysis
 
Cache optimization
Cache optimizationCache optimization
Cache optimization
 

Recently uploaded

FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
MarinCaroMartnezBerg
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
shivangimorya083
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
shivangimorya083
 
Determinants of health, dimensions of health, positive health and spectrum of...
Determinants of health, dimensions of health, positive health and spectrum of...Determinants of health, dimensions of health, positive health and spectrum of...
Determinants of health, dimensions of health, positive health and spectrum of...
shambhavirathore45
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
amitlee9823
 

Recently uploaded (20)

FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
 
Determinants of health, dimensions of health, positive health and spectrum of...
Determinants of health, dimensions of health, positive health and spectrum of...Determinants of health, dimensions of health, positive health and spectrum of...
Determinants of health, dimensions of health, positive health and spectrum of...
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
Sampling (random) method and Non random.ppt
Sampling (random) method and Non random.pptSampling (random) method and Non random.ppt
Sampling (random) method and Non random.ppt
 
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
 
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxBPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptx
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFx
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 

Community detection-Part1

  • 1. Social and Economic Network Analysis UNIT – III SOCIAL NETWORK ANALYSIS
  • 4. Strength of Weak Ties NETWORKS, CROWDS AND MARKETS - CHAPTER 3 20-04-2021 VANI KANDHASAMY, PSGTECH 4
  • 5. Granovetter’s experiment ▪How do people find out about new jobs? Ans: People find the information through personal contacts ▪But contacts were often acquaintances rather than close friends Why is it that acquaintances are most helpful? 20-04-2021 VANI KANDHASAMY, PSGTECH 5
  • 6. Triadic Closure Reasons for triadic closure: If B and C have a friend D in common, then: ▪B is more likely to meet C (since they both spend time with D) ▪B and C trust each other (since they have a friend in common) ▪D has incentive to bring B and C together (since it is hard for D to maintain two disjoint relationships) 20-04-2021 VANI KANDHASAMY, PSGTECH 6
  • 7. Bridge Vs Local Bridge 20-04-2021 VANI KANDHASAMY, PSGTECH 7
  • 8. Local Bridge – Global property An edge joining two nodes A and B in a graph is a local bridge if its endpoints A and B have no friends in common – deleting the edge would increase the distance between A and B to a value strictly more than 2. ▪Span of a local bridge is the distance its endpoints would be from each other if the edge were deleted ▪An edge is a local bridge when it does not form the side of any triangle in the graph ▪Brings new information / trend 20-04-2021 VANI KANDHASAMY, PSGTECH 8
  • 9. Strong and Weak Ties – Local property Friend–Acquaintance dichotomy Strong – Weak ties 20-04-2021 VANI KANDHASAMY, PSGTECH 9
  • 10. Strong Triadic Closure property ▪If the node has strong ties to two neighbors, then these neighbors must have at least a weak tie between them 20-04-2021 VANI KANDHASAMY, PSGTECH 10
  • 11. Local Bridge & Weak Ties If a node A in a network satisfies the Strong Triadic Closure property and is involved in at least two strong ties, then any local bridge it is involved in must be a weak tie 20-04-2021 VANI KANDHASAMY, PSGTECH 11
  • 12. Strength of Weak Ties Answer Two perspectives on links/friendships: ▪Structural: Friendships span different parts of the network ▪Interpersonal: Friendship between two people is either strong or weak Explanation ▪Structure: Local bridges spanning different parts of the network are socially weak ▪Information: Local bridge allow you to gather information from different parts of the network 20-04-2021 VANI KANDHASAMY, PSGTECH 12
  • 13. Granovetter’s experiment Granovetter’s theory leads to the following conceptual picture of networks ▪Networks are composed of tightly connected sets of nodes ▪Sets of nodes with lots of internal connections and few external ones ▪ Communities ▪ Clusters ▪ Groups ▪ Modules 20-04-2021 VANI KANDHASAMY, PSGTECH 13
  • 14. How to find network communities? 20-04-2021 VANI KANDHASAMY, PSGTECH 14
  • 15. Community Detection NETWORKS, CROWDS AND MARKETS - CHAPTER 3 20-04-2021 VANI KANDHASAMY, PSGTECH 15
  • 16. Graph Partitioning Input: Undirected graph 𝐺(𝑉, 𝐸) Bi-partitioning task: Output: Divide vertices into two disjoint groups 𝑨, 𝑩 Questions: ◦ How can we define a “good” partition of 𝑮? ◦ How can we efficiently identify such a partition? 1 3 2 5 4 6 A B 1 3 2 5 4 6 20-04-2021 VANI KANDHASAMY, PSGTECH 16
  • 17. Graph Partitioning What makes a good partition? ▪ Maximize the number of within-group connections ▪ Minimize the number of between-group connections How to identify good partition? ▪Divisive methods – top down approach ▪Agglomerative methods – bottom up approach 17 1 3 2 5 4 6 A B 20-04-2021 VANI KANDHASAMY, PSGTECH
  • 19. Community Detection – Divisive Approach 2. What principles lead us to remove the 7-8 edge first? 1. Which edge will be removed first? 20-04-2021 VANI KANDHASAMY, PSGTECH 19
  • 20. Community Detection – Divisive Approach Edge betweenness: Number of shortest paths passing over the edge 20-04-2021 VANI KANDHASAMY, PSGTECH 20
  • 21. Community Detection – Divisive Approach 20-04-2021 VANI KANDHASAMY, PSGTECH 21
  • 22. Community Detection – Divisive Approach 20-04-2021 VANI KANDHASAMY, PSGTECH 22
  • 23. Community Detection – Divisive Approach 20-04-2021 VANI KANDHASAMY, PSGTECH 23
  • 25. Girvan-Newman Algorithm ▪Divisive hierarchical clustering based on the notion of edge betweenness ▪Undirected unweighted networks ▪Algorithm: • Repeat until no edges are left: o Calculate betweenness of edges o Remove edges with highest betweenness ▪ Connected components are communities ▪ Gives a hierarchical decomposition of the network [Girvan-Newman ‘02] 20-04-2021 VANI KANDHASAMY, PSGTECH 25
  • 26. Step 1: Step 2: Step 3: Hierarchical network decomposition: 20-04-2021 VANI KANDHASAMY, PSGTECH 26
  • 27. Girvan-Newman Algorithm Zachary’s Karate club: Hierarchical decomposition 20-04-2021 VANI KANDHASAMY, PSGTECH 27
  • 28. We need to resolve 2 questions 1. HOW TO COMPUTE BETWEENNESS? 2. HOW TO SELECT THE NUMBER OF CLUSTERS? 20-04-2021 VANI KANDHASAMY, PSGTECH 28
  • 29. How to Compute Betweenness? Want to compute betweenness of paths starting at node 𝐴 Step 1: Breath first search starting from 𝐴 0 1 2 3 4 20-04-2021 VANI KANDHASAMY, PSGTECH 29
  • 30. How to Compute Betweenness? Step 2: Count the number of shortest paths from 𝐴 to all other nodes of the network: 20-04-2021 VANI KANDHASAMY, PSGTECH 30
  • 31. How to Compute Betweenness? 1 path to K. Split evenly 1+0.5 paths to J Split 1:2 1+1 paths to H Split evenly Algorithm: •Add edge flows: -- node flow = 1+∑child edges -- split the flow up based on the parent value • Repeat the BFS procedure for each starting node 𝑈 Step 3: Determine the amount of flow from A to all other nodes that use each edge 20-04-2021 VANI KANDHASAMY, PSGTECH 31
  • 32. How to select the number of clusters? Define: Modularity 𝑸 A measure of how well a network is partitioned into communities Given a partitioning of the network into groups 𝒔  𝑺: Q  ∑s S [ (# edges within group s) – (expected # edges within group s) ] Null / Erdos-Renyi model 20-04-2021 VANI KANDHASAMY, PSGTECH 32
  • 33. Modularity values take range [−1,1] 0.3-0.7<Q means significant community structure 20-04-2021 VANI KANDHASAMY, PSGTECH 33
  • 34. Modularity: Number of clusters Q 20-04-2021 VANI KANDHASAMY, PSGTECH 34
  • 35. Community Detection – Agglomerative Approach ▪Modularity optimization is NP Hard ▪Greedy Heuristic - Trivial clustering with each node in its own cluster ▪Repeat: ▪ Merge the two clusters that will increase the modularity by the largest amount ▪ Stop when all merges would reduce the modularity 20-04-2021 VANI KANDHASAMY, PSGTECH 35
  • 36. Step 1: Step 2: Step 3: Step 4: 20-04-2021 VANI KANDHASAMY, PSGTECH 36