Resolution-free community detection

Vincent Traag
Vincent TraagResearcher at CWTS
Community Detection Resolution Limit Definition of resolution-free Results
Resolution-free community detection
V.A. Traag1, P. Van Dooren1, Y.E. Nesterov2
1ICTEAM
Universit´e Catholique de Louvain
2CORE
Universit´e Catholique de Louvain
8 April 2011
Community Detection Resolution Limit Definition of resolution-free Results
Outline
1 Community Detection
2 Resolution Limit
3 Definition of resolution-free
4 Results
Community Detection Resolution Limit Definition of resolution-free Results
Community Detection
• Detect ‘natural’ communities in network.
• Modularity approach: ‘relatively’ many links inside communities
Community Detection Resolution Limit Definition of resolution-free Results
Community Detection (formal)
• In general, commmunities should have relatively
many present links (benefit),
few missing links (cost)
Minimize H = −
ij
(aij Aij − bij (1 − Aij ))δ(σi , σj ),
• Compare to random null-model pij (RB)
aij = wij − bij and bij = γRBpij
HRB = −
ij
(Aij wij − γRBpij )δ(σi , σj ).
• Modularity (NG): use configuration null model
pij =
ki kj
2m
.
Reichardt and Bornholdt. Phys Rev E (2006) 74:1,016110
Newman and Girvan. Phys Rev E (2004) 69:2,026113
Community Detection Resolution Limit Definition of resolution-free Results
Resolution limit
• Modularity might miss ‘small’ communities.
• Merge two cliques in ring of cliques when
γRB <
q
nc(nc − 1) + 2
.
• Depends on the total size of the graph.
• Number of communities scales as
√
γRBm.
• For general null model, problem remains
since ij pij = 2m.
Fortunato and Barthlemy PNAS (2007) 104:1, pp. 36
Kumpala et al. Eur Phys J B (2007) 56, pp. 41-45
Community Detection Resolution Limit Definition of resolution-free Results
Evading the resolution limit
• New model (RN) suggested
aij = wij
bij = γRN
HRN = −
ij
(Aij (wij + γRN) − γRN)δ(σi , σj ).
• Claim: no resolution limit, as merge depends only on ‘local’
variables
γRN <
1
n2
c − 1
.
• But, take pij = ki kj (rescale γRB by 2m), we obtain
γRB <
1
2(nc(nc − 1) + 2)2
,
also only ‘local’ variables. Hence, also no resolution limit?
Ronhovde and Nussinov. Phys Rev E (2010) 81:4,046114.
Community Detection Resolution Limit Definition of resolution-free Results
Problems remain
Subgraph
• Assume pij = ki kj (rescale γRB by 2m)
• Then separate in large graph when γRB >
1
2(nc(nc − 1) + 2)2
• But merged in subgraph when γRB <
1
2(nc(nc − 1) + 1)2
Community Detection Resolution Limit Definition of resolution-free Results
Resolution limit revisited
Resolution-limit
Resolution-free
• Problem is not merging per s´e.
• Rather, cliques separate in subgraph, but merge in large graph
(or vice versa).
• Suggests following definition.
Community Detection Resolution Limit Definition of resolution-free Results
Resolution limit revisited
Resolution-limit
Resolution-free
Definition (Resolution-free)
Objective function H is called resolution-free if, whenever partition
C optimal for G, then subpartition D ⊂ C also optimal for
subgraph H(D) ⊂ G induced by D.
Community Detection Resolution Limit Definition of resolution-free Results
Defining resolution-free
Definition (Resolution-free)
Objective function H is called resolution-free if, whenever partition
C optimal for G, then subpartition D ⊂ C also optimal for
subgraph H(D) ⊂ G induced by D.
• Implicitly defines resolution limit: method is not resolution-free.
• Some nice properties of resolution-free methods:
Replace optimal subpartitions
Never split cliques (unless in single nodes)
Main questions
• Do such methods exist?
• What conditions to impose?
Community Detection Resolution Limit Definition of resolution-free Results
General framework
General community detection
H = −
ij
(aij Aij − bij (1 − Aij ))δ(σi , σj ),
RB model Set aij = wij − bij , bij = γRBpij .
RN model Set aij = wij , bij = γRN.
Simpler alternative
CPM Set aij = wij − bij and bij = γ. Leads to
H = −
ij
(Aij wij − γ)δ(σi , σj ).
Clear interpretation: γ is minimum density of a community
H = −
c
ec − γn2
c.
Community Detection Resolution Limit Definition of resolution-free Results
Main result
Do resolution-free methods exists?
Yes: Both RN and CPM are resolution-free, results from general
theorem.
What conditions to impose?
Sufficient condition: aij and bij should be ‘local’.
Definition (Local weights)
Weights aij , bij called local whenever for every subgraph H ⊂ G,
weights remain similar, i.e. aij (G) ∼ aij (H) and bij (G) ∼ bij (H).
• Implies local weigths aij and bij can only depend on node i and
node j, nothing further.
• RN and CPM use local weights, hence resolution-free.
• Not necessary condition, but seem to be few exceptions.
• So, RN and CPM (almost) only sensible definitions.
Community Detection Resolution Limit Definition of resolution-free Results
Performance (directed networks)
µ0 0.2 0.4 0.6 0.8 1.0
NMI
0.25
0.5
0.75
1
CPM Infomap Modularity ER
n = 103
n = 104
Community Detection Resolution Limit Definition of resolution-free Results
Conclusions
• Provided definition of resolution-free.
• Methods using local weights are resolution-free.
• Clarifies link between ‘local’ methods and resolution limit.
• Only few resolution-free methods.
• Tested CPM, performs superbly.
Thank you for your attention.
Questions?
Traag, Van Dooren and Nesterov arXiv:1104.3083v1
1 of 14

Recommended

Deblurring of Digital Image PPT by
Deblurring of Digital Image PPTDeblurring of Digital Image PPT
Deblurring of Digital Image PPTSyed Atif Naseem
2.4K views11 slides
Realism of image composits by
Realism of image compositsRealism of image composits
Realism of image compositsAliya Ibragimova
281 views35 slides
A Richardson-Lucy Algorithm Using a Varying Point Spread Function Along the I... by
A Richardson-Lucy Algorithm Using a Varying Point Spread Function Along the I...A Richardson-Lucy Algorithm Using a Varying Point Spread Function Along the I...
A Richardson-Lucy Algorithm Using a Varying Point Spread Function Along the I...CSCJournals
77 views22 slides
Image pre processing-restoration by
Image pre processing-restorationImage pre processing-restoration
Image pre processing-restorationAshish Kumar
7.2K views27 slides
Iaetsd deblurring of noisy or blurred by
Iaetsd deblurring of noisy or blurredIaetsd deblurring of noisy or blurred
Iaetsd deblurring of noisy or blurredIaetsd Iaetsd
661 views7 slides
Color image processing Presentation by
Color image processing PresentationColor image processing Presentation
Color image processing PresentationRevanth Chimmani
17.9K views71 slides

More Related Content

What's hot

Colorization with total variantion regularization by
Colorization with total variantion regularizationColorization with total variantion regularization
Colorization with total variantion regularizationJÚLIO PEIXOTO
293 views25 slides
Image restoration by
Image restorationImage restoration
Image restorationAzad Singh
2.6K views26 slides
Frequency Domain Image Enhancement Techniques by
Frequency Domain Image Enhancement TechniquesFrequency Domain Image Enhancement Techniques
Frequency Domain Image Enhancement TechniquesDiwaker Pant
54.8K views38 slides
The Impact of Color Space and Intensity Normalization to Face Detection Perfo... by
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...TELKOMNIKA JOURNAL
10 views6 slides
The application of image enhancement in color and grayscale images by
The application of image enhancement in color and grayscale imagesThe application of image enhancement in color and grayscale images
The application of image enhancement in color and grayscale imagesNisar Ahmed Rana
10.2K views15 slides
Canny edge detection by
Canny edge detectionCanny edge detection
Canny edge detectionahmedkhaledfayez
1.1K views14 slides

What's hot(7)

Colorization with total variantion regularization by JÚLIO PEIXOTO
Colorization with total variantion regularizationColorization with total variantion regularization
Colorization with total variantion regularization
JÚLIO PEIXOTO293 views
Image restoration by Azad Singh
Image restorationImage restoration
Image restoration
Azad Singh2.6K views
Frequency Domain Image Enhancement Techniques by Diwaker Pant
Frequency Domain Image Enhancement TechniquesFrequency Domain Image Enhancement Techniques
Frequency Domain Image Enhancement Techniques
Diwaker Pant54.8K views
The Impact of Color Space and Intensity Normalization to Face Detection Perfo... by TELKOMNIKA JOURNAL
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The application of image enhancement in color and grayscale images by Nisar Ahmed Rana
The application of image enhancement in color and grayscale imagesThe application of image enhancement in color and grayscale images
The application of image enhancement in color and grayscale images
Nisar Ahmed Rana10.2K views
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSION by sipij
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSIONNEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSION
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSION
sipij23 views

Similar to Resolution-free community detection

Community structure in complex networks by
Community structure in complex networksCommunity structure in complex networks
Community structure in complex networksVincent Traag
907 views48 slides
riken-RBlur-slides.pptx by
riken-RBlur-slides.pptxriken-RBlur-slides.pptx
riken-RBlur-slides.pptxMuhammadAhmedShah2
3 views46 slides
[KHBM] Application of network analysis based on cortical thickness to obsessi... by
[KHBM] Application of network analysis based on cortical thickness to obsessi...[KHBM] Application of network analysis based on cortical thickness to obsessi...
[KHBM] Application of network analysis based on cortical thickness to obsessi...Seung-Goo Kim
938 views43 slides
ilp-nlp-slides.pdf by
ilp-nlp-slides.pdfilp-nlp-slides.pdf
ilp-nlp-slides.pdfFlorentBersani
1 view59 slides
Graph Analysis Beyond Linear Algebra by
Graph Analysis Beyond Linear AlgebraGraph Analysis Beyond Linear Algebra
Graph Analysis Beyond Linear AlgebraJason Riedy
647 views34 slides
Collision Detection In 3D Environments by
Collision Detection In 3D EnvironmentsCollision Detection In 3D Environments
Collision Detection In 3D EnvironmentsUng-Su Lee
4.3K views57 slides

Similar to Resolution-free community detection(20)

Community structure in complex networks by Vincent Traag
Community structure in complex networksCommunity structure in complex networks
Community structure in complex networks
Vincent Traag907 views
[KHBM] Application of network analysis based on cortical thickness to obsessi... by Seung-Goo Kim
[KHBM] Application of network analysis based on cortical thickness to obsessi...[KHBM] Application of network analysis based on cortical thickness to obsessi...
[KHBM] Application of network analysis based on cortical thickness to obsessi...
Seung-Goo Kim938 views
Graph Analysis Beyond Linear Algebra by Jason Riedy
Graph Analysis Beyond Linear AlgebraGraph Analysis Beyond Linear Algebra
Graph Analysis Beyond Linear Algebra
Jason Riedy647 views
Collision Detection In 3D Environments by Ung-Su Lee
Collision Detection In 3D EnvironmentsCollision Detection In 3D Environments
Collision Detection In 3D Environments
Ung-Su Lee4.3K views
columbus15_cattaneo.pdf by AhmadM65
columbus15_cattaneo.pdfcolumbus15_cattaneo.pdf
columbus15_cattaneo.pdf
AhmadM652 views
icml2004 tutorial on spectral clustering part I by zukun
icml2004 tutorial on spectral clustering part Iicml2004 tutorial on spectral clustering part I
icml2004 tutorial on spectral clustering part I
zukun1.1K views
Constraints and Global Optimization for Gene Prediction Overlap Resolution by Christian Have
Constraints and Global Optimization for Gene Prediction Overlap ResolutionConstraints and Global Optimization for Gene Prediction Overlap Resolution
Constraints and Global Optimization for Gene Prediction Overlap Resolution
Christian Have630 views
On clusteredsteinertree slide-ver 1.1 by VitAnhNguyn94
On clusteredsteinertree slide-ver 1.1On clusteredsteinertree slide-ver 1.1
On clusteredsteinertree slide-ver 1.1
VitAnhNguyn9479 views
Methods of Manifold Learning for Dimension Reduction of Large Data Sets by Ryan B Harvey, CSDP, CSM
Methods of Manifold Learning for Dimension Reduction of Large Data SetsMethods of Manifold Learning for Dimension Reduction of Large Data Sets
Methods of Manifold Learning for Dimension Reduction of Large Data Sets
Asymmetric multipartite GHZ states and Bell inequalities by Darwin Gosal
Asymmetric multipartite GHZ states and Bell inequalitiesAsymmetric multipartite GHZ states and Bell inequalities
Asymmetric multipartite GHZ states and Bell inequalities
Darwin Gosal352 views

More from Vincent Traag

Peer review uncertainty at the institutional level by
Peer review uncertainty at the institutional levelPeer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelVincent Traag
233 views12 slides
Replacing peer review by metrics in the UK REF? by
Replacing peer review by metrics in the UK REF?Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Vincent Traag
288 views18 slides
Use of the journal impact factor for assessing individual articles need not b... by
Use of the journal impact factor for assessing individual articles need not b...Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Vincent Traag
161 views13 slides
Uncovering important intermediate publications by
Uncovering important intermediate publicationsUncovering important intermediate publications
Uncovering important intermediate publicationsVincent Traag
182 views19 slides
Complex contagion of campaign donations by
Complex contagion of campaign donationsComplex contagion of campaign donations
Complex contagion of campaign donationsVincent Traag
450 views10 slides
Polarization and consensus in citation networks by
Polarization and consensus in citation networksPolarization and consensus in citation networks
Polarization and consensus in citation networksVincent Traag
801 views50 slides

More from Vincent Traag(20)

Peer review uncertainty at the institutional level by Vincent Traag
Peer review uncertainty at the institutional levelPeer review uncertainty at the institutional level
Peer review uncertainty at the institutional level
Vincent Traag233 views
Replacing peer review by metrics in the UK REF? by Vincent Traag
Replacing peer review by metrics in the UK REF?Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?
Vincent Traag288 views
Use of the journal impact factor for assessing individual articles need not b... by Vincent Traag
Use of the journal impact factor for assessing individual articles need not b...Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...
Vincent Traag161 views
Uncovering important intermediate publications by Vincent Traag
Uncovering important intermediate publicationsUncovering important intermediate publications
Uncovering important intermediate publications
Vincent Traag182 views
Complex contagion of campaign donations by Vincent Traag
Complex contagion of campaign donationsComplex contagion of campaign donations
Complex contagion of campaign donations
Vincent Traag450 views
Polarization and consensus in citation networks by Vincent Traag
Polarization and consensus in citation networksPolarization and consensus in citation networks
Polarization and consensus in citation networks
Vincent Traag801 views
Introduction to complex networks by Vincent Traag
Introduction to complex networksIntroduction to complex networks
Introduction to complex networks
Vincent Traag2.1K views
Public thesis defence: groups and reputation in social networks by Vincent Traag
Public thesis defence: groups and reputation in social networksPublic thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networks
Vincent Traag607 views
Structure of media attention by Vincent Traag
Structure of media attentionStructure of media attention
Structure of media attention
Vincent Traag783 views
Dynamics of Media Attention by Vincent Traag
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media Attention
Vincent Traag693 views
Dynamical Models Explaining Social Balance by Vincent Traag
Dynamical Models Explaining Social BalanceDynamical Models Explaining Social Balance
Dynamical Models Explaining Social Balance
Vincent Traag270 views
Significant scales in community structure by Vincent Traag
Significant scales in community structureSignificant scales in community structure
Significant scales in community structure
Vincent Traag634 views
Reconstructing Third World Elite Rotation Events from Newspapers by Vincent Traag
Reconstructing Third World Elite Rotation Events from NewspapersReconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from Newspapers
Vincent Traag8K views
Reputation Dynamics Through Gossiping by Vincent Traag
Reputation Dynamics Through GossipingReputation Dynamics Through Gossiping
Reputation Dynamics Through Gossiping
Vincent Traag385 views
Limits of community detection by Vincent Traag
Limits of community detectionLimits of community detection
Limits of community detection
Vincent Traag1.4K views
Cooperation, Reputation & Gossiping by Vincent Traag
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
Vincent Traag563 views
Cooperation, Reputation & Gossiping by Vincent Traag
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
Vincent Traag292 views
Exponential Ranking: Taking into account negative links. by Vincent Traag
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.
Vincent Traag531 views
Cooperation, Reputation & Gossiping by Vincent Traag
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
Vincent Traag374 views

Recently uploaded

DATABASE MANAGEMENT SYSTEM by
DATABASE MANAGEMENT SYSTEMDATABASE MANAGEMENT SYSTEM
DATABASE MANAGEMENT SYSTEMDr. GOPINATH D
5 views50 slides
A training, certification and marketing scheme for informal dairy vendors in ... by
A training, certification and marketing scheme for informal dairy vendors in ...A training, certification and marketing scheme for informal dairy vendors in ...
A training, certification and marketing scheme for informal dairy vendors in ...ILRI
8 views13 slides
domestic waste_100013.pptx by
domestic waste_100013.pptxdomestic waste_100013.pptx
domestic waste_100013.pptxpadmasriv25
10 views17 slides
SANJAY HPLC.pptx by
SANJAY HPLC.pptxSANJAY HPLC.pptx
SANJAY HPLC.pptxsanjayudps2016
128 views38 slides
journal of engineering and applied science.pdf by
journal of engineering and applied science.pdfjournal of engineering and applied science.pdf
journal of engineering and applied science.pdfKSAravindSrivastava
7 views7 slides
Chromatography ppt.pptx by
Chromatography ppt.pptxChromatography ppt.pptx
Chromatography ppt.pptxvarshachandgudesvpm
15 views1 slide

Recently uploaded(20)

A training, certification and marketing scheme for informal dairy vendors in ... by ILRI
A training, certification and marketing scheme for informal dairy vendors in ...A training, certification and marketing scheme for informal dairy vendors in ...
A training, certification and marketing scheme for informal dairy vendors in ...
ILRI8 views
domestic waste_100013.pptx by padmasriv25
domestic waste_100013.pptxdomestic waste_100013.pptx
domestic waste_100013.pptx
padmasriv2510 views
Ethical issues associated with Genetically Modified Crops and Genetically Mod... by PunithKumars6
Ethical issues associated with Genetically Modified Crops and Genetically Mod...Ethical issues associated with Genetically Modified Crops and Genetically Mod...
Ethical issues associated with Genetically Modified Crops and Genetically Mod...
PunithKumars618 views
Distinct distributions of elliptical and disk galaxies across the Local Super... by Sérgio Sacani
Distinct distributions of elliptical and disk galaxies across the Local Super...Distinct distributions of elliptical and disk galaxies across the Local Super...
Distinct distributions of elliptical and disk galaxies across the Local Super...
Sérgio Sacani30 views
ENTOMOLOGY PPT ON BOMBYCIDAE AND SATURNIIDAE.pptx by MN
ENTOMOLOGY PPT ON BOMBYCIDAE AND SATURNIIDAE.pptxENTOMOLOGY PPT ON BOMBYCIDAE AND SATURNIIDAE.pptx
ENTOMOLOGY PPT ON BOMBYCIDAE AND SATURNIIDAE.pptx
MN6 views
RemeOs science and clinical evidence by PetrusViitanen1
RemeOs science and clinical evidenceRemeOs science and clinical evidence
RemeOs science and clinical evidence
PetrusViitanen114 views
EVALUATION OF HEPATOPROTECTIVE ACTIVITY OF SALIX SUBSERRATA IN PARACETAMOL IN... by gynomark
EVALUATION OF HEPATOPROTECTIVE ACTIVITY OF SALIX SUBSERRATA IN PARACETAMOL IN...EVALUATION OF HEPATOPROTECTIVE ACTIVITY OF SALIX SUBSERRATA IN PARACETAMOL IN...
EVALUATION OF HEPATOPROTECTIVE ACTIVITY OF SALIX SUBSERRATA IN PARACETAMOL IN...
gynomark9 views
Gold Nanoparticle as novel Agent for Drug targeting (1).pptx by sakshijadhav9843
Gold Nanoparticle as novel Agent for Drug targeting (1).pptxGold Nanoparticle as novel Agent for Drug targeting (1).pptx
Gold Nanoparticle as novel Agent for Drug targeting (1).pptx
sakshijadhav984316 views
Workshop LLM Life Sciences ChemAI 231116.pptx by Marco Tibaldi
Workshop LLM Life Sciences ChemAI 231116.pptxWorkshop LLM Life Sciences ChemAI 231116.pptx
Workshop LLM Life Sciences ChemAI 231116.pptx
Marco Tibaldi96 views
application of genetic engineering 2.pptx by SankSurezz
application of genetic engineering 2.pptxapplication of genetic engineering 2.pptx
application of genetic engineering 2.pptx
SankSurezz6 views
Class 2 (12 july).pdf by climber9977
  Class 2 (12 july).pdf  Class 2 (12 july).pdf
Class 2 (12 july).pdf
climber99778 views
Max Welling ChemAI 231116.pptx by Marco Tibaldi
Max Welling ChemAI 231116.pptxMax Welling ChemAI 231116.pptx
Max Welling ChemAI 231116.pptx
Marco Tibaldi132 views

Resolution-free community detection

  • 1. Community Detection Resolution Limit Definition of resolution-free Results Resolution-free community detection V.A. Traag1, P. Van Dooren1, Y.E. Nesterov2 1ICTEAM Universit´e Catholique de Louvain 2CORE Universit´e Catholique de Louvain 8 April 2011
  • 2. Community Detection Resolution Limit Definition of resolution-free Results Outline 1 Community Detection 2 Resolution Limit 3 Definition of resolution-free 4 Results
  • 3. Community Detection Resolution Limit Definition of resolution-free Results Community Detection • Detect ‘natural’ communities in network. • Modularity approach: ‘relatively’ many links inside communities
  • 4. Community Detection Resolution Limit Definition of resolution-free Results Community Detection (formal) • In general, commmunities should have relatively many present links (benefit), few missing links (cost) Minimize H = − ij (aij Aij − bij (1 − Aij ))δ(σi , σj ), • Compare to random null-model pij (RB) aij = wij − bij and bij = γRBpij HRB = − ij (Aij wij − γRBpij )δ(σi , σj ). • Modularity (NG): use configuration null model pij = ki kj 2m . Reichardt and Bornholdt. Phys Rev E (2006) 74:1,016110 Newman and Girvan. Phys Rev E (2004) 69:2,026113
  • 5. Community Detection Resolution Limit Definition of resolution-free Results Resolution limit • Modularity might miss ‘small’ communities. • Merge two cliques in ring of cliques when γRB < q nc(nc − 1) + 2 . • Depends on the total size of the graph. • Number of communities scales as √ γRBm. • For general null model, problem remains since ij pij = 2m. Fortunato and Barthlemy PNAS (2007) 104:1, pp. 36 Kumpala et al. Eur Phys J B (2007) 56, pp. 41-45
  • 6. Community Detection Resolution Limit Definition of resolution-free Results Evading the resolution limit • New model (RN) suggested aij = wij bij = γRN HRN = − ij (Aij (wij + γRN) − γRN)δ(σi , σj ). • Claim: no resolution limit, as merge depends only on ‘local’ variables γRN < 1 n2 c − 1 . • But, take pij = ki kj (rescale γRB by 2m), we obtain γRB < 1 2(nc(nc − 1) + 2)2 , also only ‘local’ variables. Hence, also no resolution limit? Ronhovde and Nussinov. Phys Rev E (2010) 81:4,046114.
  • 7. Community Detection Resolution Limit Definition of resolution-free Results Problems remain Subgraph • Assume pij = ki kj (rescale γRB by 2m) • Then separate in large graph when γRB > 1 2(nc(nc − 1) + 2)2 • But merged in subgraph when γRB < 1 2(nc(nc − 1) + 1)2
  • 8. Community Detection Resolution Limit Definition of resolution-free Results Resolution limit revisited Resolution-limit Resolution-free • Problem is not merging per s´e. • Rather, cliques separate in subgraph, but merge in large graph (or vice versa). • Suggests following definition.
  • 9. Community Detection Resolution Limit Definition of resolution-free Results Resolution limit revisited Resolution-limit Resolution-free Definition (Resolution-free) Objective function H is called resolution-free if, whenever partition C optimal for G, then subpartition D ⊂ C also optimal for subgraph H(D) ⊂ G induced by D.
  • 10. Community Detection Resolution Limit Definition of resolution-free Results Defining resolution-free Definition (Resolution-free) Objective function H is called resolution-free if, whenever partition C optimal for G, then subpartition D ⊂ C also optimal for subgraph H(D) ⊂ G induced by D. • Implicitly defines resolution limit: method is not resolution-free. • Some nice properties of resolution-free methods: Replace optimal subpartitions Never split cliques (unless in single nodes) Main questions • Do such methods exist? • What conditions to impose?
  • 11. Community Detection Resolution Limit Definition of resolution-free Results General framework General community detection H = − ij (aij Aij − bij (1 − Aij ))δ(σi , σj ), RB model Set aij = wij − bij , bij = γRBpij . RN model Set aij = wij , bij = γRN. Simpler alternative CPM Set aij = wij − bij and bij = γ. Leads to H = − ij (Aij wij − γ)δ(σi , σj ). Clear interpretation: γ is minimum density of a community H = − c ec − γn2 c.
  • 12. Community Detection Resolution Limit Definition of resolution-free Results Main result Do resolution-free methods exists? Yes: Both RN and CPM are resolution-free, results from general theorem. What conditions to impose? Sufficient condition: aij and bij should be ‘local’. Definition (Local weights) Weights aij , bij called local whenever for every subgraph H ⊂ G, weights remain similar, i.e. aij (G) ∼ aij (H) and bij (G) ∼ bij (H). • Implies local weigths aij and bij can only depend on node i and node j, nothing further. • RN and CPM use local weights, hence resolution-free. • Not necessary condition, but seem to be few exceptions. • So, RN and CPM (almost) only sensible definitions.
  • 13. Community Detection Resolution Limit Definition of resolution-free Results Performance (directed networks) µ0 0.2 0.4 0.6 0.8 1.0 NMI 0.25 0.5 0.75 1 CPM Infomap Modularity ER n = 103 n = 104
  • 14. Community Detection Resolution Limit Definition of resolution-free Results Conclusions • Provided definition of resolution-free. • Methods using local weights are resolution-free. • Clarifies link between ‘local’ methods and resolution limit. • Only few resolution-free methods. • Tested CPM, performs superbly. Thank you for your attention. Questions? Traag, Van Dooren and Nesterov arXiv:1104.3083v1