The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Performance of modularity maximization in practical contexts
Open accessAbstract
Although widely used in practice, the behavior and accuracy of the popular module identification technique called modularity maximization is not well understood in practical contexts. Here, we present a broad characterization of its performance in such situations. First, we revisit and clarify the resolution limit phenomenon for modularity maximization. Second, we show that the modularity function Q exhibits extreme degeneracies: it typically admits an exponential number of distinct high-scoring solutions and typically lacks a clear global maximum. Third, we derive the limiting behavior of the maximum modularity Qmax for one model of infinitely modular networks, showing that it depends strongly both on the size of the network and on the number of modules it contains. Finally, using three real-world metabolic networks as examples, we show that the degenerate solutions can fundamentally disagree on many, but not all, partition properties such as the composition of the largest modules and the distribution of module sizes. These results imply that the output of any modularity maximization procedure should be interpreted cautiously in scientific contexts. They also explain why many heuristics are often successful at finding high-scoring partitions in practice and why different heuristics can disagree on the modular structure of the same network. We conclude by discussing avenues for mitigating some of these behaviors, such as combining information from many degenerate solutions or using generative models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“One recent study has shown that, even in relatively small networks, a large number of good solutions exist for the standard modularity criterion [51], [52].”
From Spatial Guilds in the Serengeti Food Web Revealed by a Bayesian Group Model (2011) · cites this paper as [52]
In the citing paper
“However, as of today, a common method for dealing with this degeneracy is to examine statistics averaged over the 100 repetitions of the optimization, with equal weight being placed on each solution, rather than just on the unique solutions.”
From Dynamic reconfiguration of frontal brain networks during executive cognition in humans (2015) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1979) · Cited by 43,841
Fast unfolding of communities in large networks
Blondel, V. D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/2008/10/p10008 · Cited by 21,424
The Structure and Function of Complex Networks
Newman, M. E. J. (2003) · SIAM Review · doi:10.1137/s003614450342480 · Cited by 18,719
Numerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
Social Network Analysis: Methods and Applications
Wasserman, S., & Faust, K. (1994) · doi:10.1017/cbo9780511815478 · Cited by 17,557
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 16,043
Community structure in social and biological networks
Girvan, M., & Newman, M. E. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.122653799 · Cited by 15,502
Finding and evaluating community structure in networks
Newman, M. E. J., & Girvan, M. (2004) · Physical Review E · doi:10.1103/physreve.69.026113 · Cited by 13,931
Modularity and community structure in networks
Newman, M. E. J. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601602103 · Cited by 12,256
Fortunato, S. (2010) · Physics Reports · doi:10.1016/j.physrep.2009.11.002 · Cited by 11,293
Advances in Neural Information Processing Systems 14
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 9,187
Power-Law Distributions in Empirical Data
Clauset, A., Shalizi, C. R., & Newman, M. E. J. (2009) · SIAM Review · doi:10.1137/070710111 · Cited by 8,019
Self-citationNetwork biology: understanding the cell's functional organization
Barabási, A.-L., & Oltvai, Z. N. (2004) · Nature Reviews Genetics · doi:10.1038/nrg1272 · Cited by 7,903
Finding community structure in very large networks
Clauset, A., Newman, M. E. J., & Moore, C. (2004) · Physical Review E · doi:10.1103/physreve.70.066111 · Cited by 7,390
Self-citationPower-law distributions in empirical data
Clauset, A. J., Shalizi, C. R., & Newman, M. E. J. (2018) · Figshare · doi:10.1184/r1/6586835.v1 · Cited by 6,710
Self-citationFast algorithm for detecting community structure in networks
Newman, M. E. J. (2004) · Physical Review E · doi:10.1103/physreve.69.066133 · Cited by 5,415
An Efficient Heuristic Procedure for Partitioning Graphs
Kernighan, B. W., & Lin, S. M. (1970) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1970.tb01770.x · Cited by 5,325
Maps of random walks on complex networks reveal community structure
Rosvall, M., & Bergstrom, C. T. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706851105 · Cited by 4,583
Functional cartography of complex metabolic networks
Guimerà, R., & Nunes Amaral, L. A. (2005) · Nature · doi:10.1038/nature03288 · Cited by 3,983
From molecular to modular cell biology.
Hartwell, L. H., Hopfield, J. J., Leibler, S., & Murray, A. W. (1999) · Nature · doi:10.1038/35011540 · Cited by 3,632
A Nonlinear Mapping for Data Structure Analysis
Sammon, J. W. (1969) · IEEE Transactions on Computers · doi:10.1109/t-c.1969.222678 · Cited by 3,364
Resolution limit in community detection
Fortunato, S., & Barthélemy, M. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0605965104 · Cited by 3,024
A critical point for random graphs with a given degree sequence
Molloy, M. S. O., & Reed, B. A. (1995) · Random Structures and Algorithms · doi:10.1002/rsa.3240060204 · Cited by 2,267
Hierarchical structure and the prediction of missing links in networks
Clauset, A., Moore, C., & Newman, M. E. J. (2008) · Nature · doi:10.1038/nature06830 · Cited by 2,171
Self-citationStatistical mechanics of community detection
Reichardt, J., & Bornholdt, S. (2006) · Physical Review E · doi:10.1103/physreve.74.016110 · Cited by 2,048
Detecting community structure in networks
Newman, M. E. J. (2004) · The European Physical Journal B · doi:10.1140/epjb/e2004-00124-y · Cited by 2,031
Mixed membership stochastic blockmodels
Airoldi, E. M., Blei, D. M., Fienberg, S. E., & Xing, E. P. (2007) · PubMed · doi:10.48550/arxiv.0705.4485 · Cited by 1,802
Computing Communities in Large Networks Using Random Walks
Pons, P., & Matthieu Latapy, B. (2006) · Journal of Graph Algorithms and Applications · doi:10.7155/jgaa.00124 · Cited by 1,600
Community detection in complex networks using extremal optimization
Duch, J., & Arenas, À. (2005) · Physical Review E · doi:10.1103/physreve.72.027104 · Cited by 1,550
Nonlinear Dimensionality Reduction
Lee, J. A., & Verleysen, M. (2007) · Springer eBooks · doi:10.1007/978-0-387-39351-3 · Cited by 1,548
Protein complexes and functional modules in molecular networks
Spirin, V., & Mirny, L. A. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2032324100 · Cited by 1,462
Brandes, U., Delling, D., Gaertler, M., Görke, R., Hoefer, M., Nikoloski, Z., & Wagner, D. (2008) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.190689 · Cited by 1,243
A nonparametric view of network models and Newman–Girvan and other modularities
Bickel, P., & Chen, A. (2009) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.0907096106 · Cited by 902
Modularity from fluctuations in random graphs and complex networks
Guimerà, R., Sales-Pardo, M., & Amaral, L. A. N. (2004) · Physical Review E · doi:10.1103/physreve.70.025101 · Cited by 894
Synchronization Reveals Topological Scales in Complex Networks
Arenas, À., Dı́az-Guilera, A., & Vicente, C. J. P. (2006) · Physical Review Letters · doi:10.1103/physrevlett.96.114102 · Cited by 849
Finding local community structure in networks
Clauset, A. J. (2005) · Physical Review E · doi:10.1103/physreve.72.026132 · Cited by 789
Self-citationAn information-theoretic framework for resolving community structure in complex networks
Rosvall, M., & Bergstrom, C. T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0611034104 · Cited by 789
Stoer, M., & Wagner, F. (1997) · Journal of the ACM · doi:10.1145/263867.263872 · Cited by 742
Modular organization of cellular networks
Rives, A. W., & Galitski, T. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0237338100 · Cited by 705
Mixture models and exploratory analysis in networks
Newman, M. E. J., & Leicht, E. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0610537104 · Cited by 556
Analysis of the structure of complex networks at different resolution levels
Arenas, À., Fernández, A., & Gómez, S. (2008) · New Journal of Physics · doi:10.1088/1367-2630/10/5/053039 · Cited by 550
Extracting the hierarchical organization of complex systems
Sales‐Pardo, M., Guimerà, R., Moreira, A. A., & Amaral, L. A. N. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0703740104 · Cited by 550
Proceedings of the 22nd international conference on Machine learning
Džeroski, S., Raedt, L. D., & Wrobel, S. (2005) · Cited by 523
Stochastic blockmodels for directed graphs.
Wang, Y. J., & Wong, G. Y. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478385 · Cited by 480
Quantitative function for community detection
Li, Z., Zhang, S., Wang, R., Zhang, X., & Chen, L. (2008) · Physical Review E · doi:10.1103/physreve.77.036109 · Cited by 384
Robustness of community structure in networks
Karrer, B., Levina, E., & Newman, M. E. J. (2008) · Physical Review E · doi:10.1103/physreve.77.046119 · Cited by 350
Modularity-maximizing graph communities via mathematical programming
Agarwal, G., & Kempe, D. (2008) · The European Physical Journal B · doi:10.1140/epjb/e2008-00425-1 · Cited by 333
Bayesian Approach to Network Modularity
Hofman, J. M., & Wiggins, C. H. (2008) · Physical Review Letters · doi:10.1103/physrevlett.100.258701 · Cited by 298
Characterizing the Dynamical Importance of Network Nodes and Links
Restrepo, J. G., Ott, E., & Hunt, B. R. (2006) · Physical Review Letters · doi:10.1103/physrevlett.97.094102 · Cited by 257
The evolution of modularity in bacterial metabolic networks
Kreimer, A., Borenstein, E., Gophna, U., & Ruppin, E. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0712149105 · Cited by 207
Evaluating local community methods in networks
Bagrow, J. P. (2008) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2008/05/p05001 · Cited by 198
Hierarchical thinking in network biology: the unbiased modularization of biochemical networks
Papin, J. A., Reed, J. L., & Palsson, B. Ø. (2004) · Trends in Biochemical Sciences · doi:10.1016/j.tibs.2004.10.001 · Cited by 197
Limited resolution in complex network community detection with Potts model approach
Kumpula, J. M., Saramäki, J., Kaski, K. K., & Kertész, J. (2007) · The European Physical Journal B · doi:10.1140/epjb/e2007-00088-4 · Cited by 190
Identifying network communities with a high resolution
Ruan, J., & Zhang, W. (2008) · Physical Review E · doi:10.1103/physreve.77.016104 · Cited by 187
A Nonmetric Variety of Linear Factor Analysis
Kruskal, J. B., & Shepard, R. N. (1974) · Psychometrika · doi:10.1007/bf02291465 · Cited by 156
Food web models: a plea for groups.
Allesina, S., & Pascual, M. (2009) · Ecology Letters · doi:10.1111/j.1461-0248.2009.01321.x · Cited by 149
When are networks truly modular?
Reichardt, J., & Bornholdt, S. (2006) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2006.09.009 · Cited by 116
Huss, M., & Holme, P. (2007) · IET Systems Biology · doi:10.1049/iet-syb:20060077 · Cited by 110
Information-theoretic approach to network modularity
Ziv, E., Middendorf, M., & Wiggins, C. H. (2005) · Physical Review E · doi:10.1103/physreve.71.046117 · Cited by 108
Spectral tripartitioning of networks
Richardson, T. S., Mucha, P. J., & Porter, M. A. (2009) · Physical Review E · doi:10.1103/physreve.80.036111 · Cited by 90
Hierarchy and feedback in the evolution of the Escherichia coli transcription network
Lagomarsino, M. C., Jona, P., Bassetti, B., & Isambert, H. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609023104 · Cited by 89
Stochastic Blockmodels for Directed Graphs
Wang, Y. J., & Wong, G. Y. (1987) · Journal of the American Statistical Association · doi:10.2307/2289119 · Cited by 75
Modular co-evolution of metabolic networks
Zhao, J., Ding, G., Tao, L., Yu, H. J., Yu, Z., Luo, J., Cao, Z., & Li, Y. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-311 · Cited by 69
Modularity of stress response evolution
Singh, A. H., Wolf, D. M., Wang, P., & Arkin, A. P. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0709764105 · Cited by 59
Detection of node group membership in networks with group overlap
Sawardecker, E. N., Sales‐Pardo, M., & Amaral, L. A. N. (2008) · The European Physical Journal B · doi:10.1140/epjb/e2008-00418-0 · Cited by 49
Blackshaw, T., & Crawford, G. (2009) · The SAGE Dictionary of Leisure Studies · doi:10.4135/9781446213278.n200 · Cited by 23
Modularity density of network community divisions
Holmström, E., Bock, N., & Brännlund, J. (2009) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2009.03.015 · Cited by 13
Research works printed but not linked: 4
- M. A. Porter, 2009, Not. Am. Math. Soc., 59, 1082
- L. K. Branting, Proceedings of the 2nd Workshop on Social Network Mining and Analysis
- E. M. Airoldi, 2008, J. Mach. Learn. Res., 9, 1981
- P. Demartines, 1995, Proceedings of 15th workshop GRETSI. Juan-Les-Pins France
Cited by
Sorted by citations
From Louvain to Leiden: guaranteeing well-connected communities
Traag, V. A., Waltman, L., & van Eck, N. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-41695-z · Cited by 5,635
Newman, M. E. J. (2018) · doi:10.1093/oso/9780198805090.001.0001 · Cited by 2,453
Community Structure in Time-Dependent, Multiscale, and Multiplex Networks
Mucha, P. J., Richardson, T., Macon, K., Porter, M. A., & Onnela, J.-P. (2010) · Science · doi:10.1126/science.1184819 · Cited by 2,123
Community detection in networks: a user guide
Fortunato, S., & Hric, D. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.09.002 · Cited by 2,086
Dynamic reconfiguration of human brain networks during learning
Bassett, D. S., Wymbs, N. F., Porter, M. A., Mucha, P. J., Carlson, J. M., & Grafton, S. T. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1018985108 · Cited by 1,705
Metadata
- Authors
- Good, B. H., de Montjoye, Y.-A., & Clauset, A.
- Affiliations
- Swarthmore College (US)
- Santa Fe Institute (US)
- Venue
- Physical Review E
- Publisher
- American Physical Society (APS)
- Published
- 2010-04-15
- Volume
- 81
- Issue
- 4
- Pages
- 046106-046106
- ISSN
- 1539-3755 (ISSN-L)
- 1550-2376
- OpenAlex
- W2061099285
- Cited by
- 937
- References
- 66
- Citations by year
- 2026: 18 · 2025: 38 · 2024: 36 · 2023: 36 · 2022: 35 · 2021: 45 · 2020: 58 · 2019: 57 · 2018: 94 · 2017: 76 · 2016: 59 · 2015: 71 · 2014: 80 · 2013: 79 · 2012: 70
- FWCI
- 52.48
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Physical Review E (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Clustering Algorithms Research
- Keywords
- modularity optimization, resolution limit, network module identification, degenerate solutions, modularity function, metabolic networks, community detection
- MeSH terms
- Models, Theoretical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review