Multilevel Compression of Random Walks on Networks Reveals Hierarchical Organization in Large Integrated Systems
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
To comprehend the hierarchical organization of large integrated systems, we introduce the hierarchical map equation, which reveals multilevel structures in networks. In this information-theoretic approach, we exploit the duality between compression and pattern detection; by compressing a description of a random walker as a proxy for real flow on a network, we find regularities in the network that induce this system-wide flow. Finding the shortest multilevel description of the random walker therefore gives us the best hierarchical clustering of the network--the optimal number of levels and modular partition at each level--with respect to the dynamics on the network. With a novel search algorithm, we extract and illustrate the rich multilevel organization of several large social and biological networks. For example, from the global air traffic network we uncover countries and continents, and from the pattern of scientific communication we reveal more than 100 scientific fields organized in four major disciplines: life sciences, physical sciences, ecology and earth sciences, and social sciences. In general, we find shallow hierarchical structures in globally interconnected systems, such as neural networks, and rich multilevel organizations in systems with highly separated regions, such as road networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Collective dynamics of ‘small-world’ networks
Watts, D. J., & Strogatz, S. H. (1998) · Nature · doi:10.1038/30918 · Cited by 43,060
Fast unfolding of communities in large networks
Blondel, V. D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/2008/10/p10008 · Cited by 21,424
Statistical mechanics of complex networks
Albert, R., & Barabási, A.-L. (2002) · Reviews of Modern Physics · doi:10.1103/revmodphys.74.47 · Cited by 20,471
The Structure and Function of Complex Networks
Newman, M. E. J. (2003) · SIAM Review · doi:10.1137/s003614450342480 · Cited by 18,719
Community structure in social and biological networks
Girvan, M., & Newman, M. E. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.122653799 · Cited by 15,502 · cited 1×
“(4) At each submodule level, q is the rate of codeword use for entering the mi submodules or exiting to a coarser level and H(Q) is the frequency-weighted average length of the codewords in the subindex codebook.”
BackgroundFortunato, S. (2010) · Physics Reports · doi:10.1016/j.physrep.2009.11.002 · Cited by 11,293 · cited 1×
“But many networks have important structures at multiple scales (3), and the code structure of the two-level map equation cannot capitalize on these.”
BackgroundFinding community structure in very large networks
Clauset, A., Newman, M. E. J., & Moore, C. (2004) · Physical Review E · doi:10.1103/physreve.70.066111 · Cited by 7,390
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
Maps of random walks on complex networks reveal community structure
Rosvall, M., & Bergstrom, C. T. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706851105 · Cited by 4,583
Self-citation
Cited by
Community detection in networks: a user guide
Fortunato, S., & Hric, D. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.09.002 · Cited by 2,086
Finding Statistically Significant Communities in Networks
Lancichinetti, A., Radicchi, F., Ramasco, J. J., & Fortunato, S. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018961 · Cited by 1,187
The Role of Gender in Scholarly Authorship
West, J. D., Jacquet, J., King, M. M., Correll, S. J., & Bergstrom, C. T. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066212 · Cited by 892
Self-citationStructure and dynamics of molecular networks: A novel paradigm of drug discovery
Csermely, P., Korcsmáros, T., Kiss, H. J. M., London, G., & Nussinov, R. (2013) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2013.01.016 · Cited by 892
Communities, modules and large-scale structure in networks
Newman, M. E. J. (2012) · Nature Physics · doi:10.1038/nphys2162 · Cited by 787
A new methodology for constructing a publication‐level classification system of science
Waltman, L., & van Eck, N. J. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22748 · Cited by 661
Random walks and diffusion on networks
Masuda, N., Porter, M. A., & Lambiotte, R. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.07.007 · Cited by 657
High-Dimensional Single-Cell Cartography Reveals Novel Skeletal Muscle-Resident Cell Populations
Giordani, L., He, G. J., Negroni, E., Sakai, H., Law, J. Y. C., Siu, M. M., Wan, R., Corneau, A., Tajbakhsh, S., Cheung, T. H., et al. (2019) · Molecular Cell · doi:10.1016/j.molcel.2019.02.026 · Cited by 387
Narrow scope for resolution-limit-free community detection
Traag, V. A., Van Dooren, P., & Nesterov, Y. (2011) · Physical Review E · doi:10.1103/physreve.84.016114 · Cited by 353
Addressing sustainability in research on distributed production: an integrated literature review
Kohtala, C. (2015) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2014.09.039 · Cited by 290
Cryptic inoviruses revealed as pervasive in bacteria and archaea across Earth’s biomes
Roux, S., Krupovic, M., Daly, R. A., Borges, A. L., Nayfach, S., Schulz, F., Sharrar, A., Matheus Carnevali, P. B., Cheng, J.-F., Ivanova, N. N., et al. (2019) · Nature Microbiology · doi:10.1038/s41564-019-0510-x · Cited by 290
Men Set Their Own Cites High: Gender and Self-citation across Fields and over Time
King, M. M., Bergstrom, C. T., Correll, S. J., Jacquet, J., & West, J. D. (2017) · Socius: Sociological Research for a Dynamic World · doi:10.1177/2378023117738903 · Cited by 275
“To provide more context for the importance of self-citation, we wanted to know what proportion of citations in an article are self-citations, on average.”
BackgroundSelf-citationA network approach for identifying and delimiting biogeographical regions
Vilhena, D. A., & Antonelli, A. (2015) · Nature Communications · doi:10.1038/ncomms7848 · Cited by 257
Public use and public funding of science
Yin, Y., Dong, Y., Wang, K., Wang, D., & Jones, B. F. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01397-5 · Cited by 123
Verkhivker, G. M., Agajanian, S., Hu, G., & Tao, P. (2020) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2020.00136 · Cited by 76
Mapping the multiscale structure of biological systems
Schaffer, L. V., & Ideker, T. (2021) · Cell Systems · doi:10.1016/j.cels.2021.05.012 · Cited by 75
Cheong, H. S., Eichler, K., Stürner, T., Asinof, S. K., Champion, A. S., Marin, E. C., Oram, T. B., Sumathipala, M., Venkatasubramanian, L., Namiki, S., et al. (2026) · eLife · doi:10.7554/elife.96084 · Cited by 54
Cheong, H. S., Eichler, K., Stürner, T., Asinof, S. K., Champion, A. S., Marin, E. C., Oram, T. B., Sumathipala, M., Venkatasubramanian, L., Namiki, S., et al. (2024) · doi:10.7554/elife.96084.1 · Cited by 51
Community Detection in Quantum Complex Networks
Faccin, M., Migdał, P., Johnson, T. H., Bergholm, V., & Biamonte, J. D. (2014) · Physical Review X · doi:10.1103/physrevx.4.041012 · Cited by 43
“[35] Martin Rosvall and Carl T Bergstrom.”
Background
Metadata
- Authors
- Rosvall, M., & Bergstrom, C. T.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-04-08
- Volume
- 6
- Issue
- 4
- Pages
- e18209
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W1743429370
- Cited by
- 393
- References
- 29
- FWCI
- 21.91
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.