CoChat

Measuring the hierarchy of feedforward networks

Open access
Corominas-Murtra, Bernat, Rodríguez-Caso, Carlos, Goñi, Joaquín, Solé, Ricard · 2011 · Chaos: An Interdisciplinary Journal of Nonlinear Science

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

Abstract

In this paper we explore the concept of hierarchy as a quantifiable descriptor of ordered structures, departing from the definition of three conditions to be satisfied for a hierarchical structure: order, predictability, and pyramidal structure. According to these principles, we define a hierarchical index taking concepts from graph and information theory. This estimator allows to quantify the hierarchical character of any system susceptible to be abstracted in a feedforward causal graph, i.e., a directed acyclic graph defined in a single connected structure. Our hierarchical index is a balance between this predictability and pyramidal condition by the definition of two entropies: one attending the onward flow and the other for the backward reversion. We show how this index allows to identify hierarchical, antihierarchical, and nonhierarchical structures. Our formalism reveals that departing from the defined conditions for a hierarchical structure, feedforward trees and the inverted tree graphs emerge as the only causal structures of maximal hierarchical and antihierarchical systems respectively. Conversely, null values of the hierarchical index are attributed to a number of different configuration networks; from linear chains, due to their lack of pyramid structure, to full-connected feedforward graphs where the diversity of onward pathways is canceled by the uncertainty (lack of predictability) when going backward. Some illustrative examples are provided for the distinction among these three types of hierarchical causal graphs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1063/1.3562548

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 23 references

Research works printed but not linked: 11

  1. R. B. Ash. Information Theory . New York. Dover, 1990.
  2. T. M. Cover and J. A. Thomas. Elements of Information Theory . John Wiley and Sons. New York, 1991.
  3. N. Eldredge. Unfinished synthesis: biological hierarchies and modern evolutionary thought. Oxford U. Press, New York., 1985.
  4. 1998, Graph Theory and Its Applications
  5. 1957, Mathematical Foundations of Information Theory
  6. 1974, Human Geography: Spatial Design in World Society
  7. 2001, The hierarchical structure of organisms, Paleobiology, 27, 405, 10.1666/0094-8373(2001)027<0405:thsooa>2.0.co;2 · doi:10.1666/0094-8373(2001)027<0405:thsooa>2.0.co;2
  8. 1973, Hierarchy Theory: The Challenge of Complex Systems
  9. 1962, The architecture of complexity, Proc. Am. Philos. Soc., 106, 467
  10. 1960, Axiomatic Set Theory
  11. 1969, Hierarchical Structures

Cited by

Metadata

Authors
Corominas-Murtra, B., Rodríguez-Caso, C., Goñi, J., & Solé, R.
Affiliations
  • Institució Catalana de Recerca i Estudis Avançats (ES)
  • Centro de Investigación Médica Aplicada (ES)
Venue
Chaos: An Interdisciplinary Journal of Nonlinear Science
Published
2011-03-01
Volume
21
Issue
1
Pages
016108-016108
ISSN
  • 1054-1500 (ISSN-L)
  • 1089-7682
OpenAlex
W2089809317
Cited by
16
References
22
Citations by year
2025: 1 · 2023: 2 · 2022: 1 · 2019: 1 · 2016: 4 · 2015: 3 · 2014: 2 · 2013: 2
FWCI
0.98
Type
journal article
Language
en
Open access
Locations
  • Chaos An Interdisciplinary Journal of Nonlinear Science (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • DIGITAL.CSIC (Spanish National Research Council (CSIC)) (submittedVersion, other-oa)
  • Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Systems and Dynamics
  • Physical Sciences › Mathematics › Discrete Mathematics and Combinatorics › Graph theory and applications
Keywords
hierarchy, feedforward neural networks, hierarchical index, directed acyclic graphs, causal graphs, entropy (information theory), predictability, pyramid structure, information theory

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.