The Quality of Modern Cross-Sectional Ecologic Studies: A Bibliometric Review
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The ecologic study design is routinely used by epidemiologists in spite of its limitations. It is presently unknown how well the challenges of the design are dealt with in epidemiologic research. The purpose of this bibliometric review was to critically evaluate the characteristics, statistical methods, and reporting of results of modern cross-sectional ecologic papers. A search through 6 major epidemiology journals identified all cross-sectional ecologic studies published since January 1, 2000. A total of 125 articles met the inclusion requirements and were assessed via common evaluative criteria. It was found that a considerable number of cross-sectional ecologic studies use unreliable methods or contain statistical oversights; most investigators who adjusted their outcomes for age or sex did so improperly (64%), statistical validity was a potential issue for 20% of regression models, and simple linear regression was the most common analytic approach (31%). Many authors omitted important information when discussing the ecologic nature of their study (31%), the choice of study design (58%), and the susceptibility of their research to the ecological fallacy (49%). These results suggest that there is a need for an international set of guidelines that standardizes reporting on ecologic studies. Additionally, greater attention should be given to the relevant biostatistical literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elm, E. V., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · BMJ · doi:10.1136/bmj.39335.541782.ad · Cited by 10,766
Relaxing the Rule of Ten Events per Variable in Logistic and Cox Regression
Vittinghoff, E., & McCulloch, C. E. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwk052 · Cited by 4,359 · cited 1×
“The most common recommendation is to have a minimum of 10 observations per covariate, though this may be too conservative for some models (11).”
BackgroundImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Ecological Bias, Confounding, and Effect Modification
GREENLAND, S., & MORGENSTERN, H. (1989) · International Journal of Epidemiology · doi:10.1093/ije/18.1.269 · Cited by 540
Hopewell, S., Dutton, S., Yu, L.-M., Chan, A.-W., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c723 · Cited by 504 · cited 2×
“(20) did find some improvement in the reporting of randomized trials following release of the CONSORT statement (21).”
BackgroundInvited commentary: ecologic studies—biases, misconceptions, and counterexamples
Greenland, S., & Robins, J. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117069 · Cited by 494 · cited 1×
“In spite of this wealth of knowledge, the ecologic design and its fallacy often remain misunderstood (3).”
Background
Cited by
Betran, A. P., Torloni, M. R., Zhang, J., Ye, J., Mikolajczyk, R., Deneux-Tharaux, C., Oladapo, O. T., Souza, J. P., Tunçalp, Ö., Vogel, J. P., et al. (2015) · Reproductive Health · doi:10.1186/s12978-015-0043-6 · Cited by 585
Green Space Quality and Health: A Systematic Review
Nguyen, P.-Y., Astell-Burt, T., Rahimi-Ardabili, H., & Feng, X. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182111028 · Cited by 420
“Because these tools do not provide for ecological studies, the existing tool for observational cohort and cross-sectional studies were adapted by adding 3 criteria addressing ecological fallacy, spatial autocorrelation and uncertainty in fitting spatial data [20,21].”
BackgroundMendez-Brito, A., El Bcheraoui, C., & Pozo-Martin, F. (2021) · Journal of Infection · doi:10.1016/j.jinf.2021.06.018 · Cited by 269
Pesticide exposure and Parkinson's disease: Epidemiological evidence of association
Freire, C., & Koifman, S. (2012) · NeuroToxicology · doi:10.1016/j.neuro.2012.05.011 · Cited by 253
Association between Urban Greenspace and Health: A Systematic Review of Literature
Gianfredi, V., Buffoli, M., Rebecchi, A., Croci, R., Oradini-Alacreu, A., Stirparo, G., Marino, A., Odone, A., Capolongo, S., & Signorelli, C. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18105137 · Cited by 203
Metadata
- Authors
- Dufault, B., & Klar, N.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-09-22
- Volume
- 174
- Issue
- 10
- Pages
- 1101-1107
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2156242793
- Cited by
- 73
- References
- 6
- FWCI
- 3.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Quality of Modern Cross-Sectional Ecologic Studies: A Bibliometric Review. https://app.cochat.ai/papers/10.1093/aje/kwr241
- The paper
- Dufault, B., & Klar, N. (2011). The Quality of Modern Cross-Sectional Ecologic Studies: A Bibliometric Review. American Journal of Epidemiology. https://doi.org/10.1093/aje/kwr241
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.