Ecological effects in multi-level studies
Open accessAbstract
Multi-level research that attempts to describe ecological effects in themselves (for example, the effect on individual health from living in deprived communities), while also including individual level effects (for example, the effect of personal socioeconomic disadvantage), is now prominent in research on the socioeconomic determinants of health and disease. Such research often involves the application of advanced statistical multi-level methods. It is hypothesised that such research is at risk of reaching beyond an epidemiological understanding of what constitutes an ecological effect, and what sources of error may be influencing any observed ecological effect. This paper aims to present such an epidemiological understanding. Three basic types of ecological effect are described: a direct cross level effect (for example, living in a deprived community directly affects individual personal health), cross level effect modification (for example, living in a deprived community modifies the effect of individual socioeconomic status on individual health), and an indirect cross level effect (for example, living in a deprived community increases the risk of smoking, which in turn affects individual health). Sources of error and weaknesses in study design that may affect estimates of ecological effects include: a lack of variation in the ecological exposure (and health outcome) in the available data; not allowing for intraclass correlation; selection bias; confounding at both the ecological and individual level; misclassification of variables; misclassification of units of analysis and assignment of individuals to those units; model mis-specification; and multicollinearity. Identification of ecological effects requires the minimisation of these sources of error, and a study design that captures sufficient variation in the ecological exposure of interest.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Blakely and Woodward described three principal mechanisms through which ecological constructs can affect individual-level outcomes: cross-level effect modification, direct cross-level effects, and indirect cross-level effects.
“Blakely and Woodward (2000) described three principal mechanisms through which ecological constructs can affect individual-level outcomes: cross-level effect modification (e.g. the association between men’s beliefs about gender roles and women’s experience of intimate partner violence is modified by laws disadvantaging women relative to men in their access to resources and factors of production),”
From Syndemics: a theory in search of data or data in search of a theory? (2018) · cites this paper as Blakely and Woodward (2000)
Teachers and administrators may be less reluctant to suspend students who already have a suspension history, particularly Black students, who are especially affected by implicit racial bias.
“Teachers and administrations may be less reluctant to issue suspensions to students who already have a track record of suspensions (Blakely & Woodward, 2000) and especially to already-suspended Black students—a group particularly impacted by implicit racial bias (Okonofua et al., 2016).”
From The Impact of Restorative Practices on the Use of Out-of-School Suspensions: Results from a Cluster Randomized Controlled Trial (2023) · cites this paper as Blakely & Woodward, 2000
The citation to Blakely and Woodward is attached to the claim that teachers and administrators may be less reluctant to suspend students with prior suspensions; the racial-bias clause cites a different source. The Background and bias sections discuss multilevel epidemiological research, not school discipline. Searches for suspension history and school discipline found no relevant passage in our copy. (LLM, conf=0.77)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,768 · see citing works
Goldstein, H. (2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,960 · see citing works
Hierarchical Linear Models: Applications and Data Analysis Methods.
Goldstein, H., Bryk, A. S., & Raudenbush, S. W. (1993) · Journal of the American Statistical Association · doi:10.2307/2290750 · Cited by 3,320 · see citing works
The strategy of preventive medicine
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5633 · Cited by 1,878 · see citing works
Epidemiology and the web of causation: has anyone seen the spider?
Krieger, N. (1994) · Social Science & Medicine · doi:10.1016/0277-9536(94)90202-x · Cited by 1,419 · see citing works
Bringing context back into epidemiology: variables and fallacies in multilevel analysis
Diez-Roux, A. V. (1998) · American Journal of Public Health · doi:10.2105/ajph.88.2.216 · Cited by 1,317 · see citing works
Kaplan, G. A., Pamuk, E. R., Lynch, J. W., Cohen, R. D., & Balfour, J. L. (1996) · BMJ · doi:10.1136/bmj.312.7037.999 · Cited by 1,234 · see citing works
Hox, J. J. (1995) · Utrecht University Repository (Utrecht University) · Cited by 1,179 · see citing works
Hierarchical linear models: Applications and data analysis methods
Rumberger, R. W. (1997) · Economics of Education Review · doi:10.1016/s0272-7757(97)80188-4 · Cited by 984 · see citing works
Piantadosi, S. T., Byar, D. P., & Green, S. B. (1988) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114892 · Cited by 828 · see citing works
Choosing a future for epidemiology: II. From black box to Chinese boxes and eco-epidemiology.
Susser, M., & Susser, E. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.5.674 · Cited by 790 · see citing works
Qureshi, B. (1984) · Elsevier eBooks · doi:10.1016/c2013-0-06463-8 · Cited by 786 · see citing works
Ecologic Studies in Epidemiology: Concepts, Principles, and Methods
Morgenstern, H. (1995) · Annual Review of Public Health · doi:10.1146/annurev.pu.16.050195.000425 · Cited by 755 · see citing works
Neighborhood Environments and Coronary Heart Disease: A Multilevel Analysis
Diez-Roux, A. V., Nieto, F. J., Muntaner, C., Tyroler, H. A., Comstock, G. W., Shahar, E., Cooper, L. S., Watson, R. L., & Szklo, M. (1997) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009191 · Cited by 744 · see citing works
Income inequality and health: pathways and mechanisms.
Kawachi, I. I., & Kennedy, B. P. (1999) · PubMed Central · Cited by 697 · see citing works
Burton, P. R., Gurrin, L. C., & Sly, P. D. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980615)17:11 · Cited by 629 · see citing works
Life expectancy, economic inequality, homicide, and reproductive timing in Chicago neighbourhoods
Wilson, M., & Daly, M. (1997) · BMJ · doi:10.1136/bmj.314.7089.1271 · Cited by 607 · see citing works
Ecological Bias, Confounding, and Effect Modification
GREENLAND, S., & MORGENSTERN, H. (1989) · International Journal of Epidemiology · doi:10.1093/ije/18.1.269 · Cited by 540 · see citing works
Traditional epidemiology, modern epidemiology, and public health.
Pearce, N. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.5.678 · Cited by 535 · see citing works
Invited commentary: ecologic studies—biases, misconceptions, and counterexamples
Greenland, S., & Robins, J. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117069 · Cited by 494 · see citing works
The logic in ecological: I. The logic of analysis.
Susser, M. W. (1994) · American Journal of Public Health · doi:10.2105/ajph.84.5.825 · Cited by 433 · see citing works
Gravelle, H. S. E. (1998) · BMJ · doi:10.1136/bmj.316.7128.382 · Cited by 406 · see citing works
The shape of the relationship between income and mortality in the United States
Backlund, E., Sorlie, P. D., & Johnson, N. J. (1996) · Annals of Epidemiology · doi:10.1016/1047-2797(95)00090-9 · Cited by 365 · see citing works
Hypercortisolism associated with social subordinance or social isolation among wild baboons
Sapolsky, R. M. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830240097014 · Cited by 318 · see citing works
Context and Consex: A Cautionary Tale
Hauser, R. M. (1970) · American Journal of Sociology · doi:10.1086/224894 · Cited by 305 · see citing works
Health-related behaviour in context: A multilevel modelling approach
Duncan, C., Jones, K., & Moon, G. (1996) · Social Science & Medicine · doi:10.1016/0277-9536(95)00181-6 · Cited by 285 · see citing works
Lehtonen, R. (2005) · Journal of the American Statistical Association · doi:10.1198/jasa.2005.s9 · Cited by 265 · see citing works
Duncan, C., Jones, K., & Moon, G. (1993) · Social Science & Medicine · doi:10.1016/0277-9536(93)90366-c · Cited by 263 · see citing works
Aggregation and the measurement of income inequality: effects on morbidity
Soobader, M., & LeClere, F. B. (1999) · Social Science & Medicine · doi:10.1016/s0277-9536(98)00401-8 · Cited by 259 · see citing works
Study Designs for Dependent Happenings
Halloran, M. E., & Struchiner, C. J. (1991) · Epidemiology · doi:10.1097/00001648-199109000-00004 · Cited by 241 · see citing works
Does risk factor epidemiology put epidemiology at risk? Peering into the future.
Susser, M. W. (1998) · Journal of Epidemiology & Community Health · doi:10.1136/jech.52.10.608 · Cited by 217 · see citing works
Divergent biases in ecologic and individual‐level studies
Greenland, S. (1992) · Statistics in Medicine · doi:10.1002/sim.4780110907 · Cited by 179 · see citing works
Hauser, R. M. (1974) · Sociological Methods & Research · doi:10.1177/004912417400200305 · Cited by 171 · see citing works
The Strategy of Preventive Medicine
Whincup, P. (1993) · Journal of Epidemiology & Community Health · doi:10.1136/jech.47.3.251 · Cited by 164 · see citing works
Social status and coronary artery atherosclerosis in female monkeys.
Shively, C. A., & Clarkson, T. B. (1994) · Arteriosclerosis and Thrombosis A Journal of Vascular Biology · doi:10.1161/01.atv.14.5.721 · Cited by 152 · see citing works
Boylan, A. (1985) · Nurse Education Today · doi:10.1016/0260-6917(85)90048-6 · Cited by 140 · see citing works
Place Effects for Areas Defined by Administrative Boundaries
Boyle, M. H., & Willms, J. D. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009855 · Cited by 136 · see citing works
Effects of Nondifferential Exposure Misclassification in Ecologic Studies
Brenner, H., Savitz, D. A., Jöckel, K., et al. (1992) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116205 · Cited by 123 · see citing works
Iversen, G. R. (1991) · Sage eBooks · doi:10.4135/9781412983785 · Cited by 81 · see citing works
Specification, Residuals and Contextual Effects
Farkas, G. (1974) · Sociological Methods & Research · doi:10.1177/004912417400200304 · Cited by 51 · see citing works
Mackenbach, J. P. (1995) · Journal of Epidemiology & Community Health · doi:10.1136/jech.49.4.333 · Cited by 32 · see citing works
The Effects of Nondifferential Confounder Misclassification in Ecologic Studies
Brenner, H., Greenland, S., & Savitz, D. A. (1992) · Epidemiology · doi:10.1097/00001648-199209000-00013 · Cited by 29 · see citing works
What makes populations vulnerable to ill health?
Woodward, A. J. (1996) · PubMed · Cited by 5 · see citing works
Self-citationRe: Combined Poliomyelitis, Diphtheria, Pertussis, and Tetanus Prophylactics
Ipsen, J. (1959) · American Journal of Public Health and the Nations Health · doi:10.2105/ajph.49.5.678 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 11
- Diez-Roux A, Nieto F, Muntaner C, et al. Neighourhood environment and coronary heart disease: a multilevel analysis. Am J Epidemiol 1997;146:48-63.
- Durkheim E. Suicide. Glencoe, IL: Free Press, 1951. [Origi- nal work published in 1898].
- van den Eeden P, Huttner H. Multi-level research. The Jour- nal of the International Sociological Association 1982;30:1- 182.
- Blau P. Structural eVects. American Sociological Review 1960;25:178-93.
- Hauser R. Reply to Barton. American Journal of Sociology 1970;76:517-20.
- Morgenstern H. Ecologic studies. In: Rothman K, Green- land S, eds. Modern epidemiology. 2nd ed. Philadelphia: Lippincott-Raven, 1998:459-80.
- Susser M. Causal thinking in the health sciences: concepts and strategies in the health sciences. New York: Oxford University Press, 1973.
- Rothman K, Greenland S. Modern epidemiology. 2nd ed. Philadelphia: Lippincott-Raven, 1998.
- Brenner H, Greenland S, Jockel K-H, et al. EVects of non-diVerential exposure misclassification in ecologic studies. Am J Epidemiol 1992;135:85-95.
- Boyle M, Willms J. Place eVects for areas defined by admin- istrative boundaries. Am J Epidemiol 1999;149:577-85.
- Brenner H, Greenland S, Savitz D. The eVects of non-diVerential confounder misclassification in ecologic studies. Epidemiology 1992;3:456-9.
Cited by
Sorted by citations
Fixed and random effects models: making an informed choice
Bell, A., Fairbrother, M., & Jones, K. (2019) · Quality & Quantity · doi:10.1007/s11135-018-0802-x · Cited by 1,085 · see citing works
Is there a “school effect” on pupil outcomes? A review of multilevel studies
Sellström, E., & Bremberg, S. (2006) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2005.036707 · Cited by 306 · see citing works
Syndemics: a theory in search of data or data in search of a theory?
Tsai, A. C. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.03.040 · Cited by 185 · see citing works
Disparities in completion of substance abuse treatment between and within racial and ethnic groups
Guerrero, E. G., Marsh, J. C., Duan, L., Oh, C., Perron, B., & Lee, B. (2013) · Health Services Research · doi:10.1111/1475-6773.12031 · Cited by 168 · see citing works
Urban area disadvantage and physical activity: a multilevel study in Melbourne, Australia
Kavanagh, A. M., Goller, J. L., King, T., Jolley, D., Crawford, D., & Turrell, G. (2005) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2005.035931 · Cited by 162 · see citing works
Tuberculosis associated with household crowding in a developed country
Baker, M., Das, D., Venugopal, K., & Howden-Chapman, P. (2008) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2007.063610 · Cited by 155 · see citing works
Tsai, A. C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0123182 · Cited by 122 · see citing works
Comparative configurational case analysis of ergonomic injuries
Marx, A., & van Hootegem, G. (2007) · Journal of Business Research · doi:10.1016/j.jbusres.2007.01.012 · Cited by 25 · see citing works
Huang, F. L., Gregory, A., & Ward-Seidel, A. R. (2023) · Prevention Science · doi:10.1007/s11121-023-01507-3 · Cited by 21 · see citing works
- Authors
- Blakely, T. A., & Woodward, A. J.
- Affiliations
- University of Otago (NZ)
- Corresponding author
- Blakely, Tony A
- Venue
- Journal of Epidemiology and Community Health
- Publisher
- BMJ
- Published
- 2000-05-01
- Volume
- 54
- Issue
- 5
- Pages
- 367-374
- ISSN
- 0141-7681 (ISSN-L)
- 0143-005X
- 1470-2738
- PMC
- PMC1731678
- OpenAlex
- W2143847340
- Cited by
- 385
- References
- 44
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 10 · 2023: 8 · 2022: 14 · 2021: 16 · 2020: 10 · 2019: 12 · 2018: 16 · 2017: 6 · 2016: 17 · 2015: 12 · 2014: 17 · 2013: 27 · 2012: 23
- FWCI
- 20.85
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Epidemiology & Community Health (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Health › Health disparities and outcomes
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Sociology and Political Science › Historical and modern epidemiology studies
- Keywords
- ecological effects, multilevel analysis, socioeconomic determinants of health, ecological fallacy, intraclass correlation coefficient, selection bias, confounding, misclassification, model misspecification, multicollinearity, unit of analysis, socioeconomic deprivation, underserved areas
- MeSH terms
- Data Collection, Data Interpretation, Statistical, Environment, Humans, Socioeconomic Factors, Epidemiologic Research Design, Bias, Confounding Factors, Epidemiologic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review