The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
The Study of Group-Level Factors in Epidemiology: Rethinking Variables, Study Designs, and Analytical Approaches
Open accessAbstract
A key notion that has received much attention in epidemiology over the past few years has been that not all disease determinants can be conceptualized as individual-level attributes, hence the need to consider features of the groups to which individuals belong when studying the causes of ill health. This has led epidemiologists and public health researchers to rethink the ideas on ecologic studies and ecologic variables traditionally espoused in epidemiology (1–6). This reconceptualization of ecologic or group-level variables has been manifested, for example, in recent interest and debate on the possible health effects of group-level constructs, such as income inequality (7, 8), social capital (9, 10), and neighborhood characteristics (11–14). In this context, the advent of the statistical technique of multilevel models has been viewed as especially promising because of its ability to incorporate both group-level and individual-level predictors in the study of health (4, 15–17). The idea that factors beyond individuals, referred to as group-level, ecologic, macro-level, or population-level factors (1, 3, 5, 18, 19), are important to health is not new. Two well-known examples include the concept of herd immunity in infectious diseases and Rose’s distinction between the causes of cases and the causes of incidence rates in chronic diseases. Herd immunity implies that a person’s likelihood of contracting an infectious disease depends in part on the level of immunity in the population to which he or she belongs (20). In his seminal paper, “Sick Individuals and Sick Populations,” Geoffrey Rose (18) discusses a related concept: the idea that studies that focus on what distinguishes sick individuals from healthy individuals within a population or group may miss important disease determinants. This is because population-level factors are invariant within a population and, hence, cannot be investigated in studies restricted to comparisons of individuals within a population (21). To detect these factors, researchers need studies that compare different populations (or groups) and investigate population-level (or group-level) factors. Discussions of group-level and individual-level factors in epidemiology are sometimes interpreted as implying that population-level factors are important in understanding between-population differences and that individual-level factors are important in understanding between-individual differences. A key point, however, is that factors at multiple levels may be important to understanding the causes of variability within a level. For example, both individual-level and group-level factors are important in understanding the causes of between-population differences in disease rates. Likewise, both population-level and individual-level factors are important in understanding the causes of disease in individuals. For example, herd immunity, a group-level property, is important in understanding not only the reasons for group differences in the incidence of disease but also an individual’s probability of contracting the disease. Group-level or population-level factors, such as the mass production of foods, may be important in understanding not only between-country differences in rates of hypertension but also the causes of hypertension in an individual. Of course, only individual-level factors will explain interindividual differences in outcomes within groups (18, 21). Although discussion of the importance of group-level or population-level factors has long been present in epidemiology, the interest in empirically testing for group effects in epidemiologic studies is relatively new. This interest has recently motivated many methodological discussions on the uses and misuses of ecologic variables and the strengths and limitations of multilevel models (1, 2, 4, 15, 22–24). This review will summarize selected issues related to the use of ecologic variables, ecologic studies, and multilevel studies in epidemiology. It will conclude with a discussion of the new challenges raised by the emerging multilevel paradigm. The focus will be on basic conceptual and methodological issues, rather than on specific empirical applications. Several different terms, including macro-level, ecologic, population-level, and group-level factors, have been used to refer to factors defined above the level of individuals (1, 3, 5, 18, 19, 25, 26). In the remainder of this paper, the terms “groups” and “group-level variables” will be used to refer generically to higher-level units (units defined above the lowest level at which the outcome is measured) and the variables that characterize them. These groups can be families, friendship groups, neighborhoods, schools, states, countries, and so on. The term “individuals” will be used generically to refer to the lower-level units nested within the higher-level units. Individuals can be persons nested within neighborhoods, families, or countries. The lower-level units can also be small
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Multilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 10,963
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
(2001) · Statistics for Psychologists · doi:10.4324/9781410605542-11 · Cited by 6,877
Multilevel analysis techniques and applications
Hox, J. J., Moerbeek, M., & van de Schoot, R. (2002) · Cited by 6,735
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
Ecological Correlations and the Behavior of Individuals
Robinson, W. S. (1950) · American Sociological Review · doi:10.2307/2087176 · Cited by 4,513
Models for Longitudinal Data: A Generalized Estimating Equation Approach
Zeger, S. L., Liang, K.-Y., & Albert, P. S. (1988) · Biometrics · doi:10.2307/2531734 · Cited by 4,505
Sick individuals and sick populations
Rose, G. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.3.427 · Cited by 3,736
Introducing Multilevel Modeling
Kreft, I., & de Leeuw, J. (1998) · doi:10.4135/9781849209366 · Cited by 2,997
Estimating Causal Effects from Large Data Sets Using Propensity Scores
Rubin, D. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00064 · Cited by 2,877
Pickett, K. E., & Pearl, M. (2001) · Journal of Epidemiology and Community Health · doi:10.1136/jech.55.2.111 · Cited by 2,187
Place effects on health: how can we conceptualise, operationalise and measure them?
Macintyre, S., Ellaway, A., & Cummins, S. (2002) · Social Science & Medicine · doi:10.1016/s0277-9536(01)00214-3 · Cited by 2,057
Social capital and self-rated health: a contextual analysis.
Kawachi, I., Kennedy, B. P., & Glass, R. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.8.1187 · Cited by 1,856
Investigating Neighborhood and Area Effects on Health
Diez Roux, A. V. (2001) · American Journal of Public Health · doi:10.2105/ajph.91.11.1783 · Cited by 1,841
Self-citationNeighborhood of residence and incidence of coronary heart disease
Roux, A. V. D., Merkin, S. S., Arnett, D., Chambless, L., Massing, M., Nieto, F. J., Sorlie, P., Szklo, M., Tyroler, H. A., & Watson, R. L. (2001) · New England Journal of Medicine · doi:10.1056/nejm200107123450205 · Cited by 1,799
Self-citationIdentifiability and exchangeability for direct and indirect effects
Robins, J. M., & Greenland, S. (1992) · Epidemiology · doi:10.1097/00001648-199203000-00013 · Cited by 1,793
A N EW A PPROACH TO D ECODING L IFE : Systems Biology
Ideker, T., Galitski, T., & Hood, L. (2001) · Annual Review of Genomics and Human Genetics · doi:10.1146/annurev.genom.2.1.343 · Cited by 1,664
Bringing context back into epidemiology: variables and fallacies in multilevel analysis
Diez-Roux, A. V. (1998) · American Journal of Public Health · doi:10.2105/ajph.88.2.216 · Cited by 1,317
Self-citationApplied Mixed Models in Medicine
Brown, H., & Presco, R. (2000) · Technometrics · doi:10.1080/00401706.2000.10485742 · Cited by 1,262
Multilevel Analysis in Public Health Research
Diez-Roux, A. V. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.171 · Cited by 1,220
Self-citationRaudenbush, S. W., & Sampson, R. J. (1999) · Sociological Methodology · doi:10.1111/0081-1750.00059 · Cited by 1,087
Herd Immunity: History, Theory, Practice
Fine, P. E. M. (1993) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a036121 · Cited by 905
PIANTADOSI, S., BYAR, D. P., & GREEN, S. B. (1988) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114892 · Cited by 821
Ecologic Studies in Epidemiology: Concepts, Principles, and Methods
Morgenstern, H. (1995) · Annual Review of Public Health · doi:10.1146/annurev.pu.16.050195.000425 · Cited by 818
The fallacy of the ecological fallacy: the potential misuse of a concept and the consequences.
Schwartz, S. (1994) · American Journal of Public Health · doi:10.2105/ajph.84.5.819 · Cited by 777
The (mis)estimation of neighborhood effects: causal inference for a practicable social epidemiology
Oakes, J. M. (2004) · Social Science & Medicine · doi:10.1016/j.socscimed.2003.08.004 · Cited by 760
Longford, N. T. (2011) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-642-04898-2_471 · Cited by 745
Context, composition and heterogeneity: using multilevel models in health research
Duncan, C., Jones, K., & Moon, G. (1998) · Social Science & Medicine · doi:10.1016/s0277-9536(97)00148-2 · Cited by 689
A glossary for multilevel analysis
Diez Roux, A. V. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.8.588 · Cited by 670
Self-citationHarding, D. J. (2003) · American Journal of Sociology · doi:10.1086/379217 · Cited by 644
Design Concepts in Nutritional Epidemiology
(1997) · doi:10.1093/acprof:oso/9780192627391.001.0001 · Cited by 643
Balfour, J. L. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.6.507 · Cited by 595
Statistical power and optimal design for multisite randomized trials.
Raudenbush, S. W., & Liu, X. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.199 · Cited by 593
Fallibility in estimating direct effects
Cole, S. R., & Hernán, M. A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.163 · Cited by 548
Ecological Bias, Confounding, and Effect Modification
GREENLAND, S., & MORGENSTERN, H. (1989) · International Journal of Epidemiology · doi:10.1093/ije/18.1.269 · Cited by 540
Geronimus, A. T., & Bound, J. (1998) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009673 · Cited by 485
Estimation in Covariance Components Models
Dempster, A. P., Rubin, D. B., & Tsutakawa, R. K. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477653 · Cited by 452
Neighborhood Social Environment and Risk of Death: Multilevel Evidence from the Alameda County Study
Yen, I. H., & Kaplan, G. A. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009733 · Cited by 449
The logic in ecological: I. The logic of analysis.
Susser, M. (1994) · American Journal of Public Health · doi:10.2105/ajph.84.5.825 · Cited by 436
A Rule for Inferring Individual-Level Relationships from Aggregate Data
Firebaugh, G. (1978) · American Sociological Review · doi:10.2307/2094779 · Cited by 400
Estimating neighborhood health effects: the challenges of causal inference in a complex world
Diez Roux, A. V. (2004) · Social Science & Medicine · doi:10.1016/s0277-9536(03)00414-3 · Cited by 386
Self-citationEcological effects in multi-level studies
Blakely, T. A., & Woodward, A. J. (2000) · Journal of Epidemiology and Community Health · doi:10.1136/jech.54.5.367 · Cited by 385
Multilevel Models: Methods and Substance
DiPrete, T. A., & Forristal, J. D. (1994) · Annual Review of Sociology · doi:10.1146/annurev.so.20.080194.001555 · Cited by 370
A sociological reader on complex organizations
Etzioni, A. (1969) · Cited by 365
Ecological approaches: the rediscovery of the role of the physical and social environment
Macintyre, S., & Ellaway, A. (2000) · Cited by 360
Contextual Analysis through the Multilevel Linear Model
Mason, W. M., Wong, G. Y., & Entwisle, B. (1983) · Sociological Methodology · doi:10.2307/270903 · Cited by 349
Neighborhoods and Health: An Overview
Macintyre, S., & Ellaway, A. (2003) · Neighborhoods and Health · doi:10.1093/acprof:oso/9780195138382.003.0002 · Cited by 339
Multilevel Methods for Public Health Research
Subramanian, S. V., Jones, K., & Duncan, C. (2003) · Neighborhoods and Health · doi:10.1093/acprof:oso/9780195138382.003.0004 · Cited by 332
O'Campo, P. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwf171 · Cited by 331
Context and Consex: A Cautionary Tale
Hauser, R. M. (1970) · American Journal of Sociology · doi:10.1086/224894 · Cited by 300
Social capital—Is it a good investment strategy for public health?: Figure 1
LYNCH, J., DUE, P., MUNTANER, C., & SMITH, G. D. (2000) · Journal of Epidemiology and Community Health · doi:10.1136/jech.54.6.404 · Cited by 287
Contextual-Effects Models: Theoretical and Methodological Issues
Blalock, H. M. (1984) · Annual Review of Sociology · doi:10.1146/annurev.so.10.080184.002033 · Cited by 282
Systems biology: integrating technology, biology, and computation
Hood, L. (2003) · Mechanisms of Ageing and Development · doi:10.1016/s0047-6374(02)00164-1 · Cited by 265
Evaluating Welfare and Training Programs.
Crane, J., Manski, C. F., & Garfinkel, I. (1992) · Contemporary Sociology · doi:10.2307/2075695 · Cited by 253
The right answer for the wrong question: consequences of type III error for public health research.
Schwartz, S., & Carpenter, K. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.8.1175 · Cited by 239
The control of confounding by intermediate variables
Robins, J. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080608 · Cited by 234
Geronimus, A. T., Bound, J., & Neidert, L. J. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476918 · Cited by 233
The relevance of multilevel statistical methods for identifying causal neighborhood effects
Subramanian, S. V. (2004) · Social Science & Medicine · doi:10.1016/s0277-9536(03)00415-5 · Cited by 231
Multilevel Cross-Classified Models
GOLDSTEIN, H. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003005 · Cited by 198
The logic in ecological: II. The logic of design.
Susser, M. (1994) · American Journal of Public Health · doi:10.2105/ajph.84.5.830 · Cited by 194
Using aggregate geographic data to proxy individual socioeconomic status: does size matter?
(2001) · American Journal of Public Health · doi:10.2105/ajph.91.4.632 · Cited by 189
Multi-level Analysis in Epidemiologic Research on Health Behaviors and Outcomes
Von Korff, M., Koepsell, T., Curry, S., & Diehr, P. (1992) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116207 · Cited by 180
Individual causal models and population system models in epidemiology.
Koopman, J. S., & Lynch, J. W. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.8.1170 · Cited by 167
Two Sources of Error in Ecological Correlations
Hammond, J. L. (1973) · American Sociological Review · doi:10.2307/2094137 · Cited by 159
Sloggett, A., & Joshi, H. E. (1998) · Journal of Epidemiology & Community Health · doi:10.1136/jech.52.4.228 · Cited by 136
The Quantitative Assessment of Neighborhood Social Environments
Raudenbush, S. W. (2003) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195138382.003.0005 · Cited by 110
A review of multilevel theory for ecologic analyses
Greenland, S. (2002) · Statistics in Medicine · doi:10.1002/sim.1024 · Cited by 96
Is Molecular Epidemiology a Germ Theory for the End of the Twentieth Century?
LOOMIS, D. P., & Wing, S. (1990) · International Journal of Epidemiology · doi:10.1093/ije/19.1.1 · Cited by 92
Commentary: Estimating direct and indirect effects—fallible in theory, but in the real world?
Blakely, T. A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.166 · Cited by 45
Commentary: Plugging leaks and repelling boarders—where to next for the SS Income Inequality?
Lynch, J. W., Harper, S. B., & Smith, G. D. (2003) · International Journal of Epidemiology · doi:10.1093/ije/dyg318 · Cited by 44
Response: In defence of the income inequality hypothesis
Subramanian, S. V., & Kawachi, I. I. (2003) · International Journal of Epidemiology · doi:10.1093/ije/dyg325 · Cited by 35
Cited by
Understanding and representing ‘place’ in health research: A relational approach
Cummins, S., Curtis, S., Diez-Roux, A. V., & Macintyre, S. (2007) · Social Science & Medicine · doi:10.1016/j.socscimed.2007.05.036 · Cited by 1,359
Self-citationThe Built Environment and Obesity
Papas, M. A., Alberg, A. J., Ewing, R., Helzlsouer, K. J., Gary, T. L., & Klassen, A. C. (2007) · Epidemiologic Reviews · doi:10.1093/epirev/mxm009 · Cited by 1,078
Measuring socioeconomic position in health research
Galobardes, B., Lynch, J., & Smith, G. D. (2007) · British Medical Bulletin · doi:10.1093/bmb/ldm001 · Cited by 843
Mapping community determinants of heat vulnerability
Reid, C. E., O’Neill, M. S., Gronlund, C. J., Brines, S. J., Brown, D. G., Diez-Roux, A. V., & Schwartz, J. (2009) · Environmental Health Perspectives · doi:10.1289/ehp.0900683 · Cited by 805
Self-citationNeighborhood Environment in Studies of Health of Older Adults
Yen, I. H., Michael, Y. L., & Perdue, L. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.06.022 · Cited by 798
Metadata
- Authors
- Diez Roux, A. V.
- Venue
- Epidemiologic Reviews
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-07-01
- Volume
- 26
- Issue
- 1
- Pages
- 104-111
- ISSN
- 0193-936X (ISSN-L)
- 1478-6729
- OpenAlex
- W2102245649
- Cited by
- 304
- References
- 73
- FWCI
- 20.14
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.