Invited Commentary: Using Area-based Socioeconomic Measures—Think Conceptually, Act Cautiously
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Investigators dedicated to understanding social inequalities in health in the United States face major challenges. Key among them are data constraints, limitations in theory development, and disciplinary divides. A central data concern is that many data sets do not include adequate health and socioeconomic information. Growing conceptual interest in contextual influences on health leads some investigators to link census to health data in order to use area-based socioeconomic measures (ABSMs) to estimate contextual effects (1). When data permit, both microlevel socioeconomic variables and ABSMs are included in multilevel models to estimate area impacts on health above and beyond the characteristics of individuals (2). However, investigators have also used ABSMs to substitute for missing microlevel information, raising the difficult question of how well these aggregate variables serve to proxy individual characteristics. Investigators of this question have often warned of the dangers of making inferences about individual-level relations from aggregate-level variables, including ABSMs (3–12). It is not unusual for researchers to find substantially larger estimated effects when using aggregate variables compared with when using microlevel ones. Researchers from diverse fields have derived the conditions under which overestimates are likely (9, 11, 13). Overestimates are likely when, had both variables been included in the same regression equation, the estimated coefficient on the aggregate variable would have been larger than—and of the same sign as—the estimated coefficient on the missing microlevel variable. In the case where the explanatory variable is an indicator of socioeconomic position, this condition is met when the aggregate variable represents a broader construct than the microlevel variable or when there are contextual effects (8, 11, 12). Subramanian et al. approach the question of comparability between ABSMs and microlevel socioeconomic variables through an empirical analysis. They offer empirical evidence of contextual effects and argue that ABSMs are not interchangeable with microlevel variables but measure the broader construct of “a shared collective or contextual dimension that all individuals within a context share” (14, p. 829). Thus, their findings suggest that the conditions that other investigators conclude would most often set the stage for overestimating microlevel effects when using ABSMs are met in their analysis. Yet, Subramanian et al. conclude the opposite, stating that their study “demonstrates, at least in the case of disparities in (low) birth weight, that aptly chosen ABSMs provide estimates of health inequalities that are comparable with those based on individual-based socioeconomic measures. The risk, if any, in the absence of individual-based socioeconomic information is a conservative estimate of socioeconomic inequalities in health” (14, p. 833). In light of contradictory conclusions by other investigators, have Subramanian et al. demonstrated their claim, as they say they do? I believe the evidence they provide falls short of making their case. Their confidence in ABSMs is misplaced. Analyzing Massachusetts data for 1990, Subramanian et al. compare estimates of the effect of socioeconomic position on birth weight using three ABSMs, each measured at the census tract or block group level, with microlevel maternal and paternal education variables. They report that estimates from the two approaches are roughly comparable and, in cases where they differ, that the estimate using the ABSM is lower than that using the microlevel variable. However, also studying health outcomes and performing empirical work in the spirit of that reported by Subramanian et al., Geronimus et al. (11) and Geronimus and Bound (12) concluded that ABSMs have significant limitations as proxies for unavailable microlevel variables and are likely to overestimate effects compared with microlevel measures. Subramanian et al. cite those papers (11, 12) as “an earlier assessment questioning the validity of ABSMs” (14, p. 833) but do not engage in a scientific discussion of how to reconcile the dramatic differences in conclusions. Complementing the empirical analyses, Geronimus et al. (11) explicated a statistical model illuminating two potential sources of bias inherent in using an ABSM to measure individual characteristics: a downward bias due to measurement error and an upward bias that arises if the aggregate variable has an independent effect on the outcome. Geronimus et al. formalized this logic algebraically by constructing the hypothetical situation where the coefficient on an aggregate and a microlevel measure would be estimates of the same parameter. From this idealized model, they could illuminate the nature of how the real world falls short. The statistical model of Geronimus et al. (11) led them to predict that most often the aggregation bias would predominate, inflating estimates compared with a
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On the Pooling of Time Series and Cross Section Data
Mundlak, Y. (1978) · Econometrica · doi:10.2307/1913646 · Cited by 5,412
To mitigate, resist, or undo: addressing structural influences on the health of urban populations.
(2000) · American Journal of Public Health · doi:10.2105/ajph.90.6.867 · Cited by 407
Self-citationGeronimus, A. T., & Thompson, J. P. (2004) · Du Bois Review: Social Science Research on Race · doi:10.1017/s1742058x04042031 · Cited by 170
Self-citation
Cited by
Measuring socioeconomic position in health research
Galobardes, B., Lynch, J., & Smith, G. D. (2007) · British Medical Bulletin · doi:10.1093/bmb/ldm001 · Cited by 843
A Difference-in-Differences Analysis of Health, Safety, and Greening Vacant Urban Space
Branas, C. C., Cheney, R. A., MacDonald, J. M., Tam, V. W., Jackson, T. D., & Ten Have, T. R. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr273 · Cited by 599
Juhn, Y. J., Ryu, E., Wi, C.-I., King, K. S., Malik, M., Romero-Brufau, S., Weng, C., Sohn, S., Sharp, R. R., & Halamka, J. D. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac052 · Cited by 83
Metadata
- Authors
- Geronimus, A. T.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-09-12
- Volume
- 164
- Issue
- 9
- Pages
- 835-840
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2037390919
- Cited by
- 43
- References
- 3
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.