A Cautionary Tale: Using Propensity Scores to Estimate the Effect of Food Stamps on Food Insecurity
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
This article uses propensity scores to evaluate the effect of food stamps on food insecurity, a measure of inadequate food supply. It relies on data from the Early Childhood Longitudinal Study‐Kindergarten Cohort. By balancing treatment and comparison groups on covariates, the propensity score method adjusts for bias caused by observed variables. This method may be preferable to regression because it does not rely on a linear functional form to adjust for potential confounding variables. Results show that food stamps do not decrease the probability of being food insecure, although they lessen the severity of the problem according to some models. However, propensity scores rely on several stringent assumptions, including the need for a common support region (where two compared groups share the same characteristics) and a properly specified model. Propensity scores should therefore be employed with caution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme
Heckman, J. J., Ichimura, H., & Todd, P. E. (1997) · The Review of Economic Studies · doi:10.2307/2971733 · Cited by 5,486
Matching As An Econometric Evaluation Estimator
Heckman, J. J., Ichimura, H., & Todd, P. (1998) · Review of Economic Studies · doi:10.1111/1467-937x.00044 · Cited by 3,807 · cited 1×
“…0 ⊥ This equation formally states the conditional independence assumption and essentially identifies the counterfactual for the treatment group—for example, what their level of food insecurity would have been in the absence of Food Stamp receipt (Heckman et al., 1998; Smith and Todd, in press).”
BackgroundDoes matching overcome lalonde’s critique of nonexperimental estimators?
A. Smith, J., & E. Todd, P. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.011 · Cited by 3,176
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
Hirano, K., & Imbens, G. W. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020371312283 · Cited by 1,039 · cited 1×
“Using propensity scores as weights should ensure that the treatment indicator (for example, the use of Food Stamps) is not confounded with the potentially endogenous observed covariates (Hirano and Imbens, 2001; Imbens, 2004).”
BackgroundUsing matching, instrumental variables and control functions to estimate economic choice models
Heckman, J., & Navarro-Lozano, S. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023660 · Cited by 768
How robust is the evidence on the effects of college quality? Evidence from matching
Black, D. A., & Smith, J. A. (2004) · Journal of Econometrics · doi:10.1016/j.jeconom.2003.10.006 · Cited by 673 · cited 2×
“Instead of matching directly on X, we match on the predicted probability of using the treatment.”
BackgroundMethodFood insecurity is associated with adverse health outcomes among human infants and toddlers.
Cook, J. T., Frank, D. A., Meyers, A. F., Berkowitz, C., Black, M. M., Casey, P. H., Cutts, D. B., Zaldivar, N., Skalicky, A., Levenson, S., et al. (2004) · The Journal of Nutrition · doi:10.1093/jn/134.6.1432 · Cited by 665 · cited 2×
“8 Cook et al. (2004) found that Food Stamps reduced, but did not eliminate, food insecurity among a sample of urban parents; Oberholser and Tuttle (2004) found no such relationship in their telephone survey of Food Stamp recipients in Maryland.”
BackgroundMethodAccounting for No-Shows in Experimental Evaluation Designs
Bloom, H. S. (1984) · Evaluation Review · doi:10.1177/0193841x8400800205 · Cited by 532
Cited by
A Systematic Review of Propensity Score Methods in the Social Sciences
Thoemmes, F. J., & Kim, E. S. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.540475 · Cited by 577
How Much Does the Supplemental Nutrition Assistance Program Reduce Food Insecurity?
Ratcliffe, C., McKernan, S.-M., & Zhang, S. (2011) · American Journal of Agricultural Economics · doi:10.1093/ajae/aar026 · Cited by 442
National Center for Injury Prevention and Control (U.S.). Division of Violence Prevention., Fortson, B. L., Klevens, J., Merrick, M. T., Gilbert, L. K., & Alexander, S. P. (2016) · doi:10.15620/cdc.38864 · Cited by 334
Comparing Outcomes for Youth Served in Treatment Foster Care and Treatment Group Care
Robst, J., Armstrong, M., & Dollard, N. (2011) · Journal of Child and Family Studies · doi:10.1007/s10826-011-9447-2 · Cited by 28
Promoting Persistence: The Role of Academic Advisors
Tippetts, M. M., Brandley, A. T., Metro, J., King, M., Ogren, C., & Zick, C. D. (2022) · Journal of College Student Retention: Research, Theory & Practice · doi:10.1177/1521025120924804 · Cited by 28
Metadata
- Authors
- Gibson‐Davis, C. M., & Foster, E. M.
- Venue
- Social Service Review
- Publisher
- University of Chicago Press
- Published
- 2006-03
- Volume
- 80
- Issue
- 1
- Pages
- 93-126
- ISSN
- 0037-7961 (ISSN-L)
- 1537-5404
- OpenAlex
- W2000773509
- Cited by
- 117
- References
- 10
- FWCI
- 9.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Cautionary Tale: Using Propensity Scores to Estimate the Effect of Food Stamps on Food Insecurity. https://app.cochat.ai/papers/10.1086/499416
- The paper
- Gibson‐Davis, C. M., & Foster, E. M. (2006). A Cautionary Tale: Using Propensity Scores to Estimate the Effect of Food Stamps on Food Insecurity. Social Service Review. https://doi.org/10.1086/499416
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.