Imputation of data values that are less than a detection limit
Abstract
Results of the analyses of occupational and environmental samples are frequently reported as "less than a specified value," a practice followed by many analytical laboratories. A left-censored distribution occurs when analytical laboratories do not report results that fall below their limits of detection or quantification. Approximately 37% of the household interior dust lead loadings collected in a large-scale, multisite, longitudinal study of lead-based paint hazard controls were reported to be below the "method detection limit." These unreported values are unusable in any statistical analysis of the data and must be replaced by a valid dust lead loading estimate, a process called data imputation. This investigation tested how well data imputed using a newly formulated procedure for estimating the data below the method detection limit were correlated with dust lead loadings reported by the participating laboratories after special request. These results were also compared with those obtained by imputing the minimum detectable level by the square root of 2. Imputation of the low lead loadings was accomplished by substituting the value associated with the median percentile below each laboratory's method detection limit. A correlation of r = 0.50 was calculated between the predicted and reported dust lead loadings, with only slight bias (2.9%) in the predicted values. An alternative imputation procedure that used the predicted value from structural equation models fit to the noncensored dust lead loadings performed about as well, although the predictions had to be "centered" to correspond to the censored data. An estimator that combined both of these imputation procedures only slightly improved the correlation between the predicted and laboratory values (r = 0.51). These results support the use of the new procedure rather than the commonly used imputed values of the method detection limit divided by 2 or by the square root of 2. Imputing values based on either of these common approaches may result in much more biased predictions for the censored data; in the case of these data, the dust lead loadings were overestimated by 348%. The results also suggest that analytical laboratories should provide a numerical result for all analyzed samples, with a "flag" of those values below their detection limit, since these results may be more accurate than any imputed value, particularly those provided by the commonly used method of dividing the minimum detection limit by the square root of 2.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Zero-value or LOD imputation, like mean imputation, may distort feature distributions and lead to biased parameter and variability estimates.
“However, like mean imputation, imputed values from these approaches may distort feature distributions and lead to biased parameter and variability estimates (Lubin et al., 2004; Succop et al., 2004; Webb-Robertson et al., 2015; Lazar et al., 2016; Bramer et al., 2020).”
From Missing data in multi-omics integration: Recent advances through artificial intelligence (2023) · cites this paper as Succop et al., 2004
Cites
Estimation of Average Concentration in the Presence of Nondetectable Values
Hornung, R. W., & Reed, L. D. (1990) · Applied Occupational and Environmental Hygiene · doi:10.1080/1047322x.1990.10389587 · Cited by 3,495 · see citing works
Less than obvious - statistical treatment of data below the detection limit
Helsel, D. R. (1990) · Environmental Science & Technology · doi:10.1021/es00082a001 · Cited by 697 · see citing works
Ray, A. A. (1982) · SAS Institute eBooks · Cited by 229 · see citing works
Tables for Maximum Likelihood Estimates: Singly Truncated and Singly Censored Samples
Cohen, A. (1961) · Technometrics · doi:10.1080/00401706.1961.10489973 · Cited by 198 · see citing works
Estimation for small normal data sets with detection limits
Gleit, A. (1985) · Environmental Science & Technology · doi:10.1021/es00142a011 · Cited by 143 · see citing works
Tables for Maximum Likelihood Estimates: Singly Truncated and Singly Censored Samples
Cohen, A. (1961) · Technometrics · doi:10.2307/1266559 · Cited by 55 · see citing works
Evaluation of the HUD Lead Hazard Control Grant Program: Early Overall Findings
Galke, W. A., Clark, S., Wilson, J., et al. (2001) · Environmental Research · doi:10.1006/enrs.2001.4259 · Cited by 54 · see citing works
Self-citationEstimation in linear models with censored data
Schneider, H., & Weissfeld, L. A. (1986) · Biometrika · doi:10.1093/biomet/73.3.741 · Cited by 23 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Missing data in multi-omics integration: Recent advances through artificial intelligence
Flores, J. E., Claborne, D. M., Weller, Z. D., Webb-Robertson, B.-J. M., Waters, K. M., & Bramer, L. M. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1098308 · Cited by 181 · see citing works
“However, like mean imputation, imputed values from these approaches may distort feature distributions and lead to biased parameter and variability estimates (Lubin et al., 2004; Succop et al., 2004; Webb-Robertson et al., 2015; Lazar et al., 2016; Bramer et al., 2020).”
Background
- Authors
- Succop, P. A., Clark, S., Chen, M., & Galke, W.
- Affiliations
- University of Cincinnati (US)
- National Center for Healthy Housing (US)
- Venue
- Journal of Occupational and Environmental Hygiene
- Publisher
- Informa UK Limited
- Published
- 2004-07
- Volume
- 1
- Issue
- 7
- Pages
- 436-441
- ISSN
- 1545-9624 (ISSN-L)
- 1545-9632
- OpenAlex
- W2129934104
- Cited by
- 185
- References
- 8
- Citations by year
- 2026: 6 · 2025: 18 · 2024: 17 · 2023: 8 · 2022: 14 · 2021: 15 · 2020: 17 · 2019: 10 · 2018: 15 · 2017: 8 · 2016: 14 · 2015: 11 · 2014: 7 · 2013: 3 · 2012: 3
- FWCI
- 3.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Occupational and Environmental Hygiene (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Heavy Metal Exposure and Toxicity
- Keywords
- missing data imputation, censored data, detection limit, structural equation modeling, imputation bias
- MeSH terms
- Air Pollutants, Chemistry Techniques, Analytical, Data Interpretation, Statistical, Dust, Environmental Monitoring, Housing, Humans, Lead, Paint, Reference Values, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review