A proposal for assessing study quality: Biomonitoring, Environmental Epidemiology, and Short-lived Chemicals (BEES-C) instrument
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
The quality of exposure assessment is a major determinant of the overall quality of any environmental epidemiology study. The use of biomonitoring as a tool for assessing exposure to ubiquitous chemicals with short physiologic half-lives began relatively recently. These chemicals present several challenges, including their presence in analytical laboratories and sampling equipment, difficulty in establishing temporal order in cross-sectional studies, short- and long-term variability in exposures and biomarker concentrations, and a paucity of information on the number of measurements required for proper exposure classification. To date, the scientific community has not developed a set of systematic guidelines for designing, implementing and interpreting studies of short-lived chemicals that use biomonitoring as the exposure metric or for evaluating the quality of this type of research for WOE assessments or for peer review of grants or publications. We describe key issues that affect epidemiology studies using biomonitoring data on short-lived chemicals and propose a systematic instrument--the Biomonitoring, Environmental Epidemiology, and Short-lived Chemicals (BEES-C) instrument--for evaluating the quality of research proposals and studies that incorporate biomonitoring data on short-lived chemicals. Quality criteria for three areas considered fundamental to the evaluation of epidemiology studies that include biological measurements of short-lived chemicals are described: 1) biomarker selection and measurement, 2) study design and execution, and 3) general epidemiological study design considerations. We recognize that the development of an evaluative tool such as BEES-C is neither simple nor non-controversial. We hope and anticipate that the instrument will initiate further discussion/debate on this topic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613
No adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965
Whiting, P., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-25 · Cited by 3,592
Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative.
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00010 · Cited by 3,219
Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · Radiology · doi:10.1148/radiol.2261021292 · Cited by 3,215
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181577511 · Cited by 2,779
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Ankley, G. T., Bennett, R. S., Erickson, R. J., Hoff, D. J., Hornung, M. W., Johnson, R. D., Mount, D. R., Nichols, J. W., Russom, C. L., Schmieder, P. K., et al. (2009) · Environmental Toxicology and Chemistry · doi:10.1002/etc.34 · Cited by 2,734
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 2×
“outcome reporting bias), which is defined as “selection on the basis of the results of a subset of the original variables recorded for inclusion in a publication” (Dwan et al., 2008).”
BackgroundHernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
Predictive data mining in clinical medicine: Current issues and guidelines
BELLAZZI, R., & ZUPAN, B. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.11.006 · Cited by 823
An evidence-based practice guideline for the peer review of electronic search strategies
Sampson, M., McGowan, J., Cogo, E., Grimshaw, J., Moher, D., & Lefebvre, C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.012 · Cited by 608
Zota, A. R., Calafat, A. M., & Woodruff, T. J. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1306681 · Cited by 585
Owens, D. K., Lohr, K. N., Atkins, D., Treadwell, J. R., Reston, J. T., Bass, E. B., Chang, S., & Helfand, M. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.03.009 · Cited by 513
Publication Bias: The Problem That Won't Go Away
DICKERSIN, K., & MIN, Y. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26343.x · Cited by 427
Blood Volume Changes in Normal Pregnancy
Hytten, F. (1985) · Clinics in Haematology · doi:10.1016/s0308-2261(21)00496-3 · Cited by 372
The False-positive to False-negative Ratio in Epidemiologic Studies
Ioannidis, J. P. A., Tarone, R., & McLaughlin, J. K. (2011) · Epidemiology · doi:10.1097/ede.0b013e31821b506e · Cited by 321 · cited 1×
“Even more recently, these approaches were further extended to allow calculating the FP:FN ratio (Ioannidis et al., 2011).”
BackgroundSemi-Automated Sensitivity Analysis to Assess Systematic Errors in Observational Data
Lash, T. L., & Fink, A. K. (2003) · Epidemiology · doi:10.1097/01.ede.0000071419.41011.cf · Cited by 250
Twenty-Four Hour Human Urine and Serum Profiles of Bisphenol A during High-Dietary Exposure
Teeguarden, J. G., Calafat, A. M., Ye, X., Doerge, D. R., Churchwell, M. I., Gunawan, R., & Graham, M. K. (2011) · Toxicological Sciences · doi:10.1093/toxsci/kfr160 · Cited by 215 · cited 2×
“…groups have noted the dif fi culties in attempting to measure BPA in blood samples, in part, because of contamination (including in solvents and reagents) despite great care taken to avoid such contamination (Calafat et al., 2013; Markham et al., 2010; Teeguarden et al., 2011; Ye et al., 2013).”
BackgroundMethodSelf-citationAn estimate of the science-wise false discovery rate and application to the top medical literature
Jager, L. R., & Leek, J. T. (2014) · Biostatistics · doi:10.1093/biostatistics/kxt007 · Cited by 179
Wang, H., Zhou, Y., Tang, C., He, Y., Wu, J., Chen, Y., & Jiang, Q. (2013) · PLoS ONE · doi:10.1371/journal.pone.0056800 · Cited by 141 · cited 2×
“The same concerns are also applicable to biomonitoring studies of shortlived chemicals such as phthalates (Durmaz et al., 2010; Wang et al., 2013; Wirth et al., 2008).”
BackgroundPlasma Phthalate Levels in Pubertal Gynecomastia
Durmaz, E., Özmert, E. N., Erkekoğlu, P., Giray, B., Derman, O., Hıncal, F., & Yurdakök, K. (2010) · Pediatrics · doi:10.1542/peds.2009-0724 · Cited by 126
Weed, D. (1997) · International Journal of Epidemiology · doi:10.1093/ije/26.6.1137 · Cited by 97 · cited 1×
“…perhaps the only inarguable, property of a causal association is tempo-rality, meaning that a claim of causation must be supported by an observation of the putative causal exposure preceding the outcome (Potischman and Weed, 1999; Rothman and Greenland, 2005; Weed, 1997; Weed and Gorelic, 1996).”
BackgroundMeasurement error in environmental epidemiology and the shape of exposure-response curves
Rhomberg, L. R., Chandalia, J. K., Long, C. M., & Goodman, J. E. (2011) · Critical Reviews in Toxicology · doi:10.3109/10408444.2011.563420 · Cited by 75 · cited 2×
“The effect of exposure error and exposure misclassification on the dose–response relationship is problematic (Rhomberg et al., 2011).”
Background
Cited by
Exposure assessment issues in epidemiology studies of phthalates
Johns, L. E., Cooper, G. S., Galizia, A., & Meeker, J. D. (2015) · Environment International · doi:10.1016/j.envint.2015.08.005 · Cited by 376
“Epidemiology, and Short lived Chemicals” (BEES-C) instrument for studies of commonly encountered non-persistent chemicals described by (LaKind et al. 2014).”
BackgroundMethodInfluentialMorgan, R. L., Thayer, K. A., Santesso, N., Holloway, A. C., Blain, R., Eftim, S. E., Goldstone, A. E., Ross, P., Guyatt, G., & Schünemann, H. J. (2018) · Environment International · doi:10.1016/j.envint.2018.08.018 · Cited by 106
Wirsching, J., Graßmann, S., Eichelmann, F., Harms, L. M., Schenk, M., Barth, E., Berndzen, A., Olalekan, M., Sarmini, L., Zuberer, H., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0583-x · Cited by 63
Metadata
- Authors
- LaKind, J. S., Sobus, J. R., Goodman, M., Barr, D. B., Fürst, P., Albertini, R. J., Arbuckle, T. E., Schoeters, G., Tan, Y.-M., Teeguarden, J., Tornero-Velez, R., & Weisel, C. P.
- Venue
- Environment International
- Publisher
- Elsevier BV
- Published
- 2014-12
- Volume
- 73
- Pages
- 195-207
- ISSN
- 0160-4120 (ISSN-L)
- OpenAlex
- W2043308942
- Cited by
- 95
- References
- 26
- FWCI
- 4.30
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.