Racial bias and reproducibility in pulse oximetry among medical and surgical inpatients in general care in the Veterans Health Administration 2013-19: multicenter, retrospective cohort study
Open accessAbstract
Objectives: To evaluate measurement discrepancies by race between pulse oximetry and arterial oxygen saturation (as measured in arterial blood gas) among inpatients not in intensive care. Design: Multicenter, retrospective cohort study using electronic medical records from general care medical and surgical inpatients. Setting: Veteran Health Administration, a national and racially diverse integrated health system in the United States, from 2013 to 2019. Participants: Adult inpatients in general care (medical and surgical), in Veteran Health Administration medical centers. Main outcomes measures: Occult hypoxemia (defined as arterial blood oxygen saturation (SaO 2 ) of <88% despite a pulse oximetry (SpO 2 ) reading of ≥92%), and whether rates of occult hypoxemia varied by race and ethnic origin. Results: A total of 30 039 pairs of SpO 2 -SaO 2 readings made within 10 minutes of each other were identified during the study. These pairs were predominantly among non-Hispanic white (21 918 (73.0%)) patients; non-Hispanic black patients and Hispanic or Latino patients accounted for 6498 (21.6%) and 1623 (5.4%) pairs in the sample, respectively. Among SpO 2 values greater or equal to 92%, unadjusted probabilities of occult hypoxemia were 15.6% (95% confidence interval 15.0% to 16.1%) in white patients, 19.6% (18.6% to 20.6%) in black patients (P<0.001 v white patients, with similar P values in adjusted models), and 16.2% (14.4% to 18.1%) in Hispanic or Latino patients (P=0.53 v white patients, P<0.05 in adjusted models). This result was consistent in SpO 2 -SaO 2 pairs restricted to occur within 5 minutes and 2 minutes. In white patients, an initial SpO 2 -SaO 2 pair with little difference in saturation was associated with a 2.7% (95% confidence interval −0.1% to 5.5%) probability of SaO 2 <88% on a later paired SpO 2 -SaO 2 reading showing an SpO 2 of 92%, but black patients had a higher probability (12.9% (−3.3% to 29.0%)). Conclusions: In general care inpatient settings across the Veterans Health Administration where paired readings of arterial blood gas (SaO 2 ) and pulse oximetry (SpO 2 ) were obtained, black patients had higher odds than white patients of having occult hypoxemia noted on arterial blood gas but not detected by pulse oximetry. This difference could limit access to supplemental oxygen and other more intensive support and treatments for black patients.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Patients with darker skin pigmentation are more likely than patients with lighter skin color to have overestimated SpO2 readings.
“Patients with darker skin pigmentation are more likely than patients with lighter skin color to have overestimated SpO2 readings”
From Impact of skin pigmentation on pulse oximetry blood oxygenation and wearable pulse rate accuracy: systematic review and meta-analysis (2024) · cites this paper as [12]
The Results (Probability of occult hypoxemia) show that Black inpatients were more likely than white inpatients to have SpO2 readings that masked low arterial oxygen saturation. But the Discussion (Strengths and limitations) says skin color was not recorded and race was used as a surrogate, so the study does not directly establish the comparison by skin pigmentation stated in the claim. (LLM, conf=0.88)
Experimental — accuracy not yet measuredOverestimated SpO2 readings in patients with darker skin pigmentation lead to lower hospital admission, higher occult hypoxemia, delayed or no access to dexamethasone, therapeutic oxygen, and COVID-19 therapies, resulting in increased hospital readmission, organ dysfunction, and mortality.
“leading to lower hospital admission; higher occult hypoxemia; and delayed or no access to dexamethasone, therapeutic oxygen, and COVID-19 therapies, resulting in increased hospital readmission, organ dysfunction, and mortality [11-18].”
From Impact of skin pigmentation on pulse oximetry blood oxygenation and wearable pulse rate accuracy: systematic review and meta-analysis (2024) · cites this paper as [12]
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredBlack patients were at much higher risk of having occult hypoxemia due to overestimation of blood saturation by PO, thereby limiting access to supplemental oxygen.
“A recent study comparing arterial blood gas (invasive) with PO showed that Black patients were at much higher risk of having occult hypoxemia (an arterial oxygen blood saturation of <88%) due to overestimation of blood saturation by PO thereby limiting access to supplemental oxygen for Black patients.137”
From Effect of skin color on optical properties and the implications for medical optical technologies: a review (2024) · cites this paper as [137]
Skin pigmentation affects the accuracy of PO.
“A recent flurry in publications identifies that skin pigmentation affects the accuracy of PO.11,134–140”
From Effect of skin color on optical properties and the implications for medical optical technologies: a review (2024) · cites this paper as [137]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965 · see citing works
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020 · see citing works
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.008 · Cited by 17,893 · see citing works
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619 · see citing works
Comparing methods of measurement: why plotting difference against standard method is misleading
Bland, J. M., & Altman, D. G. (1995) · The Lancet · doi:10.1016/s0140-6736(95)91748-9 · Cited by 2,343 · see citing works
Racial bias in pulse oximetry measurement
Sjoding, M. W., Dickson, R. P., Iwashyna, T. J., Gay, S. E., & Valley, T. S. (2020) · New England Journal of Medicine · doi:10.1056/nejmc2029240 · Cited by 1,114 · see citing works
Self-citationChu, D. K., Kim, L. H.-Y., Young, P. J., Zamiri, N., Almenawer, S. A., Jaeschke, R., Szczeklik, W., Schünemann, H. J., Neary, J. D., & Alhazzani, W. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30479-3 · Cited by 778 · see citing works
Effects of skin pigmentation on pulse oximeter accuracy at low saturation
Bickler, P. E., Feiner, J. R., & Severinghaus, J. W. (2005) · Anesthesiology · doi:10.1097/00000542-200504000-00004 · Cited by 427 · see citing works
Feiner, J. R., Severinghaus, J. W., & Bickler, P. E. (2007) · Anesthesia & Analgesia · doi:10.1213/01.ane.0000285988.35174.d9 · Cited by 400 · see citing works
Jubran, A., & Tobin, M. J. (1990) · Chest · doi:10.1378/chest.97.6.1420 · Cited by 296 · see citing works
Wong, A.-K. I., Charpignon, M., Kim, H., Josef, C., de Hond, A. A. H., Fojas, J. J., Tabaie, A., Liu, X., Mireles-Cabodevila, E., Carvalho, L., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.31674 · Cited by 268 · see citing works
Luks, A. M., & Swenson, E. R. (2020) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202005-418fr · Cited by 263 · see citing works
Ries, A. L., Prewitt, L. M., & Johnson, J. J. (1989) · Chest · doi:10.1378/chest.96.2.287 · Cited by 145 · see citing works
Henry, N. R., Hanson, A. C., Schulte, P. J., Warner, N. S., Manento, M. N., Weister, T. J., & Warner, M. A. (2022) · Critical Care Medicine · doi:10.1097/ccm.0000000000005394 · Cited by 133 · see citing works
Racial discrepancy in pulse oximeter accuracy in preterm infants
Vesoulis, Z., Tims, A., Lodhi, H., Lalos, N., & Whitehead, H. (2022) · Journal of Perinatology · doi:10.1038/s41372-021-01230-3 · Cited by 120 · see citing works
Valbuena, V. S. M., Barbaro, R. P., Claar, D. D., Valley, T. S., Dickson, R. P., Gay, S. E., Sjoding, M. W., & Iwashyna, T. J. (2021) · CHEST Journal · doi:10.1016/j.chest.2021.09.025 · Cited by 114 · see citing works
Self-citationFour Types of Pulse Oximeters Accurately Detect Hypoxia during Low Perfusion and Motion
Louie, A., Feiner, J. R., Bickler, P. E., Rhodes, L., Bernstein, M., & Lucero, J. (2018) · Anesthesiology · doi:10.1097/aln.0000000000002002 · Cited by 106 · see citing works
Pulse Oximeter Performance, Racial Inequity, and the Work Ahead
Okunlola, O. E., Lipnick, M. S., Batchelder, P. B., Bernstein, M., Feiner, J. R., & Bickler, P. E. (2022) · Respiratory Care · doi:10.4187/respcare.09795 · Cited by 96 · see citing works
Ebmeier, S. J., Barker, M., Bacon, M., Beasley, R. C., Bellomo, R., Chong, C. K., Eastwood, G. M., Gilchrist, J., Kagaya, H., Pilcher, J., et al. (2018) · Anaesthesia and Intensive Care · doi:10.1177/0310057x1804600307 · Cited by 92 · see citing works
Association of Race With Pulse Oximetry Accuracy in Hospitalized Children
Andrist, E., Nuppnau, M., Barbaro, R. P., Valley, T. S., & Sjoding, M. W. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.4584 · Cited by 58 · see citing works
Self-citationA clinical evaluation of the accuracy of the Nellcor N-100 and Ohmeda 3700 pulse oximeters
Cecil, W. T., Thorpe, K. J., Fibuch, E. E., & Tuohy, G. F. (1988) · Journal of Clinical Monitoring · doi:10.1007/bf01618105 · Cited by 51 · see citing works
Wiles, M. D., El‐Nayal, A., Elton, G., Malaj, M., Winterbottom, J., Gillies, C., Moppett, I. K., & Bauchmuller, K. (2022) · Anaesthesia · doi:10.1111/anae.15581 · Cited by 45 · see citing works
Racial and Ethnic Bias in Pulse Oximetry and Clinical Outcomes
Valbuena, V. S. M., Merchant, R. M., & Hough, C. L. (2022) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2022.1903 · Cited by 37 · see citing works
Self-citationPhilip, K. E. J., Bennett, B., Fuller, S., Lonergan, B., McFadyen, C., Burns, J., Tidswell, R., & Vlachou, A. (2020) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2020-000778 · Cited by 35 · see citing works
Wang, X. Q., Vincent, B. M., Wiitala, W. L., et al. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0740-x · Cited by 32 · see citing works
Critical care trainees call for pulse oximetry reform
Hidalgo, D. C., Olusanya, O., & Harlan, E. (2021) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(21)00102-8 · Cited by 21 · see citing works
Wang, X. Q., Iwashyna, T. J., Prescott, H. C., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-051978 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- [13]NHS Race & Health Observatory. Pulse Oximeter Bias Highlighted in Rapid Review [press release]. 14 April 2021.
- [31]Sun R Karaca Z Wong HS. Trends in Hospital Inpatient Stays by Age and Payer, 2000-2015: Statistical Brief #235. Healthcare Cost and Utilization Project (HCUP) Statistical Briefs. Rockville (MD). Agency for Healthcare Research and Quality, 2006. 29578670
Cited by
Sorted by citations
Setchfield, K., Gorman, A., Simpson, A. H. R. W., Somekh, M. G., & Wright, A. J. (2024) · Journal of Biomedical Optics · doi:10.1117/1.jbo.29.1.010901 · Cited by 72 · see citing works
Singh, S., Bennett, M. R., Chen, C., Shin, S., Ghanbari, H., & Nelson, B. W. (2024) · Journal of Medical Internet Research · doi:10.2196/62769 · Cited by 36 · see citing works
- Authors
- Valbuena, V. S. M., Seelye, S., Sjoding, M. W., Valley, T. S., Dickson, R. P., Gay, S. E., Claar, D., Prescott, H. C., & Iwashyna, T. J.
- Affiliations
- University of Michigan (US)
- VA Center for Clinical Management Research (US)
- Corresponding author
- Iwashyna, Theodore J
- ORCID
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2022-07-06
- Volume
- 378
- Pages
- e069775
- ISSN
- 1756-1833 (ISSN-L)
- PMC
- PMC9254870
- OpenAlex
- W4283833691
- Cited by
- 127
- References
- 27
- Citations by year
- 2026: 19 · 2025: 27 · 2024: 38 · 2023: 31 · 2022: 12
- FWCI
- 7.85
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- BMJ (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institute on Aging (T32AG000221)
- National Heart, Lung, and Blood Institute (K01HL136687, R01HL158626, R01HL144599, K23HL140165)
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Non-Invasive Vital Sign Monitoring
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Race, Genetics, and Society
- Health Sciences › Medicine › Physiology › Clinical Laboratory Practices and Quality Control
- Keywords
- pulse oximetry, racial bias, arterial oxygen saturation, arterial blood gases, hospitalized patients, veterans, racial disparities, non-Hispanic Black patients, general care, reproducibility, hypoxemia detection, Veterans Health Administration, electronic health records, non-Hispanic White patients
- MeSH terms
- Adult, Hypoxia, Humans, Inpatients, Oximetry, Retrospective Studies, Reproducibility of Results, Veterans Health, Racism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review