Cited by 15Telemedicine and Telehealth ImplementationCOVID-19 Impact on ReproductionMaternal Mental Health During Pregnancy and Postpartum

Sudden Shift to Telehealth in COVID‐19: A Retrospective Cohort Study of Disparities in Use of Telehealth for Prenatal Care in a Large Midwifery Service

Open access
Smith, Denise C., Thumm, E. Brie, Anderson, Jessica, Kissler, Katherine, Reed, Sean M., Centi, Sophia M., Staley, Alyse W., Hernandez, Teri L. +1 more·2024·Journal of Midwifery & Women's Health

Abstract

Introduction: The coronavirus disease 2019 (COVID‐19) pandemic created disruption in health care delivery, including a sudden transition to telehealth use in mid‐March 2020. The purpose of this study was to examine changes in the mode of prenatal care visits and predictors of telehealth use (provider‐patient messaging, telephone visits, and video visits) during the COVID‐19 pandemic among those receiving care in a large, academic nurse‐midwifery service. Methods: We conducted a retrospective cohort study of those enrolled for prenatal care in 2 nurse‐midwifery clinics between 2019 and 2021 (n = 3172). Use outcomes included number and type of encounter: in‐person and telehealth (primary outcome). Comparisons were made in frequency and types of encounters before and during COVID‐19. A negative binomial regression was fit on the outcome of telehealth encounter count, with race/ethnicity, age, language, parity, hypertension, diabetes, and depression as predictors. Results: When comparing pre–COVID‐19 (before March 2020) with during COVID‐19 (after March 2020), overall encounters increased from 15.9 to 19.5 mean number of encounters per person (P < .001). The increase was driven by telehealth encounters; there were no significant differences for in‐person prenatal visit counts before and during the pandemic period. Direct patient‐provider messaging was the most common type of telehealth encounter. Predictors of telehealth encounters included English as primary language and diagnoses of diabetes or depression. Discussion: No differences in the frequency of in‐person prenatal care visits suggests that telehealth encounters led to more contact with midwives and did not replace in‐person encounters. Spanish‐speaking patients were least likely to use telehealth‐delivered prenatal care during the pandemic; a small, but significant, proportion of patients had no or few telehealth encounters, and a significant proportion had high use of telehealth. Integration of telehealth in future delivery of prenatal care should consider questions of equity, patient and provider satisfaction, access, redundancies, and provider workload.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/jmwh.13601

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Interrupted time series controls for underlying temporal trends while estimating both immediate level changes and sustained slope modifications.

    “This approach controls for underlying temporal trends while estimating both immediate level changes and sustained slope modifications [22, 27].”

    From Telemedicine implementation and healthcare utilization in Rwanda: interrupted time series of Babyl digital health services from 2015 to 2024 (2026) · cites this paper as [27]

    The Data Analysis section (page not provided) describes pre/post comparisons using t-tests and predictors modeled with negative binomial regression. Searches for interrupted time series, temporal trends, level changes, and slope changes found no passage in our copy explaining the claimed properties of interrupted time series. (LLM, conf=0.76)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 26

  1. LeRouge C, Garfield MJ. Crossing the Telemedicine Chasm: Have the U.S. Barriers to Widespread Adoption of Telemedicine Been Significantly Reduced? International Journal of Environmental Research and Public Health. 2013;10(12):6472-6484. doi:10.3390/ijerph10126472 [PubMed: 24287864] · DOI
  2. Ukoha EP, Davis K, Yinger M, et al. Ensuring Equitable Implementation of Telemedicine in Perinatal Care. Obstet Gynecol. Mar 1 2021;137(3):487-492. doi:10.1097/aog.0000000000004276 [PubMed: 33543895] · DOI
  3. Smith DC, Anderson JL, Carrington S, Nacht A, Nodine PM, Barton AJ. Contemporary Nurse-Midwifery Care in Colorado: A Survey of Certified Nurse-Midwife Practices in Hospital and Community Settings. Policy, Politics, & Nursing Practice. 2023:15271544221147301. doi:10.1177/15271544221147301 · DOI
  4. Friedman Peahl A, Heisler M, Essenmacher LK, et al. A comparison of international prenatal care guidelines for low-risk women to inform high-value care. American Journal of Obstetrics and Gynecology. 2020/05/01/ 2020;222(5):505-507. doi:10.1016/j.ajog.2020.01.021 [PubMed: 31962108] · DOI
  5. Nelson DB, Moniz MH, Davis MM. Population-level factors associated with maternal mortality in the United States, 1997-2012. BMC Public Health. Aug 13 2018;18(1):1007. doi:10.1186/ s12889-018-5935-2 [PubMed: 30103716] · DOI
  6. Mbuagbaw L, Medley N, Darzi AJ, Richardson M, Habiba Garga K, Ongolo-Zogo P. Health system and community level interventions for improving antenatal care coverage and health outcomes. Cochrane Database Syst Rev. Dec 1 2015;2015(12):Cd010994. doi:10.1002/14651858.CD010994.pub2 [PubMed: 26621223] · DOI · Paper page
  7. Balk EM, Konnyu KJ, Cao W, et al. Schedule of Visits and Televisits for Routine Antenatal Care: A Systematic Review. Agency for Healthcare Research and Quality (US), Rockville (MD); 2022.
  8. Wu KK, Lopez C, Nichols M. Virtual Visits in Prenatal Care: An Integrative Review. J Midwifery Womens Health. Jan 2022;67(1):39-52. doi:10.1111/jmwh.13284 [PubMed: 34767317] · DOI
  9. Cantor AG, Jungbauer RM, Totten AM, et al. Telehealth Strategies for the Delivery of Maternal Health Care : A Rapid Review. Ann Intern Med. Sep 2022;175(9):1285-1297. doi:10.7326/ m22-0737 [PubMed: 35878405] · DOI
  10. Duryea EL, Adhikari EH, Ambia A, Spong C, McIntire D, Nelson DB. Comparison Between In-Person and Audio-Only Virtual Prenatal Visits and Perinatal Outcomes. JAMA Network Open. 2021;4(4):e215854-e215854. doi:10.1001/jamanetworkopen.2021.5854 [PubMed: 33852002] · DOI
  11. Jeganathan S, Prasannan L, Blitz MJ, Vohra N, Rochelson B, Meirowitz N. Adherence and acceptability of telehealth appointments for high-risk obstetrical patients during the coronavirus disease 2019 pandemic. Am J Obstet Gynecol MFM. Nov 2020;2(4):100233. doi:10.1016/ j.ajogmf.2020.100233 [PubMed: 32984803] · DOI
  12. Futterman I, Rosenfeld E, Toaff M, et al. Addressing Disparities in Prenatal Care via Telehealth During COVID-19: Prenatal Satisfaction Survey in East Harlem. Am J Perinatol. Jan 2021;38(1):88-92. doi:10.1055/s-0040-1718695 [PubMed: 33038898] · DOI
  13. Ukoha EP, Yee LM. Use of Electronic Patient Portals in Pregnancy: An Overview. J Midwifery Womens Health. 2018;63(3):335-339. doi:10.1111/jmwh.12761 [PubMed: 29758124] · DOI
  14. Tai-Seale M, Dillon EC, Yang Y, et al. Physicians' Well-Being Linked To In-Basket Messages Generated By Algorithms In Electronic Health Records. Health Aff (Millwood). 2019/07/01 2019;38(7):1073-1078. doi:10.1377/hlthaff.2018.05509 [PubMed: 31260371] · DOI
  15. de Mooij MJM, Hodny RL, O'Neil DA, et al. OB Nest: Reimagining Low-Risk Prenatal Care. Mayo Clinic Proceedings. 2018/04/01/ 2018;93(4):458-466. doi:10.1016/j.mayocp.2018.01.022 [PubMed: 29545005] · DOI
  16. Kahn MG, Raebel MA, Glanz JM, Riedlinger K, Steiner JF. A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research. Medical care. 2012;50 Suppl(0):S21-S29. doi:10.1097/MLR.0b013e318257dd67 [PubMed: 22692254] · DOI · Paper page
  17. Peahl AF, Howell JD. The evolution of prenatal care delivery guidelines in the United States. American Journal of Obstetrics and Gynecology. 2021/04/01/ 2021;224(4):339-347. doi:10.1016/ j.ajog.2020.12.016 [PubMed: 33316276] · DOI
  18. Singh P, Jonnalagadda P, Morgan E, Fareed N. Outpatient portal use in prenatal care: differential use by race, risk, and area social determinants of health. Journal of the American Medical Informatics Association. 2021;29(2):364-371. doi:10.1093/jamia/ocab242 · DOI
  19. Brownson RC, Kumanyika SK, Kreuter MW, Haire-Joshu D. Implementation science should give higher priority to health equity. Implementation Science. 2021;16(1):1-16. [PubMed: 33413491]
  20. Yao R, Zhang W, Evans R, Cao G, Rui T, Shen L. Inequities in Health Care Services Caused by the Adoption of Digital Health Technologies: Scoping Review. J Med Internet Res. 2022/3/21 2022;24(3):e34144. doi:10.2196/34144 [PubMed: 35311682] · DOI · Paper page
  21. North F, Crane SJ, Chaudhry R, et al. Impact of Patient Portal Secure Messages and Electronic Visits on Adult Primary Care Office Visits. Telemedicine and e-Health. 2014/03/01 2013;20(3):192-198. doi:10.1089/tmj.2013.0097 [PubMed: 24350803] · DOI · Paper page
  22. Krans EE, Davis MM, Palladino CL. Disparate patterns of prenatal care utilization stratified by medical and psychosocial risk. Matern Child Health J. May 2013;17(4):639-45. doi:10.1007/ s10995-012-1040-9 [PubMed: 22581379] · DOI
  23. Cronin RM, Davis SE, Shenson JA, Chen Q, Rosenbloom ST, Jackson GP. Growth of Secure Messaging Through a Patient Portal as a Form of Outpatient Interaction across Clinical Specialties. Appl Clin Inform. 2017/12/19 2015;06(02):288-304. doi:10.4338/ACI-2014-12- RA-0117 · DOI
  24. DiAngi YT, Stevens LA, Halpern -Felsher B, Pageler NM, Lee TC. Electronic health record (EHR) training program identifies a new tool to quantify the EHR time burden and improves providers' perceived control over their workload in the EHR. JAMIA Open. 2019;2(2):222-230. doi:10.1093/jamiaopen/ooz003 [PubMed: 31984357] · DOI · Paper page
  25. Murthy VH. Confronting Health Worker Burnout and Well-Being. New England Journal of Medicine. 2022;387(7):577-579. doi:10.1056/NEJMp2207252 [PubMed: 35830683] · DOI
  26. Bashshur RL. Guest Editorial: Compelling Issues in Telemedicine. Telemedicine and e-Health. 2013/05/01 2013;19(5):330-332. doi:10.1089/tmj.2013.9998 [PubMed: 23384331] · DOI

Cited by

Sorted by citations

Authors
Smith, D. C., Thumm, E. B., Anderson, J., Kissler, K., Reed, S. M., Centi, S. M., Staley, A. W., Hernandez, T. L., & Barton, A. J.
Affiliations
  • University of Colorado System (US)
  • Colorado School of Public Health (US)
Corresponding author
Smith, Denise C.
Venue
Journal of Midwifery & Women's Health
Publisher
Wiley
Published
2023-12-18
Volume
69
Issue
4
Pages
522-530
ISSN
  • 1526-9523 (ISSN-L)
  • 1542-2011
OpenAlex
W4389938465
Cited by
15
References
6
Citations by year
2026: 4 · 2025: 7 · 2024: 4
FWCI
3.50
Type
journal article
Language
en
Open access
Locations
  • Journal of Midwifery & Women s Health (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
Funders
  • Agency for Healthcare Research and Quality (1R01HS028085‐1)
  • National Center for Advancing Translational Sciences (UL1 TR2535)
  • Presbyterian Health Foundation
  • Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD102726)
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Health Sciences › Medicine › Obstetrics and Gynecology › COVID-19 Impact on Reproduction
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Maternal Mental Health During Pregnancy and Postpartum
Keywords
telemedicine, prenatal care, COVID-19 pandemic, health care disparities, language barriers, Spanish-speaking patients, video consultation, telephone visits, diabetes mellitus, depression, health care access
MeSH terms
COVID-19, SARS-CoV-2, Adult, Female, Humans, Midwifery, Nurse Midwives, Pregnancy, Prenatal Care, Retrospective Studies, Cohort Studies, Telemedicine, Healthcare Disparities, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review