Sudden Shift to Telehealth in COVID‐19: A Retrospective Cohort Study of Disparities in Use of Telehealth for Prenatal Care in a Large Midwifery Service
Open accessAbstract
Introduction: The coronavirus disease 2019 (COVID‐19) pandemic created disruption in health care delivery, including a sudden transition to telehealth use in mid‐March 2020. The purpose of this study was to examine changes in the mode of prenatal care visits and predictors of telehealth use (provider‐patient messaging, telephone visits, and video visits) during the COVID‐19 pandemic among those receiving care in a large, academic nurse‐midwifery service. Methods: We conducted a retrospective cohort study of those enrolled for prenatal care in 2 nurse‐midwifery clinics between 2019 and 2021 (n = 3172). Use outcomes included number and type of encounter: in‐person and telehealth (primary outcome). Comparisons were made in frequency and types of encounters before and during COVID‐19. A negative binomial regression was fit on the outcome of telehealth encounter count, with race/ethnicity, age, language, parity, hypertension, diabetes, and depression as predictors. Results: When comparing pre–COVID‐19 (before March 2020) with during COVID‐19 (after March 2020), overall encounters increased from 15.9 to 19.5 mean number of encounters per person (P < .001). The increase was driven by telehealth encounters; there were no significant differences for in‐person prenatal visit counts before and during the pandemic period. Direct patient‐provider messaging was the most common type of telehealth encounter. Predictors of telehealth encounters included English as primary language and diagnoses of diabetes or depression. Discussion: No differences in the frequency of in‐person prenatal care visits suggests that telehealth encounters led to more contact with midwives and did not replace in‐person encounters. Spanish‐speaking patients were least likely to use telehealth‐delivered prenatal care during the pandemic; a small, but significant, proportion of patients had no or few telehealth encounters, and a significant proportion had high use of telehealth. Integration of telehealth in future delivery of prenatal care should consider questions of equity, patient and provider satisfaction, access, redundancies, and provider workload.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Interrupted time series controls for underlying temporal trends while estimating both immediate level changes and sustained slope modifications.
“This approach controls for underlying temporal trends while estimating both immediate level changes and sustained slope modifications [22, 27].”
From Telemedicine implementation and healthcare utilization in Rwanda: interrupted time series of Babyl digital health services from 2015 to 2024 (2026) · cites this paper as [27]
The Data Analysis section (page not provided) describes pre/post comparisons using t-tests and predictors modeled with negative binomial regression. Searches for interrupted time series, temporal trends, level changes, and slope changes found no passage in our copy explaining the claimed properties of interrupted time series. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613 · see citing works
Tuckson, R. V., Edmunds, M., & Hodgkins, M. L. (2017) · New England Journal of Medicine · doi:10.1056/nejmsr1503323 · Cited by 907 · see citing works
Hong, Y.-R., Lawrence, J., Williams Jr, D., & Mainous III, A. (2020) · JMIR Public Health and Surveillance · doi:10.2196/18961 · Cited by 236 · see citing works
Randomized comparison of a reduced-visit prenatal care model enhanced with remote monitoring
Butler Tobah, Y. S., LeBlanc, A., Branda, M. E., Inselman, J. W., Morris, M. A., Ridgeway, J. L., Finnie, D. M., Theiler, R., Torbenson, V. E., Brodrick, E. M., et al. (2019) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2019.06.034 · Cited by 212 · see citing works
Palmer, K. R., Tanner, M., Davies-Tuck, M., Rindt, A., Papacostas, K., Giles, M. L., Brown, K., Diamandis, H., Fradkin, R., Stewart, A. E., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00668-1 · Cited by 121 · see citing works
Disparities in Electronic Patient Portal Use in Prenatal Care: Retrospective Cohort Study
Ukoha, E. P., Feinglass, J., & Yee, L. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14445 · Cited by 33 · see citing works
Flagged first, then by citations
Research works printed but not linked: 26
- LeRouge C, Garfield MJ. Crossing the Telemedicine Chasm: Have the U.S. Barriers to Widespread Adoption of Telemedicine Been Significantly Reduced? International Journal of Environmental Research and Public Health. 2013;10(12):6472-6484. doi:10.3390/ijerph10126472 [PubMed: 24287864] · DOI
- Ukoha EP, Davis K, Yinger M, et al. Ensuring Equitable Implementation of Telemedicine in Perinatal Care. Obstet Gynecol. Mar 1 2021;137(3):487-492. doi:10.1097/aog.0000000000004276 [PubMed: 33543895] · DOI
- Smith DC, Anderson JL, Carrington S, Nacht A, Nodine PM, Barton AJ. Contemporary Nurse-Midwifery Care in Colorado: A Survey of Certified Nurse-Midwife Practices in Hospital and Community Settings. Policy, Politics, & Nursing Practice. 2023:15271544221147301. doi:10.1177/15271544221147301 · DOI
- Friedman Peahl A, Heisler M, Essenmacher LK, et al. A comparison of international prenatal care guidelines for low-risk women to inform high-value care. American Journal of Obstetrics and Gynecology. 2020/05/01/ 2020;222(5):505-507. doi:10.1016/j.ajog.2020.01.021 [PubMed: 31962108] · DOI
- Nelson DB, Moniz MH, Davis MM. Population-level factors associated with maternal mortality in the United States, 1997-2012. BMC Public Health. Aug 13 2018;18(1):1007. doi:10.1186/ s12889-018-5935-2 [PubMed: 30103716] · DOI
- Mbuagbaw L, Medley N, Darzi AJ, Richardson M, Habiba Garga K, Ongolo-Zogo P. Health system and community level interventions for improving antenatal care coverage and health outcomes. Cochrane Database Syst Rev. Dec 1 2015;2015(12):Cd010994. doi:10.1002/14651858.CD010994.pub2 [PubMed: 26621223] · DOI · Paper page
- Balk EM, Konnyu KJ, Cao W, et al. Schedule of Visits and Televisits for Routine Antenatal Care: A Systematic Review. Agency for Healthcare Research and Quality (US), Rockville (MD); 2022.
- Wu KK, Lopez C, Nichols M. Virtual Visits in Prenatal Care: An Integrative Review. J Midwifery Womens Health. Jan 2022;67(1):39-52. doi:10.1111/jmwh.13284 [PubMed: 34767317] · DOI
- Cantor AG, Jungbauer RM, Totten AM, et al. Telehealth Strategies for the Delivery of Maternal Health Care : A Rapid Review. Ann Intern Med. Sep 2022;175(9):1285-1297. doi:10.7326/ m22-0737 [PubMed: 35878405] · DOI
- Duryea EL, Adhikari EH, Ambia A, Spong C, McIntire D, Nelson DB. Comparison Between In-Person and Audio-Only Virtual Prenatal Visits and Perinatal Outcomes. JAMA Network Open. 2021;4(4):e215854-e215854. doi:10.1001/jamanetworkopen.2021.5854 [PubMed: 33852002] · DOI
- Jeganathan S, Prasannan L, Blitz MJ, Vohra N, Rochelson B, Meirowitz N. Adherence and acceptability of telehealth appointments for high-risk obstetrical patients during the coronavirus disease 2019 pandemic. Am J Obstet Gynecol MFM. Nov 2020;2(4):100233. doi:10.1016/ j.ajogmf.2020.100233 [PubMed: 32984803] · DOI
- Futterman I, Rosenfeld E, Toaff M, et al. Addressing Disparities in Prenatal Care via Telehealth During COVID-19: Prenatal Satisfaction Survey in East Harlem. Am J Perinatol. Jan 2021;38(1):88-92. doi:10.1055/s-0040-1718695 [PubMed: 33038898] · DOI
- Ukoha EP, Yee LM. Use of Electronic Patient Portals in Pregnancy: An Overview. J Midwifery Womens Health. 2018;63(3):335-339. doi:10.1111/jmwh.12761 [PubMed: 29758124] · DOI
- Tai-Seale M, Dillon EC, Yang Y, et al. Physicians' Well-Being Linked To In-Basket Messages Generated By Algorithms In Electronic Health Records. Health Aff (Millwood). 2019/07/01 2019;38(7):1073-1078. doi:10.1377/hlthaff.2018.05509 [PubMed: 31260371] · DOI
- de Mooij MJM, Hodny RL, O'Neil DA, et al. OB Nest: Reimagining Low-Risk Prenatal Care. Mayo Clinic Proceedings. 2018/04/01/ 2018;93(4):458-466. doi:10.1016/j.mayocp.2018.01.022 [PubMed: 29545005] · DOI
- Kahn MG, Raebel MA, Glanz JM, Riedlinger K, Steiner JF. A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research. Medical care. 2012;50 Suppl(0):S21-S29. doi:10.1097/MLR.0b013e318257dd67 [PubMed: 22692254] · DOI · Paper page
- Peahl AF, Howell JD. The evolution of prenatal care delivery guidelines in the United States. American Journal of Obstetrics and Gynecology. 2021/04/01/ 2021;224(4):339-347. doi:10.1016/ j.ajog.2020.12.016 [PubMed: 33316276] · DOI
- Singh P, Jonnalagadda P, Morgan E, Fareed N. Outpatient portal use in prenatal care: differential use by race, risk, and area social determinants of health. Journal of the American Medical Informatics Association. 2021;29(2):364-371. doi:10.1093/jamia/ocab242 · DOI
- Brownson RC, Kumanyika SK, Kreuter MW, Haire-Joshu D. Implementation science should give higher priority to health equity. Implementation Science. 2021;16(1):1-16. [PubMed: 33413491]
- Yao R, Zhang W, Evans R, Cao G, Rui T, Shen L. Inequities in Health Care Services Caused by the Adoption of Digital Health Technologies: Scoping Review. J Med Internet Res. 2022/3/21 2022;24(3):e34144. doi:10.2196/34144 [PubMed: 35311682] · DOI · Paper page
- North F, Crane SJ, Chaudhry R, et al. Impact of Patient Portal Secure Messages and Electronic Visits on Adult Primary Care Office Visits. Telemedicine and e-Health. 2014/03/01 2013;20(3):192-198. doi:10.1089/tmj.2013.0097 [PubMed: 24350803] · DOI · Paper page
- Krans EE, Davis MM, Palladino CL. Disparate patterns of prenatal care utilization stratified by medical and psychosocial risk. Matern Child Health J. May 2013;17(4):639-45. doi:10.1007/ s10995-012-1040-9 [PubMed: 22581379] · DOI
- Cronin RM, Davis SE, Shenson JA, Chen Q, Rosenbloom ST, Jackson GP. Growth of Secure Messaging Through a Patient Portal as a Form of Outpatient Interaction across Clinical Specialties. Appl Clin Inform. 2017/12/19 2015;06(02):288-304. doi:10.4338/ACI-2014-12- RA-0117 · DOI
- DiAngi YT, Stevens LA, Halpern -Felsher B, Pageler NM, Lee TC. Electronic health record (EHR) training program identifies a new tool to quantify the EHR time burden and improves providers' perceived control over their workload in the EHR. JAMIA Open. 2019;2(2):222-230. doi:10.1093/jamiaopen/ooz003 [PubMed: 31984357] · DOI · Paper page
- Murthy VH. Confronting Health Worker Burnout and Well-Being. New England Journal of Medicine. 2022;387(7):577-579. doi:10.1056/NEJMp2207252 [PubMed: 35830683] · DOI
- Bashshur RL. Guest Editorial: Compelling Issues in Telemedicine. Telemedicine and e-Health. 2013/05/01 2013;19(5):330-332. doi:10.1089/tmj.2013.9998 [PubMed: 23384331] · DOI
Cited by
Sorted by citations
Rubuga, F. K., Absolomon, G., Uhawenimana, T. C., Nsaba-Uwera, Y. D., Muhire, J., Hagenimana, J. D., Nyabyenda, E. C., Irakiza, P., Semakula, M., Remera, E., et al. (2026) · BMC Primary Care · doi:10.1186/s12875-026-03179-8 · Cited by 1 · see citing works
- Authors
- Smith, D. C., Thumm, E. B., Anderson, J., Kissler, K., Reed, S. M., Centi, S. M., Staley, A. W., Hernandez, T. L., & Barton, A. J.
- Affiliations
- University of Colorado System (US)
- Colorado School of Public Health (US)
- Corresponding author
- Smith, Denise C.
- ORCID
- Venue
- Journal of Midwifery & Women's Health
- Publisher
- Wiley
- Published
- 2023-12-18
- Volume
- 69
- Issue
- 4
- Pages
- 522-530
- ISSN
- 1526-9523 (ISSN-L)
- 1542-2011
- PMC
- PMC11182882
- OpenAlex
- W4389938465
- Cited by
- 15
- References
- 6
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 4
- FWCI
- 3.50
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Midwifery & Women s Health (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- Funders
- Agency for Healthcare Research and Quality (1R01HS028085‐1)
- National Center for Advancing Translational Sciences (UL1 TR2535)
- Presbyterian Health Foundation
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD102726)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Obstetrics and Gynecology › COVID-19 Impact on Reproduction
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Maternal Mental Health During Pregnancy and Postpartum
- Keywords
- telemedicine, prenatal care, COVID-19 pandemic, health care disparities, language barriers, Spanish-speaking patients, video consultation, telephone visits, diabetes mellitus, depression, health care access
- MeSH terms
- COVID-19, SARS-CoV-2, Adult, Female, Humans, Midwifery, Nurse Midwives, Pregnancy, Prenatal Care, Retrospective Studies, Cohort Studies, Telemedicine, Healthcare Disparities, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review