Automated Conversation System Before Pediatric Primary Care Visits: A Randomized Trial
Abstract
BACKGROUND AND OBJECTIVES: Interactive voice response systems integrated with electronic health records have the potential to improve primary care by engaging parents outside clinical settings via spoken language. The objective of this study was to determine whether use of an interactive voice response system, the Personal Health Partner (PHP), before routine health care maintenance visits could improve the quality of primary care visits and be well accepted by parents and clinicians. METHODS: English-speaking parents of children aged 4 months to 11 years called PHP before routine visits and were randomly assigned to groups by the system at the time of the call. Parents’ spoken responses were used to provide tailored counseling and support goal setting for the upcoming visit. Data were transferred to the electronic health records for review during visits. The study occurred in an urban hospital-based pediatric primary care center. Participants were called after the visit to assess (1) comprehensiveness of screening and counseling, (2) assessment of medications and their management, and (3) parent and clinician satisfaction. RESULTS: PHP was able to identify and counsel in multiple areas. A total of 9.7% of parents responded to the mailed invitation. Intervention parents were more likely to report discussing important issues such as depression (42.6% vs 25.4%; P < .01) and prescription medication use (85.7% vs 72.6%; P = .04) and to report being better prepared for visits. One hundred percent of clinicians reported that PHP improved the quality of their care. CONCLUSIONS: Systems like PHP have the potential to improve clinical screening, counseling, and medication management.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Over 80% of users reported that the agents helped them follow their treatment more effectively, and over 80% reported being more prepared for pediatric visits.
“Over 80% of users also reported that the agents helped them follow their treatment more effectively [45] and be more prepared for pediatric visits [9].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [9]
A study of a preparatory interactive voice response phone call before pediatric visits found that visit time was significantly reduced in the IVR group compared with the control group.
“Regarding resource implications, the study of a preparatory IVR phone call before pediatric visits found that visit time was significantly reduced in the IVR group compared with the control group [9].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [9]
Cites
The Patient Health Questionnaire-2: Validity of a Two-Item Depression Screener
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000093487.78664.3c · Cited by 6,359 · see citing works
Bright Futures: Guidelines for Health Supervision of Infants, Children, and Adolescents.
Green, M. (1994) · Cited by 1,662 · see citing works
Use of an electronic medical record improves the quality of urban pediatric primary care.
Adams, W., Mann, A. M., & Bauchner, H. (2003) · Pediatrics · doi:10.1542/peds.111.3.626 · Cited by 211 · see citing works
Self-citationAutomated interventions for multiple health behaviors using conversational agents
Bickmore, T. W., Schulman, D., & Sidner, C. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.011 · Cited by 206 · see citing works
Olson, L. M., Inkelas, M., Halfon, N., Schuster, M. A., O’Connor, K. G., & Mistry, R. (2004) · Pediatrics · doi:10.1542/peds.113.s5.1907 · Cited by 186 · see citing works
The Impact of Parents' Medication Beliefs on Asthma Management
Conn, K. M., Halterman, J. S., Lynch, K., & Cabana, M. D. (2007) · PEDIATRICS · doi:10.1542/peds.2006-3023 · Cited by 147 · see citing works
Kilcup, M., Schultz, D., Carlson, J., & Wilson, B. E. (2013) · Journal of the American Pharmacists Association · doi:10.1331/japha.2013.11250 · Cited by 139 · see citing works
Bethell, C., Reuland, C. H. P., Halfon, N., & Schor, E. L. (2004) · Pediatrics · doi:10.1542/peds.113.s5.1973 · Cited by 118 · see citing works
Improving Medication Reconciliation in the Outpatient Setting
Varkey, P., Cunningham, J. L., & Bisping, S. (2007) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(07)33033-x · Cited by 101 · see citing works
Handley, M. A., Shumway, M., & Schillinger, D. (2008) · The Annals of Family Medicine · doi:10.1370/afm.889 · Cited by 95 · see citing works
A pilot study of a telehealth intervention for persons with spinal cord dysfunction
Houlihan, B. V., Jette, A. M., Friedman, R. H., Paasche‐Orlow, M. K., Ni, P., Wierbicky, J., Williams, K., Ducharme, S. H., Zazula, J., Cuevas, P. H., et al. (2013) · Spinal Cord · doi:10.1038/sc.2013.45 · Cited by 56 · see citing works
Self-citationSarkar, U., Handley, M. A., Gupta, R., Tang, A., Murphy, E. J., Seligman, H. K., Shojania, K. G., & Schillinger, D. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0398-7 · Cited by 40 · see citing works
Improving Pediatric Prevention via the Internet: A Randomized, Controlled Trial
Christakis, D., Zimmerman, F. J., Rivara, F. P., & Ebel, B. E. (2006) · PEDIATRICS · doi:10.1542/peds.2006-0209 · Cited by 39 · see citing works
Tucker, J. A., Simpson, C. A., Huang, J., Roth, D. L., & Stewart, K. E. (2013) · AIDS Patient Care and STDs · doi:10.1089/apc.2012.0322 · Cited by 24 · see citing works
The Healthy Teen Project: Tools to Enhance Adolescent Health Counseling
Olson, A. L. (2005) · The Annals of Family Medicine · doi:10.1370/afm.359 · Cited by 12 · see citing works
Bass, J. L. (1997) · The Journal of Pediatrics · doi:10.1016/s0022-3476(97)80092-3 · Cited by 3 · see citing works
Telemedicine using free voice over internet protocol (VoIP) technology.
Miller, D. J., Miljković, N., Chiesa, C., Callahan, J. B., Webb, B., & Boedeker, B. H. (2011) · PubMed · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · see citing works
Posadzki, P., Mastellos, N., Ryan, R. E., Gunn, L. H., Felix, L. M., Pappas, Y., Gagnon, M., Julious, S. A., Xiang, L., Oldenburg, B. F., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009921.pub2 · Cited by 132 · see citing works
Digital Health Interventions to Enhance Prevention in Primary Care: Scoping Review
Willis, V. C., Craig, K. J. T., Jabbarpour, Y., Scheufele, E. L., Arriaga, Y. E., Ajinkya, M., Rhee, K. B. L., & Bazemore, A. (2021) · JMIR Medical Informatics · doi:10.2196/33518 · Cited by 130 · see citing works
Patient-mediated interventions to improve professional practice
Fønhus, M. S., Dalsbø, T. K., Johansen, M., Fretheim, A., Skirbekk, H., & Flottorp, S. A. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012472.pub2 · Cited by 107 · see citing works
A Narrative Review of Patient and Family Engagement
Cené, C. W., Johnson, B., Wells, N., Baker, B., Davis, R., & Turchi, R. M. (2016) · Medical Care · doi:10.1097/mlr.0000000000000548 · Cited by 95 · see citing works
The Use and Promise of Conversational Agents in Digital Health
Dingler, T., Kwasnicka, D., Wei, J., Gong, E., & Oldenburg, B. (2021) · Yearbook of Medical Informatics · doi:10.1055/s-0041-1726510 · Cited by 81 · see citing works
Hong, G., Smith, M. A., & Lin, S. (2022) · JMIR Formative Research · doi:10.2196/37028 · Cited by 35 · see citing works
Aufegger, L., Bùi, K. H., Bicknell, C. D., & Darzi, A. W. (2020) · BMC Pediatrics · doi:10.1186/s12887-020-02361-w · Cited by 18 · see citing works
Barros, L., & Greffin, K. (2017) · Estudos de Psicologia (Campinas) · doi:10.1590/1982-02752017000300002 · Cited by 16 · see citing works
Laranjo, L., Shaw, T. J., Trivedi, R., Thomas, S. P., Charlston, E., Klimis, H., Thiagalingam, A., Kumar, S., Tan, T. C., Nguyen, T. N., et al. (2022) · JMIR Research Protocols · doi:10.2196/34470 · Cited by 14 · see citing works
Pediatrician Attitudes toward Digital Voice Assistant Technology Use in Clinical Practice
Wilder, J. L., Nadar, D., Gujral, N., Ortiz, B. D., Stevens, R., Holder-Niles, F. F., Lee, J., & Gaffin, J. M. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1687863 · Cited by 15 · see citing works
Tailored communications for obesity prevention in pediatric primary care: a feasibility study
Wright, J. A., Whiteley, J. A., Watson, B. L., Gorin, S. S., & Hayman, L. L. (2017) · Health Education Research · doi:10.1093/her/cyx063 · Cited by 13 · see citing works
Walsh, K. E., Bacic, J. D., Phillips, B. D., & Adams, W. G. (2017) · Journal of Patient Safety · doi:10.1097/pts.0000000000000375 · Cited by 9 · see citing works
Self-citationAgarwal, S., Chin, W. Y., Vasudevan, L., Henschke, N., Tamrat, T., Foss, H. S., Glenton, C., Bergman, H., Fønhus, M. S., Ratanaprayul, N., et al. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012925.pub2 · Cited by 9 · see citing works
A Systematic Review of Health Dialog Systems
Kearns, W. R., Chi, N., Choi, Y. K., Lin, S., Thompson, H. J., & Demiris, G. (2019) · Methods of Information in Medicine · doi:10.1055/s-0040-1708807 · Cited by 8 · see citing works
Health Information Technology Coordination to Support Patient-centered Care Coordination
Gregg, W., Steichen, O., & Coordination, S. E. F. T. I. Y. S. O. P.-C. C. (2015) · Yearbook of Medical Informatics · doi:10.15265/iy-2015-027 · Cited by 8 · see citing works
Bailey, S. C., Paasche‐Orlow, M. K., Adams, W. G., Brokenshire, S. A., Hickson, R. P., Oramasionwu, C. U., Curtis, L. M., Kwasny, M., & Wolf, M. S. (2016) · Contemporary Clinical Trials · doi:10.1016/j.cct.2016.10.005 · Cited by 5 · see citing works
Self-citationHands-free charting... As good as it sounds?
Wheatley, C. (2017) · Nursing Management · doi:10.1097/01.numa.0000526066.48135.84 · Cited by 5 · see citing works
Pergantis, P., Bardis, N. G., Skianis, C., & Drigas, A. S. (2026) · International Medical Education · doi:10.3390/ime5030093 · Cited by 2 · see citing works
TECNOLOGIAS EM SAÚDE IMPLEMENTADAS NA ATENÇÃO À SAÚDE DA CRIANÇA:
Nascimento, M. V. F., Assis, J. M. D., Feitosa, C. D. A., Júnior, J. D. S. A., da Conceição, H. N., dos Santos, R. S., & Gouvéia, M. T. D. O. (2022) · Revista Enfermagem Atual In Derme · doi:10.31011/reaid-2022-v.96-n.39-art.1451 · Cited by 2 · see citing works
The Enabling Role for Technology in the Support of Care Coordination in Health Care
Gibbings, R., & Wickramasinghe, N. S. (2019) · Healthcare delivery in the information age · doi:10.1007/978-3-030-17347-0_21 · Cited by 1 · see citing works
Utilizing the Strengths of the Pediatric Psychologist in Health Care Improvement Efforts
Greco, P., & Pitel, P. A. (2016) · Clinical Practice in Pediatric Psychology · doi:10.1037/cpp0000133
Saisie de prescriptions médicales en langage naturel sur terminaux mobiles
Kocabiyikoglu, A. C. (2022) · theses.fr (ABES) · doi:10.70675/998d4b74z9eb1z49bcz9763zfa1e8ebcbd43
Human-Machine Dialogue in the Medical Field. Using Dialog to Collect Important Patient Information
Liednikova, A. (2022) · theses.fr (ABES) · doi:10.70675/b572f8cbz5876z4683z828bzfb09085ddd78
- Authors
- Adams, W. G., Phillips, B. D., Bacic, J. D., Walsh, K. E., Shanahan, C. W., & Paasche-Orlow, M. K.
- Affiliations
- General Pediatrics,
- VA Central Western Massachusetts Healthcare System (US)
- Health Policy and Management,
- Cincinnati Children's Hospital Medical Center (US)
- Boston University (US)
- General Internal Medicine, Boston University/Boston Medical Center, Boston, Massachusetts;
- ORCID
- Venue
- Pediatrics
- Publisher
- American Academy of Pediatrics (AAP)
- Published
- 2014-09-01
- Volume
- 134
- Issue
- 3
- Pages
- e691-e699
- ISSN
- 0031-4005 (ISSN-L)
- 1098-4275
- OpenAlex
- W2122473406
- Cited by
- 24
- References
- 17
- Citations by year
- 2026: 1 · 2025: 1 · 2022: 5 · 2021: 2 · 2020: 2 · 2019: 3 · 2018: 1 · 2017: 4 · 2016: 4 · 2015: 1
- FWCI
- 5.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PEDIATRICS (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Agency for Healthcare Research and Quality (R18HS017248)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- interactive voice response, pediatric primary care, parental involvement, electronic health records, medication management, depression screening, parental satisfaction, provider satisfaction, health maintenance visits
- MeSH terms
- Adult, Automation, Child, Child, Preschool, Counseling, Female, Humans, Infant, Male, Pediatrics, Primary Health Care, User-Computer Interface, Speech Recognition Software, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review