Electronic consultation system demonstrates educational benefit for primary care providers
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Background: Electronic consultation systems allow primary care providers to receive timely speciality expertise via iterative electronic communication. The use of such systems is expanding across the USA with well-documented high levels of user satisfaction. We characterise the educational impact for primary care providers of a long-standing integrated electronic consultation and referral system. Methods: Primary care providers’ perceptions of the educational value inherent to electronic consultation system communication and the impact on their ability to manage common speciality clinical conditions and questions were examined by electronic survey using five-point Likert scales. Differences in primary care providers’ perceptions were examined overall and by primary care providers’ speciality, provider type and years of experience. Results: Among 221 primary care provider participants (35% response rate), 83.9% agreed or strongly agreed that the integrated electronic consultation and referral system provided educational value. There were no significant differences in educational value reported by provider type (attending physician, mid-level provider, or trainee physician), primary care providers’ speciality, or years of experience. Perceived benefit of the electronic consultation and referral system in clinical management appeared stronger for laboratory-based conditions (i.e. subclinical hypothyroidism) than more diffuse conditions (i.e. abdominal pain). Nurse practitioners/physician assistants and trainee physicians were more likely to report improved abilities to manage specific clinical conditions when using the electronic consultation and/or referral system than were attending physicians, as were primary care providers with ≤10 years experience, versus those with >20 years of experience. Conclusions: Primary care providers report overwhelmingly positive perceptions of the educational value of an integrated electronic consultation and referral system. Nurse practitioners, physician assistants, trainee physicians and less-experienced primary care providers report the greatest clinical educational benefit, particularly for conditions involving lab-based diagnosis and management.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Physician response to surveys A review of the literature
Kellerman, S. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(00)00258-0 · Cited by 956 · cited 1×
“While nonresponse bias may influence the overall positive perception reported for eConsult’s educational value, a review of physician survey response behaviours found that nonresponse bias may not be an important factor contributing to the validity of physician surveys.(24) We also obtained our list of common clinical…”
BackgroundVimalananda, V. G., Gupte, G., Seraj, S. M., Orlander, J., Berlowitz, D., Fincke, B. G., & Simon, S. R. (2015) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15582108 · Cited by 437
Liddy, C., Drosinis, P., & Keely, E. (2016) · Family Practice · doi:10.1093/fampra/cmw024 · Cited by 195
Liddy, C., Afkham, A., Drosinis, P., Joschko, J., & Keely, E. (2015) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2015.03.140255 · Cited by 140 · cited 4×
“Indeed, prior studies have demonstrated that PCP satisfaction with eCR systems is largely influenced by quality of specialist communication and response time.(6,17) In a healthcare delivery system with low PCP turnover, the educational benefits of an eConsult system are likely to materialise after several years, after…”
BackgroundResultInfluentialOlayiwola, J. N., Anderson, D., Jepeal, N., Aseltine, R., Pickett, C., Yan, J., & Zlateva, I. (2016) · The Annals of Family Medicine · doi:10.1370/afm.1869 · Cited by 117
Self-citationA Safety-Net System Gains Efficiencies Through ‘eReferrals’ To Specialists
Chen, A. H., Kushel, M. B., Grumbach, K., & Yee, H. F. (2010) · Health Affairs · doi:10.1377/hlthaff.2010.0027 · Cited by 98
Tuot, D. S., Leeds, K., Murphy, E. J., Sarkar, U., Lyles, C. R., Mekonnen, T., & Chen, A. H. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-1233-1 · Cited by 98
Self-citationLiddy, C., Drosinis, P., Deri Armstrong, C., McKellips, F., Afkham, A., & Keely, E. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010920 · Cited by 92
Veteran, Primary Care Provider, and Specialist Satisfaction With Electronic Consultation
Rodriguez, K. L., Burkitt, K. H., Bayliss, N. K., Skoko, J. E., Switzer, G. E., Zickmund, S. L., Fine, M. J., & Macpherson, D. S. (2015) · JMIR Medical Informatics · doi:10.2196/medinform.3725 · Cited by 63 · cited 1×
“Indeed, prior studies have demonstrated that PCP satisfaction with eCR systems is largely influenced by quality of specialist communication and response time.(6,17) In a healthcare delivery system with low PCP turnover, the educational benefits of an eConsult system are likely to materialise after several years, after…”
BackgroundLiddy, C., Deri Armstrong, C., McKellips, F., & Keely, E. (2016) · Journal of the American Association of Nurse Practitioners · doi:10.1002/2327-6924.12266 · Cited by 20 · cited 1×
“This is consistent with work from a free-standing electronic consultation system in Canada, in which NPs demonstrated increased use of an eCR system compared to family practice physicians and perceived greater value both for themselves and for their patients, including educational benefit.(16) Nevertheless, our result…”
Result
Cited by
Primary Care Practitioners’ Perceptions of Electronic Consult Systems: A Qualitative Analysis
Lee, M. S., Ray, K. N., Mehrotra, A., Giboney, P., Yee, H. F., & Barnett, M. L. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.0738 · Cited by 86
Evaluating diverse electronic consultation programs with a common framework
Tuot, D. S., Liddy, C., Vimalananda, V. G., Pecina, J., Murphy, E. J., Keely, E., Simon, S. R., North, F., Orlander, J. D., & Chen, A. H. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3626-4 · Cited by 45
“S, systems, participating PCPs included family physicians, internal medicine physicians, nurse practitioners and physician assistants; pediatricians also used the Mayo and SFHN services [26, 32, 33].”
BackgroundMethodSelf-citationAnderson, E., Vimalananda, V. G., Orlander, J. D., Cutrona, S. L., Strymish, J. L., Bokhour, B. G., & Rinne, S. T. (2021) · Medical Care · doi:10.1097/mlr.0000000000001575 · Cited by 16
Lee, M. S., & Nambudiri, V. E. (2020) · Applied Clinical Informatics · doi:10.1055/s-0040-1719181 · Cited by 15
Metadata
- Authors
- Kwok, J., Olayiwola, J. N., Knox, M., Murphy, E. J., & Tuot, D. S.
- Venue
- Journal of Telemedicine and Telecare
- Publisher
- SAGE Publications
- Published
- 2017-06-14
- Volume
- 24
- Issue
- 7
- Pages
- 465-472
- ISSN
- 1357-633X (ISSN-L)
- 1758-1109
- OpenAlex
- W2624787431
- Cited by
- 56
- References
- 11
- FWCI
- 9.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Electronic consultation system demonstrates educational benefit for primary care providers. https://app.cochat.ai/papers/10.1177/1357633x17711822
- The paper
- Kwok, J., Olayiwola, J. N., Knox, M., Murphy, E. J., & Tuot, D. S. (2018). Electronic consultation system demonstrates educational benefit for primary care providers. Journal of Telemedicine and Telecare. https://doi.org/10.1177/1357633x17711822
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.