Teleconsultation Between Patients and Health Care Professionals in the Catalan Primary Care Service: Message Annotation Analysis in a Retrospective Cross-Sectional Study
Open accessPublished version of a preprint
Abstract
BACKGROUND: Over the last decade, telemedicine services have been introduced in the public health care systems of several industrialized countries. In Catalonia, the use of eConsulta, an asynchronous teleconsultation service between primary care professionals and citizens in the public health care system, has already reached 1 million cases. Before the COVID-19 pandemic, the use of eConsulta was growing at a monthly rate of 7%, and the growth has been exponential from March 15, 2020 to the present day. Despite its widespread usage, there is little qualitative evidence describing how this tool is used. OBJECTIVE: The aim of this study was to annotate a random sample of teleconsultations from eConsulta, and to evaluate the level of agreement between health care professionals with respect to the annotation. METHODS: Twenty general practitioners retrospectively annotated a random sample of 5382 cases managed by eConsulta according to three aspects: the type of interaction according to 6 author-proposed categories, whether the practitioners believed a face-to-face visit was avoided, and whether they believed the patient would have requested a face-to-face visit had eConsulta not been available. A total of 1217 cases were classified three times by three different professionals to assess the degree of consensus among them. RESULTS: The general practitioners considered that 79.60% (4284/5382) of the teleconsultations resulted in avoiding a face-to-face visit, and considered that 64.96% (3496/5382) of the time, the patient would have made a face-to-face visit in the absence of a service like eConsulta. The most frequent uses were for management of test results (26.77%, 1433/5354), management of repeat prescriptions (24.30%, 1301/5354), and medical enquiries (14.23%, 762/5354). The degree of agreement among professionals as to the annotations was mixed, with the highest consensus demonstrated for the question "Has the online consultation avoided a face-to-face visit?" (3/3 professionals agreed 67.95% of the time, 827/1217), and the lowest consensus for the type of use of the teleconsultation (3/3 professionals agreed 57.60% of the time, 701/1217). CONCLUSIONS: This study shows the ability of eConsulta to reduce the number of face-to-face visits for 55% (79% × 65%) to 79% of cases. In comparison to previous research, these results are slightly more pessimistic, although the rates are still high and in line with administrative data proxies, showing that 84% of patients using teleconsultations do not make an in-person appointment in the following 3 months. With respect to the type of consultation performed, our results are similar to the existing literature, thus providing robust support for eConsulta's usage. The mixed degree of consensus among professionals implies that results derived from artificial intelligence tools such as message classification algorithms should be interpreted in light of these shortcomings.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Resolution of queries was not related to whether the consultation was initiated by the patient or clinician.
“Fewer patients felt able to provide all relevant information during e-consultation and resolution was not related to whether the consultation was initiated by the patient or clinician.”
From Effectiveness and safety of asynchronous telemedicine consultations in general practice: a systematic review (2024) · cites this paper as [47]
Fewer patients felt able to provide all relevant information during e-consultation.
“Fewer patients felt able to provide all relevant information during e-consultation and resolution was not related to whether the consultation was initiated by the patient or clinician.”
From Effectiveness and safety of asynchronous telemedicine consultations in general practice: a systematic review (2024) · cites this paper as [47]
The Methods > Annotation Procedure describes general practitioners reviewing consultation messages and recording visit avoidance and consultation type; it does not describe asking patients whether they could provide all relevant information. The Results > Annotation likewise reports practitioners’ assessments, not patients’ views. Searches for patient perceptions and ability to provide information found no passage addressing the claim; the indexed copy provides no page numbers. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Telemedicine in the face of the COVID-19 pandemic
Vidal‐Alaball, J., Acosta‐Rojas, R., Hernández, N. P., Luque, U. S., Morrison, D., Pérez, S. N., Perez-Llano, J., Vergès, À. S., & Seguí, F. L. (2020) · Atención Primaria · doi:10.1016/j.aprim.2020.04.003 · Cited by 351 · see citing works
Self-citationEedy, D. J., & Wootton, R. (2001) · British Journal of Dermatology · doi:10.1046/j.1365-2133.2001.04124.x · Cited by 224 · see citing works
Asynchronous Virtual Visits for the Follow-Up of Chronic Conditions
Dixon, R. F., & Rao, L. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0211 · Cited by 46 · see citing works
López Seguí, F., Vidal-Alaball, J., Sagarra Castro, M., García-Altés, A., & García Cuyàs, F. (2020) · Journal of Medical Internet Research · doi:10.2196/14478 · Cited by 42 · see citing works
Self-citationThe Use of Video Conferencing for Persons with Chronic Conditions: A Systematic Review
Mallow, J. A., Petitte, T., Narsavage, G., Barnes, E., Theeke, E., Mallow, B. K., & Theeke, L. A. (2016) · E-Health Telecommunication Systems and Networks · doi:10.4236/etsn.2016.52005 · Cited by 41 · see citing works
von Wangenheim, A., Nobre, L. F. D. S., Tognoli, H., Nassar, S. M., & Ho, K. (2012) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2011.0197 · Cited by 39 · see citing works
Baltaxe, E., Cano, I., Herranz, C., Barberán-García, A., Hernández, C., Alonso, A., Arguis, M. J., Bescos, C., Burgos, F., Clèries, M., et al. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4174-2 · Cited by 39 · see citing works
Seguí, F. L., Aguilar, R. A.-E., de Maeztu, G., García‐Altés, A., Cuyàs, F. G., Walsh, S. M., Castro, M. S., & Vidal‐Alaball, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17031093 · Cited by 28 · see citing works
Self-citationHa llegado para quedarse: beneficios e inconvenientes de la eConsulta
Vidal‐Alaball, J., & Seguí, F. L. (2020) · Atención Primaria Práctica · doi:10.1016/j.appr.2020.100043 · Cited by 13 · see citing works
Self-citationSolans, Ó., Seguí, F. L., Vidal‐Alaball, J., Bonet, J. M., Vian, O. H., Cabo, P. R., Hernández, M. C., Domínguez, C. O., Reig, X. A., Díaz, Y., et al. (2020) · JMIR Medical Informatics · doi:10.2196/16484 · Cited by 12 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Darley, S., Coulson, T., Peek, N., Moschogianis, S., van der Veer, S. N., Wong, D. C., & Brown, B. C. (2022) · Journal of Medical Internet Research · doi:10.2196/37436 · Cited by 53 · see citing works
Solans, O., Vidal-Alaball, J., Roig Cabo, P., Mora, N., Coma, E., Bonet Simó, J. M., Hermosilla Pérez, E., Saigí-Rubió, F., Olmos Domínguez, C., Piera-Jiménez, J., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/28629 · Cited by 43 · see citing works
Self-citationLeighton, C., Cooper, A., Porter, A., Edwards, A., & Joseph-Williams, N. (2024) · BJGP Open · doi:10.3399/bjgpo.2023.0177 · Cited by 34 · see citing works
“46,47 It is unclear whether clinicians felt queries were resolved and what reasons existed for unresolved queries.”
BackgroundFuster-Casanovas, A., & Vidal-Alaball, J. (2022) · International Journal of Integrated Care · doi:10.5334/ijic.6489 · Cited by 12 · see citing works
Self-citation
- Authors
- López Seguí, F., Walsh, S., Solans, O., Adroher Mas, C., Ferraro, G., García-Altés, A., García Cuyàs, F., Salvador Carulla, L., Sagarra Castro, M., & Vidal-Alaball, J.
- Affiliations
- Universitat Pompeu Fabra (ES)
- Australian National University (AU)
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-09-17
- Volume
- 22
- Issue
- 9
- Pages
- e19149
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7530682
- OpenAlex
- W3037490214
- Cited by
- 36
- References
- 10
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 3 · 2023: 10 · 2022: 9 · 2021: 5 · 2020: 3
- FWCI
- 5.05
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ANU Open Research (Australian National University) (submittedVersion, cc-by)
- DIGITAL.CSIC (Spanish National Research Council (CSIC)) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Generalitat de Catalunya
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Healthcare Systems and Technology
- Health Sciences › Health Professions › General Health Professions › Primary Care and Health Outcomes
- Keywords
- teleconsultation, asynchronous telemedicine, primary care, general practitioners, patient-professional interaction, interprofessional agreement, COVID-19 pandemic, Catalonia, test result management, repeat prescriptions, medical inquiry, public health care system
- MeSH terms
- COVID-19, Artificial Intelligence, Cross-Sectional Studies, Delivery of Health Care, Female, Health Personnel, Humans, Male, Middle Aged, Pneumonia, Viral, Primary Health Care, Retrospective Studies, Coronavirus Infections, Remote Consultation, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review