Are there interactional differences between telephone and face-to-face psychological therapy? A systematic review of comparative studies
Open accessAbstract
BACKGROUND: Despite comparable clinical outcomes, therapists and patients express reservations about the delivery of psychological therapy by telephone. These concerns centre around the quality of the therapeutic relationship and the ability to exercise professional skill and judgement in the absence of visual cues. However, the empirical evidence base for such perceptions has not been clearly established. METHODS: We conducted a systematic review to establish what is known empirically about interactional differences between psychotherapeutic encounters conducted face-to-face vs. by telephone. RESULTS: The review identified 15 studies that used situated, comparative approaches to exploring interactional aspects of telephone and face-to-face psychological therapy. These studies revealed evidence of little difference between modes in terms of therapeutic alliance, disclosure, empathy, attentiveness or participation. However, telephone therapy sessions were significantly shorter than those conducted face-to-face. LIMITATIONS: We identified only a small number of heterogeneous studies, many of which used non-randomised, opportunity samples and did not use validated measures to assess the constructs under investigation. Disparate therapeutic modalities were used across studies and samples included both clinically diagnosed and non-clinical populations. CONCLUSIONS: Available evidence suggests a lack of support for the viewpoint that the telephone has a detrimental effect on interactional aspects of psychological therapy. The challenge for clinical practice is to translate this evidence into a change in practitioner and patient attitudes and behaviours. In order to do so, it is important to understand and address the breadth of factors that underpin ongoing ambivalence towards the telephone mode, which pose a barrier to wider implementation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The good therapeutic relationship reported in our and earlier studies is in line with studies reporting no difference in therapeutic relationship in telephone- or face-to-face therapy.
“Despite sporicidal skepticism, the good therapeutic relationship reported in our and earlier studies (Bee et al., 2010; Haller et al., 2019) is in line with studies reporting no difference in therapeutic relationship in telephone- or face-to-face therapy (Irvine et al., 2020; Stiles-Shields et al., 2014).”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223 · see citing works
The American Psychological Association
Langfeld, H. S. (1919) · Science · doi:10.1126/science.49.1254.51 · Cited by 7,453 · see citing works
Development and validation of the working alliance inventory
Horvath, A. O., & Greenberg, L. S. (1989) · Journal of Counseling Psychology · doi:10.1037//0022-0167.36.2.223 · Cited by 3,520 · see citing works
The Effectiveness of Telemental Health: A 2013 Review
Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0075 · Cited by 1,048 · see citing works
Reducing Patients’ Unmet Concerns in Primary Care: the Difference One Word Can Make
Heritage, J., Robinson, J. D., Elliott, M. N., Beckett, M. K., & Wilkes, M. S. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0279-0 · Cited by 436 · see citing works
Depression in adults: recognition and management
(2017) · Clinical pharmacist · doi:10.1211/cp.2017.20202439 · Cited by 394 · see citing works
Robinson, J. D. (2003) · Health Communication · doi:10.1207/s15327027hc1501_2 · Cited by 393 · see citing works
The Social Impact of the Telephone
Tarr, J. A., & Pool, I. D. S. (1978) · Journal of American History · doi:10.2307/1901515 · Cited by 381 · see citing works
Conversation Analysis and Psychotherapy
Peräkylä, A., Antaki, C., Vehviläinen, S., & Leudar, I. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490002 · Cited by 376 · see citing works
Drew, P., Chatwin, J., & Collins, S. L. (2001) · Health Expectations · doi:10.1046/j.1369-6513.2001.00125.x · Cited by 367 · see citing works
Therapeutic alliance rupture as a therapy event for empirical investigation.
Safran, J. D., Crocker, P., McMain, S., & Murray, P. D. (1990) · Psychotherapy · doi:10.1037/0033-3204.27.2.154 · Cited by 333 · see citing works
Mohr, D. C., Ho, J., Duffecy, J., Reifler, D., Sokol, L., Burns, M. N., Jin, L., & Siddique, J. (2012) · JAMA · doi:10.1001/jama.2012.5588 · Cited by 330 · see citing works
Telemental Health Care, an Effective Alternative to Conventional Mental Care: a Systematic Review
Langarizadeh, M., Tabatabaei, M., Tavakol, K., Naghipour, M., & Moghbeli, F. (2017) · Acta Informatica Medica · doi:10.5455/aim.2017.25.240-246 · Cited by 314 · see citing works
The Structure of Patients' Presenting Concerns: Physicians' Opening Questions
Heritage, J., & Robinson, J. D. (2006) · Health Communication · doi:10.1207/s15327027hc1902_1 · Cited by 274 · see citing works
Mohr, D. C., Likosky, W., Bertagnolli, A., Goodkin, D. E., Wende, J. V. D., Dwyer, P., & Dick, L. P. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.2.356 · Cited by 240 · see citing works
Mohr, D. C., Likosky, W., Bertagnolli, A., Goodkin, D. E., Van Der Wende, J., Dwyer, P., & Dick, L. P. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.2.356 · Cited by 240 · see citing works
Mohr, D. C., Vella, L., Hart, S., Heckman, T., & Simon, G. (2008) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2008.00134.x · Cited by 227 · see citing works
Psychotherapy using distance technology: A comparison of face-to-face, video, and audio treatment.
Day, S. X., & Schneider, P. L. (2002) · Journal of Counseling Psychology · doi:10.1037/0022-0167.49.4.499 · Cited by 214 · see citing works
Physicians’ opening questions and patients’ satisfaction
Robinson, J. D., & Heritage, J. C. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2005.11.009 · Cited by 209 · see citing works
Reinforcement of affect responses of schizophrenics during the clinical interview.
Salzinger, K., & Pisoni, S. (1958) · Journal of Abnormal & Social Psychology · doi:10.1037/h0040304 · Cited by 165 · see citing works
Lovell, K., Cox, D., Haddock, G., Jones, C., Raines, D., Garvey, R., Roberts, C., & Hadley, S. (2006) · BMJ · doi:10.1136/bmj.38940.355602.80 · Cited by 162 · see citing works
Fann, J. R., Bombardier, C. H., Vannoy, S., Dyer, J., Ludman, E., Dikmen, S., Marshall, K., Barber, J., & Temkin, N. (2015) · Journal of Neurotrauma · doi:10.1089/neu.2014.3423 · Cited by 147 · see citing works
Jones, D., Drew, P., Elsey, C., Blackburn, D. J., Wakefield, S., Harkness, K., & Reuber, M. (2015) · Aging & Mental Health · doi:10.1080/13607863.2015.1021753 · Cited by 146 · see citing works
Concept mapping the client's perspective on counseling alliance formation.
Bedi, R. P. (2006) · Journal of Counseling Psychology · doi:10.1037/0022-0167.53.1.26 · Cited by 139 · see citing works
Effectiveness of telephone counseling: A field-based investigation.
Reese, R. J., Conoley, C. W., & Brossart, D. F. (2002) · Journal of Counseling Psychology · doi:10.1037/0022-0167.49.2.233 · Cited by 116 · see citing works
Everitt, H. A., Landau, S., O'Reilly, G., Sibelli, A., Hughes, S., Windgassen, S., Holland, R., Little, P., McCrone, P., Bishop, F. L., et al. (2019) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(19)30243-2 · Cited by 116 · see citing works
Turner, C. M., Mataix-Cols, D., Lovell, K., Krebs, G., Lang, K., Byford, S., & Heyman, I. (2014) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2014.09.012 · Cited by 111 · see citing works
A systematic review of telephone-based interventions for mental disorders
Leach, L. S., & Christensen, H. (2006) · Journal of Telemedicine and Telecare · doi:10.1258/135763306776738558 · Cited by 94 · see citing works
Psychotherapy by telephone: Risks and benefits for psychologists and consumers.
Haas, L. J., Benedict, J. G., & Kobos, J. C. (1996) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.27.2.154 · Cited by 91 · see citing works
Clinical issues in analyses over the telephone and the internet
Scharff, J. S. (2012) · The International Journal of Psychoanalysis · doi:10.1111/j.1745-8315.2011.00548.x · Cited by 89 · see citing works
Telephone-Based Cognitive–Behavioral Therapy for Depression in Parkinson Disease
Dobkin, R. D., Menza, M., Allen, L. A., Tiu, J., Friedman, J., Bienfait, K. L., Gara, M. A., & Mark, M. H. (2011) · Journal of Geriatric Psychiatry and Neurology · doi:10.1177/0891988711422529 · Cited by 88 · see citing works
Furukawa, T. A., Horikoshi, M., Kawakami, N., Kadota, M., Sasaki, M., Sekiya, Y., Hosogoshi, H., Kashimura, M., Asano, K., Terashima, H., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035330 · Cited by 83 · see citing works
Hammond, G. C., Croudace, T. J., Radhakrishnan, M., Lafortune, L., Watson, A., McMillan-Shields, F., & Jones, P. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042916 · Cited by 79 · see citing works
Coughtrey, A. E., & Pistrang, N. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16686547 · Cited by 78 · see citing works
Castro, A., Gili, M., Ricci-Cabello, I., Roca, M., Gilbody, S., Perez-Ara, M. Á., Seguí, A., & McMillan, D. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.09.023 · Cited by 78 · see citing works
Self-citationDeveloping a U.K. protocol for collaborative care: a qualitative study
Richards, D. A., Lankshear, A. J., Fletcher, J., Rogers, A. E., Barkham, M., Bower, P., Gask, L. L., Gilbody, S. M., & Lovell, K. (2006) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2006.03.005 · Cited by 72 · see citing works
Therapeutic alliance in face-to-face and telephone-administered cognitive behavioral therapy.
Stiles-Shields, C., Kwasny, M. J., Cai, X., & Mohr, D. C. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035554 · Cited by 69 · cited 2× · see citing works
“Alliance: Five studies (Fann et al., 2015; Himmelhoch et al., 2013; Mulligan et al., 2014; Reese et al., 2002; Stiles-Shields et al., 2014) considered patient and/or therapist ratings of therapeutic alliance across telephone and face-to-face therapy sessions, using versions of the Working Alliance Inventory (WAI; Horv…”
MethodTelephone counselling in Australia: Applications and considerations for use
Coman, G. J., Burrows, G. D., & Evans, B. J. (2001) · British Journal of Guidance and Counselling · doi:10.1080/03069880124904 · Cited by 68 · see citing works
Himelhoch, S. S., Medoff, D. R., Maxfield, J., Dihmes, S. E., Dixon, L. B., Robinson, C., Potts, W., & Mohr, D. C. (2013) · AIDS and Behavior · doi:10.1007/s10461-013-0465-5 · Cited by 64 · see citing works
Rosenfield, M. (1997) · SAGE Publications Ltd eBooks · doi:10.4135/9781446222058 · Cited by 58 · see citing works
Telephone-delivered cognitive behavioural therapy: a systematic review and meta-analysis
Müller, I., & Yardley, L. (2011) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2010.100709 · Cited by 52 · see citing works
Technology in Counselling and Psychotherapy: A Practitioner's Guide
Anthony, K., & Goss, S. (2003) · Medical Entomology and Zoology · Cited by 46 · see citing works
Heritage, J. C., Elliott, M. N., Stivers, T., Richardson, A., & Mangione-Smith, R. M. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2009.12.005 · Cited by 46 · see citing works
Analysis and Psychotherapy by Telephone: Twenty Years of Clinical Experience
Leffert, M. (2003) · Journal of the American Psychoanalytic Association · doi:10.1177/00030651030510011301 · Cited by 45 · see citing works
Affective Self-Disclosure in Telephone Versus Face To Face Interviews
Janofsky, A. I. (1971) · Journal of Humanistic Psychology · doi:10.1177/002216787101100110 · Cited by 42 · see citing works
Psychoanalysis online: mental health, teletherapy, and training
Anthony, K. (2014) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2015.975090 · Cited by 41 · see citing works
Lingley‐Pottie, P., & McGrath, P. J. (2007) · Advances in Nursing Science · doi:10.1097/01.ans.0000300184.94595.25 · Cited by 39 · see citing works
Telephone therapy: A review and case report.
Grumet, G. W. (1979) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1979.tb02643.x · Cited by 39 · see citing works
Bee, P., Lovell, K., Airnes, Z., & Pruszynska, A. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0761-5 · Cited by 38 · see citing works
Turner, J., Brown, J. C., & Carpenter, D. T. (2018) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.12440 · Cited by 37 · see citing works
The Telephone in Outpatient Psychotherapy
Miller, W. B. (1973) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1973.27.1.15 · Cited by 31 · see citing works
Ekberg, S., Barnes, R., Kessler, D. S., Mirza, S., Montgomery, A. A., Malpass, A., & Shaw, A. R. G. (2014) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465814000241 · Cited by 29 · see citing works
Mulligan, J., Haddock, G., Hartley, S., Davies, J., Sharp, T., KELLY, J. A., Neil, S. T., Taylor, C. D. J., Welford, M., Price, J., et al. (2014) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12018 · Cited by 26 · see citing works
(2016) · Human Rights Documents online · doi:10.1163/2210-7975_hrd-1763-0129 · Cited by 24 · see citing works
Christogiorgos, S., Vassilopoulou, V., Florou, A., Xydou, V., Douvou, M., Vgenopoulou, S., & Tsiantis, J. (2010) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2010.482394 · Cited by 23 · see citing works
Koons, C. R. (2010) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2009.10.008 · Cited by 22 · see citing works
Gellatly, J. L., Pedley, R., Molloy, C., Butler, J. A., Lovell, K., & Bee, P. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1238-x · Cited by 22 · see citing works
Orienting Clients to Telephone Coaching in Dialectical Behavior Therapy
Ben‐Porath, D. D. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.02.004 · Cited by 20 · see citing works
Bedi, R. P., & Duff, C. T. (2013) · Counselling Psychology Quarterly · doi:10.1080/09515070.2013.857295 · Cited by 18 · see citing works
Phone coaching in Dialectical Behavior Therapy: frequency and relationship to client variables
Oliveira, P. N., & Rizvi, S. L. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2018.1437469 · Cited by 18 · see citing works
Love in the Age of the Internet: Attachment in the Digital Era
Cundy, L. (2014) · Cited by 18 · see citing works
Stephenson, D., Bingaman, D., Plaza, C., Selvik, R., Sudgen, B., & Ross, C. (2004) · Employee Assistance Quarterly · doi:10.1300/j022v19n02_02 · Cited by 15 · see citing works
Viewing Telephone Therapy Through the Lens of Attachment Theory and Infant Research
Bennett, S. (2004) · Clinical Social Work Journal · doi:10.1023/b:csow.0000035106.05138.f3 · Cited by 14 · see citing works
Is empathy ear‐to‐ear or face‐to‐face?
Dilley, J. S., LEE, J. L., & VERRILL, E. L. (1971) · The Personnel and Guidance Journal · doi:10.1002/j.2164-4918.1971.tb03708.x · Cited by 13 · see citing works
Robson, C., Drew, P., & Reuber, M. (2013) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2013.03.008 · Cited by 13 · see citing works
Jones, E. A., Bale, H. L., & Morera, T. (2013) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x13000226 · Cited by 12 · see citing works
Observations on silence in telephone delivered cognitive behavioural therapy (T-CBT)
Chatwin, J., Bee, P., Macfarlane, G. J., & Lovell, K. (2014) · Journal of Applied Linguistics and Professional Practice · doi:10.1558/japl.27652 · Cited by 12 · see citing works
Evaluation of an Australian primary care telephone cognitive behavioural therapy pilot
Bassilios, B., Pirkis, J., King, K., Fletcher, J. R., Blashki, G. A., & Burgess, P. M. (2012) · Australian Journal of Primary Health · doi:10.1071/py12111 · Cited by 11 · see citing works
Haregu, T., Chimeddamba, O., & Islam, M. R. (2015) · SM Journal of Depression Research and Treatment · doi:10.36876/smjdrt.1006 · Cited by 9 · see citing works
The unique contributions of telephone therapy.
Williams, T., & Douds, J. (2002) · Cited by 7 · see citing works
Using Counselling Skills on the Telephone and in Computer-mediated Communication
Sanders, P. (2007) · Medical Entomology and Zoology · Cited by 3 · see citing works
Transition from in-person psychotherapy to telephone psychoanalysis
Bakalar, N. L. (2018) · Routledge eBooks · doi:10.4324/9780429478833-10 · Cited by 3 · see citing works
Differences Between Telephone and In-Person Peer Counseling.
Hinrichsen, J. J., & Zwibelman, B. B. (1981) · Journal of College Student Personnel · Cited by 1 · see citing works
Flagged first, then by citations
7 of the 80 references couldn’t be matched to a known paper.
Research works printed but not linked: 7
- Antonioni, D.T., 1973. A field study comparison of counselor empathy, concreteness and client self-exploration in face-to-face and telephone counseling during first and second interviews(Doctoral Thesis). University of Wisconsin, USA.
- Brown, L. J., 1985. Antecedents of compliance in employee assistance programs: telephone vs. face-to-face communications(Doctoral Thesis). University of Windsor, Ontario, Canada.
- Daniel, L.S., 1973. A study of the influence of introversion-extraversion and neuroticism on telephone counseling vs. face to face counselling(Doctoral Thesis). University of Texas, Austin, USA.
- Heritage J. Maynard D. Communication in Medical Care 2006 Cambridge University Press Cambridge
- National Institute for Health and Care Excellence (NICE), 2011. Generalised anxiety disorder and panic disorder in adults: management. NICE, London. 31961629
- Spizman, P., 2001. Is Counseling by Telephone Effective?(Doctoral Thesis). University of Pennsylvania, Indiana. USA.
- Webb, C., 2014. A qualitative study of the therapeutic alliance during telephone cognitive behavioural therapy: Clinicians’ perspectives(Doctoral Thesis). University of East Anglia, UK.
Cited by
Sorted by citations
Rauschenberg, C., Schick, A., Hirjak, D., Seidler, A., Paetzold, I., Apfelbacher, C., Riedel-Heller, S. G., & Reininghaus, U. (2021) · Journal of Medical Internet Research · doi:10.2196/23365 · Cited by 205 · see citing works
Research priorities for the COVID‐19 pandemic and beyond: A call to action for psychological science
O'Connor, D. B., Aggleton, J. P., Chakrabarti, B., Cooper, C. L., Creswell, C., Dunsmuir, S., Fiske, S. T., Gathercole, S., Gough, B., Ireland, J. L., et al. (2020) · British Journal of Psychology · doi:10.1111/bjop.12468 · Cited by 210 · see citing works
Psychological Intervention and COVID-19: What We Know So Far and What We Can Do
Inchausti, F., MacBeth, A. M., Hasson‐Ohayon, I., & Dimaggio, G. (2020) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-020-09460-w · Cited by 153 · see citing works
Alkureishi, M. A., Choo, Z.-Y., Rahman, A., Ho, K., Benning-Shorb, J., Lenti, G., Velázquez Sánchez, I., Zhu, M., Shah, S. D., & Lee, W. W. (2021) · JMIR Human Factors · doi:10.2196/33364 · Cited by 143 · see citing works
Rosen, C. S., Morland, L. A., Glassman, L. H., Marx, B. P., Weaver, K. R., Smith, C. A., Pollack, S. J., & Schnurr, P. P. (2020) · American Psychologist · doi:10.1037/amp0000751 · Cited by 114 · see citing works
Witte, N. A. J. D., Carlbring, P., Etzelmueller, A., Nordgreen, T., Karekla, M., Haddouk, L., Belmont, A., Øverland, S., Abi‐Habib, R., Bernaerts, S., et al. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100405 · Cited by 112 · see citing works
Giovanetti, A. K., Punt, S. E. W., Nelson, E., & Ilardi, S. S. (2022) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2021.0294 · Cited by 91 · see citing works
The impact of eHealth on relationships and trust in primary care: a review of reviews
Ramachandran, M., Brinton, C. G., Wiljer, D., Upshur, R. E. G., & Gray, C. S. (2023) · BMC Family Practice · doi:10.1186/s12875-023-02176-5 · Cited by 92 · see citing works
La Psicología Clínica ante la Pandemia COVID-19 en España
Inchausti, F., García‐Poveda, N. V., Prado-Abril, J., & Sánchez-Reales, S. (2020) · Clínica y Salud · doi:10.5093/clysa2020a11 · Cited by 77 · see citing works
Probst, T., Haid, B., Schimböck, W., Reisinger, A., Gasser, M., Eichberger-Heckmann, H., Stippl, P., Jesser, A., Humer, E. C., Korecka, N., et al. (2021) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2553 · Cited by 51 · see citing works
Telepsychotherapy in the age of COVID-19: A commentary.
Inchausti, F., MacBeth, A. M., Hasson‐Ohayon, I., & Dimaggio, G. (2020) · Journal of Psychotherapy Integration · doi:10.1037/int0000222 · Cited by 49 · see citing works
Provider Perceptions of Virtual Care During the Coronavirus Disease 2019 Pandemic
Connolly, S. L., Gifford, A. L., Miller, C. J., Bauer, M. S., Lehmann, L. S., & Charness, M. E. (2021) · Medical Care · doi:10.1097/mlr.0000000000001562 · Cited by 37 · see citing works
The barriers, benefits and training needs of clinicians delivering psychological therapy via video
Buckman, J. E. J., Saunders, R., Leibowitz, J., & Minton, R. (2021) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465821000187 · Cited by 42 · see citing works
Zhang, Y., Wang, S., Ding, W., Meng, Y., Hu, H., Liu, Z., Zeng, X., Guan, Y., & Wang, M. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.110253 · Cited by 41 · see citing works
Fritz, J. M., Davis, A. F., Burgess, D. J., Coleman, B. C., Cook, C. E., Farrokhi, S., Goertz, C., Heapy, A. A., Lisi, A. J., McGeary, D. D., et al. (2020) · Pain · doi:10.1097/j.pain.0000000000002139 · Cited by 40 · see citing works
Venville, A., O’Connor, S., Roeschlein, H., Ennals, P., McLoughlan, G., & Thomas, N. (2021) · JMIR Mental Health · doi:10.2196/29671 · Cited by 38 · see citing works
Maldonato, M. N., Bottone, M., Chiodi, A., Continisio, G. I., Falco, R. D., Duval, M., Muzii, B., Siani, G., Valerio, P., Vitelli, R., et al. (2020) · Sustainability · doi:10.3390/su12104244 · Cited by 35 · see citing works
Wyler, H., Liebrenz, M., Ajdacic‐Gross, V., Seifritz, E., Young, S., Burger, P. H. M., & Buadze, A. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03236-9 · Cited by 35 · see citing works
From Therapy to Teletherapy: Relocating Mental Health Services Online
Yamamoto, F. R., Voida, A., & Voida, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479508 · Cited by 38 · see citing works
Faija, C., Connell, J., Welsh, C., Ardern, K., Hopkin, E., Gellatly, J. L., Rushton, K., Fraser, C., Irvine, A. L., Armitage, C. J., et al. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02761-3 · Cited by 33 · see citing works
Villarreal‐Zegarra, D., Alarcon-Ruiz, C. A., Meléndez‐Torres, G. J., Torres-Puente, R., Navarro‐Flores, A., Cavero, V., Ambrosio-Melgarejo, J. I., Rojas-Vargas, J., Almeida-Huanca, G., Albitres‐Flores, L., et al. (2022) · JMIR Mental Health · doi:10.2196/34760 · Cited by 33 · see citing works
Shifting a training clinic to teletherapy during the COVID-19 pandemic: a trainee perspective
Scharff, A., Breiner, C. E., Ueno, L. F., Underwood, S. B., Merritt, E. C., Welch, L. M., Fonda, C., Malatras, J. W., Lin, B., Hormes, J. M., et al. (2020) · Counselling Psychology Quarterly · doi:10.1080/09515070.2020.1786668 · Cited by 32 · see citing works
Research in counselling and psychotherapy Post‐COVID‐19
Bell, C. A., Crabtree, S. A., Hall, E. L., & Sandage, S. J. (2020) · Counselling and Psychotherapy Research · doi:10.1002/capr.12334 · Cited by 31 · see citing works
Digital Interventions for Psychological Comorbidities in Chronic Diseases—A Systematic Review
Maisto, M., Diana, B., Di Tella, S., Matamala-Gomez, M., Montana, J. I., Rossetto, F., Mavrodiev, P. A., Cavalera, C., Blasi, V., Mantovani, F., et al. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11010030 · Cited by 30 · see citing works
Ford, J., & Reuber, M. (2023) · Health Communication · doi:10.1080/10410236.2023.2201733 · Cited by 29 · see citing works
Telehealth use by mental health professionals during COVID-19
Farrer, L. M., Clough, B. A., Bekker, M. J., Calear, A. L., Werner‐Seidler, A., Newby, J. M., Knott, V. E., Gooding, P., Reynolds, J., Brennan, L., et al. (2022) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/00048674221089229 · Cited by 26 · see citing works
Mattocks, K. M., Moore, D. T., Wischik, D. L., Lazar, C. M., & Rosen, M. I. (2022) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2022.108777 · Cited by 24 · see citing works
Putting a face to a name: Telephone contact as part of a blended approach to probation supervision
Dominey, J., Coley, D., Devitt, K. E., & Lawrence, J. (2021) · Probation Journal · doi:10.1177/02645505211050870 · Cited by 21 · see citing works
Burton, A., Rapaport, P., Palomo, M., Lord, K., Budgett, J., Barber, J., Hunter, R. M., Butler, L. T., Vickerstaff, V., Rockwood, K. J., et al. (2021) · Trials · doi:10.1186/s13063-021-05851-z · Cited by 21 · see citing works
Lekagul, A., Piancharoen, P., Chattong, A., Suradom, C., & Tangcharoensathien, V. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-060804 · Cited by 22 · see citing works
Cox, C. M., MASIANO, S. P., Mazenga, A. C., Stark, M., Udedi, M. M., Simon, K., Ahmed, S., Nyasulu, P., & Kim, M. H. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2023.84 · Cited by 18 · see citing works
Μουδάτσου, Μ., Stavropoulou, A., Rovithis, M., & Koukouli, S. (2024) · Healthcare · doi:10.3390/healthcare12040495 · Cited by 18 · see citing works
Budd, G., Griffiths, D., Howick, J., Vennik, J. L., Bishop, F. L., Durieux, N., & Everitt, H. (2022) · PEC Innovation · doi:10.1016/j.pecinn.2022.100065 · Cited by 18 · see citing works
Tang, L., Broad, J., Lewis, R., David, W. L., & Haines, J. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2021.02.043 · Cited by 18 · see citing works
Biassoni, F., & Gnerre, M. (2025) · Patient Education and Counseling · doi:10.1016/j.pec.2025.108663 · Cited by 17 · see citing works
Covid-19, les effets psychopathologiques de la pandémie
Joboory, S. A., Fernández, V. Á., Remingol, L., Brulin-Solignac, D., & Bouchard, J. (2020) · Soins Psychiatrie · doi:10.1016/s0241-6972(20)30119-5 · Cited by 16 · see citing works
Orlowski, E. W., Friedlander, M. L., Megale, A., Peterson, E. K., & Anderson, S. R. (2022) · Contemporary Family Therapy · doi:10.1007/s10591-022-09640-x · Cited by 16 · see citing works
Zentner, K., Gaine, G. S., Ethridge, P., Surood, S., & Abba‐Aji, A. (2022) · JMIR Formative Research · doi:10.2196/35535 · Cited by 14 · see citing works
Vogt, K. S., Johnson, J., Conner, M. T., Armitage, C. J., & Keyworth, C. (2023) · British Journal of Health Psychology · doi:10.1111/bjhp.12653 · Cited by 14 · see citing works
Telephone delivery of psychological interventions: Balancing protocol with patient-centred care
Drew, P., Irvine, A. L., Barkham, M., Faija, C., Gellatly, J. L., Ardern, K., Armitage, C. J., Brooks, H. L., Rushton, K., Welsh, C., et al. (2021) · Social Science & Medicine · doi:10.1016/j.socscimed.2021.113818 · Cited by 14 · see citing works
Honey, A., Waks, S., Hines, M., Glover, H., Hancock, N., Hamilton, D., & Smith‐Merry, J. (2021) · Community Mental Health Journal · doi:10.1007/s10597-021-00871-0 · Cited by 14 · see citing works
Uses of Virtual Care in Primary Care: Scoping Review
Agarwal, P., Fletcher, G. G., Ramamoorthi, K., Yao, X., & Bhattacharyya, O. K. (2024) · Journal of Medical Internet Research · doi:10.2196/55007 · Cited by 15 · see citing works
Töpfer, N. F., Wrede, N., Theurer, C., & Wilz, G. (2023) · Journal of Clinical Psychology · doi:10.1002/jclp.23538 · Cited by 12 · see citing works
Beck, A. K., Waks, S., Argent, A., Deane, F. P., Larance, B., Manning, V., Baker, A., Hides, L. M., & Kelly, P. J. (2023) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2023.104174 · Cited by 13 · see citing works
Leeming, D., Lucock, M. P., Shibazaki, K., Pilkington, N., & Scott, B. L. (2022) · Community Mental Health Journal · doi:10.1007/s10597-021-00932-4 · Cited by 12 · see citing works
Effect of Problem-solving Treatment on Self-reported Disability Among Veterans With Gulf War Illness
McAndrew, L. M., Quigley, K. S., Lu, S., Litke, D. R., Rath, J. F., Lange, G., Santos, S. L., Anastasides, N., Petrakis, B. A., Greenberg, L. M., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.45272 · Cited by 12 · see citing works
Thielecke, J., Buntrock, C., Freund, J., Braun, L., Ebert, D. D., Berking, M., Baumeister, H., & Titzler, I. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100671 · Cited by 10 · see citing works
Wang, Z., Chen, X., Zhou, J., Lin, C., Luo, H., & Li, Q. (2023) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2884 · Cited by 11 · see citing works
Shaw, R. B., Giroux, E. E., Gainforth, H. L., McBride, C. B., Vierimaa, M., & Ginis, K. A. M. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2021.09.008 · Cited by 11 · see citing works
Algorithm-Based Hearing and Speech Therapy Rehabilitation after Cochlear Implantation
Eichler, T., Rötz, W., Kayser, C., Bröhl, F., Römer, M., Witteborg, A. H., Kümmert, F., Sandmeier, T., Schulte, C., Stolz, P., et al. (2022) · Brain Sciences · doi:10.3390/brainsci12050580 · Cited by 10 · see citing works
Saunders, S. B., Santos, C. G., Rodríguez, N. M., Hermida, J. R. F., Santolaya, F. J., Fernández, J. S., & García‐Vera, M. P. (2020) · PubMed Central · Cited by 10 · see citing works
Case series associated with COVID‐19 pandemic in causing psychiatric morbidity
Mahapatra, A., & Sharma, P. (2021) · General Psychiatry · doi:10.1136/gpsych-2020-100343 · Cited by 10 · see citing works
Mulligan, L. D., Neil, S. T., Johnstone, M., Morris, R. K., & Swift, E. (2022) · Community Mental Health Journal · doi:10.1007/s10597-022-00963-5 · Cited by 10 · see citing works
Flowers, K. M., Colebaugh, C. A., Hruschak, V., Azizoddin, D. R., Meints, S. M., Jamison, R. N., Wilson, J. M., Edwards, R. R., & Schreiber, K. L. (2022) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-022-09901-9 · Cited by 9 · see citing works
Nam, S. H., & Yang, J.-C. (2021) · Chonnam Medical Journal · doi:10.4068/cmj.2021.57.1.7 · Cited by 9 · see citing works
Reilly, K., Maher, M., Smith, E., Coyne, E., Murphy, S., & Wilson, C. E. (2022) · Counselling and Psychotherapy Research · doi:10.1002/capr.12542 · Cited by 9 · see citing works
Saxon, D. H., Barkham, M., Bee, P., Gellatly, J. L., Faija, C., & Bower, P. (2023) · BMC Psychiatry · doi:10.1186/s12888-022-04404-1 · Cited by 8 · see citing works
Broadbear, J. H., Heidari, P., Dharwadkar, N. P., Cheney, L., & Rao, S. (2021) · Global Journal of Health Science · doi:10.5539/gjhs.v13n12p61 · Cited by 9 · see citing works
Shearsmith, L., Coventry, P. A., Sloan, C., Henry, A. F., Newbronner, E., Littlewood, E., Bailey, D., Gascoyne, S., Burke, L., Ryde, E., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-064694 · Cited by 8 · see citing works
Apego en la Práctica Clínica durante la Pandemia por COVID-19
Jiménez, L. V., & Ruiz, D. S. (2020) · Revista de Psicoterapia · doi:10.33898/rdp.v31i116.391 · Cited by 8 · see citing works
Santiago, V. A., Cassin, S. E., Wnuk, S., Du, C., Hawa, R., Parikh, S. V., & Sockalingam, S. (2020) · Clinical Obesity · doi:10.1111/cob.12431 · Cited by 7 · see citing works
Lucock, M. P., Borthwick, R., Cupac, J., Elliott, R., Howell, R., Kendal, S., Khan, W., Sandford, D. M., & Tolley, B. (2021) · Psychotherapy Research · doi:10.1080/10503307.2021.1959079 · Cited by 7 · see citing works
Young, D. K. W., Carlbring, P., Petrus, Y. N. N. G., & Chen, Q.-R. J. (2022) · Research on Social Work Practice · doi:10.1177/10497315221079236 · Cited by 7 · see citing works
Kyle, S. D., Bower, P., Yu, L., Siriwardena, A. N., Yang, Y., Petrou, S., Ogburn, E., Begum, N., Maurer, L., Robinson, B., et al. (2024) · Health Technology Assessment · doi:10.3310/rjyt4275 · Cited by 9 · see citing works
Online mental health resources in Wuhan amid the COVID-19 pandemic: the role of social workers
Zhao, K., Tan, W., & Tsang, A. K. T. (2021) · China Journal of Social Work · doi:10.1080/17525098.2021.2006899 · Cited by 7 · see citing works
Velasco, E. R., Pedersen, H. S., & Skinner, T. C. (2022) · JMIR Formative Research · doi:10.2196/40058 · Cited by 7 · see citing works
Remote probation by phone in France and Scotland during the 2020 lockdown
Herzog-Evans, M., & Sturgeon, J. (2022) · European Journal of Probation · doi:10.1177/20662203211056545 · Cited by 7 · see citing works
Armstrong, S., Pattinson, J., Siriwardena, A. N., Kyle, S. D., Bower, P., Yu, L., Yang, Y., Ogburn, E., Begum, N., Maurer, L., et al. (2023) · British Journal of General Practice · doi:10.3399/bjgp.2023.0162 · Cited by 6 · see citing works
Eliezer, K., Knei-Paz, C., Zvi, L., Schnall, I., Gitlitz, T., & Gavriel‐Fried, B. (2021) · The British Journal of Social Work · doi:10.1093/bjsw/bcab206 · Cited by 6 · see citing works
Maher, M., Reilly, K., Smith, E., Coyne, E., Murphy, S., & Wilson, C. E. (2022) · Counselling and Psychotherapy Research · doi:10.1002/capr.12558 · Cited by 6 · see citing works
Phillip, K., Beel, N., & Machin, T. M. (2020) · Psychotherapy and Counselling Journal of Australia · doi:10.59158/001c.71253 · Cited by 6 · see citing works
Saunders, J., & Allen, C. (2021) · Clinical Case Studies · doi:10.1177/15346501211018278 · Cited by 6 · see citing works
Day, E., & Thomas‐Anttila, K. (2021) · Psychotherapy and Counselling Journal of Australia · doi:10.59158/001c.71080 · Cited by 6 · see citing works
Wyler, H., Liebrenz, M., Ajdacic‐Gross, V., Seifritz, E., Young, S., Burger, P. H. M., & Buadze, A. (2020) · medRxiv · doi:10.1101/2020.12.11.20242511 · Cited by 6 · see citing works
Sun, Z., Yang, X., Wang, Y., Li, R., Zhang, Y., Li, Q., & Zhao, J. (2024) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2024.102608 · Cited by 5 · see citing works
Ghiretti, F., Gabriela, G., Grassi, G. M., Torricelli, L., Elena, B., Elisa, B., Francesca, B., Borelli, S., Cagnolati, F., Katia, C., et al. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.561742 · Cited by 5 · see citing works
The Dynamics of the Social Worker-Client Relationship
Walsh, J. (2021) · doi:10.1093/oso/9780197517956.001.0001 · Cited by 5 · see citing works
COVID-19 Adaptations for Health Service Psychology Internship Training in a Medical School
Agazzi, H. C., Najmabadi, S. J., Flood, J., Cimorelli, D., & Chenneville, T. (2021) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-021-09784-2 · Cited by 5 · see citing works
Cederberg, M., Fors, A., Ali, L., Goulding, A., & Mäkitalo, Å. (2022) · Health Expectations · doi:10.1111/hex.13440 · Cited by 5 · see citing works
Park, H., Nabin, L., Lee, J. H., Lee, D., Kim, K. A., Kim, H. S., Oh, E., Ha, J. H., Hyun, S. Y., Lee, J., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.834965 · Cited by 5 · see citing works
Riesco, L. R., & Senín‐Calderón, C. (2021) · Ansiedad y Estrés · doi:10.5093/anyes2022a5 · Cited by 8 · see citing works
Andrews, G., Flood, T., & Shepherd, P. (2021) · Journal of Radiotherapy in Practice · doi:10.1017/s1460396921000613 · Cited by 5 · see citing works
Lalor, I., Costello, C., O'Sullivan, M., Rice, C. E., & Collins, P. (2022) · Mental Health Review Journal · doi:10.1108/mhrj-05-2022-0029 · Cited by 4 · see citing works
Cederberg, M., Barenfeld, E., Ali, L., Ekman, I., Goulding, A., & Fors, A. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10190-7 · Cited by 4 · see citing works
Nakimuli‐Mpungu, E., Kwesiga, J. M., Bwanika, J. M., Musinguzi, D., Nakanyike, C., Iya, J., Akimana, B., Hawkins, C., Cavazos‐Rehg, P. A., Nachega, J. B., et al. (2025) · IntechOpen eBooks · doi:10.5772/intechopen.1008155 · Cited by 3 · see citing works
A survey of mental health professionals in a paediatric hospital during COVID-19
Ching, B. C. F., Bennett, S. D., Heyman, I., Liang, H., Catanzano, M., Fifield, K., Berger, Z. E., Gray, S., Hewson, E., Bryon, M., et al. (2021) · Clinical Child Psychology and Psychiatry · doi:10.1177/13591045211033186 · Cited by 4 · see citing works
Catanzano, M., Bennett, S. D., Fifield, K., Xu, L., Sanderson, C., Coughtrey, A. E., Kerry, E., Liang, H., Heyman, I., & Shafran, R. (2022) · Child Care Health and Development · doi:10.1111/cch.13051 · Cited by 4 · see citing works
Assessing the delivering of i MA gery‐focused therapy for PS ychosis (i MAPS ) via telehealth
Cairns, A. J. J., KELLY, J. A., & Taylor, C. D. J. (2023) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12463 · Cited by 4 · see citing works
Faija, C., Connell, J., Gellatly, J. L., Rushton, K., Lovell, K., Brooks, H. L., Armitage, C. J., Bower, P., & Bee, P. (2023) · BMC Psychiatry · doi:10.1186/s12888-023-04829-2 · Cited by 6 · see citing works
Witte, N. A. J. D., Carlbring, P., Etzelmueller, A., Nordgreen, T., Karekla, M., Haddouk, L., Belmont, A., Øverland, S., Abi‐Habib, R., Bernaerts, S., et al. (2020) · doi:10.2196/preprints.26541 · Cited by 4 · see citing works
Mental health practitioners’ perceptions of online working: a literature review
Roddy, J., Gabriel, L., Sheehy, R., Charura, D., Dunn, E., Hall, J., Moller, N. P., Smith, K., & Cooper, M. (2024) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2024.2373179 · Cited by 3 · see citing works
Integrating Online and Face-to-Face Counselling in Schools: Benefits, Challenges, and Strategies
Boniel‐Nissim, M. (2026) · Journal of Psychologists and Counsellors in Schools · doi:10.1177/20556365261428304 · Cited by 4 · see citing works
COVID-19’s Nudge to Modernise: An Opportunity to Reconsider Telehealth and Counselling Placements
Beel, N. (2021) · Psychotherapy and Counselling Journal of Australia · doi:10.59158/001c.71230 · Cited by 3 · see citing works
Velasco, E. R., Pedersen, H. S., Laursen, D. H., & Skinner, T. C. (2023) · PEC Innovation · doi:10.1016/j.pecinn.2023.100211 · Cited by 4 · see citing works
Howes, E., Smith, S. G., Gillies, K., Zhang, L. M., & Farrin, A. J. (2025) · Trials · doi:10.1186/s13063-025-09145-6 · Cited by 2 · see citing works
Management referral triaging process pilot study: a ‘telephone first’ approach
O’Reilly, A., & McDonnell, C. (2020) · Occupational Medicine · doi:10.1093/occmed/kqaa190 · Cited by 3 · see citing works
Johnson, D. A., Stone, A., & Marsh, S. (2022) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2022.2066545 · Cited by 3 · see citing works
Therapists’ experiences of remote working during the COVID-19 pandemic
Morgan, A., Davies, C., Olabi, Y., Hope‐Stone, L., Cherry, M. G., & Fisher, P. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.966021 · Cited by 3 · see citing works
Saffaryazdi, N., Kirkcaldy, N., Lee, G., Loveys, K., Broadbent, E., & Billinghurst, M. (2024) · Telematics and Informatics Reports · doi:10.1016/j.teler.2024.100131 · Cited by 4 · see citing works
Atiq, M., Nazir, H., Rahman, A., Malik, A., Atif, N., & Surkan, P. J. (2024) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2024.59 · Cited by 3 · see citing works
- Authors
- Irvine, A., Drew, P., Bower, P., Brooks, H., Gellatly, J., Armitage, C. J., Barkham, M., McMillan, D., & Bee, P.
- Affiliations
- University of York (GB)
- Manchester Academic Health Science Centre (GB)
- University of Liverpool (GB)
- University of Manchester (GB)
- University of Sheffield (GB)
- Corresponding author
- Irvine, Annie
- ORCID
- Venue
- Journal of Affective Disorders
- Publisher
- Elsevier BV
- Published
- 2020-03
- Volume
- 265
- Pages
- 120-131
- ISSN
- 0165-0327 (ISSN-L)
- PMC
- PMC7049904
- OpenAlex
- W2998977303
- Cited by
- 196
- References
- 80
- Citations by year
- 2026: 13 · 2025: 13 · 2024: 17 · 2023: 41 · 2022: 35 · 2021: 52 · 2020: 25
- FWCI
- 6.41
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Affective Disorders (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Research Explorer (The University of Manchester) (submittedVersion, cc-by-nc-nd)
- Funders
- National Institute for Health Research (RP-PG-1016-20010)
- Department of Health and Social Care
- Manchester Biomedical Research Centre
- NIHR Greater Manchester Patient Safety Translational Research Centre
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- face-to-face psychotherapy, therapeutic relationship, empathy, patient participation, disclosure, session duration, therapist attitudes, patient attitudes
- MeSH terms
- Empathy, Humans, Telephone, Exercise
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
