Psychiatric diagnosis by telephone: is it an opportunity?
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Background For reasons of feasibility, diagnostic telephone interviews are frequently used in research of psychiatric morbidity. However, it is unknown whether diagnostic telephone interviews are as valid as diagnostic face-to-face interviews. Research question Are diagnostic telephone interviews for psychiatric disorders as valid as diagnostic face-to-face interviews? Method A systematic review of original studies in PubMed, PsychINFO and Embase was carried out. We included studies considering (1) the sensitivity and specificity of diagnostic telephone interviews using face-to-face interviews as a golden standard and (2) the agreement between diagnostic telephone and diagnostic face-to-face interviews. Eligible were studies in the general population, in patients at risk for psychiatric disorders and in psychiatric outpatients. We assessed risk of bias with the quality assessment of diagnostic accuracy studies (QUADAS) instrument. Results We included sixteen studies. The included studies were generally small with thirteen studies reporting about Discussion There is insufficient evidence that diagnostic telephone interviews for the diagnosis of psychiatric disorders are valid, although results for depression and anxiety disorders seem promising.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Implementation outcomes were reported in eight reviews [21,24,25,27,28,30,32,38].”
From Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews (2021) · cites this paper as [32]
In the citing paper
“A review of telephone assessments found lack of properly performed studies on telephone assessments [32].”
From Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews (2021) · cites this paper as [32]
In the citing paper
“A total of 2 reviews examined the comparability of remote versus face-to-face assessment, with one review finding a good correlation between assessments and another finding that there was insufficient high-quality evidence published thus far to draw accurate and meaningful conclusions [27,32].”
From Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews (2021) · cites this paper as [32]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“0 as excellent agreement [15].”
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Quality criteria were proposed for measurement properties of health status questionnaires
Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. W. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.012 · Cited by 10,764 · cited 1×
“Percentage agreement is defined as the extent to which the outcomes of the telephone and face-to-face interview agree with each other [17].”
Background(2005) · PubMed · Cited by 7,011
Robins, L. N. (1981) · Archives of General Psychiatry · doi:10.1001/archpsyc.1981.01780290015001 · Cited by 5,219 · cited 1×
“Studies using standardized psychiatric interviews (SCID [22], DIS [23] and CIDI [24]) frequently used only one diagnostic section.”
MethodKessler, R. C., & Üstün, T. B. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.168 · Cited by 4,771 · cited 1×
“Studies using standardized psychiatric interviews (SCID [22], DIS [23] and CIDI [24]) frequently used only one diagnostic section.”
MethodThe Structured Clinical Interview for DSM-III-R (SCID): I: History, Rationale, and Description
Spitzer, R. L. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080032005 · Cited by 4,336
Mode of questionnaire administration can have serious effects on data quality
Bowling, A. (2005) · Journal of Public Health · doi:10.1093/pubmed/fdi031 · Cited by 1,871 · cited 3×
“Telephone interviews in general show more compliance or acquiescence (yes-saying), evasiveness (‘‘I don’t know’’ answers, or no response at all) and more extreme responses compared with the face-to-face interviews [2, 3, 9–11].”
BackgroundClinical tests: sensitivity and specificity
Lalkhen, A. G., & McCluskey, A. (2008) · Continuing Education in Anaesthesia Critical Care & Pain · doi:10.1093/bjaceaccp/mkn041 · Cited by 934 · cited 1×
“In general, the higher the sensitivity, the lower the specificity and vice versa [16].”
BackgroundTelephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires
Holbrook, A. L., Green, M. C., & Krosnick, J. A. (2003) · Public Opinion Quarterly · doi:10.1086/346010 · Cited by 916 · cited 2×
“Telephone interviews in general show more compliance or acquiescence (yes-saying), evasiveness (‘‘I don’t know’’ answers, or no response at all) and more extreme responses compared with the face-to-face interviews [2, 3, 9–11].”
Background
Research works printed but not linked: 1
- Hoek L, Hovens JE (2011) Psychiatric diagnosis by telephone? Tijdschr Psychiatr 53(7):419–424
Cited by
Anxiety After Stroke: The Importance of Subtyping
Chun, H.-Y. Y., Whiteley, W. N., Dennis, M. S., Mead, G. E., & Carson, A. J. (2018) · Stroke · doi:10.1161/strokeaha.117.020078 · Cited by 172
Barnett, P., Goulding, L., Casetta, C., Jordan, H., Sheridan-Rains, L., Steare, T., Williams, J., Wood, L., Gaughran, F., & Johnson, S. (2021) · Journal of Medical Internet Research · doi:10.2196/26492 · Cited by 136
Gillan, C. M., Kalanthroff, E., Evans, M., Weingarden, H. M., Jacoby, R. J., Gershkovich, M., Snorrason, I., Campeas, R., Cervoni, C., Crimarco, N. C., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.2998 · Cited by 92
DSM‐5 eating disorders among adolescents and young adults in Finland: A public health concern
Silén, Y., Sipilä, P. N., Raevuori, A., Mustelin, L., Marttunen, M., Kaprio, J., & Keski‐Rahkonen, A. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23236 · Cited by 90
Real-time teleophthalmology versus face-to-face consultation: A systematic review
Tan, I. J., Dobson, L. P., Bartnik, S. E., Muir, J., & Turner, A. W. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16660640 · Cited by 75
Threat to democracy: Physical and mental health impact of democracy movement in Hong Kong
Kai Hou, W., Hall, B. J., Canetti, D., Lau, K. M., Ng, S. M., & Hobfoll, S. E. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.07.005 · Cited by 61
“However, phone-based structured clinical interviews have been found to be a valid method for detecting and monitoring psychiatric symptoms (Hobfoll et al., 2011; Muskens et al., 2014) .”
MethodSchellekens, M. P. J., van den Hurk, D. G. M., Prins, J. B., Molema, J., van der Drift, M. A., & Speckens, A. E. M. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.05.044 · Cited by 59
Self-citationTønning, M. L., Kessing, L. V., Bardram, J. E., & Faurholt-Jepsen, M. (2019) · Journal of Medical Internet Research · doi:10.2196/15362 · Cited by 40
“Nevertheless, telephonic interviews (by trained lay interviewers or professionals) have been used in the research of depression and anxiety disorders with reasonable validity of diagnosis [51].”
BackgroundRIFD – A brief clinical research interview for functional somatic disorders and health anxiety
Petersen, M. W., Schröder, A., Jørgensen, T., Ørnbøl, E., Dantoft, T. M., Eliasen, M., & Fink, P. (2019) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2019.04.001 · Cited by 38
Iannuccelli, C., Lucchino, B., Gioia, C., Dolcini, G., Favretti, M., Franculli, D., & Franco, M. D. (2021) · Clinical and Experimental Rheumatology · doi:10.55563/clinexprheumatol/4nb0ku · Cited by 35
The epidemiology of current depression in Macau, China: towards a plan for mental health action
Hall, B. J., Lam, A. I. F., Wu, T. L., Hou, W. K., Latkin, C. A., & Galea, S. (2017) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-017-1415-8 · Cited by 33
“The previous studies showed that minimal bias is expected with telephone survey [41, 42] and general acceptability of this method [43, 44].”
MethodSocial media and mental health in democracy movement in Hong Kong: A population-based study
Lau, K. M., Hou, W. K., Hall, B. J., Canetti, D., Ng, S. M., Lam, A. I. F., & Hobfoll, S. E. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.07.028 · Cited by 30
Fogliati, V. J., Terides, M. D., Gandy, M., Staples, L. G., Johnston, L., Karin, E., Rapee, R. M., Titov, N., & Dear, B. F. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1158206 · Cited by 23
Österman, S., Axelsson, E., Lindefors, N., Hedman‐Lagerlöf, E., Hedman‐Lagerlöf, M., Kern, D., Svanborg, C., & Ivanov, V. Z. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04367-3 · Cited by 23
“I [23] and the HPDI interview [13] and were conducted over the telephone which has been shown to be a valid method for conducting psychiatric diagnostic interviews [26].”
MethodNielsen, M. G., Ørnbøl, E., Bech, P., Vestergaard, M., & Christensen, K. S. (2017) · Clinical Epidemiology · doi:10.2147/clep.s132913 · Cited by 16
“27 The M-CIDI seems acceptable for the respondents and is efficient considering the required time and the ease of administration.”
Shaw, Z. A., Conway, C., & Starr, L. R. (2021) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-020-00714-8 · Cited by 15
Telephone Versus face-to-face Interviews for Patient-Reported Outcome Instrument Development
Mazar, I., Lamoureux, R. E., Ojo, O. R., Kevane, G., Banderas, B. F., Stokes, J., & Shields, A. (2015) · Value in Health · doi:10.1016/j.jval.2015.09.2718 · Cited by 9
Osman, N., Chow, W. S., Michel, C., Meisenzahl, E. M., SCHIMMELMANN, B. G., & Schultze‐Lutter, F. (2022) · Early Intervention in Psychiatry · doi:10.1111/eip.13296 · Cited by 7
Katyal, J., Rashid, H., Tripathi, M., & Sood, M. (2021) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2021.108342 · Cited by 7
Kwakkenbos, L., Minton, O., Stone, P. C., Alexander, S. B., Baron, M. G., Hudson, M., & Thombs, B. D. (2015) · The Journal of Rheumatology · doi:10.3899/jrheum.141421 · Cited by 8
Hou, W. K., Canetti, D., Wah, T., Hall, B. J., Lau, K. M., Ng, S. M., & Hobfoll, S. E. (2018) · Journal of Social and Political Psychology · doi:10.5964/jspp.v6i2.791 · Cited by 4
“…have been found to be a valid method for assessing psychological variables in both cross-sectional and longitudinal designs (Hobfoll et al., 2011; Muskens et al., 2014), response bias and social desirability could influence respondents’ answers and discount data validity, especially for…”
MethodOuali, U., Aissa, A., Rjaibi, S., Zoghlami, N., Zgueb, Y., Larnaout, A., Zid, M., Kacem, I., Charfi, F., Moro, M. F., et al. (2022) · Clinical Practice and Epidemiology in Mental Health · doi:10.2174/17450179-v18-e221026-2022-19 · Cited by 4
“A systematic review comparing the validity of diagnostic telephone interviews versus diagnostic face-to-face interviews concluded that telephone interviewing in the general population may not be valid because comparability measures are lowest in these low-risk populations, especially for low prevalence disorders such…”
Verma, A., Kaur, D., Singh, A., Dere, S. S., & Ghildiyal, R. (2024) · MGM Journal of Medical Sciences · doi:10.4103/mgmj.mgmj_55_23
Smith, B. H., Koshinski, J. L., Ozdag, Y., Mahmoud, M., Garcia, V. C., Dwyer, C. L., Klena, J. C., & Grandizio, L. C. (2025) · The Journal Of Hand Surgery · doi:10.1016/j.jhsa.2025.03.011
Metadata
- Authors
- Muskens, E. M. H., Lucassen, P., Groenleer, W., van Weel, C., Oude Voshaar, R., & Speckens, A.
- Affiliations
- Radboud University Medical Center (NL)
- Corresponding author
- Muskens, Esther M. H.
- Venue
- Social Psychiatry and Psychiatric Epidemiology
- Published
- 2014-03-15
- Volume
- 49
- Issue
- 10
- Pages
- 1677-1689
- ISSN
- 0933-7954 (ISSN-L)
- 1433-9285
- OpenAlex
- W2111992746
- Cited by
- 24
- References
- 42
- Citations by year
- 2025: 1 · 2024: 1 · 2022: 3 · 2021: 4 · 2020: 1 · 2019: 3 · 2018: 2 · 2017: 2 · 2016: 4 · 2015: 3
- FWCI
- 1.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Social Psychiatry and Psychiatric Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- psychiatric diagnosis, diagnostic accuracy, face-to-face interviews, sensitivity and specificity, interobserver agreement, anxiety disorders, depressive disorders, psychiatric morbidity, risk of bias
- MeSH terms
- Mental Disorders, Humans, Sensitivity and Specificity, Telephone, Remote Consultation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.