Psychiatric diagnosis by telephone: is it an opportunity?
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Background For reasons of feasibility, diagnostic telephone interviews are frequently used in research of psychiatric morbidity. However, it is unknown whether diagnostic telephone interviews are as valid as diagnostic face-to-face interviews. Research question Are diagnostic telephone interviews for psychiatric disorders as valid as diagnostic face-to-face interviews? Method A systematic review of original studies in PubMed, PsychINFO and Embase was carried out. We included studies considering (1) the sensitivity and specificity of diagnostic telephone interviews using face-to-face interviews as a golden standard and (2) the agreement between diagnostic telephone and diagnostic face-to-face interviews. Eligible were studies in the general population, in patients at risk for psychiatric disorders and in psychiatric outpatients. We assessed risk of bias with the quality assessment of diagnostic accuracy studies (QUADAS) instrument. Results We included sixteen studies. The included studies were generally small with thirteen studies reporting about Discussion There is insufficient evidence that diagnostic telephone interviews for the diagnosis of psychiatric disorders are valid, although results for depression and anxiety disorders seem promising.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Implementation outcomes were reported in eight reviews [21,24,25,27,28,30,32,38].”
From Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews (2021) · cites this paper as [32]
In the citing paper
“A review of telephone assessments found lack of properly performed studies on telephone assessments [32].”
From Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews (2021) · cites this paper as [32]
In the citing paper
“A total of 2 reviews examined the comparability of remote versus face-to-face assessment, with one review finding a good correlation between assessments and another finding that there was insufficient high-quality evidence published thus far to draw accurate and meaningful conclusions [27,32].”
From Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews (2021) · cites this paper as [32]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“0 as excellent agreement [15].”
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Quality criteria were proposed for measurement properties of health status questionnaires
Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. W. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.012 · Cited by 10,764 · cited 1×
“Percentage agreement is defined as the extent to which the outcomes of the telephone and face-to-face interview agree with each other [17].”
Background(2005) · PubMed · Cited by 7,011
Robins, L. N. (1981) · Archives of General Psychiatry · doi:10.1001/archpsyc.1981.01780290015001 · Cited by 5,219 · cited 1×
“Studies using standardized psychiatric interviews (SCID [22], DIS [23] and CIDI [24]) frequently used only one diagnostic section.”
MethodKessler, R. C., & Üstün, T. B. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.168 · Cited by 4,771 · cited 1×
“Studies using standardized psychiatric interviews (SCID [22], DIS [23] and CIDI [24]) frequently used only one diagnostic section.”
MethodThe Structured Clinical Interview for DSM-III-R (SCID): I: History, Rationale, and Description
Spitzer, R. L. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080032005 · Cited by 4,336
Mode of questionnaire administration can have serious effects on data quality
Bowling, A. (2005) · Journal of Public Health · doi:10.1093/pubmed/fdi031 · Cited by 1,871 · cited 3×
“Telephone interviews in general show more compliance or acquiescence (yes-saying), evasiveness (‘‘I don’t know’’ answers, or no response at all) and more extreme responses compared with the face-to-face interviews [2, 3, 9–11].”
BackgroundClinical tests: sensitivity and specificity
Lalkhen, A. G., & McCluskey, A. (2008) · Continuing Education in Anaesthesia Critical Care & Pain · doi:10.1093/bjaceaccp/mkn041 · Cited by 934 · cited 1×
“In general, the higher the sensitivity, the lower the specificity and vice versa [16].”
BackgroundTelephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires
Holbrook, A. L., Green, M. C., & Krosnick, J. A. (2003) · Public Opinion Quarterly · doi:10.1086/346010 · Cited by 916 · cited 2×
“Telephone interviews in general show more compliance or acquiescence (yes-saying), evasiveness (‘‘I don’t know’’ answers, or no response at all) and more extreme responses compared with the face-to-face interviews [2, 3, 9–11].”
BackgroundData Quality in Mail, Telephone and Face to Face Surveys.
Leeuw, D., & de Leeuw, E. D. (1992) · Cited by 525
Comparability of telephone and face-to-face interviews in assessing axis I and II disorders
Rohde, P., Lewinsohn, P. M., & Seeley, J. R. (1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.11.1593 · Cited by 522 · cited 6×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundMethodInfluentialInterview Mode Effects in Surveys of Drug and Alcohol Use: A Field Experiment
Aquilino, W. S. (1994) · Public Opinion Quarterly · doi:10.1086/269419 · Cited by 458
A comparison of mail, telephone, and home interview strategies for household health surveys.
Siemiatycki, J. (1979) · American Journal of Public Health · doi:10.2105/ajph.69.3.238 · Cited by 402 · cited 2×
“W at so n [2 5 ] C o m m u n it y v o lu n te er s”
BackgroundBravo, G., & H�bert, R. (1997) · International Journal of Geriatric Psychiatry · doi:10.1002/(sici)1099-1166(199710)12:10<1008::aid-gps676>3.0.co;2-a · Cited by 344
No role for quality scores in systematic reviews of diagnostic accuracy studies
Whiting, P., Harbord, R., & Kleijnen, J. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-19 · Cited by 337
Telephone Surveys in Public Health Research
Marcus, A. C., & Crane, L. A. (1986) · Medical Care · doi:10.1097/00005650-198602000-00002 · Cited by 241 · cited 10×
“R o h d e [3 5 ] P ar ti ci p an ts fr o m fo ll o w u p”
BackgroundInfluentialWells, K. B., Burnam, M. A., Leake, B., & Robins, L. N. (1988) · Journal of Psychiatric Research · doi:10.1016/0022-3956(88)90006-4 · Cited by 230 · cited 7×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundInfluentialTelephone assessment of depression severity
Simon, G. E., Revicki, D., & VonKorff, M. (1993) · Journal of Psychiatric Research · doi:10.1016/0022-3956(93)90035-z · Cited by 220 · cited 5×
“84 Simon [36] SCID 0.”
BackgroundInfluentialCharter, R. A. (1999) · Journal of Clinical and Experimental Neuropsychology · doi:10.1076/jcen.21.4.559.889 · Cited by 215 · cited 1×
“Future studies should include larger samples of participants, for example, at least 200 respondents (pilot) or 400 for reliability studies and even more for validity studies [43].”
BackgroundEffects of Interview Mode on Self-Reported Drug Use
Aquilino, W. S., & Sciuto, L. A. L. (1990) · Public Opinion Quarterly · doi:10.1086/269212 · Cited by 201 · cited 4×
“Telephone interviews may be less suitable for people who are hearing impaired [2, 3, 10], mistrustful [8, 12], older, [3, 7, 10, 13] or very ill [3, 7].”
BackgroundInfluentialLyneham, H. J., & Rapee, R. M. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200503000-00012 · Cited by 198 · cited 6×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundInfluentialAZIZ, M. A., & KENFORD, S. (2004) · Journal of Psychiatric Practice · doi:10.1097/00131746-200409000-00004 · Cited by 181 · cited 9×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundMethodInfluentialTheories and Methods of Telephone Surveys
Groves, R. M. (1990) · Annual Review of Sociology · doi:10.1146/annurev.so.16.080190.001253 · Cited by 163 · cited 6×
“P au ls en [2 7 ] M em b er s o f fa m il ie s o f”
BackgroundInfluentialReliability of the Telephone Interview in Diagnosing Anxiety Disorders
Paulsen, A. S. (1988) · Archives of General Psychiatry · doi:10.1001/archpsyc.1988.01800250076009 · Cited by 110 · cited 10×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundInfluentialCrippa, J. A. S., de Lima Osório, F., Del-Ben, C. M., Filho, A. S., da Silva Freitas, M. C., & Loureiro, S. R. (2008) · Perspectives In Psychiatric Care · doi:10.1111/j.1744-6163.2008.00183.x · Cited by 109 · cited 10×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundInfluentialPatten, S. B. (2009) · BMC Psychiatry · doi:10.1186/1471-244x-9-19 · Cited by 96 · cited 2×
“For example, Segal [41] reports test–retest reliabilities (kappa) of the SCID interview of 0.”
Cacciola, J. S., Alterman, A. I., Rutherford, M. J., McKay, J. R., & May, D. J. (1999) · Assessment · doi:10.1177/107319119900600304 · Cited by 86 · cited 8×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundInfluentialInterviewing Older Adults: A Comparison of Telephone and Face-to-Face Modalities
Herzog, A. R., Rodgers, W. L., & Kulka, R. A. (1983) · Public Opinion Quarterly · doi:10.1086/268798 · Cited by 82 · cited 4×
“Telephone interviews may be less suitable for people who are hearing impaired [2, 3, 10], mistrustful [8, 12], older, [3, 7, 10, 13] or very ill [3, 7].”
BackgroundInfluentialEVANS, M., KESSLER, D., LEWIS, G., PETERS, T. J., & SHARP, D. (2004) · Psychological Medicine · doi:10.1017/s0033291703008055 · Cited by 80 · cited 5×
“From the four studies with intermediate risk of psychiatric morbidity [27, 31–33] only the study by Wells [32] with 230 patients provided data about criterion validity.”
BackgroundInfluentialThe Reliability and Validity of the Geriatric Depression Rating Scale Administered by Telephone
Burke, W. J., Roccaforte, W. H., Wengel, S. P., Conley, D. M., & Potter, J. F. (1995) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1995.tb07205.x · Cited by 80 · cited 7×
“92 Burke [37]CS-GDS 94 % 42 % Revicki [34] CIDI 0.”
BackgroundMethodInfluentialRevicki, D. A., Tohen, M., Gyulai, L., Thompson, C., Pike, S., Davis-Vogel, A., & Zarate, C. (1997) · Harvard Review of Psychiatry · doi:10.3109/10673229709034730 · Cited by 58 · cited 6×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundInfluentialTelephone Survey Methods: The State of the Art
Tyebjee, T. T. (1979) · Journal of Marketing · doi:10.1177/002224297904300307 · Cited by 50
Hajebi, A., Motevalian, A., Amin-Esmaeili, M., Hefazi, M., Radgoodarzi, R., Rahimi-Movaghar, A., & Sharifi, V. (2012) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2011.06.001 · Cited by 44 · cited 10×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundMethodInfluentialThe tele-assessment of cognitive state: a review
Ball, C., & Mclaren, P. (1997) · Journal of Telemedicine and Telecare · doi:10.1258/1357633971931020 · Cited by 40 · cited 2×
“Witchen [42] found very high kappa’s for test–retest reliability of the CIDI interview, probably due to the fully structured nature of the CIDI interview.”
BackgroundSTARD Statement: Still Room for Improvement in the Reporting of Diagnostic Accuracy Studies
Bossuyt, P. M. (2008) · Radiology · doi:10.1148/radiol.2483080868 · Cited by 36 · cited 1×
“For the construction of the data extraction form, we used the items of the STARD statement (Standards for Reporting of Diagnostic Accuracy) [21].”
MethodWard-King, J., Cohen, I. L., Penning, H., & Holden, J. J. A. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-010-0987-x · Cited by 32 · cited 5×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundInfluentialTelephone Interviewing: A Reappraisal and a Field Experiment
Quinn, R. P., Gutek, B. A., & Walsh, J. T. (1980) · Basic and Applied Social Psychology · doi:10.1207/s15324834basp0102_3 · Cited by 29 · cited 5×
“Researchers assumed that telephone interviews should be short and that they were only suitable for gathering factual data and not for more sensitive issues [1, 3].”
BackgroundMethodInfluentialComparability of Telephone and Face to Face Diagnostic Interview Schedules
Watson, C. G., Anderson, P. E. D., Thomas, D., & Nyberg, K. (1992) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199208000-00010 · Cited by 27 · cited 10×
“In 13 studies, there were problems concerning patient selection [25–32, 34, 35, 38–40]: for instance, oversampling of patients with depressive symptoms [32] or with any lifetime psychotic disorder [29] or other sampling strategies leading to one group with cases and one group with non-cases.”
BackgroundMethodInfluentialTelephone Survey Methods: The State of the Art
Tyebjee, T. T. (1979) · Journal of Marketing · doi:10.2307/1250148 · Cited by 21
THE MEDICOLEGAL DANGERS OF TELEPHONE TRIAGE IN MENTAL HEALTH CARE
Erdman, C. (2001) · Journal of Legal Medicine · doi:10.1080/01947640152750964 · Cited by 12 · cited 1×
“Telephone interviews may be less suitable for people who are hearing impaired [2, 3, 10], mistrustful [8, 12], older, [3, 7, 10, 13] or very ill [3, 7].”
BackgroundTunstall, N., Prince, M. J., & MANN, A. H. (1997) · International Journal of Geriatric Psychiatry · Cited by 11
Paing, W. W., Weller, R. A., Dixon, T. A. M., & Weller, E. B. (2010) · Current Psychiatry Reports · doi:10.1007/s11920-010-0101-2 · Cited by 10
[Psychiatric diagnosis by telephone?].
Hoek, L., & Hovens, J. E. J. M. (2011) · PubMed · Cited by 2
Research works printed but not linked: 1
- Hoek L, Hovens JE (2011) Psychiatric diagnosis by telephone? Tijdschr Psychiatr 53(7):419–424
Cited by
Anxiety After Stroke: The Importance of Subtyping
Chun, H.-Y. Y., Whiteley, W. N., Dennis, M. S., Mead, G. E., & Carson, A. J. (2018) · Stroke · doi:10.1161/strokeaha.117.020078 · Cited by 172
Barnett, P., Goulding, L., Casetta, C., Jordan, H., Sheridan-Rains, L., Steare, T., Williams, J., Wood, L., Gaughran, F., & Johnson, S. (2021) · Journal of Medical Internet Research · doi:10.2196/26492 · Cited by 136
Gillan, C. M., Kalanthroff, E., Evans, M., Weingarden, H. M., Jacoby, R. J., Gershkovich, M., Snorrason, I., Campeas, R., Cervoni, C., Crimarco, N. C., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.2998 · Cited by 92
DSM‐5 eating disorders among adolescents and young adults in Finland: A public health concern
Silén, Y., Sipilä, P. N., Raevuori, A., Mustelin, L., Marttunen, M., Kaprio, J., & Keski‐Rahkonen, A. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23236 · Cited by 90
Real-time teleophthalmology versus face-to-face consultation: A systematic review
Tan, I. J., Dobson, L. P., Bartnik, S. E., Muir, J., & Turner, A. W. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16660640 · Cited by 75
Metadata
- Authors
- Muskens, E. M. H., Lucassen, P., Groenleer, W., van Weel, C., Oude Voshaar, R., & Speckens, A.
- Affiliations
- Radboud University Medical Center (NL)
- Corresponding author
- Muskens, Esther M. H.
- Venue
- Social Psychiatry and Psychiatric Epidemiology
- Published
- 2014-03-15
- Volume
- 49
- Issue
- 10
- Pages
- 1677-1689
- ISSN
- 0933-7954 (ISSN-L)
- 1433-9285
- OpenAlex
- W2111992746
- Cited by
- 24
- References
- 42
- Citations by year
- 2025: 1 · 2024: 1 · 2022: 3 · 2021: 4 · 2020: 1 · 2019: 3 · 2018: 2 · 2017: 2 · 2016: 4 · 2015: 3
- FWCI
- 1.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Social Psychiatry and Psychiatric Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- psychiatric diagnosis, diagnostic accuracy, face-to-face interviews, sensitivity and specificity, interobserver agreement, anxiety disorders, depressive disorders, psychiatric morbidity, risk of bias
- MeSH terms
- Mental Disorders, Humans, Sensitivity and Specificity, Telephone, Remote Consultation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.