The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Assessing depression in primary care with the PHQ-9: Can it be carried out over the telephone?
Open accessAbstract
Background Telephone assessment of depression for research purposes is increasingly being used. The Patient Health Questionnaire 9-item depression module (PHQ-9) is a well-validated, brief, self-reported, diagnostic, and severity measure of depression designed for use in primary care (PC). To our knowledge, there are no available data regarding its validity when administered over the telephone.Objective The aims of the present study were to evaluate agreement between self-administered and telephone-administered PHQ-9, to investigate possible systematic bias, and to evaluate the internal consistency of the telephone-administered PHQ-9.Methods Three hundred and forty-six participants from two PC centers were assessed twice with the PHQ-9. Participants were divided into 4 groups according to administration procedure order and administration procedure of the PHQ-9: Self-administered/Telephone-administered; Telephone-administered/Self-administered; Telephone-administered/Telephone-administered; and Self-administered/Self-administered. The first 2 groups served for analyzing the procedural validity of telephone-administered PHQ-9. The last 2 allowed a test-retest reliability analysis of both self- and telephone-administered PHQ-9. Intraclass correlation coefficient (ICC) and weighted kappa (for each item) were calculated as measures of concordance. Additionally, Pearson's correlation coefficient, Student's t-test, and Cronbach's alpha were analyzed.Results Intraclass correlation coefficient and weighted kappa between both administration procedures were excellent, revealing a strong concordance between telephone- and self-administered PHQ-9. A small and clinically nonsignificant tendency was observed toward lower scores for the telephone-administered PHQ-9. The internal consistency of the telephone-administered PHQ-9 was high and close to the self-administered one.Conclusions Telephone and in-person assessments by means of the PHQ-9 yield similar results. Thus, telephone administration of the PHQ-9 seems to be a reliable procedure for assessing depression in PC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, previous evidence suggests that the information gathering methods might not influence the results when assessing psychiatric disorders (Fenig et al., 1993;Rohde et al., 1997), and particularly when using the PHQ (Pinto-Meza et al., 2005).”
From Prevalence and age patterns of depression in the United Kingdom. A population-based study (2021) · cites this paper as Pinto-Meza et al., 2005
In the citing paper
“The telephone-administered version of the PHQ-9 showed adequate reliability (α=0.82),43”
From Efficacy, cost-utility and physiological effects of Acceptance and Commitment Therapy (ACT) and Behavioural Activation Treatment for Depression (BATD) in patients with chronic low back pain and depression: study protocol of a randomised, controlled trial including mobile-technology-based ecological momentary assessment (IMPACT study) (2020) · cites this paper as [43]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR)
American Psychiatric Association (2000) · doi:10.1176/appi.books.9780890423349 · Cited by 11,069
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
Measuring Health: A Guide to Rating Scales and Questionnaires
McDowell, I., & Newell, C. (1987) · Cited by 4,207
The de Facto US Mental and Addictive Disorders Service System
Regier, D. A. (1993) · Archives of General Psychiatry · doi:10.1001/archpsyc.1993.01820140007001 · Cited by 1,988
Löwe, B., Kroenke, K., Herzog, W., & Gräfe, K. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(03)00198-8 · Cited by 1,558
Measuring Health: A Guide to Rating Scales and Questionnaires
Anderson, J. C. (1997) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199711000-00018 · Cited by 1,534
LOWE, B. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00237-9 · Cited by 1,060
Screening psychischer Störungen mit dem “Gesundheitsfragebogen für Patienten (PHQ-D)“
Gräfe, K., Zipfel, S., Herzog, W., & Löwe, B. (2004) · Diagnostica · doi:10.1026/0012-1924.50.4.171 · Cited by 805
Research works printed but not linked: 2
- Spitzer RL, Williams JB. Clasificación de los transtornos mentales [Classification of mental disorders]. In: Kaplan HI, Sakock BJ, eds. Tratado de psiquiatría [Comprehensive Textbook of Psychiatry]. 2nd edn. Barcelona, Spain: Salvat; 1989:585–607.
- Doménech JM. Fundamentos de diseño y estadística. UD 14: Medida del cambio: Análisis de diseños con medidas intrasujeto [Statistics and Design Basis. UD 14: Change Measures: Intra-Subject Measure Design Analysis]. Barcelona, Spain: Signo; 2002.
Cited by
Sorted by citations
Items 301–347 of 347
Stress and depressive symptoms in Latin Americans in Toronto
Ginieniewicz, J., & McKenzie, K. J. (2012) · Ethnicity and Inequalities in Health and Social Care · doi:10.1108/17570981211319401 · Cited by 1
Evaluation of behavioural activation and inhibition systems by telephone
Pinto‐Meza, A., Suarez, D. L., Caseras, X., Haro, J. M., Serrano‐Blanco, A., & Torrúbia, R. (2009) · Revista de Psiquiatría y Salud Mental (English Edition) · doi:10.1016/s2173-5050(09)70033-0 · Cited by 1
Gavrić, Ž., Marković, B., & Cukafic, A. (2012) · Electronic Journal of General Medicine · doi:10.29333/ejgm/82468 · Cited by 1
Diagnostica la depresión antes
Campagne, D. M. (2017) · Medicina de Familia SEMERGEN · doi:10.1016/j.semerg.2017.04.013 · Cited by 1
Prevalence and severity of poststroke depression among stroke survivors in Northeastern Nigeria
Rufa'i, A., Oyeyemi, A. Y., Fidelis, F., & Ahmad, R. (2018) · Nigerian Journal of Basic and Clinical Sciences. · doi:10.4103/njbcs.njbcs_25_17 · Cited by 1
Abbudi, S. J. R. A. (2018) · Clinical Psychiatry · doi:10.21767/2471-9854.100056 · Cited by 1
Mediation Analysis of Co-occurring Conditions for Complex Longitudinal Clinical Data
Gunzler, D. D., Morris, N. J., Perzynski, A. T., Miller, D., Lewis, S., & Bermel, R. A. (2017) · SM Journal of Biometrics & Biostatistics · doi:10.36876/smjbb.1004
Caliskan, E., Cumurcu, H. B., Talu, B., Zayman, E. P., & Aydın, Y. (2020) · Medicine Science | International Medical Journal · doi:10.5455/medscience.2020.04.051 · Cited by 1
Wang, D., Ge, P., Xue, D.-M., Hu, C., Huang, G., Qi, J., Hong, W.-Y., Pan, L., Han, X., Zhang, J., et al. (2025) · Archives of Public Health · doi:10.1186/s13690-025-01579-3 · Cited by 1
Training and Administration of Behavioral Health Screens within the Veterans Health Administration
Funderburk, J. S., Dev, C., & Maisto Stephen, A. (2016) · Quality in primary care · Cited by 1
Kronish, I. M., Moise, N., & Davidson, K. W. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2019.7113 · Cited by 1
Rakshasa-Loots, A. M., & Laughton, B. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.840912 · Cited by 1
Tracy, M. (2012) · Deep Blue (University of Michigan) · Cited by 1
Entrevistas realizadas a distância no campo da pesquisa qualitativa em saúde
Gonçalo, C. D. S., & de Barros, N. F. (2013) · Cadernos Brasileiros de Terapia Ocupacional · doi:10.4322/cto.2013.066 · Cited by 1
Using Client Feedback in Psychotherapy – In Practice
Green, D. G., & Latchford, G. J. (2012) · doi:10.1002/9781119967590.ch7
An Exploratory Study of Pharmacist Self-Reported Antidepressant Medication Counseling Behaviors
Cannon-Breland, M. L. (2011)
Promoting Survey-Based Action by U.S. Army Unit Leaders in Afghanistan: A Case Study
Whalen, R. J., Foral, T. A., Prevette, C. M., & Radford, K. (2015) · Military Behavioral Health · doi:10.1080/21635781.2014.995246
Screening for Psychiatric Problems in the Orofacial Trauma Setting
Marshall, G. N. (2011) · Perioperative Nursing Clinics · doi:10.1016/j.cpen.2011.08.003
Depression-Avoidance Defences in Bipolar-Euthymia
Granger, S. (2015) · Victoria University Research Repository (Victoria University)
personneland receipt of treatment among UK service
Rona, R. J., Wessely, S. C., Thornicroft, G., Fear, N. T., Iversen, A. C., van Staden, L. N., Hughes, J. H., Browne, T., & Greenberg, N. L. (2010)
Holloway, E. E. (2017) · Minerva Access (University of Melbourne)
Alsubaie, A. T., & Mirghani, H. O. (2018) · The Egyptian Journal of Hospital Medicine · doi:10.12816/0044647
Examining the sleep hygiene behaviors of migraineurs in a university setting
Walters, A. B. (2011)
Yoga for chronic pain in veterans: A mixed methods study
Donaldson, M. T. (2018) · University of Minnesota Digital Conservancy (University of Minnesota) · doi:10.5281/zenodo.20799500
Towards the Evidence-based Trauma-Informed Mental Health Policy in Georgia
Makhashvili, N. (2015)
Developing a Culturally Relevant Mental Health Assessment for Persons of African Descent
Iyamu, R. (2021) · USF Scholarship Repository (University of San Francisco)
Oquendo, M. A. (2010) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.1474963.954061
Signs of Depression Following Laparoscopic Gastric Banding
(2014) · Journal of Obesity and Bariatrics · doi:10.13188/2377-9284.1000002
Literacy limitations to psychological evaluation tools: The case of MU
Luo, C. Y., Ufongene, C., & Weintraub, J. (2022) · Torture Journal · doi:10.7146/torture.v32i3.132023
Ritter, C., Abdullahi, S. U., Gambo, S., Murtala, H. A., Kabir, H., Shamsu, K. A., Gwarzo, G. D., Banaei, Y., Acra, S. A., Stallings, V. A., et al. (2024) · BMC Nutrition · doi:10.1186/s40795-024-00826-0
Co-existence of depression and post-concussion syndrome one month after mild traumatic brain injury
Biard, A., Ayar, P. V., Diallo, A., Gatineau-Sailliant, M., Lefèvre-Dognin, C., Cogné, M., Azouvi, P., Faillot, T., Decq, P., & Faillot, M. (2024) · Brain Injury · doi:10.1080/02699052.2024.2311338
Espeleta, H. C., Witcraft, S. M., Raffa, T., Kartiko, S., Dawson, D. N., Becerra, G., Roisman, H., Halbert, C. H., Mueller, M., Powell, E., et al. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2024.107694
Intestinal Stomas and Quality of Life Measures: Uganda Perspectives
Omona, K. (2024) · Springer eBooks · doi:10.1007/978-3-031-32046-0_113-1
Intestinal Stomas and Quality of Life Measures: Uganda Perspectives
Omona, K. (2025) · Springer eBooks · doi:10.1007/978-3-031-73363-5_113
Douglas, C., Congdon, E. L., Huang, C., Seok, D., Cohen, Z. D., Akre, S., Tozzo, V., Huang, F., Ramo-Larios, D., Bernier, R. A., et al. (2025) · medRxiv · doi:10.1101/2025.10.01.25337105
Milić, J., Skitarelić, N., Majstorović, D., Zoranić, S., Čivljak, M., Ivanišević, K., Marendić, M., Mesarić, J., Puharić, Z., Neuberg, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.24995552
Milić, J., Skitarelić, N., Majstorović, D., Zoranić, S., Čivljak, M., Ivanišević, K., Marendić, M., Mesarić, J., Puharić, Z., Neuberg, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.24995579
Moehring, A., Guertler, D., Krause, K., Bischof, G., Rumpf, H.-J., Batra, A., Wurm, S., John, U., & Meyer, C. (2021) · Figshare · doi:10.6084/m9.figshare.15110095
Milić, J., Skitarelić, N., Majstorović, D., Zoranić, S., Čivljak, M., Ivanišević, K., Marendić, M., Mesarić, J., Puharić, Z., Neuberg, M., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26667343
Хвостова, И. И., & Скугаревская, М. М. (2025) · Психиатрия психотерапия и клиническая психология · doi:10.34883/pi.2025.16.4.015
Douglas, C., Congdon, E. L., Huang, C., Seok, D., Cohen, Z. D., Akre, S., Tozzo, V., Huang, F., Ramo-Larios, D., Bernier, R. A., et al. (2026) · npj Digital Public Health · doi:10.1038/s44482-026-00029-3
Evaluation of a Cognitive-Behavioral Mood Management Intervention for Depressed College Smokers
Schleicher, H. E. (2010) · The Mathematics Enthusiast
HIV and depression in a primary care clinic in Johannesburg, South Africa
Cholera, R. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/wq6y-7270
Metadata
- Authors
- Pinto-Meza, A., Serrano-Blanco, A., Peñarrubia, M. T., Blanco, E., & Haro, J. M.
- ORCID
- Haro, Josep Maria
- Venue
- Journal of General Internal Medicine
- Published
- 2005-08
- Volume
- 20
- Issue
- 8
- Pages
- 738-742
- ISSN
- 0884-8734 (ISSN-L)
- 1525-1497
- PMC
- PMC1490180
- OpenAlex
- W2037263999
- Cited by
- 347
- References
- 23
- Citations by year
- 2026: 1 · 2025: 13 · 2024: 13 · 2023: 25 · 2022: 19 · 2021: 23 · 2020: 24 · 2019: 18 · 2018: 20 · 2017: 13 · 2016: 19 · 2015: 20 · 2014: 23 · 2013: 14 · 2012: 21
- FWCI
- 10.80
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of General Internal Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- depression assessment, PHQ-9, telephone administration, self-administered questionnaire, primary care, test-retest reliability, internal consistency, measurement agreement
- MeSH terms
- Adult, Aged, Depression, Female, Health Status Indicators, Humans, Male, Middle Aged, Primary Health Care, Surveys and Questionnaires, Telephone, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review