Interformat reliability of the patient health questionnaire: validation of the computerized version of the PHQ-9
Open accessAbstract
BACKGROUND: Computerized versions of well-established measurements such as the PHQ-9 are widely used, but data on the comparability of psychometric properties are scarce. OBJECTIVE: Our objective was to compare the interformat reliability of the paper-and-pen version with a computerized version of the PHQ-9 in a clinical sample. METHODS: 130 participants with mental health disorders were recruited during psychotherapeutic treatment in a mental health clinic. In a crossover design, they all completed the PHQ-9 in both the computerized and paper-and-pen versions in randomized order. RESULTS: = 0.92). PHQ-9 total scores were not significantly different between the paper and the computer delivered versions. There was a significant interaction effect between format and order of administration for the PHQ-9, indicating that the first administration delivered slightly higher scores. LIMITATIONS: In order to reduce the required effort for the participants, we did not ask them to fill out anything but the PHQ-9 once in paper and once in computer version. CONCLUSIONS: Our findings suggest that the PHQ-9 can be transferred to computerized use without affecting psychometric properties in a clinically meaningful way.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
When delivered online, the PHQ-9 has good inter-format reliability to the paper version.
“When delivered online, it has shown to have a good inter-format reliability to the paper version (Erbe et al., 2016).”
From The efficacy of automated feedback after internet-based depression screening: Study protocol of the German, three-armed, randomised controlled trial DISCOVER (2021) · cites this paper as Erbe et al., 2016
The Discussion reports high correlation and no significant difference in mean scores between the computerized and paper PHQ-9, supporting good interformat reliability. However, the Methods describe administration on clinic computers, not online delivery; the paper does not establish reliability specifically for an online version. (LLM, conf=0.85)
Experimental — accuracy not yet measuredThe computerised version of the PHQ-9 has internal consistency (α=0.88) equally high as the paper-and-pencil version (α=0.89).
“The computerised version (α=0.88) of the PHQ-9 shows an equally high internal consistency as the paper-and-pencil version (α=0.89).103”
The PHQ-9 has been evaluated as an online version.
“It has also been evaluated as an online version [68].”
PHQ-9 is reliable and valid for detecting depression, including in patients with CVD (heart failure), and is valid in computerized format.
“The PHQ-9 has been found to be reliable and valid for detecting depression [18,23] and also in patients with CVD (ie, heart failure) [24]. The PHQ-9 has also been found to be valid in the computerized format [25].”
From An Internet-Based Cognitive Behavioral Therapy Program Adapted to Patients With Cardiovascular Disease and Depression: Randomized Controlled Trial (2019) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · see citing works
Social Measurement: Current Issues
Bohrnstedt, G. W., & Borgatta, E. F. (1981) · Medical Entomology and Zoology · Cited by 1,397 · see citing works
Gilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290 · see citing works
Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283 · see citing works
Manea, L., Gilbody, S., & McMillan, D. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2014.09.009 · Cited by 795 · see citing works
Hedman, E., Ljótsson, B., & Lindefors, N. (2012) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.12.67 · Cited by 672 · see citing works
Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care
Cameron, I. M., Crawford, J. R., Lawton, K., & Reid, I. C. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x263794 · Cited by 590 · see citing works
Ebert, D. D., Zarski, A.-C., Christensen, H., Stikkelbroek, Y., Cuijpers, P., Berking, M., & Riper, H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0119895 · Cited by 533 · see citing works
Self-citationCarlbring, P., Brunt, S., Bohman, S., Austin, D., Richards, J., Öst, L.-G., & Andersson, G. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2005.05.002 · Cited by 319 · cited 2× · see citing works
“, 2014), there are also a few results suggesting that higher values are obtained on the Becks Depression Inventory if it is administered over the Internet or on a computer (Carlbring et al., 2007; George et al., 1992).”
BackgroundGriffiths, K. M., Farrer, L., & Christensen, H. (2010) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03685.x · Cited by 303 · see citing works
Riper, H., Blankers, M., Hadiwijaya, H., Cunningham, J., Clarke, S., Wiers, R., Ebert, D., & Cuijpers, P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099912 · Cited by 265 · see citing works
Self-citationSocial desirability effects on computerized and paper-and-pencil questionnaires
Booth‐Kewley, S., Larson, G. E., & Miyoshi, D. K. (2005) · Computers in Human Behavior · doi:10.1016/j.chb.2004.10.020 · Cited by 220 · see citing works
Theme issue on e-mental health: A growing field in internet research
Riper, H., Andersson, G., Christensen, H., Cuijpers, P., Lange, A., & Eysenbach, G. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1713 · Cited by 200 · see citing works
International Guidelines on Computer-Based and Internet-Delivered Testing
The International Test Commission (2006) · International Journal of Testing · doi:10.1207/s15327574ijt0602_4 · Cited by 200 · see citing works
Holländare, F., Andersson, G., & Engström, I. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1392 · Cited by 179 · see citing works
Internet-based Questionnaire Assessment: Appropriate Use in Clinical Contexts
Buchanan, T. (2003) · Cognitive Behaviour Therapy · doi:10.1080/16506070310000957 · Cited by 168 · see citing works
Depression screening via a smartphone app: cross-country user characteristics and feasibility
BinDhim, N. F., Shaman, A. M., Trevena, L. J., Basyouni, M. H., Pont, L., & Alhawassi, T. M. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-002840 · Cited by 153 · see citing works
Fann, J. R., Berry, D. L., Wolpin, S. E., Austin‐Seymour, M., Bush, N. E., Halpenny, B., Lober, W. B., & McCorkle, R. C. (2008) · Psycho-Oncology · doi:10.1002/pon.1368 · Cited by 142 · see citing works
Equivalence of electronic and paper-based patient-reported outcome measures
Campbell, N., Ali, F. M., Finlay, A. Y., & Salek, S. (2015) · Quality of Life Research · doi:10.1007/s11136-015-0937-3 · Cited by 135 · see citing works
Online interventions for depression and anxiety – a systematic review
Saddichha, S., Al-Desouki, M., Lamia, A., Linden, I. A., & Krausz, M. (2014) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2014.945934 · Cited by 133 · see citing works
Interformat Reliability of Digital Psychiatric Self-Report Questionnaires: A Systematic Review
Alfonsson, S., Maathz, P., & Hursti, T. J. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3395 · Cited by 94 · see citing works
Behavioral Screening Measures Delivered With a Smartphone App
Bush, N. E., Skopp, N. A., Smolenski, D. J., Crumpton, R. M., & Fairall, J. M. (2013) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000039 · Cited by 83 · see citing works
The effects of computerized versus paper-and-pencil administration on measures of negative affect
George, C. E., Lankford, J. S., & Wilson, S. E. (1992) · Computers in Human Behavior · doi:10.1016/0747-5632(92)90004-x · Cited by 55 · see citing works
Austin, D., Carlbring, P., Richards, J. C., & Andersson, G. (2006) · International Journal of Testing · doi:10.1207/s15327574ijt0601_2 · Cited by 47 · see citing works
Vallejo, M. Á., Mañanes, G., Comeche, M. I., & Díaz, M. I. (2007) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2007.04.001 · Cited by 45 · see citing works
Volker, D., Zijlstra-Vlasveld, M. C., Brouwers, E. P. M., Homans, W. A., Emons, W. H. M., & Feltz-Cornelis, C. M. V. D. (2015) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-015-9607-0 · Cited by 42 · see citing works
Ethical issues in the use of computerized assessment
Schulenberg, S. E., & Yutrzenka, B. A. (2003) · Computers in Human Behavior · doi:10.1016/j.chb.2003.10.006 · Cited by 38 · see citing works
Acceptance of computerized compared to paper-and-pencil assessment in psychiatric inpatients
Weber, B., Schneider, B., Fritze, J., Gille, B., Hornung, S., Kühner, T., & Maurer, K. (2003) · Computers in Human Behavior · doi:10.1016/s0747-5632(02)00012-2 · Cited by 19 · see citing works
Spangenberg, L., Glaesmer, H., Boecker, M., & Forkmann, T. (2015) · Quality of Life Research · doi:10.1007/s11136-015-1040-5 · Cited by 15 · see citing works
Andersson, G., Ritterband, L. M., & Carlbring, P. (2008) · Clinical Psychologist · doi:10.1080/13284200802069027 · Cited by 10 · see citing works
Flagged first, then by citations
1 of the 31 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
González‐Blanch, C., Medrano, L. A., Muñoz‐Navarro, R., Ruiz‐Rodríguez, P., Moriana, J. A., Limonero, J. T., Schmitz, F., & Vindel, A. C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0193356 · Cited by 114 · see citing works
Hallford, D. J., Barry, T. J., Austin, D., Raes, F., Takano, K., & Klein, B. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.09.039 · Cited by 104 · see citing works
Lin, J., Faust, B., Ebert, D. D., Krämer, L., & Baumeister, H. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9925 · Cited by 97 · see citing works
Self-citationJohansson, P., Westas, M., Andersson, G., Alehagen, U., Broström, A., Jaarsma, T., Mourad, G., & Lundgren, J. (2019) · JMIR Mental Health · doi:10.2196/14648 · Cited by 77 · see citing works
Taquet, M., Skórniewska, Z., Deyn, T. D., Hampshire, A., Trender, W. R., Hellyer, P. J., Chalmers, J. D., Horsley, A. R., Horsley, A. R., Marks, M., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00214-1 · Cited by 77 · see citing works
Etzelmueller, A., Radkovsky, A., Hannig, W., Berking, M., & Ebert, D. D. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.01.003 · Cited by 75 · see citing works
Self-citationWeisel, K. K., Zarski, A.-C., Berger, T., Krieger, T., Schaub, M. P., Moser, C. T., Berking, M., Dey, M., Botella, C., Baños, R., et al. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.04.002 · Cited by 57 · see citing works
Self-citationPsychometrics of the Patient Health Questionnaire (PHQ-9) in Uganda: A Systematic Review
Kaggwa, M. M., Najjuka, S. M., Ashaba, S., & Mamun, M. A. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.781095 · Cited by 54 · see citing works
Sander, L., Paganini, S., Lin, J., Schlicker, S., Ebert, D. D., Buntrock, C., & Baumeister, H. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1193-6 · Cited by 44 · see citing works
Self-citationVu, L. G., Le, L. K., Dam, A. V. T., Nguyen, S. H., Vu, T. M. T., Trinh, T. T. H., Do, A. L., Minh, N., Le, T. H., Latkin, C. A., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.838747 · Cited by 42 · see citing works
COACH consortium, Lunkenheimer, F., Domhardt, M., Geirhos, A., Kilian, R., Mueller-Stierlin, A. S., Holl, R. W., Meissner, T., Minden, K., Moshagen, M., et al. (2020) · Trials · doi:10.1186/s13063-019-4041-9 · Cited by 37 · see citing works
Why We Imagine Our Future: Introducing the Functions of Future Thinking Scale (FoFTS)
Hallford, D., & D'Argembeau, A. (2020) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-021-09910-2 · Cited by 25 · see citing works
Kaggwa, M. M., Arinaitwe, I., Nduhuura, E., Muwanguzi, M., Kajjimu, J., Kule, M., Ajuna, N., Machacha, I., Nkola, R., Najjuka, S. M., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.842466 · Cited by 41 · see citing works
Comtois, K. A., Mata-Greve, F., Johnson, M., Pullmann, M. D., Mosser, B. A., & Areán, P. A. (2022) · JMIR mhealth and uhealth · doi:10.2196/41689 · Cited by 29 · see citing works
van Ballegooijen, W., Ruwaard, J., Karyotaki, E., Ebert, D. D., Smit, J. H., & Riper, H. M. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1065-5 · Cited by 32 · see citing works
Self-citationKarbownik, M. S., Mokros, Ł., Dobielska, M., Kowalczyk, M., & Kowalczyk, E. (2022) · Frontiers in Nutrition · doi:10.3389/fnut.2022.850249 · Cited by 33 · see citing works
Lin, J., Sander, L., Paganini, S., Schlicker, S., Ebert, D., Berking, M., Bengel, J., Nobis, S., Lehr, D., Mittag, O., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015226 · Cited by 27 · see citing works
Self-citationMessage-Based vs Video-Based Psychotherapy for Depression
Pullmann, M. D., Rouvere, J., Raue, P. J., Fillipo, I. G., Mosser, B. A., Heagerty, P. J., Fridling, N., Padmanabhan, A., Hull, T. D., & Areán, P. A. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.40065 · Cited by 27 · see citing works
Hallford, D. J. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.12.100 · Cited by 28 · see citing works
Carlozzi, N. E., Goodnight, S. M., Kratz, A. L., Stout, J. C., McCormack, M. K., Paulsen, J. S., Boileau, N. R., Cella, D. F., & Ready, R. E. (2019) · Journal of Huntington s Disease · doi:10.3233/jhd-190364 · Cited by 25 · see citing works
National Norms and Correlates of the PHQ-8 and GAD-7 in Parents of School-age Children
Sequeira, S. L., Morrow, K. E., Silk, J. S., Kolko, D. J., Pilkonis, P. A., & Lindhiem, O. J. (2021) · Journal of Child and Family Studies · doi:10.1007/s10826-021-02026-x · Cited by 24 · see citing works
Xiang, X., Kayser, J., Turner, S., Ash, S., & Himle, J. A. (2024) · Journal of Medical Internet Research · doi:10.2196/53001 · Cited by 24 · see citing works
Schuster, R., Laireiter, A., Berger, T., Moritz, S., Meyer, B., Hohagen, F., & Klein, J. P. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.122 · Cited by 22 · see citing works
Kim, S., & Lee, K. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s339412 · Cited by 25 · see citing works
Schuster, R., Schreyer, M. L., Kaiser, T., Berger, T., Klein, J. P., Moritz, S., Laireiter, A.-R., & Trutschnig, W. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100313 · Cited by 21 · see citing works
Westas, M., Lundgren, J., Andersson, G., Mourad, G., & Johansson, P. (2022) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvab131 · Cited by 22 · see citing works
Psychometric Properties of a Chatbot Version of the PHQ-9 With Adults and Older Adults
Dosovitsky, G., Kim, E., & Bunge, E. L. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.645805 · Cited by 22 · see citing works
Weisel, K. K., Zarski, A., Berger, T., Schaub, M. P., Krieger, T., Moser, C. T., Berking, M., & Ebert, D. D. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00274 · Cited by 21 · see citing works
Self-citationZhen, L., Wang, G., Gai-ling, X., Xiao, L., Feng, L., Xu, C., Liu, M., & Zhu, X. (2020) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s241766 · Cited by 20 · see citing works
Warschburger, P., Petersen, A.-C., von Rezori, R. E., Buchallik, F., Baumeister, H., Holl, R. W., Minden, K., Mueller‐Stierlin, A. S., Reinauer, C., & Staab, D. (2021) · BMC Pediatrics · doi:10.1186/s12887-021-02869-9 · Cited by 18 · see citing works
Warschburger, P., Kamrath, C., Lanzinger, S., Sengler, C., Wiegand, S., Göldel, J. M., Blüher, S., Holl, R. W., & Minden, K. (2023) · BMC Pediatrics · doi:10.1186/s12887-023-03912-7 · Cited by 17 · see citing works
Freund, J., Titzler, I., Thielecke, J., Braun, L., Baumeister, H., Berking, M., & Ebert, D. D. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02800-z · Cited by 17 · see citing works
Self-citationBraun, L., Titzler, I., Ebert, D. D., Buntrock, C., Terhorst, Y., Freund, J., Thielecke, J., & Baumeister, H. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2244-y · Cited by 17 · see citing works
Self-citationSikorski, F., König, H.-H., Wegscheider, K., Zapf, A., Löwe, B., & Kohlmann, S. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100435 · Cited by 15 · see citing works
“When delivered online, it has shown to have a good inter-format reliability to the paper version (Erbe et al., 2016).”
BackgroundCheung, B. S., Murphy, J., Michalak, E. E., Liu, J., Yang, X., Wang, X., Chen, J., & Lam, R. W. M. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.09.055 · Cited by 16 · see citing works
Web-Based Versus Paper-Pencil Assessment of Behavioral Problems Using the Youth Self-Report
Zeiler, M. D., Peer, S., Philipp, J., Truttmann, S., Wagner, G., Karwautz, A. F. K., & Waldherr, K. (2020) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000585 · Cited by 15 · see citing works
Hallford, D. J., & Austin, D. (2021) · Assessment · doi:10.1177/1073191121998767 · Cited by 14 · see citing works
Küchler, A.-M., Schultchen, D., Pollatos, O., Moshagen, M., Ebert, D. D., & Baumeister, H. (2020) · Trials · doi:10.1186/s13063-020-04868-0 · Cited by 12 · see citing works
Self-citationPeterson, B. S., West, A. E., Weisz, J. R., Mack, W. J., Kipke, M. D., Findling, R. L., Mittman, B. S., Bansal, R., Piantadosi, S., Takata, G., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03314-y · Cited by 13 · see citing works
Bekendam, M. T., Vermeltfoort, I. A. C., Kop, W. J., Widdershoven, J. W. M. G., & Mommersteeg, P. M. C. (2020) · Journal of Nuclear Cardiology · doi:10.1007/s12350-020-02360-5 · Cited by 13 · see citing works
Robichaud, M., Talbot, F., Titov, N., Dear, B. F., Hadjistavropoulos, H. D., Hadjistavropoulos, T., & Jbilou, J. (2019) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246581900047x · Cited by 13 · see citing works
Thielecke, J., Buntrock, C., Titzler, I., Braun, L., Freund, J., Berking, M., Baumeister, H., & Ebert, D. D. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00125 · Cited by 13 · see citing works
Self-citationOptimizing the predictive power of depression screenings using machine learning
Terhorst, Y., Sander, L., Ebert, D. D., & Baumeister, H. (2023) · Digital Health · doi:10.1177/20552076231194939 · Cited by 11 · see citing works
Self-citationOltean, L.-E., Miu, A. C., Șoflău, R., & Szentágotai-Tătar, A. (2022) · Journal of Happiness Studies · doi:10.1007/s10902-022-00530-5 · Cited by 11 · see citing works
Screening for common mental health disorders: a psychometric evaluation of a chatbot system
Podina, I. R., Bucur, A.-M., Fodor, L. A., & Boian, R. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2275164 · Cited by 10 · see citing works
An Exploratory Study of Marital and Quality of Life Ratings Among Male Spouses of Military Members
Lufkin, K. P. (2017) · Contemporary Family Therapy · doi:10.1007/s10591-017-9413-2 · Cited by 10 · see citing works
Terhorst, Y., Braun, L., Titzler, I., Buntrock, C., Freund, J., Thielecke, J., Ebert, D., & Baumeister, H. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034271 · Cited by 9 · see citing works
Self-citationSikorski, F., Löwe, B., & Kohlmann, S. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100685 · Cited by 9 · see citing works
Titzler, I., Egle, V., Berking, M., Gumbmann, C., & Ebert, D. D. (2019) · Verhaltenstherapie · doi:10.1159/000503408 · Cited by 9 · see citing works
Self-citationHuang, Z., & Kämpfen, F. (2021) · PLoS ONE · doi:10.1371/journal.pone.0246370 · Cited by 8 · see citing works
Thesen, T., Himle, J. A., Martinsen, E. W., Walseth, L. T., Thorup, F., Gallefoss, F., & Jonsbu, E. (2021) · Journal of Medical Internet Research · doi:10.2196/33631 · Cited by 9 · see citing works
Westas, M., Mourad, G., Andersson, G., Lundgren, J., & Johansson, P. (2024) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvad097 · Cited by 8 · see citing works
“30 Cronbach’s Alpha in this study was 0.78, indicating good reliability.”
InfluentialForsström, D., Badinlou, F., Johansson, M., Ojala, O., Alaoui, S. E., Månsson, K. N. T., Rozental, A., Lundin, J., Jangard, S., Shahnavaz, S., et al. (2025) · BMC Psychiatry · doi:10.1186/s12888-024-06417-4 · Cited by 8 · see citing works
Treating internet use disorders via the internet? Results of a two-armed randomized controlled trial
Bernstein, K., Schaub, M. P., Baumeister, H., Berking, M., Ebert, D. D., & Zarski, A. (2023) · Journal of Behavioral Addictions · doi:10.1556/2006.2023.00049 · Cited by 7 · see citing works
Self-citationKrämer, L. V., Mueller-Weinitschke, C., Zeiss, T., Baumeister, H., Ebert, D. D., & Bengel, J. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-054775 · Cited by 7 · see citing works
Self-citationAreán, P. A., Pullmann, M. D., Fillipo, I. G., Wu, J., Mosser, B. A., Chen, S., Heagerty, P. J., & Hull, T. D. (2024) · Psychiatric Services · doi:10.1176/appi.ps.20230176 · Cited by 6 · see citing works
Treffers, E., Duijndam, S., Schiffer, A., Scherders, M., Habibović, M., & Denollet, J. (2021) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2021.08.011 · Cited by 4 · see citing works
Pilot Study of Blended-Format Interpersonal Psychotherapy for Major Depressive Disorder
van Schaik, A., Schotanus, A. Y., Dozeman, E., Huibers, M. J. H., Cuijpers, P. J., & Donker, T. (2022) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.20210061 · Cited by 6 · see citing works
Schotanus, A. Y., Dozeman, E., Ikelaar, S. L. C., van Straten, A., Beekman, A. T. F., van Nassau, F., Bosmans, J. E., & van Schaik, A. (2023) · BMC Psychiatry · doi:10.1186/s12888-022-04492-z · Cited by 6 · see citing works
Trusty, W. T., & Swift, J. K. (2023) · Journal of Clinical Psychology · doi:10.1002/jclp.23573 · Cited by 6 · see citing works
Hammerfald, K., Jahren, H. H., & Solbakken, O. A. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1494729 · Cited by 5 · see citing works
Thake, M., Sikorski, F., Löwe, B., & Kohlmann, S. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119926 · Cited by 5 · see citing works
Kuleindiren, N., Rifkin-Zybutz, R. P., Johal, M., Selim, H., Palmon, I., Lin, A., Yu, Y., Alim‐Marvasti, A., & Mahmud, M. (2021) · JMIR Formative Research · doi:10.2196/31209 · Cited by 5 · see citing works
Mental Health Among LGBTQ+ Farmers in the United States
Cuthbertson, C. A., Rivas‐Koehl, D., Codamon, A., Billington, A., & Rivas‐Koehl, M. (2024) · Journal of Agromedicine · doi:10.1080/1059924x.2024.2368185 · Cited by 4 · see citing works
Chau, L. W., Murphy, J., Nguyen, V. C., Tran, H., Minas, H., Lam, R. W. M., Hayashi, K., Nguyen, T. T. X., Krebs, E., & O’Neil, J. (2025) · JMIR Formative Research · doi:10.2196/68297 · Cited by 4 · see citing works
Validation of a German version of the caregiver strain questionnaire-short form 11 (CGSQ-SF11)
Göldel, J. M., & Warschburger, P. (2024) · BMC Psychology · doi:10.1186/s40359-024-01875-7 · Cited by 3 · see citing works
Uslu, B., Busching, R., & Warschburger, P. (2025) · Mindfulness · doi:10.1007/s12671-025-02698-2 · Cited by 3 · see citing works
Equivalence of Paper and Smartphone Versions of the Beck Depression Inventory-II
Uchida, H., Igusa, T., Higashi, Y., Takeda, M., Tsuchiya, K., Kikuchi, S., & Hirao, K. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14020500 · Cited by 3 · see citing works
McGeough, J., Gallagher‐Mitchell, T., Clark, D. P. A., & Harrison, N. (2019) · JMIR mhealth and uhealth · doi:10.2196/11055 · Cited by 3 · see citing works
Jeon, Y. J., Lee, Y., Yang, J. S., Park, Y. S., & Jung, S. J. (2022) · Epidemiology and Health · doi:10.4178/epih.e2022064 · Cited by 3 · see citing works
Mourad, G., Lundgren, J., Andersson, G., Klompstra, M. W., & Johansson, P. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100696 · Cited by 3 · see citing works
Sengler, C., Klotsche, J., Pedersen, M. J., Niewerth, M., Göldel, J. M., Windschall, D., Haas, J., Dressler, F., Trauzeddel, R., Hospach, A., et al. (2024) · Pediatric Rheumatology · doi:10.1186/s12969-024-00979-z · Cited by 3 · see citing works
Bekendam, M. T., Mommersteeg, P. M. C., Vermeltfoort, I. A. C., Widdershoven, J. W. M. G., & Kop, W. J. (2022) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001085 · Cited by 2 · see citing works
Etzelmueller, A., Heber, E., Horvath, H., Radkovsky, A., Lehr, D., & Ebert, D. D. (2024) · Journal of Medical Internet Research · doi:10.2196/42976 · Cited by 3 · see citing works
Self-citationBondre, A. P., Ranjan, A., Shrivastava, R., Tugnawat, D. K., Chaturvedi, N., Bhan, A., Gupta, S., Rozatkar, A. R., Nagendra, S., Dutt, S., et al. (2025) · JMIR Formative Research · doi:10.2196/67745 · Cited by 2 · see citing works
Titzler, I., Egle, V., Berking, M., Gumbmann, C., & Ebert, D. D. (2019) · Verhaltenstherapie · doi:10.1159/000502390 · Cited by 2 · see citing works
Self-citationWinkworth, O., & Thomas, S. J. (2019) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2019.100477 · Cited by 2 · see citing works
Hallford, D. J. (2020) · doi:10.31234/osf.io/zn5cb · Cited by 2 · see citing works
Informatics Technologies in the Diagnosis and Treatment of Mental Health Conditions
Ingram, W. M., Khanna, R., & Weston, C. L. (2021) · Health informatics · doi:10.1007/978-3-030-70558-9_17 · Cited by 1 · see citing works
Sikorski, F., Löwe, B., Daubmann, A., & Kohlmann, S. (2025) · Journal of Medical Internet Research · doi:10.2196/59476 · Cited by 1 · see citing works
Psychometric properties of a chatbot version of the PHQ-9 for adults and older adults
Dosovitsky, G., Kim, E., & Bunge, E. L. (2021) · PsycEXTRA Dataset · doi:10.1037/e509932022-001 · Cited by 1 · see citing works
Hannig, W., Etzelmueller, A., Zarski, A., & Ebert, D. D. (2019) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000519
Self-citationMourad, G., Lundgren, J., Andersson, G., Klompstra, M. W., & Johansson, P. (2021) · Research Square · doi:10.21203/rs.3.rs-858227/v1
Analisis Faktor-Faktor Yang Mempengaruhi Tingkat Suku Bunga Nominal di Indonesia
Tarigan, E. P. (2008)
Westas, M. (2022) · Linköping University Medical Dissertations · doi:10.3384/9789179293796
The criterion validity of the online version of the Patient Health Questionnaire-9 (Preprint)Preprint
Thake, M., Sikorski, F., Löwe, B., & Kohlmann, S. (2024) · doi:10.2196/preprints.69988
Göldel, J. M., & Warschburger, P. (2024) · Figshare · doi:10.6084/m9.figshare.26747759
Schotanus, A. Y., Dozeman, E., Ikelaar, S. L. C., van Straten, A., Beekman, A. T. F., van Nassau, F., Bosmans, J. E., & van Schaik, A. (2024) · Figshare · doi:10.6084/m9.figshare.26564589
Lunkenheimer, F., Domhardt, M., Geirhos, A., Kilian, R., Mueller-Stierlin, A. S., Holl, R. W., Meissner, T., Minden, K., Moshagen, M., Ranz, R., et al. (2020) · Figshare · doi:10.6084/m9.figshare.11978766
Göldel, J. M., & Warschburger, P. (2024) · Figshare · doi:10.6084/m9.figshare.26747756
Sengler, C., Klotsche, J., Pedersen, M. J., Niewerth, M., Göldel, J. M., Windschall, D., Haas, J.-P., Dressler, F., Trauzeddel, R., Hospach, A., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26708552
Kreis, L. G., König, H., Sikorski, F., Löwe, B., Kohlmann, S., & Brettschneider, C. (2025) · JMIR Formative Research · doi:10.2196/68282
Burus, T., & Borger, T. N. (2026) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2026.103554
Riper, H. M., Kleiboer, A. M., Hoogendoorn, A. W., Bosmans, J. E., Schulte, M. H. J., Mathiasen, K., Hazo, J., Holtzmann, J., Chevreul, K., Ebert, D. D., et al. (2026) · Interactive Journal of Medical Research · doi:10.2196/72866
Self-citationEmery, J. B., Matheson, L. N., Shaw, O., Mannan, N., Cota, M. R., Fu, A., Haight, T. J., & Brody, D. L. (2026) · medRxiv · doi:10.64898/2026.09.24.26363933
Michalak, J., Gemander, M., Heidenreich, T., Kvetnaya, T., Puntke, T., & Schultze, M. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.101016
- Authors
- Erbe, D., Eichert, H.-C., Rietz, C., & Ebert, D.
- Affiliations
- University of Cologne (DE)
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- Corresponding author
- Erbe, Doris
- Venue
- Internet Interventions
- Publisher
- Elsevier BV
- Published
- 2016-09
- Volume
- 5
- Pages
- 1-4
- ISSN
- 2214-7829 (ISSN-L)
- PMC
- PMC6096192
- OpenAlex
- W2465348707
- Cited by
- 97
- References
- 31
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 12 · 2023: 9 · 2022: 13 · 2021: 15 · 2020: 12 · 2019: 10 · 2018: 6 · 2017: 4 · 2016: 1
- FWCI
- 7.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Internet Interventions (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Kölner Universitäts PublikationsServer (Universität zu Köln) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- PHQ-9, Patient Health Questionnaire, computerized administration, depression screening, psychometric properties, mental illness, psychotherapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review