Validation of online psychometric instruments for common mental health disorders: a systematic review
Open accessThe DOI matches its Crossref record; 59 of the 61 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Online questionnaires for measuring common mental health disorders such as depression and anxiety disorders are increasingly used. The psychometrics of several pen-and-paper questionnaires have been re-examined for online use and new online instruments have been developed and tested for validity as well. This study aims to review and synthesise the literature on this subject and provide a framework for future research. METHODS: We searched Medline and PsycINFO for psychometric studies on online instruments for common mental health disorders and extracted the psychometric data. Studies were coded and assessed for quality by independent raters. RESULTS: We included 56 studies on 62 online instruments. For common instruments such as the CES-D, MADRS-S and HADS there is mounting evidence for adequate psychometric properties. Further results are scattered over different instruments and different psychometric characteristics. Few studies included patient populations. CONCLUSIONS: We found at least one online measure for each of the included mental health disorders and symptoms. A small number of online questionnaires have been studied thoroughly. This study provides an overview of online instruments to refer to when choosing an instrument for assessing common mental health disorders online, and can structure future psychometric research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Several studies support the validity of Web-based administration of HADS [22].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.006 · Cited by 4,465 · cited 1×
“Second, we used the COSMIN Checklist with a 4point scale [10, 14–17].”
MethodMokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9606-8 · Cited by 4,260 · cited 1×
“Second, we used the COSMIN Checklist with a 4point scale [10, 14–17].”
MethodThe handbook of psychological testing
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1802 · Cited by 3,534 · cited 1×
“A sample size below 100 was found in 10 studies, which generally gives too little statistical power for psychometric analyses [54].”
BackgroundTerwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W. J. G., Bouter, L. M., & de Vet, H. C. W. (2012) · Quality of Life Research · doi:10.1007/s11136-011-9960-1 · Cited by 1,978 · cited 1×
“For each variable, a quality score is obtained by taking the lowest rating of any item in that list of criteria [10].”
MethodMokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., Bouter, L. M., & de Vet, H. C. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-22 · Cited by 1,834
Handbook of Psychological Testing
Kline, P. (2013) · Routledge eBooks · doi:10.4324/9781315812274 · Cited by 1,194
Research works printed but not linked: 1
- Groves RM, Fowler Jr FJ, Couper MP, Lepkowski JM, Singer E, Tourangeau R. Survey methodology (Vol. 561). Hoboken, NJ: John Wiley & Sons; 2011.
Cited by
Internet-delivered psychological treatments: from innovation to implementation
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019) · World Psychiatry · doi:10.1002/wps.20610 · Cited by 750
The impact of digital technology on psychological treatments and their dissemination
Fairburn, C. G., & Patel, V. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.08.012 · Cited by 448
“Overall, their performance appears to be similar to that of their pencil-and-paper counterparts but exceptions have been found (Alfonsson, Maathz, & Hursti, 2014; van Ballegooijen, Riper, Cuijpers, van Oppen, & Smit, 2016).”
Internet interventions: Past, present and future
Andersson, G. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.03.008 · Cited by 315
Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions
Boß, L., Lehr, D., Reis, D., Vis, C., Riper, H., Berking, M., & Ebert, D. D. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5952 · Cited by 251
“In general, low satisfaction with the intervention is assumed to be associated with low adherence [25]; notwithstanding that individuals experiencing a high burden (eg, due to depressive symptoms) may be under considerable pressure to find relief.”
BackgroundInfluentialSelf-citationDíaz-García, A., González-Robles, A., Mor, S., Mira, A., Quero, S., García-Palacios, A., Baños, R. M., & Botella, C. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-2472-1 · Cited by 207
Metadata
- Authors
- van Ballegooijen, W., Riper, H., Cuijpers, P., van Oppen, P., & Smit, J. H.
- Affiliations
- Amsterdam Public Health (NL)
- Venue
- BMC Psychiatry
- Published
- 2016-02-25
- Volume
- 16
- Issue
- 1
- Pages
- 45-45
- ISSN
- 1471-244X (ISSN-L)
- PMC
- PMC4766750
- OpenAlex
- W2277647511
- Cited by
- 114
- References
- 61
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 7 · 2023: 9 · 2022: 13 · 2021: 17 · 2020: 14 · 2019: 13 · 2018: 8 · 2017: 13 · 2016: 2
- FWCI
- 1.59
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMC Psychiatry (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- Pure Amsterdam UMC (acceptedVersion, other-oa)
- Pure Amsterdam UMC (submittedVersion)
- VU Research Portal (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- online surveys, psychometric validation, common mental disorders, depression, anxiety disorders, CES-D, Hospital Anxiety and Depression Scale, online assessment, questionnaire reliability and validity
- MeSH terms
- Anxiety Disorders, Mental Disorders, Depression, Depressive Disorder, Diagnosis, Computer-Assisted, Humans, Mental Health, Psychiatric Status Rating Scales, Psychometrics, Surveys and Questionnaires, Reproducibility of Results, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Validation of online psychometric instruments for common mental health disorders: a systematic review. https://app.cochat.ai/papers/10.1186/s12888-016-0735-7
- The paper
- van Ballegooijen, W., Riper, H., Cuijpers, P., van Oppen, P., & Smit, J. H. (2016). Validation of online psychometric instruments for common mental health disorders: a systematic review. BMC Psychiatry. https://doi.org/10.1186/s12888-016-0735-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
