The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Can mental health diagnoses in administrative data be used for research? A systematic review of the accuracy of routinely collected diagnoses
Open accessAbstract
BACKGROUND: There is increasing availability of data derived from diagnoses made routinely in mental health care, and interest in using these for research. Such data will be subject to both diagnostic (clinical) error and administrative error, and so it is necessary to evaluate its accuracy against a reference-standard. Our aim was to review studies where this had been done to guide the use of other available data. METHODS: We searched PubMed and EMBASE for studies comparing routinely collected mental health diagnosis data to a reference standard. We produced diagnostic category-specific positive predictive values (PPV) and Cohen's kappa for each study. RESULTS: We found 39 eligible studies. Studies were heterogeneous in design, with a wide range of outcomes. Administrative error was small compared to diagnostic error. PPV was related to base rate of the respective condition, with overall median of 76 %. Kappa results on average showed a moderate agreement between source data and reference standard for most diagnostic categories (median kappa = 0.45-0.55); anxiety disorders and schizoaffective disorder showed poorer agreement. There was no significant benefit in accuracy for diagnoses made in inpatients. CONCLUSIONS: The current evidence partly answered our questions. There was wide variation in the quality of source data, with a risk of publication bias. For some diagnoses, especially psychotic categories, administrative data were generally predictive of true diagnosis. For others, such as anxiety disorders, the data were less satisfactory. We discuss the implications of our findings, and the need for researchers to validate routine diagnostic data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728
Self-citationBenchimol, E. I., Manuel, D. G., To, T., Griffiths, A. M., Rabeneck, L., & Guttmann, A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.10.006 · Cited by 368
Diagnosis of Nonpsychotic Patients in Community Clinics
Shear, M. K., Greeno, C., Kang, J., Ludewig, D., Frank, E., Swartz, H. A., & Hanekamp, M. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.4.581 · Cited by 316
Perlis, R. H., Iosifescu, D. V., Castro, V. M., Murphy, S. N., Gainer, V. S., Minnier, J., Cai, T., Goryachev, S., Zeng, Q., Gallagher, P. J., et al. (2012) · Psychological Medicine · doi:10.1017/s0033291711000997 · Cited by 193
Young cases of schizophrenia identified in a national inpatient register
Dalman, C., Broms, J., Cullberg, J., & Allebeck, P. (2002) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-002-0582-3 · Cited by 192
BRUGHA, T. S., BEBBINGTON, P. E., & JENKINS, R. (1999) · Psychological Medicine · doi:10.1017/s0033291799008880 · Cited by 191
Spiranovic, C., Matthews, A., Scanlan, J., & Kirkby, K. C. (2016) · Advances in Mental Health · doi:10.1080/18387357.2015.1063635 · Cited by 37
Classification of bipolar disorder in psychiatric hospital. a prospective cohort study
Øiesvold, T., Nivison, M., Hansen, V., Sørgaard, K. W., Østensen, L., & Skre, I. (2012) · BMC Psychiatry · doi:10.1186/1471-244x-12-13 · Cited by 19 · cited 1×
“Of these 72 were excluded, and a further six were found to be of inadequate quality, leaving a total of 39 [25–63].”
Background
Cited by
Screening and Management of Depression in Patients With Cardiovascular Disease
Jha, M. K., Qamar, A., Vaduganathan, M., Charney, D. S., & Murrough, J. W. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.01.041 · Cited by 365
Fusar-Poli, P., Rutigliano, G., Stahl, D., Davies, C., De Micheli, A., Ramella-Cravaro, V., Bonoldi, I., & McGuire, P. (2017) · European Psychiatry · doi:10.1016/j.eurpsy.2016.11.010 · Cited by 120
Indicators of mental disorders in UK Biobank—A comparison of approaches
Davis, K. A. S., Cullen, B., Adams, M., Brailean, A., Breen, G., Coleman, J. R. I., Dregan, A., Gaspar, H. A., Hübel, C., Lee, W., et al. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1796 · Cited by 111
Self-citationUsing the tools of genetic epidemiology to understand sex differences in neuropsychiatric disorders
Merikangas, A. K., & Almasy, L. (2020) · Genes, Brain and Behavior · doi:10.1111/gbb.12660 · Cited by 82
Raket, L. L., Jaskolowski, J., Kinon, B. J., Brasen, J. C., Jönsson, L., Wehnert, A., & Fusar-Poli, P. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30024-8 · Cited by 60
Metadata
- Authors
- Davis, K. A. S., Sudlow, C. L. M., & Hotopf, M.
- Venue
- BMC Psychiatry
- Published
- 2016-07-26
- Volume
- 16
- Issue
- 1
- Pages
- 263-263
- ISSN
- 1471-244X (ISSN-L)
- OpenAlex
- W2496660608
- Cited by
- 259
- References
- 9
- FWCI
- 4.26
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Can mental health diagnoses in administrative data be used for research? A systematic review of the accuracy of routinely collected diagnoses. https://app.cochat.ai/papers/10.1186/s12888-016-0963-x
- The paper
- Davis, K. A. S., Sudlow, C. L. M., & Hotopf, M. (2016). Can mental health diagnoses in administrative data be used for research? A systematic review of the accuracy of routinely collected diagnoses. BMC Psychiatry. https://doi.org/10.1186/s12888-016-0963-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
