The Precision in Psychiatry (PIP) study: Testing an internet-based methodology for accelerating research in treatment prediction and personalisation
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Background: Evidence-based treatments for depression exist but not all patients benefit from them. Efforts to develop predictive models that can assist clinicians in allocating treatments are ongoing, but there are major issues with acquiring the volume and breadth of data needed to train these models. We examined the feasibility, tolerability, patient characteristics, and data quality of a novel protocol for internet-based treatment research in psychiatry that may help advance this field. Methods: A fully internet-based protocol was used to gather repeated observational data from patient cohorts receiving internet-based cognitive behavioural therapy (iCBT) (N = 600) or antidepressant medication treatment (N = 110). At baseline, participants provided > 600 data points of self-report data, spanning socio-demographics, lifestyle, physical health, clinical and other psychological variables and completed 4 cognitive tests. They were followed weekly and completed another detailed clinical and cognitive assessment at week 4. In this paper, we describe our study design, the demographic and clinical characteristics of participants, their treatment adherence, study retention and compliance, the quality of the data gathered, and qualitative feedback from patients on study design and implementation. Results: Participant retention was 92% at week 3 and 84% for the final assessment. The relatively short study duration of 4 weeks was sufficient to reveal early treatment effects; there were significant reductions in 11 transdiagnostic psychiatric symptoms assessed, with the largest improvement seen for depression. Most participants (66%) reported being distracted at some point during the study, 11% failed 1 or more attention checks and 3% consumed an intoxicating substance. Data quality was nonetheless high, with near perfect 4-week test retest reliability for self-reported height (ICC = 0.97). Conclusions: An internet-based methodology can be used efficiently to gather large amounts of detailed patient data during iCBT and antidepressant treatment. Recruitment was rapid, retention was relatively high and data quality was good. This paper provides a template methodology for future internet-based treatment studies, showing that such an approach facilitates data collection at a scale required for machine learning and other data-intensive methods that hope to deliver algorithmic tools that can aid clinical decision-making in psychiatry.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SAUNDERS, J. B., AASLAND, O. G., BABOR, T. F., DE LA FUENTE, J. R., & GRANT, M. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb02093.x · Cited by 13,597 · cited 1×
“…trait portion of the State-Trait Anxiety Inventory (STAI) [28], alcohol addiction measured by the Alcohol Use Disorder Identification Test (AUDIT) [29], apathy measured by the Apathy Evaluation Scale (AES) [30], eating disorders measured by the Eating Attitude Test (EAT-26) [31], impulsivity…”
MethodRush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643 · cited 1×
“Many patients must try multiple, sequential and/or parallel treatments on a trial-and-error basis, each taking weeks or months for potential therapeutic effects to unfold, without guarantee of success [3, 4].”
BackgroundThe Work and Social Adjustment Scale: a simple measure of impairment in functioning
Mundt, J. C., Marks, I. M., Shear, M. K., & Greist, J. M. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.5.461 · Cited by 2,515
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
The Raven's Progressive Matrices: Change and Stability over Culture and Time
Raven, J. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0735 · Cited by 1,560 · cited 1×
“Our final cognitive assessment was abstract reasoning using a computerised adaptive task based on Raven’s Standard Progressive Matrices [46].”
MethodRegier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12070999 · Cited by 1,163 · cited 1×
“…agreement) for some of the most common mental health conditions, including depression, is relatively low for the criteria of the Diagnostic and Statistical Manual of Mental Disorders-5 (DSM-5) [70], while self-report assessments enjoy much higher reliability, both in-person [71] and online [72].”
BackgroundUsing Mechanical Turk to Study Clinical Populations
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013) · Clinical Psychological Science · doi:10.1177/2167702612469015 · Cited by 1,139
Treatment-resistant depression: therapeutic trends, challenges, and future directions
Al-harbi (2012) · Patient Preference and Adherence · doi:10.2147/ppa.s29716 · Cited by 796 · cited 1×
“This leads to sustained human suffering, accumulation of side-effects, and substantial economic costs [5, 6].”
BackgroundCross-trial prediction of treatment outcome in depression: a machine learning approach
Chekroud, A. M., Zotti, R. J., Shehzad, Z., Gueorguieva, R., Johnson, M. K., Trivedi, M. H., Cannon, T. D., Krystal, J. H., & Corlett, P. R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00471-x · Cited by 676 · cited 2×
“As previously mentioned, Chekroud and colleagues’ study (2016) developed a predictive model that achieved ~ 60% accuracy in predicting antidepressant response in a re-analysis of the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) dataset [18].”
MethodCharacterizing a psychiatric symptom dimension related to deficits in goal-directed control
Gillan, C. M., Kosinski, M., Whelan, R., Phelps, E. A., & Daw, N. D. (2016) · eLife · doi:10.7554/elife.11305 · Cited by 586 · cited 3×
“Prior studies have shown that model-based planning is linked to compulsivity in the general population [35] and compulsive disorders like obsessive–compulsive disorders (OCD) [41], which benefit from antidepressant medication (albeit at higher doses) [42] and are commonly co-morbid with anxiety and…”
BackgroundMethodSelf-citation
Cited by
Identifying Transdiagnostic Mechanisms in Mental Health Using Computational Factor Modeling
Wise, T., Robinson, O. J., & Gillan, C. M. (2023) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.09.034 · Cited by 108
“Lee et al. (100) partnered with a digital CBT provider to recruit, assess (using CFM), and follow hundreds of patients through treatment in a short space of time.”
Self-citationAn observational treatment study of metacognition in anxious-depression
Fox, C. A., Lee, C. T., Hanlon, A. K., Seow, T. X., Lynch, K., Harty, S., Richards, D., Palacios, J., O'Keane, V., Stephan, K. E., et al. (2023) · eLife · doi:10.7554/elife.87193.3 · Cited by 1
Self-citationAn observational treatment study of metacognition in anxious-depression
Fox, C. A., Lee, C. T., Hanlon, A., Seow, T. X. F., Lynch, K., Harty, S., Richards, D., Palacios, J., O'Keane, V., Stephan, K. E., et al. (2023) · doi:10.31234/osf.io/uk7hr · Cited by 2
Self-citationMetacognition in anxious-depression is state-dependent: an observational treatment study
Fox, C. A., Lee, C. T., Hanlon, A. K., Seow, T. X., Lynch, K., Harty, S., Richards, D., Palacios, J., O’Keane, V., Stephan, K. E., et al. (2023) · doi:10.7554/elife.87193.2 · Cited by 1
Self-citation
Metadata
- Authors
- Lee, C. T., Palacios, J., Richards, D., Hanlon, A. K., Lynch, K., Harty, S., Claus, N., Swords, L., O’Keane, V., Stephan, K. E., & Gillan, C. M.
- Venue
- BMC Psychiatry
- Published
- 2023-01-11
- Volume
- 23
- Issue
- 1
- Pages
- 25-25
- ISSN
- 1471-244X (ISSN-L)
- OpenAlex
- W4315465102
- Cited by
- 25
- References
- 27
- FWCI
- 5.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Precision in Psychiatry (PIP) study: Testing an internet-based methodology for accelerating research in treatment prediction and personalisation. https://app.cochat.ai/papers/10.1186/s12888-022-04462-5
- The paper
- Lee, C. T., Palacios, J., Richards, D., Hanlon, A. K., Lynch, K., Harty, S., Claus, N., Swords, L., O’Keane, V., Stephan, K. E., & Gillan, C. M. (2023). The Precision in Psychiatry (PIP) study: Testing an internet-based methodology for accelerating research in treatment prediction and personalisation. BMC Psychiatry. https://doi.org/10.1186/s12888-022-04462-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.