Applying Computer Adaptive Testing to Optimize Online Assessment of Suicidal Behavior: A Simulation Study
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The Internet is used increasingly for both suicide research and prevention. To optimize online assessment of suicidal patients, there is a need for short, good-quality tools to assess elevated risk of future suicidal behavior. Computer adaptive testing (CAT) can be used to reduce response burden and improve accuracy, and make the available pencil-and-paper tools more appropriate for online administration. OBJECTIVE: The aim was to test whether an item response-based computer adaptive simulation can be used to reduce the length of the Beck Scale for Suicide Ideation (BSS). METHODS: The data used for our simulation was obtained from a large multicenter trial from The Netherlands: the Professionals in Training to STOP suicide (PITSTOP suicide) study. We applied a principal components analysis (PCA), confirmatory factor analysis (CFA), a graded response model (GRM), and simulated a CAT. RESULTS: The scores of 505 patients were analyzed. Psychometric analyses showed the questionnaire to be unidimensional with good internal consistency. The computer adaptive simulation showed that for the estimation of elevation of risk of future suicidal behavior 4 items (instead of the full 19) were sufficient, on average. CONCLUSIONS: This study demonstrated that CAT can be applied successfully to reduce the length of the Dutch version of the BSS. We argue that the use of CAT can improve the accuracy and the response burden when assessing the risk of future suicidal behavior online. Because CAT can be daunting for clinicians and applied scientists, we offer a concrete example of our computer adaptive simulation of the Dutch version of the BSS at the end of the paper.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessment of suicidal intention: The Scale for Suicide Ideation.
Beck, A. T., Kovacs, M., & Weissman, A. (1979) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.47.2.343 · Cited by 3,419
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 1×
“Attrition in online interventions and studies is a well-known problem [11].”
Differential Item Functioning.
Gudgeon, A. C., Holland, P. W., & Wainer, H. (1994) · The Statistician · doi:10.2307/2348590 · Cited by 2,091
Risk factors for suicide in psychiatric outpatients: A 20-year prospective study.
Brown, G. K., Beck, A. T., Steer, R. A., & Grisham, J. R. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.3.371 · Cited by 1,317
Experience sampling research in psychopathology: opening the black box of daily life
Myin-Germeys, I., Oorschot, M., Collip, D., Lataster, J., Delespaul, P., & van Os, J. (2009) · Psychological Medicine · doi:10.1017/s0033291708004947 · Cited by 817
Nock, M. K., Prinstein, M. J., & Sterba, S. K. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0016948 · Cited by 662 · cited 1×
“Online self-help interventions are offered to recover from suicide ideation [7], researchers collect data on suicidal behavior in real time via mobile applications [8,9], and mental health institutions monitor suicidal behavior of patients via online questionnaires [10].”
van Spijker, B. A. J., van Straten, A., & Kerkhof, A. J. F. M. (2010) · Trials · doi:10.1186/1745-6215-11-25 · Cited by 85
Self-citation
Research works printed but not linked: 22
- Beck, AT, 1979, J Consult Clin Psychol, 47, 343, 10.1037/0022-006X.47.2.343 · doi:10.1037/0022-006x.47.2.343 · Paper page
- Beck, AT, 1988, J Clin Psychol, 44, 499, 10.1002/1097-4679(198807)44:4<499::AID-JCLP2270440404>3.0.CO;2-6 · DOI · Paper page
- BrownGKA review of suicide assessment measures for intervention research with adults and older adult200101012014-09-01http://ruralccp.org/lyra-data/storage/asset/brown-nd-27cb.pdf6SGBncew4
- Mishara, BL, 2013, Suicide Prevention and New Technologies, 1, 10.1057/9781137351692_1 · DOI
- van SpijkerBReducing the Burden of Suicidal Thoughts Through Online Self-Help [dissertation]201201012014-09-05AmsterdamVU University Amsterdamhttp://dare.ubvu.vu.nl/bitstream/handle/1871/35540/dissertation.pdf;jsessionid=0292571E72767707968B94D6CDEF289F?sequence=16SMQ4ARzX
- 10.1002/cpp.696 · DOI · Paper page
- 10.1097/01.mlr.0000250483.85507.04 · DOI · Paper page
- 10.1016/j.psychres.2010.12.001 · DOI
- 10.1007/s11136-007-9191-7 · DOI
- 10.1017/S0033291706009779 · DOI · Paper page
- 10.1186/1471-2296-14-68 · DOI
- Embretson, SE, 2000, Item Response Theory for Psychologists
- 10.1186/1745-6215-14-372 · DOI
- 10.1186/1745-6215-14-9 · DOI
- Rizopoulos, D, 2006, Journal of Statistical Software, 17, 1, 10.18637/jss.v017.i05 · DOI · Paper page
- Choi, SW, 2011, J Stat Softw, 39, 1
- 10.1146/annurev.clinpsy.032408.153553 · DOI · Paper page
- van der Linden, WJ, 1997, Handbook of Modern Item Response Theory, 10.1007/978-1-4757-2691-6 · DOI · Paper page
- 10.1007/BF01175143 · DOI
- 10.1016/j.jclinepi.2008.03.003 · DOI
- 10.1007/s11136-009-9560-5 · DOI · Paper page
- 2006, Psychometrika, 71, 425, 10.1007/s11336-006-1447-6 · DOI · Paper page
Cited by
Exploring the psychology of suicidal ideation: a theory driven network analysis.
De Beurs, D., Fried, E. I., Wetherall, K., Cleare, S., O’ Connor, D. B., Ferguson, E., O'Carroll, R. E., & O’ Connor, R. C. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103419 · Cited by 171
Self-citationBush, N. E., Smolenski, D. J., Denneson, L. M., Williams, H. B., Thomas, E. K., & Dobscha, S. K. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600283 · Cited by 124
Entrapment and suicide risk: The development of the 4-item Entrapment Scale Short-Form (E-SF)
De Beurs, D., Cleare, S., Wetherall, K., Eschle-Byrne, S., Ferguson, E., B O'Connor, D., & C O'Connor, R. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112765 · Cited by 77
Self-citationDevelopment of a Computerized Adaptive Test Suicide Scale—The CAT-SS
Gibbons, R. D., Kupfer, D., Frank, E., Moore, T., Beiser, D. G., & Boudreaux, E. D. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.16m10922 · Cited by 65
Metadata
- Authors
- De Beurs, D. P., de Vries, A. L., de Groot, M. H., de Keijser, J., & Kerkhof, A. J.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2014-09-11
- Volume
- 16
- Issue
- 9
- Pages
- e207
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W1968077568
- Cited by
- 59
- References
- 7
- FWCI
- 8.63
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.