CoChat

Applying Computer Adaptive Testing to Optimize Online Assessment of Suicidal Behavior: A Simulation Study

Open access
De Beurs, Derek Paul, de Vries, Anton LM, de Groot, Marieke H, de Keijser, Jos, Kerkhof, Ad JFM · 2014 · Journal of Medical Internet Research
Cited by 59

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

BACKGROUND: The Internet is used increasingly for both suicide research and prevention. To optimize online assessment of suicidal patients, there is a need for short, good-quality tools to assess elevated risk of future suicidal behavior. Computer adaptive testing (CAT) can be used to reduce response burden and improve accuracy, and make the available pencil-and-paper tools more appropriate for online administration. OBJECTIVE: The aim was to test whether an item response-based computer adaptive simulation can be used to reduce the length of the Beck Scale for Suicide Ideation (BSS). METHODS: The data used for our simulation was obtained from a large multicenter trial from The Netherlands: the Professionals in Training to STOP suicide (PITSTOP suicide) study. We applied a principal components analysis (PCA), confirmatory factor analysis (CFA), a graded response model (GRM), and simulated a CAT. RESULTS: The scores of 505 patients were analyzed. Psychometric analyses showed the questionnaire to be unidimensional with good internal consistency. The computer adaptive simulation showed that for the estimation of elevation of risk of future suicidal behavior 4 items (instead of the full 19) were sufficient, on average. CONCLUSIONS: This study demonstrated that CAT can be applied successfully to reduce the length of the Dutch version of the BSS. We argue that the use of CAT can improve the accuracy and the response burden when assessing the risk of future suicidal behavior online. Because CAT can be daunting for clinicians and applied scientists, we offer a concrete example of our computer adaptive simulation of the Dutch version of the BSS at the end of the paper.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/jmir.3511

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 22

  1. Beck, AT, 1979, J Consult Clin Psychol, 47, 343, 10.1037/0022-006X.47.2.343 · doi:10.1037/0022-006x.47.2.343 · Paper page
  2. Beck, AT, 1988, J Clin Psychol, 44, 499, 10.1002/1097-4679(198807)44:4<499::AID-JCLP2270440404>3.0.CO;2-6 · DOI · Paper page
  3. BrownGKA review of suicide assessment measures for intervention research with adults and older adult200101012014-09-01http://ruralccp.org/lyra-data/storage/asset/brown-nd-27cb.pdf6SGBncew4
  4. Mishara, BL, 2013, Suicide Prevention and New Technologies, 1, 10.1057/9781137351692_1 · DOI
  5. van SpijkerBReducing the Burden of Suicidal Thoughts Through Online Self-Help [dissertation]201201012014-09-05AmsterdamVU University Amsterdamhttp://dare.ubvu.vu.nl/bitstream/handle/1871/35540/dissertation.pdf;jsessionid=0292571E72767707968B94D6CDEF289F?sequence=16SMQ4ARzX
  6. 10.1002/cpp.696 · DOI · Paper page
  7. 10.1097/01.mlr.0000250483.85507.04 · DOI · Paper page
  8. 10.1016/j.psychres.2010.12.001 · DOI
  9. 10.1007/s11136-007-9191-7 · DOI
  10. 10.1017/S0033291706009779 · DOI · Paper page
  11. 10.1186/1471-2296-14-68 · DOI
  12. Embretson, SE, 2000, Item Response Theory for Psychologists
  13. 10.1186/1745-6215-14-372 · DOI
  14. 10.1186/1745-6215-14-9 · DOI
  15. Rizopoulos, D, 2006, Journal of Statistical Software, 17, 1, 10.18637/jss.v017.i05 · DOI · Paper page
  16. Choi, SW, 2011, J Stat Softw, 39, 1
  17. 10.1146/annurev.clinpsy.032408.153553 · DOI · Paper page
  18. van der Linden, WJ, 1997, Handbook of Modern Item Response Theory, 10.1007/978-1-4757-2691-6 · DOI · Paper page
  19. 10.1007/BF01175143 · DOI
  20. 10.1016/j.jclinepi.2008.03.003 · DOI
  21. 10.1007/s11136-009-9560-5 · DOI · Paper page
  22. 2006, Psychometrika, 71, 425, 10.1007/s11336-006-1447-6 · DOI · Paper page

Cited by

See all 59

Metadata

Authors
De Beurs, D. P., de Vries, A. L., de Groot, M. H., de Keijser, J., & Kerkhof, A. J.
Venue
Journal of Medical Internet Research
Published
2014-09-11
Volume
16
Issue
9
Pages
e207
ISSN
1438-8871 (ISSN-L)
OpenAlex
W1968077568
Cited by
59
References
7
FWCI
8.63
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.