Predicting mechanical restraint of psychiatric inpatients by applying machine learning on electronic health data
Open accessAbstract
Objective: Mechanical restraint (MR) is used to prevent patients from harming themselves or others during inpatient treatment. The objective of this study was to investigate whether incident MR occurring in the first 3 days following admission could be predicted based on analysis of electronic health data available after the first hour of admission. Methods: The dataset consisted of clinical notes from electronic health records from the Central Denmark Region and data from the Danish Health Registers from patients admitted to a psychiatric department in the period from 2011 to 2015. Supervised machine learning algorithms were trained on a randomly selected subset of the data and validated using an independent test dataset. Results: A total of 5050 patients with 8869 admissions were included in the study. One hundred patients were mechanically restrained in the period between one hour and 3 days after the admission. A Random Forest algorithm predicted MR with an area under the curve of 0.87 (95% CI 0.79–0.93). At 94% specificity, the sensitivity was 56%. Among the ten strongest predictors, nine were derived from the clinical notes. Conclusions: These findings open for the development of an early warning system that may guide interventions to reduce the use of MR.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Once a person was admitted as an involuntary patient they were more likely to be subject to use of coercive treatment modalities such as restraint and seclusion than people admitted on a voluntary basis.
“A similar cycle of coercive care provision may also be evident during admission, with the available literature indicating that once a person was admitted as an involuntary patient they were more likely to be subject to use of coercive treatment modalities such as restraint and seclusion than people admitted on a voluntary basis (34,76–88), and may be more likely to display aggressive behaviours (”
From The benefits and harms of inpatient involuntary psychiatric treatment: a scoping review (2025) · cites this paper as [79]
The “Involuntary admission” section identifies involuntary admission as the model’s most important predictor of mechanical restraint, supporting the restraint portion of the claim. The paper’s outcome is mechanical restraint, however; our copy does not establish that involuntarily admitted patients were also more likely than voluntarily admitted patients to experience seclusion. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970 · see citing works
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · see citing works
General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491 · see citing works
The Danish Civil Registration System
Pedersen, C. (2011) · Scandinavian Journal of Public Health · doi:10.1177/1403494810387965 · Cited by 4,713 · see citing works
Big Data and Machine Learning in Health Care
Beam, A. L., & Kohane, I. S. (2018) · JAMA · doi:10.1001/jama.2017.18391 · Cited by 2,506 · see citing works
The Danish Psychiatric Central Research Register
Mors, O., Perto, G. P., & Mortensen, P. B. (2011) · Scandinavian Journal of Public Health · doi:10.1177/1403494810395825 · Cited by 1,589 · see citing works
Self-citationLuo, W., Phung, D., Tran, T., Gupta, S., Rana, S., Karmakar, C., Shilton, A., Yearwood, J., Dimitrova, N., Ho, T. B., et al. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5870 · Cited by 988 · see citing works
Cross-trial prediction of treatment outcome in depression: a machine learning approach
Chekroud, A. M., Zotti, R. J., Shehzad, Z., Gueorguieva, R., Johnson, M. K., Trivedi, M. H., Cannon, T. D., Krystal, J. H., & Corlett, P. R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00471-x · Cited by 676 · see citing works
Fazel, S., Singh, J. P., Doll, H., & Grann, M. (2012) · BMJ · doi:10.1136/bmj.e4692 · Cited by 535 · see citing works
Simon, G. E., Johnson, E., Lawrence, J. M., Rossom, R. C., Ahmedani, B., Lynch, F. L., Beck, A., Waitzfelder, B., Ziebell, R., Penfold, R. B., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101167 · Cited by 400 · cited 1× · see citing works
“This approach has been used before (27) and enables modeling of changes in risk over time (new predicted risk for each included admission) within patients.”
MethodSteinert, T., Lepping, P., Bernhardsgrütter, R., Conca, A., Hatling, T., Janssen, W. A., Keski-Valkama, A., Mayoral, F., & Whittington, R. (2009) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-009-0132-3 · Cited by 382 · see citing works
Predicting suicidal behavior from longitudinal electronic health records.
Barak-Corren, Y., Castro, V. M., Javitt, S., Hoffnagle, A. G., Dai, Y., Perlis, R. H., Nock, M. K., Smoller, J. W., & Reis, B. Y. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16010077 · Cited by 339 · see citing works
Almvik, R., Woods, P., & Rasmussen, K. B. (2000) · Journal of Interpersonal Violence · doi:10.1177/088626000015012003 · Cited by 236 · see citing works
Knox, D., & Holloman, G. (2012) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2011.9.6867 · Cited by 234 · see citing works
Structured risk assessment and violence in acute psychiatric wards: randomised controlled trial
Abderhalden, C., Needham, I., Dassen, T. W. N., et al. (2008) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.107.045534 · Cited by 234 · see citing works
Kessler, R. C., Hwang, I., Hoffmire, C. A., McCarthy, J. F., Petukhova, M. V., Rosellini, A. J., Sampson, N. A., Schneider, A. L., Bradley, P. A., Katz, I. R., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1575 · Cited by 209 · see citing works
Variation in use of coercive measures in psychiatric hospitals
Lay, B., Nordt, C., & Wulf Rössler, A. (2011) · European Psychiatry · doi:10.1016/j.eurpsy.2010.11.007 · Cited by 146 · see citing works
Aggression and seclusion on acute psychiatric wards: effect of short-term risk assessment
van de Sande, R., Nijman, H. L. I., Noorthoorn, E. O., et al. (2011) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.111.095141 · Cited by 146 · see citing works
Singh, J. P., Serper, M. R., Reinharth, J., & Fazel, S. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr093 · Cited by 144 · see citing works
Prevalence and risk factors for the use of restraint in psychiatry: a systematic review
Beghi, M., Peroni, F., Gabola, P., Rossetti, A., & Cornaggia, C. (2013) · Rivista di psichiatria · doi:10.1708/1228.13611 · Cited by 130 · see citing works
Bowers, L., van der Werf, B., Vokkolainen, A., Muir‐Cochrane, E., Allan, T. F., & Alexander, J. (2006) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2006.01.005 · Cited by 126 · see citing works
Gudjonsson, G. H., Rabe‐Hesketh, S., & SZMUKLER, G. I. (2004) · The British Journal of Psychiatry · doi:10.1192/bjp.184.3.258 · Cited by 107 · see citing works
Coercion within Danish psychiatry compared with 10 other European countries
Bak, J., & Aggernaes, H. (2011) · Nordic Journal of Psychiatry · doi:10.3109/08039488.2011.632645 · Cited by 104 · see citing works
Morbidity and Mortality Associated with the Utilization of Restraints
Rakhmatullina, M., Taub, A., & Jacob, T. (2013) · Psychiatric Quarterly · doi:10.1007/s11126-013-9262-6 · Cited by 103 · see citing works
Steinert, T., Birk, M., Flammer, E., & Bergk, J. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201200315 · Cited by 101 · see citing works
The Two Cultures of Computational Psychiatry
Bennett, D., Silverstein, S. M., & Niv, Y. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0231 · Cited by 79 · see citing works
Longitudinal histories as predictors of future diagnoses of domestic abuse: modelling study
Reis, B. Y., Kohane, I. S., & Mandl, K. D. (2009) · BMJ · doi:10.1136/bmj.b3677 · Cited by 71 · see citing works
Restraints and the code of ethics: An uneasy fit
Mohr, W. K. (2009) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2009.03.003 · Cited by 64 · see citing works
Coercion in mental healthcare: time for a change in direction
Molodynski, A., Khazaal, Y., & Callard, F. J. (2016) · BJPsych International · doi:10.1192/s2056474000000854 · Cited by 51 · see citing works
Violence risk–assessment screening tools for acute care mental health settings: Literature review
Anderson, K. K., & Jenson, C. E. (2018) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2018.08.012 · Cited by 51 · see citing works
Risk factors of coercion among psychiatric inpatients: a nationwide register-based cohort study
Thomsen, C. T., Starkopf, L., Hastrup, L. H., Andersen, P. K., Nordentoft, M., & Benros, M. E. (2017) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-017-1363-3 · Cited by 50 · see citing works
Thomas, S. D. M., Daffern, M., Martin, T., Ogloff, J. R. P., Thomson, L. D. G., & Ferguson, M. (2009) · International Journal of Mental Health Nursing · doi:10.1111/j.1447-0349.2008.00567.x · Cited by 49 · see citing works
Risk for physical restraint or seclusion in the psychiatric emergency service (PES)
Simpson, S. A., Joesch, J. M., West, I. I., & Pasic, J. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.09.009 · Cited by 49 · see citing works
Early detection of risk factors for seclusion and restraint: a prospective study
Georgieva, I., Vesselinov, R., & Mulder, C. L. (2012) · Early Intervention in Psychiatry · doi:10.1111/j.1751-7893.2011.00330.x · Cited by 48 · see citing works
Lorenzo, R. D., Miani, F., Formicola, V., et al. (2014) · Clinical Practice and Epidemiology in Mental Health · doi:10.2174/1745017901410010094 · Cited by 42 · see citing works
Hansson, L. I., Muus, S., Saarento, O., et al. (1999) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270050118 · Cited by 41 · see citing works
Use of Coercive Physical Measures in a Psychiatric Ward of a General Hospital in Greece
Bilanakis, N., Kalampokis, G., Christou, K., & Peritogiannis, V. (2010) · International Journal of Social Psychiatry · doi:10.1177/0020764009106620 · Cited by 41 · see citing works
Use of restraint in a general hospital psychiatric unit in Japan
Odawara, T., Narita, H., Yamada, Y., FUJITA, J., Yamada, T., & Hirayasu, Y. (2005) · Psychiatry and Clinical Neurosciences · doi:10.1111/j.1440-1819.2005.01422.x · Cited by 33 · see citing works
Hotzy, F., Theodoridou, A., Hoff, P. T., Schneeberger, A. R., Seifritz, E., Olbrich, S., & Jäger, M. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00258 · Cited by 33 · see citing works
Big Data From Health Records in Mental Health Care
Simon, G. E. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.4510 · Cited by 30 · see citing works
Dumais, A., Larue, C., Michaud, C., et al. (2012) · Issues in Mental Health Nursing · doi:10.3109/01612840.2012.697254 · Cited by 27 · see citing works
Predicting risk of seclusion and restraint in a P sychiatric I ntensive C are ( PIC ) unit
Roles, S., Gouge, A., & Smith, H. E. (2014) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.12152 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- Roles S, Gouge A, Smith H. Predicting risk of seclusion and restraint in a psychiatric intensive care (PIC) unit. J Psychiatr Ment Health Nurs. 2014;21(5):466-470.
- Almvik R, Woods P, Rasmussen K. The Broset violence checklist -Sensitivity, specificity, and interrater reliability. J Interpers Violence. 2000;15(12):1284-1296.
Cited by
Sorted by citations
Machine learning and natural language processing in mental health: systematic review
Le Glaz, A., Haralambous, Y., Kim-Dufor, D.-H., Lenca, P., Billot, R., Ryan, T. C., Marsh, J., DeVylder, J., Walter, M., Berrouiguet, S., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/15708 · Cited by 576 · see citing works
“Only 1 study on mechanical restraints [90] and 1 on cognitive troubles [97] were found.”
Predicting outcomes of psychotherapy for depression with electronic health record data
Coley, R. Y., Boggs, J. M., Beck, A., & Simon, G. E. (2021) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2021.100198 · Cited by 29 · see citing works
The benefits and harms of inpatient involuntary psychiatric treatment: a scoping review
Corderoy, A., Kisely, S., Zirnsak, T., & Ryan, C. J. (2025) · Psychiatry, Psychology and Law · doi:10.1080/13218719.2024.2346734 · Cited by 19 · see citing works
Perfalk, E., Damgaard, J. G., Bernstorff, M., Hansen, L., Danielsen, A. A., & Østergaard, S. D. (2024) · Psychological Medicine · doi:10.1017/s0033291724002642 · Cited by 12 · see citing works
Self-citation
- Authors
- Danielsen, A. A., Fenger, M. H. J., Østergaard, S. D., Nielbo, K. L., & Mors, O.
- Affiliations
- Aarhus University (DK)
- University of Southern Denmark (DK)
- Corresponding author
- Danielsen, A. A.
- Venue
- Acta Psychiatrica Scandinavica
- Publisher
- Wiley
- Published
- 2019-07-06
- Volume
- 140
- Issue
- 2
- Pages
- 147-157
- ISSN
- 0001-690X (ISSN-L)
- 1600-0447
- OpenAlex
- W2952147341
- Cited by
- 38
- References
- 42
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 12 · 2023: 3 · 2022: 4 · 2021: 6 · 2020: 2
- FWCI
- 3.50
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Acta Psychiatrica Scandinavica (publishedVersion)
- PubMed (publishedVersion)
- University of Southern Denmark Research Portal (University of Southern Denmark) (submittedVersion, other-oa)
- Funders
- Aarhus Universitet
- Danmarks Frie Forskningsfond (7016‐00048)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Healthcare Decision-Making and Restraints
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Psychiatry and Mental health › Electroconvulsive Therapy Studies
- Keywords
- mechanical restraint, psychiatric inpatients, electronic health records, clinical notes, early warning systems, random forest, risk factors, hospitalization
- MeSH terms
- Machine Learning, Early Warning Score, Mental Disorders, Denmark, Female, Hospitalization, Humans, Inpatients, Male, Predictive Value of Tests, Restraint, Physical, Sensitivity and Specificity, Time Factors, Case-Control Studies, Self-Injurious Behavior, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review