CoChat

Could artificial intelligence write mental health nursing care plans?

Open access
Woodnutt, Samuel, Allen, Chris, Snowden, Jasmine, Flynn, Matt, Hall, Simon, Libberton, Paula, Purvis, Francesca · 2024 · Journal of Psychiatric and Mental Health Nursing
Cited by 89

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Abstract

Accessible Summary: What is Known on the Subject?: Artificial intelligence (AI) is freely available, responds to very basic text input (such as a question) and can now create a wide range of outputs, communicating in many languages or art forms. AI platforms like OpenAI's ChatGPT can now create passages of text that could be used to create plans of care for people with mental health needs. As such, AI output can be difficult to distinguish from human‐output, and there is a risk that its use could go unnoticed. What this Paper Adds to Existing Knowledge?: Whilst it is known that AI can produce text or pass pre‐registration health‐profession exams, it is not known if AI can produce meaningful results for care delivery. We asked ChatGPT basic questions about a fictitious person who presents with self‐harm and then evaluated the quality of the output. We found that the output could look reasonable to laypersons but there were significant errors and ethical issues. There are potential harms to people in care if AI is used without an expert correcting or removing these errors. What are the Implications for Practice?: We suggest that there is a risk that AI use could cause harm if it was used in direct care delivery. There is a lack of policy and research to safeguard people receiving care ‐ and this needs to be in place before AI should be used in this way. Key aspects of the role of a mental health nurse are relational and AI use may diminish mental health nurses' ability to provide safe care in its current form. Many aspects of mental health recovery are linked to relationships and social engagement, however AI is not able to provide this and may push the people who are in most need of help further away from services that assist recovery. Background: Artificial intelligence (AI) is being increasingly used and discussed in care contexts. ChatGPT has gained significant attention in popular and scientific literature although how ChatGPT can be used in care‐delivery is not yet known. Aims: To use artificial intelligence (ChatGPT) to create a mental health nursing care plan and evaluate the quality of the output against the authors’ clinical experience and existing guidance. Materials & Methods: Basic text commands were input into ChatGPT about a fictitious person called ‘Emily’ who presents with self‐injurious behaviour. The output from ChatGPT was then evaluated against the authors’ clinical experience and current (national) care guidance. Results: ChatGPT was able to provide a care plan that incorporated some principles of dialectical behaviour therapy, but the output had significant errors and limitations and thus there is a reasonable likelihood of harm if used in this way. Discussion: AI use is increasing in direct‐care contexts through the use of chatbots or other means. However, AI can inhibit clinician to care‐recipient engagement, ‘recycle’ existing stigma, and introduce error, which may thus diminish the ability for care to uphold personhood and therefore lead to significant avoidable harms. Conclusion: Use of AI in this context should be avoided until a point where policy and guidance can safeguard the wellbeing of care recipients and the sophistication of AI output has increased. Given ChatGPT’s ability to provide superficially reasonable outputs there is a risk that errors may go unnoticed and thus increase the likelihood of patient harms. Further research evaluating AI output is needed to consider how AI may be used safely in care delivery.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/jpm.12965

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 89

Metadata

Authors
Woodnutt, S., Allen, C., Snowden, J., Flynn, M., Hall, S., Libberton, P., & Purvis, F.
Venue
Journal of Psychiatric and Mental Health Nursing
Publisher
Wiley
Published
2023-08-04
Volume
31
Issue
1
Pages
79-86
ISSN
  • 1351-0126 (ISSN-L)
  • 1365-2850
OpenAlex
W4385564356
Cited by
89
References
2
FWCI
3.08
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.