Identifying nurses’ concern concepts about patient deterioration using a standard nursing terminology
Open accessAbstract
Objectives Nurse concerns documented in nursing notes are important predictors of patient risk of deterioration. Using a standard nursing terminology and inputs from subject-matter experts (SMEs), we aimed to identify and define nurse concern concepts and terms about patient deterioration, which can be used to support subsequent automated tasks, such as natural language processing and risk predication. Methods Group consensus meetings with nurse SMEs were held to identify nursing concerns by grading Clinical Care Classification (CCC) system concepts based on clinical knowledge. Next, a fundamental lexicon was built placing selected CCC concepts into a framework of entities and seed terms to extend CCC granularity. Results A total of 29 CCC concepts were selected as reflecting nurse concerns. From these, 111 entities and 586 seed terms were generated into a fundamental lexicon. Nursing concern concepts differed across settings (intensive care units versus non-intensive care units) and unit types (medicine versus surgery units). Conclusions The CCC concepts were useful for representing nursing concern as they encompass a nursing-centric conceptual framework and are practical in lexicon construction. It enabled the codification of nursing concerns for deteriorating patients at a standardized conceptual level. The boundary of selected CCC concepts and lexicons were determined by the SMEs. The fundamental lexicon offers more granular terms that can be identified and processed in an automated fashion.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CONCERN leverages evidence that nurses alter their documentation behavior or use selected language in their narrative notes when they are concerned about a patient's changing clinical state.
“As such, it leverages evidence that nurses alter their documentation behavior or use selected language in their narrative notes when they are concerned about a patient’s changing clinical state [21-24].”
From Factors influencing clinician trust in predictive clinical decision support systems for in-hospital deterioration: qualitative descriptive study (2022) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 20
- [1]Törnvall E, Wilhelmsson S. Nursing documentation for communicating and evaluating care. Journal of clinical nursing 2008; 17(16): 2116– 24 18710374
- [3]Penoyer DA, Cortelyou-Ward KH, Noblin AM, Use of electronic health record documentation by healthcare workers in an acute care hospital system. Journal of healthcare management 2014; 59(2): 130– 44 24783371
- [4]Cioffi J. Recognition of patients who require emergency assistance: a descriptive study. Heart & Lung: The Journal of Acute and Critical Care 2000; 29(4): 262– 68 10900063
- [5]Cioffi J. Nurses’ experiences of making decisions to call emergency assistance to their patients. Journal of advanced nursing 2000; 32(1): 108– 14 10886441
- [6]Odell M, Victor C, Oliver D. Nurses’ role in detecting deterioration in ward patients: systematic literature review. Journal of advanced nursing 2009; 65(10): 1992– 2006 20568317
- [7]Kenward G, Hodgetts T. Nurse concern: a predictor of patient deterioration. Nursing times 2002; 98(22): 38– 39 12168455
- [8]Douw G, Schoonhoven L, Holwerda T, van Zanten AR, van Achterberg T, van der Hoeven JG. Nurses’ worry or concern and early recognition of deteriorating patients on general wards in acute care hospitals: a systematic review. Critical Care 2015; 19(1): 230 25990249 PMC4461986
- [9]Liaw SY, Scherpbier A, Klainin-Yobas P, Rethans JJ. A review of educational strategies to improve nurses’ roles in recognizing and responding to deteriorating patients. International Nursing Review 2011; 58(3): 296– 303 21848774
- [10]Collins SA, Vawdrey DK. “Reading Between the Lines” of Flowsheet Data: Nurses’ Optional Documentation Associated with Cardiac Arrest Outcomes. Applied nursing research: ANR 2012; 25(4): 251 22079746 PMC3288795
- [11]Collins SA, Cato K, Albers D, Relationship between nursing documentation and patients’ mortality. American Journal of Critical Care 2013; 22(4): 306– 13 23817819 PMC3771321
- [12]Capability of Using Clinical Care Classification System to Represent Nursing Practice in Acute Setting in Taiwan NI 2012:11th International Congress on Nursing Informatics, June 23–27, 2012, Montreal, Canada.; 2012 American Medical Informatics Association. PMC3799145 24199066
- [13]Representing critical care data using the clinical care classification AMIA Annual Symposium Proceedings; 2005 American Medical Informatics Association. PMC1560509 16779099
- [14]Feng R-C, Chang P. Usability of the Clinical Care Classification System for Representing Nursing Practice According to Specialty. CIN: Computers, Informatics, Nursing 2015; 33(10): 448– 55 26418298
- [15]Saba V. Clinical Care Classification (CCC) System Version 2.5: User’s Guide: Springer Publishing Company, 2012.
- [17]Gundlapalli AV, Divita G, Redd A, Detecting the presence of an indwelling urinary catheter and urinary symptoms in hospitalized patients using natural language processing. Journal of biomedical informatics 2017; 71: S39– S45 27404849
- [18]Carrell DS, Cronkite D, Palmer RE, Using natural language processing to identify problem usage of prescription opioids. International journal of medical informatics 2015; 84(12): 1057– 64 26456569
- [19]Hyun S, Johnson SB, Bakken S. Exploring the ability of natural language processing to extract data from nursing narratives. Computers, informatics, nursing: CIN 2009; 27(4): 215 PMC4415266 19574746
- [20]Kudesia V, Strymish J, D’avolio L, Gupta K. Natural language processing to identify Foley catheter-days. Infection Control & Hospital Epidemiology 2012; 33(12): 1270– 72 23143371
- [21]Clark HH, Brennan SE. Grounding in communication. Perspectives on socially shared cognition 1991; 13(1991): 127– 49
- [22]Describing the clinical communication space through a model of common ground:‘you don’t know what you don’t know’ AMIA Annual Symposium proceedings; 2010 American Medical Informatics Association. PMC3041298 21347010
Cited by
Sorted by citations
Schwartz, J. M., George, M., Rossetti, S. C., Dykes, P. C., Minshall, S. R., Lucas, E., & Cato, K. D. (2022) · JMIR Human Factors · doi:10.2196/33960 · Cited by 88 · see citing works
“As such, it leverages evidence that nurses alter their documentation behavior or use selected language in their narrative notes when they are concerned about a patient’s changing clinical state [21-24].”
BackgroundSelf-citationRossetti, S. C., Knaplund, C., Albers, D., Dykes, P. C., Kang, M. J., Korach, T. Z., Zhou, L., Schnock, K., Garcia, J., Schwartz, J., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab006 · Cited by 42 · see citing works
Self-citation
- Authors
- Kang, M.-J., Dykes, P. C., Korach, T. Z., Zhou, L., Schnock, K. O., Thate, J., Whalen, K., Jia, H., Schwartz, J., Garcia, J. P., Knaplund, C., Cato, K. D., & Rossetti, S. C.
- Affiliations
- Brigham and Women's Hospital (US)
- Siena College (US)
- Massachusetts General Hospital (US)
- Columbia University (US)
- Corresponding author
- Kang, Min-Jeoung
- ORCID
- Venue
- International Journal of Medical Informatics
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 133
- Pages
- 104016
- ISSN
- 1386-5056 (ISSN-L)
- PMC
- PMC6957124
- OpenAlex
- W2982496000
- Cited by
- 24
- References
- 0
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 6 · 2023: 1 · 2022: 5 · 2021: 3
- FWCI
- 5.47
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- International Journal of Medical Informatics (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Nursing Research
- Topics
- Health Sciences › Nursing › Issues, ethics and legal aspects › Nursing Diagnosis and Documentation
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
- Keywords
- clinical deterioration, nurses' concerns, nursing terminology, nursing notes, lexicon construction, intensive care unit, risk prediction, natural language processing
- MeSH terms
- Standardized Nursing Terminology, Humans, Intensive Care Units, Natural Language Processing, Nurses
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review