Automatic generation of natural language nursing shift summaries in neonatal intensive care: BT-Nurse
Open accessAbstract
Introduction Our objective was to determine whether and how a computer system could automatically generate helpful natural language nursing shift summaries solely from an electronic patient record system, in a neonatal intensive care unit (NICU).Methods A system was developed which automatically generates partial NICU shift summaries (for the respiratory and cardiovascular systems), using data-to-text technology. It was evaluated for 2 months in the NICU at the Royal Infirmary of Edinburgh, under supervision.Results In an on-ward evaluation, a substantial majority of the summaries was found by outgoing and incoming nurses to be understandable (90%), and a majority was found to be accurate (70%), and helpful (59%). The evaluation also served to identify some outstanding issues, especially with regard to extra content the nurses wanted to see in the computer-generated summaries.Conclusions It is technically possible automatically to generate limited natural language NICU shift summaries from an electronic patient record. However, it proved difficult to handle electronic data that was intended primarily for display to the medical staff, and considerable engineering effort would be required to create a deployable system from our proof-of-concept software.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Hunter et al. used natural-language generation to summarize EHR data and generate potential problems and care plans in a dynamic shift-change report in the neonatal ICU context.
“In the neonatal ICU context, Hunter et al63 used natural-language generation to summarize EHR data and generate potential problems and care plans in a dynamic shift-change report.”
From Potential uses of AI for perioperative nursing handoffs: a qualitative study (2023) · cites this paper as [63]
The abstract (p. 1) and system description (p. 2) confirm that BT-Nurse generated natural-language summaries from electronic NICU records for shift handover. The Data Interpretation section (p. 8) says it identified potential problems, but the paper does not say it generated care plans: the care-plan example is from an expert nurse’s summary (p. 2), while BT-Nurse’s summaries were intended to help nurses with care planning (Methodology, p. 12). (LLM, conf=0.89)
Experimental — accuracy not yet measuredNurse users largely accepted a prototype system for shift change in the neonatal intensive care unit which focused on summarizing data in natural language and included expert decision rules as a minor component.
“Nurse users largely accepted a prototype system for shift change in the neonatal intensive care unit which focused on summarizing data in natural language and included expert decision rules as a minor component.63”
From Potential uses of AI for perioperative nursing handoffs: a qualitative study (2023) · cites this paper as [63]
The abstract (p. 1) reports that nurses rated most generated summaries understandable, accurate and helpful, supporting a broadly positive reception of the NICU shift-handover prototype. Section 3.2.6 (p. 8) describes medical-knowledge if–then rules used in data interpretation, but the paper does not establish that expert decision rules were a minor component. The evaluation measured nurses’ ratings of partial summaries, not acceptance of a deployable system. (LLM, conf=0.82)
Experimental — accuracy not yet measuredHunter and Forbes's work suggests a distinct role for AI prediction from traditional CDS: facilitating problem-based report and assessment during handoffs.
“Hunter and Forbes's work56,63,64 suggests a distinct role for AI prediction from traditional CDS: facilitating problem-based report and assessment during handoffs.”
From Potential uses of AI for perioperative nursing handoffs: a qualitative study (2023) · cites this paper as [63]
The Conclusions (p. 15) say BT-Nurse generates shift summaries that include current status and potential problems, supporting its role in handoff reporting. The paper does not present BT-Nurse as an AI prediction system or establish a distinct predictive role from traditional clinical decision support; its Computerised shift handover section (p. 2) describes the summaries as complementing other handover communication. (LLM, conf=0.85)
Experimental — accuracy not yet measuredWorks [101,102] have demonstrated the possible uses of systems combining classical data mining techniques with natural language generation in both clinical and experimental contexts.
“Works such as [101,102] have demonstrated the possible uses of such systems in both clinical and experimental contexts.”
From Data Mining for Wearable Sensors in Health Monitoring Systems: A Review of Recent Trends and Challenges (2013) · cites this paper as [102]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · see citing works
(2004) · Cited by 9,718 · see citing works
Bleu: a method for automatic evaluation of machine translation
Papineni, K. (2024) · doi:10.57702/ljteqmrb · Cited by 3,682 · see citing works
Towards a General Theory of Action and Time
Allen, J. F. (1984) · Artificial Intelligence · doi:10.1016/0004-3702(84)90008-0 · Cited by 3,073 · see citing works
Patient Safety and Quality: An Evidence‐Based Handbook for Nurses
Barton, A. (2009) · AORN Journal · doi:10.1016/j.aorn.2009.09.014 · Cited by 2,542 · see citing works
McKinsey, J. C. C., & Reichenbach, H. (1948) · American Mathematical Monthly · doi:10.2307/2305604 · Cited by 2,247 · see citing works
Safar, P. J., & Grenvik, A. N. A. (1971) · CHEST Journal · doi:10.1378/chest.59.5.535 · Cited by 1,995 · see citing works
Inter-Coder Agreement for Computational Linguistics
Artstein, R., & Poesio, M. (2008) · Computational Linguistics · doi:10.1162/coli.07-034-r2 · Cited by 1,665 · see citing works
Building Natural-Language Generation SystemsPreprint
Reiter, E. (1996) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9605002 · Cited by 1,228 · see citing works
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162 · see citing works
An online algorithm for segmenting time series
Keogh, E., Chu, S., Hart, D., & Pazzani, M. (2002) · Proceedings 2001 IEEE International Conference on Data Mining · doi:10.1109/icdm.2001.989531 · Cited by 1,149 · see citing works
Goodman, N., & Reichenbach, H. (1948) · The Philosophical Review · doi:10.2307/2181740 · Cited by 1,094 · see citing works
Some Structural Analogies between Tenses and Pronouns in English
Partee, B. H. (1973) · The Journal of Philosophy · doi:10.2307/2025024 · Cited by 947 · see citing works
Patient Safety and Quality: An Evidence-Based Handbook for Nurses
Rg, H. (2008) · Cited by 842 · see citing works
Temporal Ontology and Temporal Reference
Moens, M., & Steedman, M. J. (2005) · doi:10.1093/oso/9780199268535.003.0007 · Cited by 802 · see citing works
McKeown, K. R. (1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620751 · Cited by 773 · see citing works
Building Natural Language Generation Systems
Reiter, E., & Dale, R. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511519857 · Cited by 772 · see citing works
Proceedings 2002 IEEE International Conference on Data Mining. ICDM 2002
(2002) · Proceedings · doi:10.1109/icdm.2002.1183878 · Cited by 727 · see citing works
Re-evaluating the Role of Bleu in Machine Translation Research
Callison-Burch, C., Osborne, M., & Koehn, P. (2006) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 632 · see citing works
Temporal ontology and temporal reference
MoensMarc, & SteedmanMark (1988) · Computational Linguistics · doi:10.5555/55056.55058 · Cited by 579 · see citing works
Shaḥar, Y., Miksch, S., & Johnson, P. D. (1998) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(98)00015-3 · Cited by 453 · see citing works
Albert Gatt, A., & Reiter, E. (2009) · European Workshop on Natural Language Generation (ENLG) · doi:10.3115/1610195.1610208 · Cited by 324 · see citing works
Automatic generation of textual summaries from neonatal intensive care data
Portet, F., Reiter, E., Albert Gatt, A., Jim Hunter, A., Sripada, S. G., Freer, Y., & Cindy Sykes, B. (2008) · Artificial Intelligence · doi:10.1016/j.artint.2008.12.002 · Cited by 318 · see citing works
Jess in Action: Java Rule-Based Systems
Hill, E. F. (2003) · Cited by 317 · see citing works
Knowledge-based temporal abstraction in clinical domains
D, Y. S. M., & Musen, M. A. (1996) · Artificial Intelligence in Medicine · doi:10.1016/0933-3657(95)00036-4 · Cited by 313 · see citing works
The Pyramid Method: Incorporating human content selection variation in summarization evaluation
Nenkova, A., Passonneau, R., & McKeown, K. (2007) · ACM Transactions on Speech and Language Processing · doi:10.1145/1233912.1233913 · Cited by 307 · see citing works
Using natural-language processing to produce weather forecasts
Goldberg, E., Driedger, N., & Kittredge, R. I. (1994) · IEEE Expert · doi:10.1109/64.294135 · Cited by 265 · see citing works
Choosing words in computer-generated weather forecasts
Reiter, E., Sripada, S. G., Jim Hunter, A., Yu, J. S., & Davy, I. P. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.06.006 · Cited by 262 · see citing works
Rohde, H., Elsner, M., & Clarke, A. V. (2014) · The Association for Computational Linguistics · Cited by 245 · see citing works
Webber, B., Webber, B., & Lab, L. (1988) · ScholarlyCommons (University of Pennsylvania) · Cited by 238 · see citing works
Protégé-2000: an open-source ontology-development and knowledge-acquisition environment.
Noy, N. F., Crubézy, M., Fergerson, R. W., Knublauch, H., Tu, S. W., Vendetti, J., & Musen, M. A. (2003) · PubMed · Cited by 235 · see citing works
An architecture for data-to-text systems
Reiter, E. (2007) · European Workshop on Natural Language Generation (ENLG) · doi:10.3115/1610163.1610180 · Cited by 229 · see citing works
Lessons from a failure: Generating tailored smoking cessation letters
Reiter, E., Robertson, R., & Osman, L. M. (2003) · Artificial Intelligence · doi:10.1016/s0004-3702(02)00370-3 · Cited by 229 · see citing works
The UMLS project: making the conceptual connection between users and the information they need.
Humphreys, B. L., & Lindberg, D. A. B. (1993) · PubMed · Cited by 227 · see citing works
Design of a knowledge-based report generator
Kukich, K. (1983) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/981311.981340 · Cited by 211 · see citing works
Reiter, E., & Belz, A. (2009) · Computational Linguistics · doi:10.1162/coli.2009.35.4.35405 · Cited by 204 · see citing works
Belz, A. (2007) · Natural Language Engineering · doi:10.1017/s1351324907004664 · Cited by 180 · see citing works
A Practical Guide to Knowledge Acquisition
Scott, A. C., Clayton, J. E., & Gibson, E. L. (1991) · Medical Entomology and Zoology · Cited by 173 · see citing works
Summarization from medical documents: a survey
Afantenos, S., Karkaletsis, V., & Stamatopoulos, P. (2004) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2004.07.017 · Cited by 164 · see citing works
Information sharing : reference and presupposition in language generation and interpretation
van Deemter, K., & Kibble, R. (2002) · Cited by 118 · see citing works
Representing Time in Natural Language
ter Meulen, A. G. Β. (1995) · The MIT Press eBooks · doi:10.7551/mitpress/5897.001.0001 · Cited by 112 · see citing works
Efficient context-sensitive generation of referring expressions
Krahmer, E., & Theune, M. (2002) · University of Twente Research Information · Cited by 111 · see citing works
Computerized clinical documentation system in the pediatric intensive care unit
Menke, J. A., Broner, C. W., Campbell, D., McKissick, M. Y., & Edwards‐Beckett, J. (2001) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-1-3 · Cited by 108 · see citing works
Choosing the content of textual summaries of large time-series data sets
Yu, J. S., Reiter, E., Jim Hunter, A., & Mellish, C. (2006) · Natural Language Engineering · doi:10.1017/s1351324905004031 · Cited by 101 · see citing works
Can Technology Improve Intershift Report? What the Research Reveals
Strople, B., & Ottani, P. A. (2006) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2006.03.007 · Cited by 100 · see citing works
Law, A. S., Freer, Y., Jim Hunter, A., Logie, R. H., McIntosh, N., & Quinn, J. A. (2005) · Journal of Clinical Monitoring and Computing · doi:10.1007/s10877-005-0879-3 · Cited by 97 · see citing works
Albert Gatt, A., Portet, F., Reiter, E., Jim Hunter, A., Mahamood, S., Moncur, W., & Sripada, S. G. (2009) · AI Communications · doi:10.3233/aic-2009-0453 · Cited by 95 · see citing works
Generating Affective Natural Language for Parents of Neonatal Infants
Mahamood, S., & Reiter, E. (2011) · Cited by 94 · see citing works
Proceedings of the 13th European Workshop on Natural Language Generation
Gardent, C., & Striegnitz, K. (2011) · Cited by 88 · see citing works
Developing and empirically evaluating robust explanation generators: the KNIGHT experiments
Lester, J. C., & Porter, B. (1997) · Cited by 84 · see citing works
Caenepeel, M. (1995) · Linguistics · doi:10.1515/ling.1995.33.2.213 · Cited by 79 · see citing works
Staggers, N., Clark, L., Blaz, J. W., & Kapsandoy, S. (2011) · Health Informatics Journal · doi:10.1177/1460458211405809 · Cited by 76 · see citing works
A review of explanation methods for heuristic expert systems
Lacave, C., & Díez, F. J. (2004) · The Knowledge Engineering Review · doi:10.1017/s0269888904000190 · Cited by 67 · see citing works
Generation of extended bilingual statistical reports
Iordanskaja, L., Kim, M., Kittredge, R. I., Lavoie, B., & Polguère, A. (1992) · International Conference on Computational Linguistics · doi:10.3115/993079.993120 · Cited by 61 · see citing works
Introducing Shared Tasks to NLG: The TUNA Shared Task Evaluation Challenges
Albert Gatt, A., & Belz, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15573-4_14 · Cited by 55 · see citing works
van der Meulen, M., Logie, R. H., Freer, Y., Cindy Sykes, B., McIntosh, N., & Jim Hunter, A. (2008) · Applied Cognitive Psychology · doi:10.1002/acp.1545 · Cited by 55 · see citing works
Proceedings of the 12th European Workshop on Natural Language Generation - ENLG '09
Belz, A., Albert Gatt, A., Portet, F., & Purver, M. (2009) · doi:10.3115/1610195 · Cited by 49 · see citing works
Language generation for multimedia healthcare briefings
McKeown, K. R., Pan, S., Shaw, J., Jordan, D. A., & Allen, B. A. (1997) · Conference on Applied Natural Language Processing · doi:10.3115/974557.974598 · Cited by 47 · see citing works
Empirical Methods in Natural Language Generation
Krahmer, E., & Theune, M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15573-4 · Cited by 47 · see citing works
Proceedings of the UK e-Science All-Hands Meeting 2007
Voss, A., Mascord, M., Fraser, M., Jirotka, M. D., Procter, R., Halfpenny, P., Fergusson, D., Atkinson, M., Dunn, S., & Blanke, T. (2007) · Cited by 47 · see citing works
The interpretation of tense in discourse
Webber, B. (1987) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/981175.981196 · Cited by 46 · see citing works
Text Generation in Clinical Medicine – a Review
Hüske-Kraus, D. (2003) · Methods of Information in Medicine · doi:10.1055/s-0038-1634209 · Cited by 44 · see citing works
Ferres, L., Parush, A., Roberts, S., & Lindgaard, G. (2006) · Lecture notes in computer science · doi:10.1007/11788713_163 · Cited by 42 · see citing works
Alberdi, E., Becher, J., Gilhooly, K. J., Jim Hunter, A., Logie, R. H., Lyon, A., McIntosh, N., & Reiss, J. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0477 · Cited by 35 · see citing works
A Methodology for Extrinsic Evaluation of Text Summarization: Does ROUGE Correlate?
Dorr, B. J., Monz, C., President, S., Schwartz, R. M., & Zajic, D. M. (2005) · Cited by 35 · see citing works
SimpleNLG : a realisation engine for practical applications
Gatt, A., Reiter, E., & Generation, 1. E. W. O. N. L. (2009) · OAR@UM (University of Malta) · Cited by 32 · see citing works
Introducing shared task evaluation to NLG : The TUNA shared task evaluation challenges
Albert Gatt, A., Belz, E., Krahmer, E., & Theune, M. (2010) · Research portal (Tilburg University) · Cited by 31 · see citing works
Cunningham, S., Deere, S., Symon, A., Elton, R. A., & McIntosh, N. (1998) · Critical Care Medicine · doi:10.1097/00003246-199812000-00040 · Cited by 30 · see citing works
Hunter, J. D., Freer, Y., Albert Gatt, A., Reiter, E., Sripada, S. G., Cindy Sykes, B., & Westwater, D. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000193 · Cited by 30 · see citing works
Summarisation and Visualisation of e-Health Data Repositories
Hallett, C., Power, R., & Scott, D. (2005) · Open Research Online (The Open University) · Cited by 28 · see citing works
Building a large-scale commercial NLG system for an EMR
Harris, M. D. (2008) · International Conference on Natural Language Generation · doi:10.3115/1708322.1708351 · Cited by 25 · see citing works
Hüske-Kraus, D. (2003) · doi:10.3115/1067737.1067788 · Cited by 25 · see citing works
Turner, R., Sripada, S. G., Reiter, E., & Davy, I. P. (2007) · Springer eBooks · doi:10.1007/978-1-84800-086-5_6 · Cited by 22 · see citing works
Evaluation of On-Line Bradycardia Boundary Detectors from Neonatal Clinical Data
Portet, F., Gao, F., Jim Hunter, A., & Sripada, S. G. (2007) · Conference proceedings · doi:10.1109/iembs.2007.4353032 · Cited by 20 · see citing works
Design Issues for Socially Intelligent User Interfaces
McVittie, C., Reiter, E., Freer, Y., Sykes, C., Logie, R. H., & McKinlay, A. (2009) · Methods of Information in Medicine · doi:10.3414/me0613 · Cited by 16 · see citing works
Generating clausal coordinate ellipsis multilingually
Harbusch, K., & Kempen, G. (2009) · doi:10.3115/1610195.1610219 · Cited by 16 · see citing works
Moncur, W., Reiter, E., Masthoff, J., & Carmichael, A. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2035361 · Cited by 14 · see citing works
Bayesian Condition Monitoring in Neonatal Intensive Care
Quinn, J. A. (2007) · ERA · Cited by 12 · see citing works
Supporting Communication and Decision Making in Finnish Intensive Care with Language Technology
Suominen, H., & Salakoski, T. (2010) · Journal of Healthcare Engineering · doi:10.1260/2040-2295.1.4.595 · Cited by 10 · see citing works
Suregen-2: a shell system for the generation of clinical documents.
Kraus, D. (2003) · Conference of the European Chapter of the Association for Computational Linguistics · Cited by 7 · see citing works
Freer, Y., Ferguson, L., Ewing, G., Jim Hunter, A., Logie, R. H., Rudkin, S., & McIntosh, N. (2002) · Journal of Clinical Monitoring and Computing · doi:10.1023/a:1026264722707 · Cited by 5 · see citing works
Generating clausal coordinate ellipsis multilingually: A uniform approach based on postediting
Harbusch, K., & Kempen, G. (2009) · Max Planck Digital Library · Cited by 2 · see citing works
Using NLG to Manage Information in Medical Emergencies
Nguyen, H. P. N., Mellish, C. S., Mort, A. J., Kindness, P., Knight, J., & Reiter, E. (2011) · Aberdeen University Research Archive (Aberdeen University) · Cited by 1 · see citing works
Flagged first, then by citations
5 of the 92 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Gatt, A., & Krahmer, E. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5477 · Cited by 776 · see citing works
Banaee, H., Ahmed, M., & Loutfi, A. (2013) · Sensors · doi:10.3390/s131217472 · Cited by 452 · see citing works
Artificial Intelligence -based technologies in nursing: A scoping literature review of the evidence
von Gerich, H., Moen, H., Block, L. J., Chu, C. H., DeForest, H., Hobensack, M., Michalowski, M., Mitchell, J., Nibber, R., Olalia, M. A., et al. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104153 · Cited by 360 · see citing works
Human evaluation of automatically generated text: Current trends and best practice guidelines
van der Lee, C., Albert Gatt, A., van Miltenburg, E., & Krahmer, E. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101151 · Cited by 178 · see citing works
Deutsch, M. B., & Buchholz, D. (2015) · Journal of General Internal Medicine · doi:10.1007/s11606-014-3148-7 · Cited by 171 · see citing works
Recent Advances in Large Language Models for Healthcare
Nassiri, K., & Akhloufi, M. A. (2024) · BioMedInformatics · doi:10.3390/biomedinformatics4020062 · Cited by 105 · see citing works
Natural language generation for electronic health records
Lee, S. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0070-0 · Cited by 88 · see citing works
Hwang, G.-J., Tang, K.-Y., & Tu, Y.-F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2022.2086579 · Cited by 87 · see citing works
A rapid review on current and potential uses of large language models in nursing
Hobensack, M., von Gerich, H., Vyas, P., Withall, J., Peltonen, L.-M., Block, L. J., Davies, S., Chan, R., Van Bulck, L., Cho, H., et al. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104753 · Cited by 80 · see citing works
Ramos-Soto, A., Bugarín, A., & Barro, S. (2015) · Fuzzy Sets and Systems · doi:10.1016/j.fss.2015.06.019 · Cited by 69 · see citing works
Liao, P.-H., Hsu, P.-T., Chu, W., & Chu, W. (2015) · Health Informatics Journal · doi:10.1177/1460458213509806 · Cited by 66 · see citing works
Implementation of Artifact Detection in Critical Care: A Methodological Review
Nizami, S., Green, J. R., & McGregor, C. (2013) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2013.2243724 · Cited by 52 · see citing works
Goldstein, A., & D, Y. S. M. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.03.022 · Cited by 46 · see citing works
Scott, D., Hallett, C., & Fettiplace, R. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.04.019 · Cited by 44 · see citing works
Artificial Intelligence in Critical Care
Mathur, P., & Burns, M. L. (2019) · International Anesthesiology Clinics · doi:10.1097/aia.0000000000000221 · Cited by 45 · see citing works
Marsili, N. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.12 · Cited by 39 · see citing works
Ando, K., Okumura, T., Komachi, M., Horiguchi, H., & Matsumoto, Y. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000158 · Cited by 36 · see citing works
Fallis, D. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.13 · Cited by 31 · see citing works
What is this article about? Generative summarization with the BERT model in the geosciences domain
Ma, K., Tian, M., Tan, Y., Xie, X., & Qiu, Q. (2021) · Earth Science Informatics · doi:10.1007/s12145-021-00695-2 · Cited by 32 · see citing works
Natural Language Generation Challenges for Explainable AI
Reiter, E. (2019) · doi:10.18653/v1/w19-8402 · Cited by 30 · see citing works
Potential uses of AI for perioperative nursing handoffs: a qualitative study
King, C. R., Shambe, A., & Abraham, J. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad015 · Cited by 27 · see citing works
“63 Our findings can also be related to work with dashboards intended to detect change in patient status which lack explicit AI predictions.”
BackgroundMethodInfluentialContemporary Approaches to the Philosophy of Lying
Mahon, J. E. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.3 · Cited by 26 · see citing works
Sensors talk and humans sense Towards a reciprocal collective awareness smart city framework
Vakali, A. I., Angelis, L., & Γιάτσογλου, Μ. (2013) · IEEE International Conference on Communications workshops · doi:10.1109/iccw.2013.6649226 · Cited by 26 · see citing works
Making Effective Use of Healthcare Data Using Data-to-Text Technology
Pauws, S. C., Albert Gatt, A., Krahmer, E., & Reiter, E. (2019) · Springer eBooks · doi:10.1007/978-3-030-05249-2_4 · Cited by 26 · see citing works
Maier, E. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.23 · Cited by 23 · see citing works
Stokke, A. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.20 · Cited by 23 · see citing works
Hwang, G., Chang, P.-Y., Tseng, W.-Y., Chou, C.-A., Wu, C.-H., & Tu, Y. (2022) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000897 · Cited by 22 · see citing works
Terkourafi, M. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.29 · Cited by 22 · see citing works
Dietz, S. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.22 · Cited by 22 · see citing works
A Framework for Automatic Text Generation of Trends in Physiological Time Series Data
Banaee, H., Ahmed, M. U., & Loutfi, A. (2013) · 2013 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2013.661 · Cited by 21 · see citing works
Patient Information Summarization in Clinical Settings: Scoping Review
Keszthelyi, D., Gaudet-Blavignac, C., Bjelogrlic, M., & Lovis, C. (2023) · JMIR Medical Informatics · doi:10.2196/44639 · Cited by 24 · see citing works
Stokke, A. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.10 · Cited by 20 · see citing works
Carson, T. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.001.0001 · Cited by 20 · see citing works
Gupta, S., & Ortony, A. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.11 · Cited by 19 · see citing works
Galasiński, D. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.41 · Cited by 19 · see citing works
Fuzzy sets across the natural language generation pipeline
Ramos-Soto, A., Bugarín, A., & Barro, S. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0097-x · Cited by 19 · see citing works
Benton, M. A. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.9 · Cited by 19 · see citing works
Evaluation of a Data-To-Text System for Verbalizing a Learning Analytics Dashboard
Ramos-Soto, A., Vázquez-Barreiros, B., Bugarín, A., Barujel, A. G., & Barro, S. (2016) · International Journal of Intelligent Systems · doi:10.1002/int.21835 · Cited by 18 · see citing works
Lying, Irony, and Default Interpretation
Giora, R. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.26 · Cited by 17 · see citing works
Dynel, M. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.25 · Cited by 17 · see citing works
Ganis, G. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.35 · Cited by 17 · see citing works
Samaras, C. V., Vakali, A. I., Γιάτσογλου, Μ., Chatzakou, D., & Angelis, L. (2013) · Panhellenic Conference on Informatics · doi:10.1145/2491845.2491887 · Cited by 16 · see citing works
Characterizing patient-friendly "micro-explanations"of medical events
Wilcox, L. G., Morris, D., Tan, D. S., Gatewood, J., & Horvitz, E. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978948 · Cited by 15 · see citing works
Effects of Individual Differences in Working Memory on Plan Presentational Choices
Tintarev, N., & Masthoff, J. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01793 · Cited by 14 · see citing works
Goldstein, A., D, Y. S. M., Orenbuch‐Harroch, E., & Cohen, M. J. (2017) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2017.09.001 · Cited by 14 · see citing works
Textual summarization of events leading to health alerts
Jain, A., & Keller, J. M. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7320160 · Cited by 13 · see citing works
Égré, P., & Icard, B. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.27 · Cited by 13 · see citing works
Towards NLG for Physiological Data Monitoring with Body Area Networks
Banaee, H., Ahmed, M. U., & Loutfi, A. (2013) · Cited by 12 · see citing works
Green, S. P. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.38 · Cited by 11 · see citing works
Albert Gatt, A., & Portet, F. (2015) · Fuzzy Sets and Systems · doi:10.1016/j.fss.2015.07.018 · Cited by 11 · see citing works
Building a Persuasive Virtual Dietitian
Luca Anselma, A., & Mazzei, A. (2020) · Informatics · doi:10.3390/informatics7030027 · Cited by 10 · see citing works
Gu, Y., Li, R., Wang, X., & Zhou, Z. (2023) · Bioengineering · doi:10.3390/bioengineering10080966 · Cited by 10 · see citing works
Lying, Implicating, and Presupposing
Meibauer, J. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.14 · Cited by 10 · see citing works
MIME : NLG in pre-hospital care
Schneider, A. H., Mort, A. J., Mellish, C., Reiter, E., Wilson, P., Vaudry, P.-L., & Montréal, U. D. (2013) · Aberdeen University Research Archive (Aberdeen University) · Cited by 9 · see citing works
A Study on Automatic Generation of Chinese Discharge Summary
Xiong, Y., Tang, B., Chen, Q., Wang, X., & Yan, J. (2019) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983293 · Cited by 9 · see citing works
Nursing clinical handover in neonatal care
Brown, J. A., & Sims, S. (2014) · Contemporary Nurse · doi:10.1080/10376178.2014.11081953 · Cited by 9 · see citing works
Lying and Deception in Politics
Robinson, P., Miller, D., Herring, E., & Bakir, V. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.42 · Cited by 9 · see citing works
Lying and Computational Linguistics
van Deemter, K., & Reiter, E. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.32 · Cited by 8 · see citing works
Trummer, I., Zhu, J., & Bryan, M. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137628.3137663 · Cited by 8 · see citing works
Meibauer, J. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.19 · Cited by 7 · see citing works
Ando, K., Okumura, T., Komachi, M., Horiguchi, H., & Matsumoto, Y. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000099 · Cited by 7 · see citing works
Lackey, J. A. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.18 · Cited by 6 · see citing works
Beier, K. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.15 · Cited by 6 · see citing works
Data Vocalization with CiceroDB.
Trummer, I. (2019) · Conference on Innovative Data Systems Research · Cited by 5 · see citing works
Classic Philosophical Approaches to Lying and Deception
Mahon, J. E. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.2 · Cited by 5 · see citing works
Development of Lying and Cognitive Abilities
Talwar, V. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.30 · Cited by 5 · see citing works
TBI-Doc: Generating Patient and Clinician Reports from Brain Imaging Data
Jordan, P., Green, N., Thomas, C., & Holm, S. L. (2014) · International Conference on Natural Language Generation · doi:10.3115/v1/w14-4423 · Cited by 5 · see citing works
Linguistic Approaches to Lying and Deception
Hardin, K. J. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.4 · Cited by 4 · see citing works
Jary, M. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.8 · Cited by 4 · see citing works
Personality-dependent content selection in natural language generation systems
Ramos, R. M. S., Monteiro, D. S., & Paraboni, I. (2020) · Journal of the Brazilian Computer Society · doi:10.1186/s13173-020-00096-1 · Cited by 4 · see citing works
Commentary generation for financial markets
Zhu, D., Lappas, T., & Rachidi, T. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118364 · Cited by 4 · see citing works
Deep Multi-Objective Learning from Low-Dose CT for Automatic Lung-RADS Report Generation
Chang, Y., Hsing, Y.-C., Chiu, Y.-W., Shih, C.-C., Lin, J.-H., Hsiao, S.-H., Sakai, K., Ko, K., & Chen, C. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12030417 · Cited by 4 · see citing works
Vocalizing large time series efficiently
Trummer, I., Bryan, M., & Narasimha, R. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3236187.3236206 · Cited by 4 · see citing works
Narrative Generation from Extracted Associations
Vaudry, P.-L., & Lapalme, G. (2015) · European Workshop on Natural Language Generation (ENLG) · doi:10.18653/v1/w15-4724 · Cited by 3 · see citing works
MIME- NLG Support for Complex and Unstable Pre-hospital Emergencies
Schneider, A. H., Mort, A. J., Mellish, C., Reiter, E., Wilson, P., & Vaudry, P.-L. (2013) · Aberdeen University Research Archive (Aberdeen University) · Cited by 3 · see citing works
Machine learning model for temporal pattern recognition
Inibhunu, C., & McGregor, C. (2016) · IEEE EMBS International Student Conference · doi:10.1109/embsisc.2016.7508614 · Cited by 3 · see citing works
Lying, Testimony, and Epistemic Vigilance
Michaelson, E. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.16 · Cited by 3 · see citing works
Nishimura, F. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.45 · Cited by 3 · see citing works
Understanding the Challenges Nurses Encounter with Monitoring Technologies in a NICU
Venkatasubramanian, K., Ranalli, T.-M., Kirupaharan, P., Solanki, D., & Mankodiya, K. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2278297 · Cited by 3 · see citing works
Using Conceptual Spaces to Model Domain Knowledge in Data-to-Text Systems
Banaee, H., & Loutfi, A. (2014) · International Conference on Natural Language Generation · doi:10.18653/v1/w14-4403 · Cited by 3 · see citing works
Lying, Metaphor, and Hyperbole
Claridge, C. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.28 · Cited by 2 · see citing works
Mann, S. A. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.31 · Cited by 2 · see citing works
Kümmerling‐Meibauer, B. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.44 · Cited by 2 · see citing works
A framework for generating anomaly analysis comments in DHI interpretation report
Han, X., Gao, M., Shen, W., Liu, H., Dai, B., He, Y., & Liu, H. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108331 · Cited by 2 · see citing works
Psycholinguistic Approaches to Lying and Deception
Bott, L. A., & Williams, E. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.5 · Cited by 2 · see citing works
McGlone, M. S., & Baryshevtsev, M. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.24 · Cited by 2 · see citing works
Serra-García, M. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.39 · Cited by 2 · see citing works
DePaulo, B. M. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.33 · Cited by 2 · see citing works
Lying, Deception, and the Brain
Decker, A., Disney, A., D’elia, B., & Keenan, J. P. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.6 · Cited by 1 · see citing works
Reiter, E. (2024) · Natural Language Generation · doi:10.1007/978-3-031-68582-8_2 · Cited by 1 · see citing works
Generative AI in health sciences education and practice. Part 3: supporting written communication
Reimers, S. J. (2026) · British Journal of Cardiac Nursing · doi:10.12968/bjca.2026.0024 · Cited by 1 · see citing works
Inglis, S. (2015) · European Workshop on Natural Language Generation (ENLG) · doi:10.18653/v1/w15-4716 · Cited by 1 · see citing works
Automatic Reports from Spreadsheets: Data Analysis for the Rest of Us
Duboue, P. A. (2016) · International Conference on Natural Language Generation · doi:10.18653/v1/w16-6641 · Cited by 1 · see citing works
Wright, S. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.7 · Cited by 1 · see citing works
Staffel, J. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.17 · Cited by 1 · see citing works
Fuzzy-Based Language Grounding of Geographical References: From Writers to Readers
Ramos, A., Alonso, J. M., Reiter, E., van Deemter, K., & Albert Gatt, A. (2019) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.d.190826.002 · Cited by 1 · see citing works
Carson, T. L. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198736578.013.36 · Cited by 1 · see citing works
- Authors
- Hunter, J., Freer, Y., Gatt, A., Reiter, E., Sripada, S., & Sykes, C.
- Affiliations
- University of Aberdeen (GB)
- Venue
- Artificial Intelligence in Medicine
- Publisher
- Elsevier BV
- Published
- 2012-11
- Volume
- 56
- Issue
- 3
- Pages
- 157-172
- ISSN
- 0933-3657 (ISSN-L)
- OpenAlex
- W2154568233
- Cited by
- 127
- References
- 92
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 6 · 2023: 5 · 2022: 7 · 2021: 3 · 2020: 5 · 2019: 7 · 2018: 53 · 2017: 3 · 2016: 10 · 2015: 10 · 2014: 4 · 2013: 10
- FWCI
- 38.93
- Type
- journal article
- Language
- en
- Open access
- green
- www.um.edu.mt
- Licence
- Locations
- Artificial Intelligence in Medicine (publishedVersion)
- PubMed (publishedVersion)
- OAR@UM (University of Malta) (submittedVersion, other-oa)
- Funders
- Engineering and Physical Sciences Research Council (EP/D049520/1, EP/D05057X/1)
- Topics
- Health Sciences › Nursing › Issues, ethics and legal aspects › Nursing Diagnosis and Documentation
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- text generation, neonatal intensive care, electronic health records, clinical information systems, nursing documentation
- MeSH terms
- Communication, Humans, Information Systems, Intensive Care Units, Neonatal, Natural Language Processing, Nursing Staff, Hospital, Electronic Health Records, Patient Handoff
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review