Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index; 13 of the 37 sources its claims cite were checked for support.
Abstract
BACKGROUND: Rapid advances in healthcare technologies and hospital informatization have prompted the need for enhanced nursing informatics literacy among undergraduate nursing students. Traditional nursing curricula often lack authentic, design-oriented learning experiences that integrate nursing, computer science, and information technology. AIM: This four-year participatory action research study aimed to explore the effectiveness of a Design-Based Learning (DBL) approach in improving undergraduate nursing students' informatics literacies within a "Nursing Informatics" course. METHODS: This study adopted a participatory action research design with a convergent mixed-methods approach. From 2020 to 2024, a total of 622 undergraduate nursing students at a comprehensive university in China were recruited through total population sampling from an iterative, DBL-enhanced "Nursing Informatics" course. Students tackled real-world clinical informatics problems through iterative cycles of investigation, design, and redesign. Pre- and post-course informatics literacy scores were measured using a validated 28-item, 5-point Likert scale questionnaire (total score range: 28-140). Paired t-tests and Bayesian modeling assessed improvements over time, while focus group interviews provided qualitative insights into students' learning experiences. RESULTS: Across all four cohorts, informatics literacy scores improved significantly (p < 0.001). The 2018 cohort's mean score increased from 73.13 ± 13.38 to 86.55 ± 12.21 (Cohen's d = 2.21), and by 2021 cohort, scores rose from 73.17 ± 15.15 to 92.47 ± 12.07 (Cohen's d = 3.07). Bayesian analysis confirmed that yearly improvements were credible, with posterior intervals excluding zero. Qualitative themes revealed enhanced interdisciplinary thinking, informatics skill mastery, stronger professional identity, and improved teamwork capabilities, suggesting that the observed quantitative gains represented meaningful, transformative learning experiences. CONCLUSIONS: Implementing a DBL approach within the "Nursing Informatics" curriculum significantly enhanced undergraduate nursing students' informatics literacy and fostered deeper engagement, critical thinking, and interdisciplinary collaboration. These findings underscore the value of authentic, design-oriented instructional strategies in preparing future nurses for increasingly informatics-driven clinical environments. Further research is recommended to compare DBL with alternative pedagogical models and assess long-term impacts on professional practice. CLINICAL TRIAL NUMBER: Not applicable. This study did not involve a clinical trial.
Overview
CoChat Summary
TL;DR
This four-year participatory action research study integrated Design-Based Learning (DBL) into an undergraduate “Nursing Informatics” course and evaluated its impact on informatics literacy. Across four cohorts, pre–post scores improved significantly, with qualitative themes indicating gains in interdisciplinary thinking, skill mastery, professional identity, and teamwork.
Key findings
- Informatics literacy improved significantly in every cohort (p < 0.001). The 2018 cohort rose from 73.13 ± 13.38 to 86.55 ± 12.21 (Cohen’s d = 2.21); the 2021 cohort rose from 73.17 ± 15.15 to 92.47 ± 12.07 (Cohen’s d = 3.07).
- Bayesian modeling showed positive yearly improvements with 94% HDIs excluding zero: posterior mean improvement 0.478 (94% HDI 0.440–0.514) in 2018, 0.626 (0.579–0.670) in 2019, 0.620 (0.580–0.660) in 2020, and 0.689 (0.650–0.722) in 2021.
- Focus group analysis yielded four themes: interdisciplinary thinking; integration of theory and practice through informatics skill mastery; professional identity development; and teamwork and leadership.
- The authors conclude that DBL enhanced informatics literacy and fostered deeper engagement, critical thinking, and interdisciplinary collaboration.
Methods
- Participatory action research using a “Plan-Act-Observe-Reflect” framework, with a convergent mixed-methods design across four iterative cycles from 2020 to 2024, preceded by a six-month preparatory phase.
- A total of 622 undergraduate nursing students at one comprehensive university in China were included through total population sampling; participants were 510 women (81.99%) and 112 men (18.01%), mean age 20.43 ± 0.61 years. Twenty-two stakeholders also participated.
- Informatics literacy was measured pre- and post-course with the validated 28-item, 5-point Likert SANICS (total score range 28–140; Chinese version Cronbach’s α = 0.93, test-retest r = 0.88). Paired t-tests, Cohen’s d, and Bayesian modeling with 94% HDIs were used; focus groups after the fourth round included 10 students and 6 educators and were analyzed with qualitative content analysis.
Limitations
- The paper states that the study was conducted at a single institution, potentially limiting generalizability; it lacked a control group receiving traditional instruction, making it difficult to attribute all improvements solely to DBL; and COVID-19 may have influenced learning conditions and student experiences across cohorts.
- The text makes evident that informatics literacy was measured by self-assessment/perceived competency rather than objective performance, and focus groups were conducted only after the fourth cycle, limiting qualitative comparison across cycles.
- The paper recommends future multi-site designs, comparison groups, and longitudinal follow-up, indicating that long-term retention and practice impacts were not assessed here.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
8 Valid · 4 Not valid · 14 Not checked · 74 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“However, these methods are typically limited to predefined scenarios that lack the complexity of authentic, real-world informatics challenges.”
§ Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study > Background
What the sources say
- Could not verifycites [12] Johnsen HM, et al. Teaching clinical reasoning and decision-making skills to nursing students: Design, development, and usability evaluation of a serious game. Int J Med Informatics. 2016;94:39–48. https://doi.org/10.1016/j.ijmedinf.2016.06.014. sourceExperimental — accuracy not yet measured
Section 3.4 reports that participants found this serious game's scenario realistic and its tasks adequately complex; Section 4.1 likewise describes it as clinically relevant. Neither passage assesses whether problem-based learning, simulations, and serious games are typically limited to predefined scenarios or fail to capture real-world informatics challenges. (LLM, conf=0.74)
- Not checked — no full text of the sourcecites [13] Chiang VC, Chan SS. An evaluation of advanced simulation in nursing: a mixed-method study. Collegian. Elsevier. 2014;21(4):257–65. https://doi.org/10.1016/j.colegn.2013.05.003. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Design-Based Learning (DBL) offers a pedagogical framework that directly addresses these limitations through its iterative cycles of design, testing, and reflection around authentic problems [14, 15].”
§ Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study > Background
What the sources say
- Not checked — no full text of the sourcecites [14] Phillips JM, Resnick J, Boni MS, Bradley P, Grady JL, Ruland JP, Stuever NL. Voices of innovation: Building a model for curriculum transformation. Int J Nurs Educ Scholarsh. 2013. https://doi.org/10.1515/ijnes-2012-0008. source
- Could not verifycites [15] Ghasemi MR, Moonaghi HK, Heydari A. Strategies for sustaining and enhancing nursing students’ engagement in academic and clinical settings: a narrative review. Korean J Med Educ. 2020;32(2):103–17. https://doi.org/10.3946/kjme.2020.159. sourceExperimental — accuracy not yet measured
The Results sections on collaborative strategies discuss team-based and service-based learning, but do not address Design-Based Learning. Searches for “Design-Based Learning” and its claimed iterative cycles found no passage describing DBL, design, testing, and reflection around authentic problems. Page numbers were not available in our copy. (LLM, conf=0.76)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Recent systematic reviews demonstrate that many undergraduate nursing students exhibit inadequate information literacy levels, potentially compromising their preparedness for clinical practice in digital healthcare settings [4, 5].”
§ Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study > Background
What the sources say
- Not checked — no full text of the sourcecites [4] Nes AA, et al. Technological literacy in nursing education: A scoping review. J Prof Nursing: Official J Am Association Colleges Nurs. 2021;37(2):320–34. https://doi.org/10.1016/j.profnurs.2021.01.008. source
- Could not verifycites [5] Saban M, et al. A comparative vignette study: evaluating the potential role of a generative AI model in enhancing clinical decision-making in nursing. J Adv Nurs. 2024. https://doi.org/10.1111/jan.16101. sourceExperimental — accuracy not yet measured
The Introduction reports deficiencies in clinical decision-making among novice nurses and new graduates, not inadequate information literacy among undergraduate students. The Methods describe a vignette study assessing clinical decision-making, rather than a systematic review. Searches for information literacy and preparedness in digital healthcare settings found no passage addressing the claim. (LLM, conf=0.76)
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Compared to traditional lecture-based approaches, DBL provided a dynamic, iterative framework that fostered deeper engagement and critical thinking [33, 34].”
§ Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study > Discussion > Educational trasformation through DBL
What the sources say
- Not checked — no full text of the sourcecites [33] Shin I, et al. The effect of problem-based learning in nursing education: a meta-analysis. Adv Health Sci Educ. 2013;18:1103–20. https://doi.org/10.1007/s10459-012-9436-2. source
- Supportedcites [34] Xugang, Zhang, et al. Application of Design-Based learning and Outcome-Based education in basic industrial engineering teaching: A new teaching method. Sustainability. 2021. https://doi.org/10.3390/SU13052632. source
The Introduction describes DBL as an iterative cycle distinct from traditional teaching and links it to higher-level critical thinking. The Results report more active participation and teacher–student interaction in the experimental class than in the control class, supporting the engagement comparison. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students struggled to integrate their nursing knowledge with informatics skills, producing projects that focused narrowly on technical functions without considering nursing workflows.”
§ Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study > Methods > Study design
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
45 more claims
Create a free account to see all 100 claims and to verify the 3 references still open.
- It may state two separate claims as one. 35
- Probably not a substantial claim. 26
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study > Methods > Study design
“Beginning in September 2020, four consecutive PAR cycles were launched to implement, evaluate, and continuously optimize the DBL strategy.”
§ Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study > Methods > Study design
“First Cycle (Feb 2021 - Jun 2021):Initial DBL Implementation”
Citations
Cites
The Action Research Planner: Doing Critical Participatory Action Research
Kemmis, S., McTaggart, R., & Nixon, R. (2014) · doi:10.1007/978-981-4560-67-2 · Cited by 4,207
Methodological challenges in qualitative content analysis: A discussion paper
Graneheim, U. H., Lindgren, B.-M., & Lundman, B. (2017) · Nurse Education Today · doi:10.1016/j.nedt.2017.06.002 · Cited by 3,195 · cited 1×
“Qualitative content analysis [27] guided the data analysis, and coding was performed using Python QualCoder software [28].”
Metrics for evaluating performance and uncertainty of Bayesian network models
Marcot, B. G. (2012) · Ecological Modelling · doi:10.1016/j.ecolmodel.2012.01.013 · Cited by 380 · cited 1×
“Bayesian modeling was used to estimate the posterior distributions of the mean differences (post minus pre) and assess the credibility of observed improvements, with 94% High-Density Intervals (HDIs) used to represent uncertainty [29, 30].”
Artificial intelligence in nursing and midwifery: A systematic review
O'Connor, S., Yan, Y., Thilo, F. J. S., Felzmann, H., Dowding, D., & Lee, J. J. (2023) · Journal of Clinical Nursing · doi:10.1111/jocn.16478 · Cited by 351 · cited 5×
“Teachers saw this as a critical step: “ What impressed me most was watching students apply theoretical frameworks like workflow optimization to develop prototypes for real clinical scenarios ,” Nursing Informatics Teacher 3 remarked.”
InfluentialMixed Methods Research for Nursing and the Health Sciences
(2009) · Wiley eBooks · doi:10.1002/9781444316490 · Cited by 316
Gholami, M., Moghadam, P. K., Mohammadipoor, F., Tarahi, M. J., Sak, M., Toulabi, T., & Pour, A. H. H. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2016.06.007 · Cited by 200 · cited 1×
“This finding aligns with previous studies demonstrating that authentic, learner-centered strategies enhance literacies and professional readiness [36, 37].”
Technological literacy in nursing education: A scoping review
Nes, A. A. G., Steindal, S. A., Larsen, M. H., Heer, H. C., Lærum-Onsager, E., & Gjevjon, E. R. (2021) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2021.01.008 · Cited by 182
The effect of problem-based learning in nursing education: a meta-analysis
Shin, I.-S., & Kim, J.-H. (2013) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9436-2 · Cited by 149 · cited 1×
“Compared to traditional lecture-based approaches, DBL provided a dynamic, iterative framework that fostered deeper engagement and critical thinking [33, 34].”
Johnsen, H. M., Fossum, M., Vivekananda-Schmidt, P., Fruhling, A., & Slettebø, Å. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.06.014 · Cited by 141 · cited 1×
“Current educational approaches, including problem-based learning, simulations, and serious games, have shown promise in enhancing clinical reasoning and procedural skills [12, 13].”
Reflective practice in nursing: A concept analysis
Patel, K. M., & Metersky, K. (2022) · International Journal of Nursing Knowledge · doi:10.1111/2047-3095.12350 · Cited by 127 · cited 1×
“This study employed a participatory action research (PAR) approach following the “Plan-Act-Observe-Reflect” framework to systematically design, implement, and refine a Design-Based Learning (DBL) strategy within a nursing informatics course [22].”
Research works printed but not linked: 1
- Kolodner JL. Facilitating the learning of design practices: lessons learned from an Inquiry into science education. National Association of Industrial and Technical Teacher Educators. J Indust Teach Educ. 2002;39(3):9–40. http://scholar.lib.vt.edu/ejournals/JITE/.
Cited by
Curasma, R. P., Sapallanay-Gomez, N. N., Yarasca, U. C., Acra-Despradel, C., & Ponce-Aranibar, M. D. P. (2026) · Education Sciences · doi:10.3390/educsci16060929 · Cited by 1
Nursing Informatics and Undergraduate Nursing Curricula: A Scoping Review
Reid, L., Button, D., Breaden, K., & Brommeyer, M. (2026) · Nursing Reports · doi:10.3390/nursrep16020042 · Cited by 2
“…later, recognition of the context specific applications of nursing informatics, that exist across a range of clinical settings, requires a nuanced approach, which can “more effectively bridge the gap between educational preparation and practice requirements in nursing informatics [144] (p. 2).”
InfluentialRen, Y., & Li, C. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1867526
Li, G., JIANG, J., Ma, Y., et al. (2026) · Nurse Education Today · doi:10.1016/j.nedt.2026.107388
Muehlbauer, M. K., Colander, S., Husson, N. M., Morouse, K., & Forman, T. M. (2026) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2026.08.020
Metadata
- Authors
- Shen, M., Feng, Z., Shen, Y., & Shi, Z.
- Affiliations
- Zhejiang Shuren University (CN)
- Corresponding author
- Shen, Mingyan
- Feng, Zhixian
- Shen, Yanping
- Shi, Zuxin
- Venue
- BMC Nursing
- Published
- 2025-10-14
- Volume
- 24
- Issue
- 1
- Pages
- 1268-1268
- ISSN
- 1472-6955 (ISSN-L)
- PMC
- PMC12523023
- OpenAlex
- W4415151316
- Semantic Scholar
- 019e7061129e553ef3a2a41780703aa1b5da6a19
- Cited by
- 12
- References
- 42
- Citations by year
- 2026: 12
- FWCI
- 12.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- creativecommons.org/licenses/by-nc-nd/4.0 (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0 (vor)
- Locations
- BMC Nursing (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Department of Education of Zhejiang Province (JGBA2024419)
- Zhejiang Shuren University (yk 202401)
- 2023 University-Level Blended First-Class Course Construction Project of Zhejiang Shuren University
- Topics
- Social Sciences › Education › Digital literacy in education
- Social Sciences › Library and Information Sciences › Library Science and Information Literacy
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- design-based learning, undergraduate nursing education, interdisciplinary learning, professional identity, teamwork skills, critical thinking, hospital informatization, student learning experience
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study. https://app.cochat.ai/papers/10.1186/s12912-025-03927-8
- The paper
- Shen, M., Feng, Z., Shen, Y., & Shi, Z. (2025). Enhancing undergraduate nursing informatics literacy through design-based learning: a mixed-methods participatory action research study. BMC Nursing. https://doi.org/10.1186/s12912-025-03927-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.