CoChat

Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study

Open access

The DOI matches its Crossref record; 26 of the 29 references it cites were found in a registry or an index; 3 of the 21 sources its claims cite were checked for support.

Abstract

OBJECTIVE: This study explores the effectiveness of a comprehensive licensure review and adaptive quizzing assignments intervention in improving the performance of undergraduate senior nursing students on the end-of-programme exit exam. DESIGN: A quasi-experimental single-group design was used to compare pretest and post-test scores through computerised adaptive tests. SETTING: The setting was a nursing college in Saudi Arabia. PARTICIPANTS: The study included 292 senior nursing students enrolled in the Bachelor of Science in Nursing programme. INTERVENTION: A comprehensive licensure review bundled with adaptive quizzing assignments was delivered over 15 weeks in the academic year 2021-2022. The bundle was guided by the elaboration theory, and it included 3-hour synchronous lectures every week and 23 adaptive quizzing assignments that covered weekly content. PRIMARY AND SECONDARY OUTCOME MEASURES: Students' mastery scores and the percentage of correct answers were the primary and secondary measures, respectively. Both measures were collected in the pretest and post-test (exit examination). Additionally, demographic characteristics were collected in the pre-test using an online survey. RESULTS: The overall mean of the mastery score was statistically significantly higher in the exit exam (M=2.51, SD=1.70) than in the pretest (M=1.45, SD=0.44; p<0.001). Although the overall mean of the mastery score in the exit exam did not reach the cut-off score, students who demonstrated the required knowledge and satisfactory performance in the pretest achieved a mastery score above the cut-off. The percentage of correct answers was statistically significantly higher in the exit exam (M=58.59%, SD=9.50) than in the pretest (M=49.32%, SD=9.78; p<0.001). A statistically significant difference in students' performance based on gender, age and grade point average was observed. CONCLUSIONS: A comprehensive licensure review and adaptive quizzing assignments intervention bundle fostered the performance of undergraduate nursing students in the end-of-programme exit exam.

Overview

CoChat Summary

TL;DR

A 15-week comprehensive licensure review plus adaptive quizzing bundle was associated with improved end-of-programme exit exam performance among senior nursing students in Saudi Arabia. Mastery scores and percentage of correct answers increased significantly from pretest to post-test, though the overall post-test mastery score remained below the NCLEX-RN pass cut-off.

Key findings

  • Overall mean mastery score increased significantly from 1.45 (SD=0.44) at pretest to 2.51 (SD=1.70) at post-test (t(286)=11.24, p<0.001, d=0.66).
  • Mean percentage of correct answers increased significantly from 49.32% (SD=9.78) to 58.59% (SD=9.50) (t(286)=15.76, p<0.001, d=0.93).
  • The post-test mastery score did not reach the minimum 4-point score required to pass the NCLEX-RN; however, students in Group 2, who performed better at pretest, reached a post-test mastery score of 4.35 (SD=1.73) and 67.78% (SD=5.60) correct answers.
  • Female students had significantly higher mastery scores and correct-answer percentages than male students; GPA had moderate positive correlations with pretest and post-test performance, while age had weak negative correlations.

Methods

  • Quasi-experimental single-group pretest–post-test design; 292 senior BSN students were recruited from one nursing college at a public university in Saudi Arabia, with 287 included in analysis after 5 students did not complete the intervention.
  • The 15-week intervention included weekly 3-hour synchronous lectures and 23 adaptive quizzing assignments, guided by elaboration theory and designed around NCLEX-RN and SNLE blueprints.
  • Computerised adaptive tests of 75 questions over 2 hours were administered at week 1 (pretest) and week 15 (exit exam); paired sample t-tests, independent sample t-tests, and Pearson correlations were used, with significance set at p<0.05.

Limitations

  • Stated: the study lacked a control group, which may have affected internal validity, and participants were recruited from only one university, limiting generalisability.
  • Evident from the text: the single-group pretest–post-test design cannot rule out testing, maturation, or secular effects, and the overall post-test mastery mean remained below the 4-point NCLEX-RN pass cut-off despite significant improvement.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2023-074469

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

2 Valid · 1 Not valid · 14 Not checked · 40 Own results and interpretations

21 more claims

Create a free account to see all 57 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 21
  • It may state two separate claims as one. 14

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentt(286) = 11.24reported p < .001 · recomputed p < .001

    “t(286) = 11.24, p < .001”

  • Consistentt(286) = 15.76reported p < .001 · recomputed p < .001

    “t(286) = 15.76, p < .001”

  • Consistentt(78) = 5.97reported p < .001 · recomputed p < .001

    “t(78) = 5.97, p < .001”

  • Consistentt(98) = 14.77reported p < .001 · recomputed p < .001

    “t(98) = 14.77, p < .001”

  • Consistentt(98) = 12.67reported p < .001 · recomputed p < .001

    “t(98) = 12.67, p < .001”

5 of 7 · the rest aren’t loaded

2 more recomputed tests

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 26 references

Research works printed but not linked: 3

  1. Atemafac J . Consequences for nursing graduates of failing the National Council Licensure examination (NCLEX) [Dissertation on the Internet]. Minnesota: Walden University. 2014. Available: https://www.proquest.com/openview/6ff1ca5275c5a6e89b24bb8fa9807f7e/1?pq-origsite=gscholar&cbl=18750
  2. Phelan JC . An investigation of student use of Passpoint and NCLEX-RN® outcomes. 2021. Available: https://download.lww.com/efficacy/WP_PassPoint.pdf
  3. Monroe HE . Determining readiness to take the National Council Licensure examination for registered nurses® [Dissertation on the Internet]. Colorado: University of northern Colorado. 2019. Available: http://www.proquest.com/docview/2302691385/abstract/D233A270344E43F1PQ/2

Cited by

See all 6

Metadata

Authors
Almotairy, M. M., Innab, A., Alqahtani, N., Nahari, A., Alghamdi, R., Moafa, H., & Alshael, D.
Affiliations
King Saud University (SA)
Corresponding author
Almotairy, Monir M
Venue
BMJ Open
Publisher
BMJ
Published
2023-07
Volume
13
Issue
7
Pages
e074469
ISSN
2044-6055 (ISSN-L)
OpenAlex
W4384071434
Cited by
6
References
29
Citations by year
2026: 1 · 2025: 2 · 2024: 3
FWCI
1.53
Type
journal article
Language
en
Open access
Locations
  • BMJ Open (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • HighWire Press Open Archive (submittedVersion)
Funders
The Deputyship for Research and Innovation, Ministry of Education in Saudi Arabia (IFKSUOR3–091–3)
Topics
  • Social Sciences › Education › Innovations in Medical Education
  • Health Sciences › Nursing › Leadership and Management › Healthcare Education and Workforce Issues
  • Social Sciences › Education › Educational Assessment and Pedagogy
Keywords
computerized adaptive testing, nursing students, nursing education, elaboration theory, exam performance, Saudi Arabia
MeSH terms
Education, Nursing, Baccalaureate, Humans, Licensure, Saudi Arabia, Students, Nursing, Knowledge

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study. https://app.cochat.ai/papers/10.1136/bmjopen-2023-074469
The paper
Almotairy, M. M., Innab, A., Alqahtani, N., Nahari, A., Alghamdi, R., Moafa, H., & Alshael, D. (2023). Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study. BMJ Open. https://doi.org/10.1136/bmjopen-2023-074469

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.