Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study
Open accessThe DOI matches its Crossref record; 26 of the 29 references it cites were found in a registry or an index; 3 of the 21 sources its claims cite were checked for support.
Abstract
OBJECTIVE: This study explores the effectiveness of a comprehensive licensure review and adaptive quizzing assignments intervention in improving the performance of undergraduate senior nursing students on the end-of-programme exit exam. DESIGN: A quasi-experimental single-group design was used to compare pretest and post-test scores through computerised adaptive tests. SETTING: The setting was a nursing college in Saudi Arabia. PARTICIPANTS: The study included 292 senior nursing students enrolled in the Bachelor of Science in Nursing programme. INTERVENTION: A comprehensive licensure review bundled with adaptive quizzing assignments was delivered over 15 weeks in the academic year 2021-2022. The bundle was guided by the elaboration theory, and it included 3-hour synchronous lectures every week and 23 adaptive quizzing assignments that covered weekly content. PRIMARY AND SECONDARY OUTCOME MEASURES: Students' mastery scores and the percentage of correct answers were the primary and secondary measures, respectively. Both measures were collected in the pretest and post-test (exit examination). Additionally, demographic characteristics were collected in the pre-test using an online survey. RESULTS: The overall mean of the mastery score was statistically significantly higher in the exit exam (M=2.51, SD=1.70) than in the pretest (M=1.45, SD=0.44; p<0.001). Although the overall mean of the mastery score in the exit exam did not reach the cut-off score, students who demonstrated the required knowledge and satisfactory performance in the pretest achieved a mastery score above the cut-off. The percentage of correct answers was statistically significantly higher in the exit exam (M=58.59%, SD=9.50) than in the pretest (M=49.32%, SD=9.78; p<0.001). A statistically significant difference in students' performance based on gender, age and grade point average was observed. CONCLUSIONS: A comprehensive licensure review and adaptive quizzing assignments intervention bundle fostered the performance of undergraduate nursing students in the end-of-programme exit exam.
Overview
CoChat Summary
TL;DR
A 15-week comprehensive licensure review plus adaptive quizzing bundle was associated with improved end-of-programme exit exam performance among senior nursing students in Saudi Arabia. Mastery scores and percentage of correct answers increased significantly from pretest to post-test, though the overall post-test mastery score remained below the NCLEX-RN pass cut-off.
Key findings
- Overall mean mastery score increased significantly from 1.45 (SD=0.44) at pretest to 2.51 (SD=1.70) at post-test (t(286)=11.24, p<0.001, d=0.66).
- Mean percentage of correct answers increased significantly from 49.32% (SD=9.78) to 58.59% (SD=9.50) (t(286)=15.76, p<0.001, d=0.93).
- The post-test mastery score did not reach the minimum 4-point score required to pass the NCLEX-RN; however, students in Group 2, who performed better at pretest, reached a post-test mastery score of 4.35 (SD=1.73) and 67.78% (SD=5.60) correct answers.
- Female students had significantly higher mastery scores and correct-answer percentages than male students; GPA had moderate positive correlations with pretest and post-test performance, while age had weak negative correlations.
Methods
- Quasi-experimental single-group pretest–post-test design; 292 senior BSN students were recruited from one nursing college at a public university in Saudi Arabia, with 287 included in analysis after 5 students did not complete the intervention.
- The 15-week intervention included weekly 3-hour synchronous lectures and 23 adaptive quizzing assignments, guided by elaboration theory and designed around NCLEX-RN and SNLE blueprints.
- Computerised adaptive tests of 75 questions over 2 hours were administered at week 1 (pretest) and week 15 (exit exam); paired sample t-tests, independent sample t-tests, and Pearson correlations were used, with significance set at p<0.05.
Limitations
- Stated: the study lacked a control group, which may have affected internal validity, and participants were recruited from only one university, limiting generalisability.
- Evident from the text: the single-group pretest–post-test design cannot rule out testing, maturation, or secular effects, and the overall post-test mastery mean remained below the 4-point NCLEX-RN pass cut-off despite significant improvement.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 1 Not valid · 14 Not checked · 40 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although the post-test mastery score was found to be satisfactory during the analysis, it did not meet the minimum 4-point score required to pass the NCLEX-RN exam.”
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The overall mean of the mastery score was statistically significantly higher in the exit exam (M=2.51, SD=1.70) than in the pretest (M=1.45, SD=0.44; p<0.001).”
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A statistically significant difference in students’ performance based on gender, age and grade point average was observed.”
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Abstract > Results
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The percentage of correct answers was statistically significantly higher in the exit exam (M=58.59%, SD=9.50) than in the pretest (M=49.32%, SD=9.78; p<0.001).”
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although the overall mean of the mastery score in the exit exam did not reach the cut-off score, students who demonstrated the required knowledge and satisfactory performance in the pretest achieved a mastery score above the cut-off.”
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Abstract > Results
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
21 more claims
Create a free account to see all 57 claims and every source verdict.
- Probably not a substantial claim. 21
- It may state two separate claims as one. 14
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(286) = 11.24reported p < .001 · recomputed p < .001
“t(286) = 11.24, p < .001”
- Consistentt(286) = 15.76reported p < .001 · recomputed p < .001
“t(286) = 15.76, p < .001”
- Consistentt(78) = 5.97reported p < .001 · recomputed p < .001
“t(78) = 5.97, p < .001”
- Consistentt(98) = 14.77reported p < .001 · recomputed p < .001
“t(98) = 14.77, p < .001”
- Consistentt(98) = 12.67reported p < .001 · recomputed p < .001
“t(98) = 12.67, p < .001”
2 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Results
“| Mastery score | 79 | 1.20 (0.16) | 1.24 (0.11) | 1.81 | 0.08 | 0.003 | 0.06 |”
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Results
“the mastery score of students in Group 1 did not increase significantly from the pretest to the post-test (p=0.08).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Methods > Study measures
“The mastery score was rated on an 8-point scale ranging from 1 (easiest) to 2 (most difficult) in the online adaptive testing system. A minimum score of 4 was required to pass the NCLEX-RN exam.”
§ Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study > Results
“The mastery score was rated on an 8-point scale ranging from 1 (easiest) to 8 (most difficult) in the online adaptive testing system.”
Citations
Cites
Instructional Design Theories and Models
(1983) · doi:10.4324/9780203824283 · Cited by 2,192
Jeffreys, M. R. (2015) · Nurse Education Today · doi:10.1016/j.nedt.2014.11.004 · Cited by 144
(2010) · College student journal · Cited by 73
Changing paradigms and challenging assumptions: redefining quality and NCLEX-RN pass rates
Giddens, J. F. (2009) · Journal of Nursing Education · doi:10.3928/01484834-20090301-04 · Cited by 56
A critical review of elaboration theory
Wilson, B., & Cole, P. (1992) · Educational Technology Research and Development · doi:10.1007/bf02296843 · Cited by 45
Strategies to improve NCLEX-RN success: a review
Quinn, B. L., Smolinski, M., & Peters, A. B. (2018) · Teaching and learning in nursing · doi:10.1016/j.teln.2017.09.002 · Cited by 37
Exploring Predictors of NCLEX-RN Success: One School's Search for Excellence
Havrilla, E., Zbegner, D. A., & Victor, J. (2018) · Journal of Nursing Education · doi:10.3928/01484834-20180815-08 · Cited by 35
Roa, M., Shipman, D., Hooten, J., & Carter, M. (2011) · Nurse Education Today · doi:10.1016/j.nedt.2010.07.009 · Cited by 33
People are failing! something needs to be done: Canadian students' experience with the NCLEX-RN
McGillis Hall, L., Lalonde, M., & Kashin, J. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2016.08.022 · Cited by 25
Coaching to NCLEX-RN success: a Postgraduation intervention to improve first-time pass rates
Czekanski, K., Mingo, S., & Piper, L. (2018) · Journal of Nursing Education · doi:10.3928/01484834-20180815-10 · Cited by 25
Research works printed but not linked: 3
- Atemafac J . Consequences for nursing graduates of failing the National Council Licensure examination (NCLEX) [Dissertation on the Internet]. Minnesota: Walden University. 2014. Available: https://www.proquest.com/openview/6ff1ca5275c5a6e89b24bb8fa9807f7e/1?pq-origsite=gscholar&cbl=18750
- Phelan JC . An investigation of student use of Passpoint and NCLEX-RN® outcomes. 2021. Available: https://download.lww.com/efficacy/WP_PassPoint.pdf
- Monroe HE . Determining readiness to take the National Council Licensure examination for registered nurses® [Dissertation on the Internet]. Colorado: University of northern Colorado. 2019. Available: http://www.proquest.com/docview/2302691385/abstract/D233A270344E43F1PQ/2
Cited by
Innab, A., Almotairy, M. M., Alqahtani, N., Nahari, A. M., Alghamdi, R., Moafa, H., & Alshael, D. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e28506 · Cited by 39
“Some teaching approaches use a combination of a comprehensive licensure review and adaptive quizzing assignments, serving as a formative assessment tool [27], to improve the performance of undergraduate nursing students in the end-of-program exit exam [28].”
BackgroundSelf-citationAl-Hassan, M., Dorri, R., & Al-Omari, E. (2024) · Nurse Education in Practice · doi:10.1016/j.nepr.2024.104126 · Cited by 5
Dorri, R., Al-Omari, E., Al-Hassan, M., Mohamed, S., & Ansar, S. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104334 · Cited by 3
Saralegui‐Gainza, A., Soto‐Ruiz, N., Escalada‐Hernández, P., García‐Vivar, C., & Martín‐Rodríguez, L. S. (2024) · Enfermería Clínica · doi:10.1016/j.enfcli.2024.06.004
“En Espa˜na, con superar la titulación de grado es suficiente para acceder al mundo laboral, a diferencia del contexto árabe, donde es necesario además aprobar un examen de competencias previo a la incorporación a un puesto en el hospital 21 .”
Scope of nursing practice in medical-surgical hospitalization and intensive care units
Saralegui‐Gainza, A., Soto‐Ruiz, N., Escalada‐Hernández, P., García‐Vivar, C., & Martín‐Rodríguez, L. S. (2025) · Enfermería Clínica (English Edition) · doi:10.1016/j.enfcle.2025.102124
“21 This requirement may make nurses more aware of the competences they need to possess and put into practice in order to get their job, and this may influence their subsequent implementation of their scope of practice.”
Metadata
- Authors
- Almotairy, M. M., Innab, A., Alqahtani, N., Nahari, A., Alghamdi, R., Moafa, H., & Alshael, D.
- Affiliations
- King Saud University (SA)
- Corresponding author
- Almotairy, Monir M
- ORCID
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2023-07
- Volume
- 13
- Issue
- 7
- Pages
- e074469
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC10347515
- OpenAlex
- W4384071434
- Cited by
- 6
- References
- 29
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 3
- FWCI
- 1.53
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- HighWire Press Open Archive (submittedVersion)
- Funders
- The Deputyship for Research and Innovation, Ministry of Education in Saudi Arabia (IFKSUOR3–091–3)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Nursing › Leadership and Management › Healthcare Education and Workforce Issues
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- computerized adaptive testing, nursing students, nursing education, elaboration theory, exam performance, Saudi Arabia
- MeSH terms
- Education, Nursing, Baccalaureate, Humans, Licensure, Saudi Arabia, Students, Nursing, Knowledge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study. https://app.cochat.ai/papers/10.1136/bmjopen-2023-074469
- The paper
- Almotairy, M. M., Innab, A., Alqahtani, N., Nahari, A., Alghamdi, R., Moafa, H., & Alshael, D. (2023). Comprehensive licensure review and adaptive quizzing assignments for enhancement of end-of-programme exit examination scores in Saudi Arabia: a quasi-experimental study. BMJ Open. https://doi.org/10.1136/bmjopen-2023-074469
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.