CoChat

Evaluating the Instructional Design and Effect on Knowledge, Teamwork, and Skills of Technology-Enhanced Simulation-Based Training in Obstetrics in Uganda: Stepped-Wedge Cluster Randomized Trial

Open access
van Tetering, Anne Antonia Cornelia, Segers, Maartje Henrica Martine, Ntuyo, Peter, Namagambe, Imelda, van der Hout-van der Jagt, M Beatrijs, Byamugisha, Josaphat K, Oei, S Guid · 2021 · JMIR Medical Education

Published version of a preprint

The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Simulation-based training is a common strategy for improving the quality of facility-based maternity services and is often evaluated using Kirkpatrick's theoretical model. The results on the Kirkpatrick levels are closely related to the quality of the instructional design of a training program. The instructional design is generally defined as the "set of prescriptions for teaching methods to improve the quality of instruction with a goal of optimizing learning outcomes." OBJECTIVE: The aim of this study is to evaluate the instructional design of a technology-enhanced simulation-based training in obstetrics, the reaction of participants, and the effect on knowledge, teamwork, and skills in a low-income country. METHODS: A stepped-wedge cluster randomized trial was performed in a university hospital in Kampala, Uganda, with an annual delivery volume of over 31,000. In November 2014, a medical simulation center was installed with a full-body birthing simulator (Noelle S550, Gaumard Scientific), an interactive neonate (Simon S102 Newborn CPR Simulator, Gaumard Scientific), and an audio and video recording system. Twelve local obstetricians were trained and certified as medical simulation trainers. From 2014 to 2016, training was provided to 57 residents in groups of 6 to 9 students. Descriptive statistics were calculated for ten instructional design features of the training course measured by the 42-item ID-SIM (Instructional Design of a Simulation Improved by Monitoring). The Wilcoxon signed rank test was conducted to investigate the differences in scores on knowledge, the Clinical Teamwork Scale, and medical technical skills. RESULTS: The mean scores on the ten instructional design features ranged from 54.9 (95% CI 48.5-61.3) to 84.3 (95% CI 80.9-87.6) out of 100. The highest mean score was given on the feature feedback and the lowest scores on repetitive practice and controlled environment. The overall score for the training day was 92.8 out of 100 (95% CI 89.5-96.1). Knowledge improved significantly, with a test score of 63.4% (95% CI 60.7-66.1) before and 78.9% (95% CI 76.8-81.1) after the training (P<.001). The overall score on the 10-point Clinical Teamwork Scale was 6.0 (95% CI 4.4-7.6) before and 5.9 (95% CI 4.5-7.2) after the training (P=.78). Medical technical skills were scored at 55.5% (95% CI 47.2-63.8) before and 65.6% (95% CI 56.5-74.7) after training (P=.08). CONCLUSIONS: Most instructional design features of a technology-enhanced simulation-based training in obstetrics in a low-income country were scored high, although intervals were large. The overall score for the training day was high, and knowledge did improve after the training program, but no changes in teamwork and (most) medical technical skills were found. The lowest-scored instructional design features may be improved to achieve further learning aims. TRIAL REGISTRATION: ISRCTN Registry ISRCTN98617255; http://www.isrctn.com/ISRCTN98617255. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s12884-020-03050-3.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/17277

Cites

66 of 66 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 66 references

Research works printed but not linked: 2

  1. Bang A Patel A Bellad R Gisore P Goudar SS Esamai F Liechty EA Meleth S Goco N Niermeyer S Keenan W Kamath-Rayne BD Little GA Clarke SB Flanagan VA Bucher S Jain M Mujawar N Jain V Rukunga J Mahantshetti N Dhaded S Bhandankar M McClure EM Carlo WA Wright LL Hibberd PL Helping Babies Breathe (HBB) training: What happens to knowledge and skills over time? BMC Pregnancy Childbirth 2016 11 22 16 1 364 10.1186/s12884-016-1141-3 27875999 10.1186/s12884-016-1141-3 27875999 PMC5120476 · DOI · Paper page
  2. Arabi Ali M E Ibrahim SA Ahmed SE MacGinnea F Hawkes G Dempsey E Ryan C Anthony Skills retention in Sudanese village midwives 1 year following Helping Babies Breathe training Arch Dis Child 2016 05 101 5 439 42 10.1136/archdischild-2015-309190 26826172 archdischild-2015-309190 26826172 · DOI

Cited by

See all 11

Metadata

Authors
van Tetering, A. A. C., Segers, M. H. M., Ntuyo, P., Namagambe, I., van der Hout-van der Jagt, M. B., Byamugisha, J. K., & Oei, S. G.
Affiliations
  • Máxima Medisch Centrum (NL)
  • Mulago Hospital (UG)
Venue
JMIR Medical Education
Published
2021-02-05
Volume
7
Issue
1
Pages
e17277
ISSN
2369-3762 (ISSN-L)
OpenAlex
W3035292487
Cited by
11
References
66
Citations by year
2026: 3 · 2025: 3 · 2023: 3 · 2022: 1 · 2021: 1
FWCI
0.75
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Medical Education (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • TU/e Research Portal (publishedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • TU/e Research Portal (submittedVersion, other-oa)
Topics
  • Social Sciences › Education › Simulation-Based Education in Healthcare
  • Health Sciences › Medicine › Surgery › Surgical Simulation and Training
  • Social Sciences › Education › Innovations in Medical Education
Keywords
simulation-based training, instructional design, obstetrics, medical education, Kirkpatrick model, clinical skills, obstetric residents, feedback, low-income countries, obstetric care, training simulators, Uganda

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.