Cited by 0Augmented Reality ApplicationsMultimedia Learning SystemsVirtual Reality Applications and Impacts

Evaluating the Effectiveness of Educational Augmented Reality Authoring Tool: Insights From Instructors, Experts, and Students

Kim, Jiwon W., Wang, Kexin, Dorneich, Michael C., Winer, Eliot, Brown, Lori J., Whitehurst, Geoffrey·2026·IEEE Transactions on Human-Machine Systems

Abstract

This article assessed the effectiveness of an augmented reality (AR) authoring tool for aviation weather training developed to support flight instructors without requiring technical expertise. While AR-based training showed promise in aviation weather education, there are limited tools available for nontechnologist instructors. To address this challenge, an instructor-centered AR authoring tool was developed and evaluated using a multiphase framework. The AR authoring approach was validated on three dimensions: instructors’ authoring experience; instructional quality of produced AR lessons; and students’ learning outcomes and engagement. Flight instructors successfully developed interactive AR lessons on aviation weather topics of their choice, and reported high usability and manageable workload for authoring. Instructors reported increased confidence in creating AR content, while their concerns regarding technical complexity, mental effort, and time demands decreased. Subject matter experts rated the instructional quality of instructor-authored AR lessons highly. Using the produced AR lessons, students showed significant gains in knowledge and motivation. These findings demonstrate the potential of instructor-centered authoring approach to enable the creation of high-quality, interactive educational content without requiring technical expertise, and to provide a replicable, evidence-based framework for assessing educational technologies and supporting broader integration of AR in education.

Integrity signals

Registry

Crossref · 10.1109/thms.2026.3667033

Cites

42 of 59 references verified0 citation errors · 4 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Cites

Flagged first, then by citations

17 of the 59 references couldn’t be matched to a known paper.

Cited by

Still being checked.

Authors
Kim, J. W., Wang, K., Dorneich, M. C., Winer, E., Brown, L. J., & Whitehurst, G.
Affiliations
  • Iowa State University (US)
  • College of Aviation, Kalamazoo, MI, USA
Venue
IEEE Transactions on Human-Machine Systems
Published
2026-06
Volume
56
Issue
3
Pages
572-581
ISSN
  • 2168-2291 (ISSN-L)
  • 2168-2305
OpenAlex
W7134980363
Cited by
0
References
59
FWCI
0.00
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Human-Machine Systems (publishedVersion)
  • Iowa State University Digital Repository (Iowa State University) (submittedVersion)
Funders
  • Partnership to Enhance General Aviation Safety, Accessibility, and Sustainability
  • Federal Aviation Administration (12-C-GA-ISU)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
  • Physical Sciences › Computer Science › Information Systems › Multimedia Learning Systems
  • Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
Keywords
educational augmented reality, flight instructors, usability, teaching quality, learning outcomes, student engagement, non-technical users, AR in education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review