The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Towards Aircraft Maintenance Metaverse Using Speech Interactions with Virtual Objects in Mixed Reality
Open accessAbstract
Metaverses embedded in our lives create virtual experiences inside of the physical world. Moving towards metaverses in aircraft maintenance, mixed reality (MR) creates enormous opportunities for the interaction with virtual airplanes (digital twin) that deliver a near-real experience, keeping physical distancing during pandemics. 3D twins of modern machines exported to MR can be easily manipulated, shared, and updated, which creates colossal benefits for aviation colleges who still exploit retired models for practicing. Therefore, we propose mixed reality education and training of aircraft maintenance for Boeing 737 in smart glasses, enhanced with a deep learning speech interaction module for trainee engineers to control virtual assets and workflow using speech commands, enabling them to operate with both hands. With the use of the convolutional neural network (CNN) architecture for audio features and learning and classification parts for commands and language identification, the speech module handles intermixed requests in English and Korean languages, giving corresponding feedback. Evaluation with test data showed high accuracy of prediction, having on average 95.7% and 99.6% on the F1-Score metric for command and language prediction, respectively. The proposed speech interaction module in the aircraft maintenance metaverse further improved education and training, giving intuitive and efficient control over the operation, enhancing interaction with virtual objects in mixed reality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation
Sokolova, M., Japkowicz, N., & Szpakowicz, S. (2006) · Lecture Notes in Computer Science · doi:10.1007/11941439_114 · Cited by 1,974
(1992) · Cited by 1,405
A Dataset and Taxonomy for Urban Sound Research
Salamon, J., Jacoby, C., & Bello, J. P. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2655045 · Cited by 1,309
An augmented reality system for training and assistance to maintenance in the industrial context
Schwald, B., & de Laval, B. (2003) · Digital Library (University of West Bohemia) · Cited by 183
Martinez, J., Perez-Meana, H. M., Escamilla-Hernández, E., & Suzuki, M. M. (2012) · International Conference on Electronics, Communications, and Computers · doi:10.1109/conielecomp.2012.6189918 · Cited by 133
Social distancing in response to the novel coronavirus (COVID-19) in the United States
Masters, N. B., Shih, S., Bukoff, A., Akel, K. B., Kobayashi, L. C., Miller, A. L., Harapan, H., Lu, Y., & Wagner, A. L. (2020) · PLoS ONE · doi:10.1371/journal.pone.0239025 · Cited by 132
Ensemble of convolutional neural networks to improve animal audio classification
Nanni, L., Costa, Y. M. G., Aguiar, R. L., Mangolin, R. B., Brahnam, S., & Junior, C. N. S. (2020) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-020-00175-3 · Cited by 84
Cited by
A Metaverse: Taxonomy, Components, Applications, and Open Challenges
Park, S.-M., & Kim, Y.-G. (2022) · IEEE Access · doi:10.1109/access.2021.3140175 · Cited by 1,824
Blockchain for the metaverse: A Review
Huynh-The, T., Gadekallu, T. R., Wang, W., Yenduri, G., Ranaweera, P., Pham, Q.-V., da Costa, D. B., & Liyanage, M. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.02.008 · Cited by 771
Is Metaverse in education a blessing or a curse: a combined content and bibliometric analysis
Tlili, A., Huang, R., Shehata, B., Liu, D., Zhao, J., Metwally, A. H. S., Wang, H., Denden, M., Bozkurt, A., Lee, L.-H., et al. (2022) · Smart Learning Environments · doi:10.1186/s40561-022-00205-x · Cited by 624
Metaverse in Education: Vision, Opportunities, and Challenges
Lin, H., Wan, S., Gan, W., Chen, J., & Chao, H.-C. (2022) · 2022 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata55660.2022.10021004 · Cited by 305
Constructing an Edu-Metaverse Ecosystem: A New and Innovative Framework
Wang, M., Yu, H., Bell, Z., & Chu, X. (2022) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3210828 · Cited by 271
Metadata
- Authors
- Siyaev, A., & Jo, G.-S.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2021-03-15
- Volume
- 21
- Issue
- 6
- Pages
- 2066
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W3138431583
- Cited by
- 261
- References
- 20
- FWCI
- 18.34
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Towards Aircraft Maintenance Metaverse Using Speech Interactions with Virtual Objects in Mixed Reality. https://app.cochat.ai/papers/10.3390/s21062066
- The paper
- Siyaev, A., & Jo, G.-S. (2021). Towards Aircraft Maintenance Metaverse Using Speech Interactions with Virtual Objects in Mixed Reality. Sensors. https://doi.org/10.3390/s21062066
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.