The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Experimental Test and Evaluation of Autonomous Underwater Vehicles
Abstract
AUV will increasingly play critical roles for maritime operations and warfare; however, they must first become trusted assets that complement an organisations culture and existing capability. This dependency is a global challenge for organisations implementing AUV, where robotics control systems are becoming more capable, yet the user or organisation may not be prepared for their effective integration and employment. Operational Test & Evaluation (OT&E) is the opportunity to determine the readiness of the overall system for deployments; however, OT&E of complex robotic systems such as AUV is notoriously difficult and evolving. Hence, a framework for Experimental T&E (ET&E), merging research, development, acceptance and operational testing through designed experiments is appropriate. This paper outlines a repeatable, comparable ET&E framework to determine suitability, readiness, and improvement of AUV for Mine Counter-Measures. The framework proposed maintains a focus on technical capability throughout operational testing, but is adaptable for different organisations, and operating concepts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“robotics became included in the naval warfare domain as part of autonomous boats, ships, submarines, torpedoes and as part of Naval Mine Counter-Measures (NMCM), passive Anti-Submarine Warfare (ASW) [97–99], anti-piracy operations (i.e. Somalian coasts, Nigeria’s Niger Delta, Gulf of Guinea, Gulf of Aden [100, 101], and Guardafui Channel) and countering-terrorism, relying on the Combined Task”
From Robotics cyber security: vulnerabilities, attacks, countermeasures, and recommendations (2022) · cites this paper as [98]
Citations
Cites
Thrun, S. (2002) · Communications of the ACM · doi:10.1145/504729.504754 · Cited by 7,994 · cited 1×
“This characteristic allows AUV to accommodate the uncertainty that arises in field robotic applications; however, it means an operator or tester must also think probabil-istically in order to understand and manage mission behaviours (Thrun, Burgard, and Fox 2006).”
BackgroundTackling the widespread and critical impact of batch effects in high-throughput data
Leek, J. T., Scharpf, R. B., Bravo, H. C., Simcha, D., Langmead, B., Johnson, W. E., Geman, D., Baggerly, K., & Irizarry, R. A. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2825 · Cited by 2,196 · cited 1×
“…the total number of test cases while achieving a predetermined coverage level and is in accepted use in pharmaceutical (Baker 2010; Macarron et al., 2011), genetics (Leek et al. 2010), material science (Muster et al. 2011) and software development (Hagar et al. 2015; Lopez-Herrejon et al. 2015).”
BackgroundImpact of high-throughput screening in biomedical research
Macarron, R., Banks, M. N., Bojanic, D., Burns, D. J., Cirovic, D. A., Garyantes, T., Green, D. V. S., Hertzberg, R. P., Janzen, W. P., Paslay, J. W., et al. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3368 · Cited by 1,364 · cited 1×
“…this by reducing the total number of test cases while achieving a predetermined coverage level and is in accepted use in pharmaceutical (Baker 2010; Macarron et al., 2011), genetics (Leek et al. 2010), material science (Muster et al. 2011) and software development (Hagar et al. 2015;…”
BackgroundDesign of Experiments for Engineers and Scientists
(2014) · Elsevier eBooks · doi:10.1016/c2012-0-03558-2 · Cited by 977
A review of high throughput and combinatorial electrochemistry
Muster, T. H., Trinchi, A., Markley, T., Lau, D., Martin, P., Bradbury, A. M., Bendavid, A., & Dligatch, S. (2011) · Electrochimica Acta · doi:10.1016/j.electacta.2011.09.003 · Cited by 137 · cited 1×
“…the total number of test cases while achieving a predetermined coverage level and is in accepted use in pharmaceutical (Baker 2010; Macarron et al., 2011), genetics (Leek et al. 2010), material science (Muster et al. 2011) and software development (Hagar et al. 2015; Lopez-Herrejon et al. 2015).”
BackgroundA first systematic mapping study on combinatorial interaction testing for software product lines
Lopez-Herrejon, R. E., Fischer, S., Ramler, R., & Egyed, A. F. (2015) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw.2015.7107435 · Cited by 85 · cited 1×
“…the total number of test cases while achieving a predetermined coverage level and is in accepted use in pharmaceutical (Baker 2010; Macarron et al., 2011), genetics (Leek et al. 2010), material science (Muster et al. 2011) and software development (Hagar et al. 2015; Lopez-Herrejon et al. 2015).”
BackgroundA Survey of Missions for Unmanned Undersea Vehicles
Button, R. W., van der Kamp, J., Curtin, T. B., & Dryden, J. A. (2009) · Cited by 79
Adaptive autonomous underwater vehicles for littoral surveillance: The GLINT10 field trial results
Kemna, S., Hamilton, M. J., Hughes, D. T., & LePage, K. D. (2011) · Intelligent Service Robotics · doi:10.1007/s11370-011-0097-4 · Cited by 64 · cited 1×
“Autonomous Underwater Vehicles (AUV) are increasingly a critical capability for military and civilian operations (Kemna et al. 2011).”
BackgroundIntroducing Combinatorial Testing in a Large Organization
Hagar, J. D., Wissink, T. L., Kuhn, D. R., & Kacker, R. N. (2015) · Computer · doi:10.1109/mc.2015.114 · Cited by 46 · cited 1×
“…the total number of test cases while achieving a predetermined coverage level and is in accepted use in pharmaceutical (Baker 2010; Macarron et al., 2011), genetics (Leek et al. 2010), material science (Muster et al. 2011) and software development (Hagar et al. 2015; Lopez-Herrejon et al. 2015).”
Designed Experiments for the Defense Community
Johnson, R. T., Hutto, G. T., Simpson, J. R., & Montgomery, D. C. (2011) · Quality Engineering · doi:10.1080/08982112.2012.627288 · Cited by 35 · cited 2×
“Designed multi-factor and multi-output experiments are critical to such ET&E sharing test events (Johnson et al. 2012; Lednicky and Silvestrini 2013).”
BackgroundMethod
Research works printed but not linked: 14
- Bjorkman, E. 2019. “Going Faster: Implications for Test and Evaluation.” ITEA Journal 40: 83–85.
- Brickhill, R. 2019. “Automation technologies and their impact on submarine control.” InProceedings of 5th Submarine Science, Technology and Engineering Conference (SubSTEC5), edited by G. A. Morgan, 187–192. Fremantle, Western Australia: Submarine Institute of Australia Inc.
- Grafton, R., G. Brown, Z. Novakovic, and K. F. Joiner. 2018. “Developments in test design and analysis techniques for aircraft survivability assessments,” Systems Evaluation Test and Evaluation Conference 2018: Unlocking the Future Through Systems Engineering: SETE 2018, Sydney, Australia: Engineers Australia.
- Guimond, B., and T. Casey. 2017. “Submerged acoustic navigation system.” In Proceedings of 4th Submarine Science, Technology & Engineering Conference 2017, edited by C. J. Skinner and G. A. Morgan, 137–144. Adelaide: Submarine Institute of Australia.
- Joiner, K. F., S. R. Atkinson, K. Castelle, and J. Bradley. 2019. “Near-Term Asian War: Impacts and Options for Australia’s Submarine Program.” In Proceedings of 5th Submarine Science, Technology and Engineering Conference (SubSTEC5), edited by G. A. Morgan, 15–28. Fremantle, Western Australia: Submarine Institute of Australia Inc.
- Jones, A., M. Greening, and A. Zinviev. 2017. “The Effects on Sonar Transmission of Modelled Water Column Variations off South East and South West Australia.” In SUBSTEC4, 293–305.
- Kass, R. 2015. “Twenty-one Parameters for Rigorous, Robust, and Realistic Operational Testing.” ITEA Journal 36: 121–138.
- Lammas, A., and K. Sammut. 2019. “Trajectory planning for dynamic autonomous underwater vehicle docking.” In SubSTEC5, edited by G. A. Morgan, 171–178. Submarine Institute of Australia. Perth, Australia.
- Lumsden, J., A. Ghiotto, and S. Elson. 2019. “Bridging the underwater communications gap.” In 5th Submarine Science, Technology and Engineering Conference (SubSTEC5), Submarine Institute of Australia Inc, edited by G. A. Morgan, 271–278. Fremantle, Western Australia: Submarine Institute of Australia.
- Norman, R. 2019. “Embracing the Evaluation Revolution.” ITEA Journal 40: 230–231.
- Reagan, L. A., and M. J. Kiemele. 2008. Design for Six Sigma: The Tool Guide for Practitioners. Colorado, USA: Colorado Springs: Air Academy Associates, LLC.
- Rucker, A. 2014. “Improving statistical rigor in Defense T&E: Use of tolerance intervals in designed experiments.” Defense ARJ 21 (4): 804–824.
- Sheehan, M., L. Cortes, and A. Duhon. 2019. “Expanding the Systems Test Engineer’s Toolbox: A multi-criteria Decision Analysis Technique Using the Onse-Sided Tolerance Interval for Analysis of DOE Planned Tests.” ITEA Journal 40: 239–248.
- Vinyard, R. 2019. “Project Odin: A Case Study in Migrating to a Massively Parallel Big Data Environment.” ITEA Journal 40: 233–238.
Cited by
Robotics cyber security: vulnerabilities, attacks, countermeasures, and recommendations
Yaacoub, J.-P. A., Noura, H. N., Salman, O., & Chehab, A. (2022) · International Journal of Information Security · doi:10.1007/s10207-021-00545-8 · Cited by 320
Odeyemi, O. O., & Alaba, P. A. (2024) · Corrosion Reviews · doi:10.1515/corrrev-2024-0046 · Cited by 41
Keane, J., Joiner, K. F., Arulampalam, S., & Webber, R. (2022) · Journal of Field Robotics · doi:10.1002/rob.22110 · Cited by 13
“…use of AUV in maritime warfare, two key improvements were identified to build resilience and trust: (1) a means of rapid and safe recovery, and (2) for the Australian context, iterative development and assurance involving greater modeling and simulation (Joiner & Tutty, 2018; Keane & Joiner, 2020).”
BackgroundMethodInfluentialSelf-citationA Framework for Testing and Evaluation of Operational Performance of Multi-UAV Systems
Sarkar, M., Yan, X., Nateghi, S., Holmes, B. J., Vamvoudakis, K. G., & Homaifar, A. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-82193-7_24 · Cited by 11
Verbruggen, M. (2022) · Studies in peace and security · doi:10.1007/978-3-031-11043-6_13 · Cited by 7
Metadata
- Authors
- Keane, J., & Joiner, K.
- Affiliations
- RAN/ADFA, HMAS Waterhen, Waverton, Australia
- Australian Defence Force Academy (AU)
- Corresponding author
- Keane, James
- Venue
- Australian Journal of Multi-Disciplinary Engineering
- Publisher
- Informa UK Limited
- Published
- 2020-01
- Volume
- 16
- Issue
- 1
- Pages
- 67-79
- ISSN
- 1448-8388 (ISSN-L)
- 2204-2180
- OpenAlex
- W3040065721
- Cited by
- 6
- References
- 29
- Citations by year
- 2025: 1 · 2024: 1 · 2022: 2 · 2021: 2
- FWCI
- 0.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Australian Journal of Multi-Disciplinary Engineering (publishedVersion)
- Topics
- Physical Sciences › Engineering › Ocean Engineering › Underwater Vehicles and Communication Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Systems Engineering Methodologies and Applications
- Physical Sciences › Engineering › Aerospace Engineering › Military Technology and Strategies
- Keywords
- autonomous underwater vehicles, operational testing, mine countermeasures, maritime operations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Experimental Test and Evaluation of Autonomous Underwater Vehicles. https://app.cochat.ai/papers/10.1080/14488388.2020.1788228
- The paper
- Keane, J., & Joiner, K. (2020). Experimental Test and Evaluation of Autonomous Underwater Vehicles. Australian Journal of Multi-Disciplinary Engineering. https://doi.org/10.1080/14488388.2020.1788228
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.