The DOI matches its Crossref record; 115 of the 115 references it cites were found in a registry or an index.
Is My Model Good Enough? Best Practices for Verification and Validation of Musculoskeletal Models and Simulations of Movement
Open accessAbstract
Computational modeling and simulation of neuromusculoskeletal (NMS) systems enables researchers and clinicians to study the complex dynamics underlying human and animal movement. NMS models use equations derived from physical laws and biology to help solve challenging real-world problems, from designing prosthetics that maximize running speed to developing exoskeletal devices that enable walking after a stroke. NMS modeling and simulation has proliferated in the biomechanics research community over the past 25 years, but the lack of verification and validation standards remains a major barrier to wider adoption and impact. The goal of this paper is to establish practical guidelines for verification and validation of NMS models and simulations that researchers, clinicians, reviewers, and others can adopt to evaluate the accuracy and credibility of modeling studies. In particular, we review a general process for verification and validation applied to NMS models and simulations, including careful formulation of a research question and methods, traditional verification and validation steps, and documentation and sharing of results for use and testing by other researchers. Modeling the NMS system and simulating its motion involves methods to represent neural control, musculoskeletal geometry, muscle–tendon dynamics, contact forces, and multibody dynamics. For each of these components, we review modeling choices and software verification guidelines; discuss variability, errors, uncertainty, and sensitivity relationships; and provide recommendations for verification and validation by comparing experimental data and testing robustness. We present a series of case studies to illustrate key principles. In closing, we discuss challenges the community must overcome to ensure that modeling and simulation are successfully used to solve the broad spectrum of problems that limit human mobility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wächter, A., & Biegler, L. T. (2006) · Mathematical Programming · doi:10.1007/s10107-004-0559-y · Cited by 9,483
OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement
Delp, S. L., Anderson, F. C., Arnold, A. S., Loan, P., Habib, A., John, C. T., Guendelman, E., & Thelen, D. G. (2007) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2007.901024 · Cited by 4,933
Self-citationBayesian Inference in Statistical Analysis.
Kadane, J. B., Box, G. E. P., & Tiao, G. C. (1975) · Journal of the American Statistical Association · doi:10.2307/2285412 · Cited by 3,824
Structural Reliability Analysis and Prediction
(2017) · Wiley eBooks · doi:10.1002/9781119266105 · Cited by 3,778
Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control.
Zajac, F. E. (1989) · PubMed · Cited by 3,021
Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems
Helton, J. C., & Davis, F. J. (2003) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(03)00058-9 · Cited by 2,688
(2007) · Springer eBooks · doi:10.1007/978-0-387-71107-2 · Cited by 2,687
An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures
Delp, S. L., Loan, J. P., Hoy, M. G., Zajac, F. E., Topp, E. L., & Rosen, J. M. (1990) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.102791 · Cited by 2,005
Self-citationDynamics of Multibody Systems: Symposium Munich/Germany August 29–September 3, 1977
(1978) · Springer eBooks · doi:10.1007/978-3-642-86461-2 · Cited by 1,953
A review of techniques for parameter sensitivity analysis of environmental models
Hamby, D. M. (1994) · Environmental Monitoring and Assessment · doi:10.1007/bf00547132 · Cited by 1,952
Cited by
Full-Body Musculoskeletal Model for Muscle-Driven Simulation of Human Gait
Rajagopal, A., Dembia, C. L., DeMers, M. S., Delp, D. D., Hicks, J. L., & Delp, S. L. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2586891 · Cited by 1,053
Self-citationDe Groote, F., Kinney, A. L., Rao, A. V., & Fregly, B. J. (2016) · Annals of Biomedical Engineering · doi:10.1007/s10439-016-1591-9 · Cited by 327
OpenSim Moco: Musculoskeletal optimal control
Dembia, C. L., Bianco, N. A., Falisse, A., Hicks, J. L., & Delp, S. L. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008493 · Cited by 276
Self-citationErdemir, A., Mulugeta, L., Ku, J. P., Drach, A., Horner, M., Morrison, T. M., Peng, G. C. Y., Vadigepalli, R., Lytton, W. W., & Myers, J. G. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02540-4 · Cited by 118
Werling, K., Bianco, N. A., Raitor, M., Stingel, J., Hicks, J. L., Collins, S. H., Delp, S. L., & Liu, C. K. (2023) · PLOS ONE · doi:10.1371/journal.pone.0295152 · Cited by 65
Self-citationCucurull‐Sanchez, L., Chappell, M. J., Chelliah, V., Amy Cheung, S. Y., Derks, G., Penney, M., Phipps, A., Malik‐Sheriff, R. S., Timmis, J., Tindall, M. J., et al. (2019) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12381 · Cited by 61
“Here, we refer to model verification as the process in which the modeler determines the degree of self- consistency and robustness of the model prior to assessing its performance against experimental observations.(43,45)”
Method
Metadata
- Authors
- Hicks, J. L., Uchida, T. K., Seth, A., Rajagopal, A., & Delp, S. L.
- Venue
- Journal of Biomechanical Engineering
- Publisher
- ASME International
- Published
- 2015-02-01
- Volume
- 137
- Issue
- 2
- Pages
- 020905-020905
- ISSN
- 0148-0731 (ISSN-L)
- 1528-8951
- OpenAlex
- W2129242603
- Cited by
- 748
- References
- 115
- FWCI
- 14.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.