Reliability and validity of instrumented soccer equipment

Akins, Jonathan S.; Heebner, Nicholas R.; Lovalekar, Mita; Sell, Timothy C.

doi:10.1123/jab.2014-0191

Cited by 17Lower Extremity Biomechanics and PathologiesFoot and Ankle SurgerySports Dynamics and Biomechanics

Reliability and validity of instrumented soccer equipment

Akins, Jonathan S., Heebner, Nicholas R., Lovalekar, Mita, Sell, Timothy C.·2015·Journal of Applied Biomechanics

DOI 10.1123/jab.2014-0191

Open this paper in CoChat — free account

Abstract

Ankle ligament sprains are the most common injury in soccer. The high rate of these injuries demonstrates a need for novel data collection methodologies. Therefore, soccer shoes and shin guards were instrumented with inertial sensors to measure ankle joint kinematics in the field. The purpose of this study was to assess test-retest reliability and concurrent criterion validity of a kinematic assessment using the instrumented soccer equipment. Twelve soccer athletes performed athletic maneuvers in the laboratory and field during 2 sessions. In the laboratory, ankle joint kinematics were simultaneously measured with the instrumented equipment and a conventional motion analysis system. Reliability was assessed using ICC and validity was assessed using correlation coefficients and RMSE. While our design criteria of good test-retest reliability was not supported (ICC > .80), sagittal plane ICCs were mostly fair to good and similar to motion analysis results; and sagittal plane data were valid (r = .90-98; RMSE < 5°). Frontal and transverse plane data were not valid (r < .562; RMSE > 3°). Our results indicate that the instrumented soccer equipment can be used to measure sagittal plane ankle joint kinematics. Biomechanical studies support the utility of sagittal plane measures for lower extremity injury prevention.

Integrity signals

Registry

Crossref · 10.1123/jab.2014-0191

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Ankle RMSE and correlation coefficients varied from 0.4 to 18.8° and 0.33 to 0.99.
“RMSE and correlation coefficients varied respectively from 0.4 to 18.8° and 0.33 to 0.99 [29,37,41,43,53,54,55,57,59,62,63].”
From Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review (2019) · cites this paper as [29]
Ankle intra- and inter-rater reliability varied across movement complexity (better for walking ICC 0.6 to 0.95 than jumping ICC 0.39 to 0.99 or playing soccer ICC 0.28 to 0.79).
“Intra- and inter-rater reliability varied across movements complexity (better for walking [ICC of 0.6 to 0.95] than jumping [ICC of 0.39 to 0.99] or playing soccer [ICC of 0.28 to 0.79] [29,53,62]).”
From Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review (2019) · cites this paper as [29]

Foundations of Clinical Research: Applications to Practice,
(2002) · Survey of Ophthalmology · doi:10.1016/s0039-6257(02)00362-4 · Cited by 9,485 · see citing works
The Design and Analysis of Clinical Experiments
Fleiss, J. L. (1999) · Wiley eBooks · doi:10.1002/9781118032923 · Cited by 4,819 · see citing works
Measurement of lower extremity kinematics during level walking
Kadaba, M. P., Ramakrishnan, H. K., & Wootten, M. E. (1990) · Journal of Orthopaedic Research · doi:10.1002/jor.1100080310 · Cited by 3,216 · see citing works
A gait analysis data collection and reduction technique
Davis, R. B., Õunpuu, S., Tyburski, D., & Gage, J. R. (1991) · Human Movement Science · doi:10.1016/0167-9457(91)90046-z · Cited by 3,086 · see citing works
Estimation of IMU and MARG orientation using a gradient descent algorithm
Madgwick, S., Harrison, A. J., & Vaidyanathan, R. (2011) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2011.5975346 · Cited by 2,108 · see citing works
Repeatability of kinematic, kinetic, and electromyographic data in normal adult gait
Kadaba, M. P., Ramakrishnan, H. K., Wootten, M. E., Gainey, J., Gorton, G. E., & Cochran, G. V. B. (1989) · Journal of Orthopaedic Research® · doi:10.1002/jor.1100070611 · Cited by 1,479 · see citing works
Descriptive Epidemiology of Collegiate Men's Lacrosse Injuries: National Collegiate Athletic Association Injury Surveillance System, 1988–1989 Through 2003–2004
The University of North Carolina at Chapel Hill University Libraries (2020) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/43s4-g204 · Cited by 1,046 · see citing works
Effect of landing stiffness on joint kinetics and energetics in the lower extremity
DeVita, P., & Skelly, W. A. (1992) · Medicine & Science in Sports & Exercise · doi:10.1249/00005768-199201000-00018 · Cited by 773 · see citing works
An epidemiological survey on ankle sprain.
Yeung, M. S., Chan, K. M., So, C. H., & Yuan, W. Y. (1994) · British Journal of Sports Medicine · doi:10.1136/bjsm.28.2.112 · Cited by 687 · see citing works
Ligamentous Posttraumatic Ankle Osteoarthritis
Valderrábano, V., Hintermann, B., Horisberger, M., & Fung, T. S. (2005) · The American Journal of Sports Medicine · doi:10.1177/0363546505281813 · Cited by 658 · see citing works
Arthroscopic Findings in Patients with Chronic Ankle Instability
Hintermann, B., Boss, A., & Schäfer, D. (2002) · The American Journal of Sports Medicine · doi:10.1177/03635465020300031601 · Cited by 611 · see citing works
Soccer injuries and their mechanisms
Ekstrand, J., & Gillquist, J. (1983) · Medicine & Science in Sports & Exercise · doi:10.1249/00005768-198315030-00014 · Cited by 567 · see citing works
Gait event detection using linear accelerometers or angular velocity transducers in able-bodied and spinal-cord injured individuals
Jasiewicz, J. M., Allum, J. H. J., Middleton, J. W., Barriskill, A., Condie, P., Purcell, B., & Li, R. C. T. (2006) · Gait & Posture · doi:10.1016/j.gaitpost.2005.12.017 · Cited by 371 · see citing works
The use of inertial sensors system for human motion analysis
Cuesta-Vargas, A. I., Galán-Mercant, A., & Williams, J. M. (2010) · Physical Therapy Reviews · doi:10.1179/1743288x11y.0000000006 · Cited by 369 · see citing works
Soccer injuries in Iceland
Árnason, Á., Guðmundsson, Á., Dahl, H. A., & Jóhannsson, E. (1996) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/j.1600-0838.1996.tb00069.x · Cited by 347 · see citing works
The influence of foot positioning on ankle sprains
Wright, I. C., Neptune, R. R., van den Bogert, A. J., & Nigg, B. M. (2000) · Journal of Biomechanics · doi:10.1016/s0021-9290(99)00218-3 · Cited by 325 · see citing works
The Football Association Medical Research Programme: an audit of injuries in professional football: an analysis of ankle sprains
Woods, C., Hawkins, R., Hulse, M., & Hodson, A. (2003) · British Journal of Sports Medicine · doi:10.1136/bjsm.37.3.233 · Cited by 315 · see citing works
An inertial and magnetic sensor based technique for joint angle measurement
O’Donovan, K. J., Kamnik, R., O'Keeffe, D. T., & Lyons, G. M. (2007) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2006.12.010 · Cited by 281 · see citing works
Algorithms to determine event timing during normal walking using kinematic data
Hreljac, A. P., & Marshall, B. (2000) · Journal of Biomechanics · doi:10.1016/s0021-9290(00)00014-2 · Cited by 272 · see citing works
Joint kinematics estimate using wearable inertial and magnetic sensing modules
Picerno, P., Cereatti, A., & Cappozzo, A. (2008) · Gait & Posture · doi:10.1016/j.gaitpost.2008.04.003 · Cited by 263 · see citing works
Prolonged Reaction Time in Patients with Chronic Lateral Instability of the Ankle
Löfvenberg, R., Kärrholm, J., Sundelin, G., & Ahlgren, O. (1995) · The American Journal of Sports Medicine · doi:10.1177/036354659502300407 · Cited by 248 · see citing works
Individuals with mechanical ankle instability exhibit different motion patterns than those with functional ankle instability and ankle sprain copers
Brown, C. N., Padua, D. A., Marshall, S. W., & Guskiewicz, K. M. (2008) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2008.02.013 · Cited by 233 · see citing works
Biomechanics of Supination Ankle Sprain
Fong, D. T.-P., Hong, Y., Shima, Y., Krosshaug, T., Yung, P. S., & Chan, K.-M. (2009) · The American Journal of Sports Medicine · doi:10.1177/0363546508328102 · Cited by 198 · see citing works
Mechanical stability, muscle strength and proprioception in the functionally unstable ankle
Ryan, L. (1994) · Australian Journal of Physiotherapy · doi:10.1016/s0004-9514(14)60453-0 · Cited by 184 · see citing works
First in vivo assessment of “Outwalk”: a novel protocol for clinical gait analysis based on inertial and magnetic sensors
Ferrari, A., Cutti, A. G., Garofalo, P., Raggi, M., Heijboer, M., Cappello, A., & Davalli, A. (2009) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-009-0544-y · Cited by 181 · see citing works
Foot placement modifies kinematics and kinetics during drop jumping
KOV??CS, I., Tihanyi, J., DeVita, P., R??CZ, L., Barrier, J., & HORTOB??GYI, T. (1999) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-199905000-00014 · Cited by 161 · see citing works
Effects of Recurrent Lateral Ankle Sprains on Active and Passive Judgments of Joint Position
Gross, M. T. (1987) · Physical Therapy · doi:10.1093/ptj/67.10.1505 · Cited by 157 · see citing works
Intrinsic Risk Factors of Noncontact Ankle Sprains in Soccer
Fousekis, K., Tsepis, E., & Vagenas, G. K. (2012) · The American Journal of Sports Medicine · doi:10.1177/0363546512449602 · Cited by 148 · see citing works
Repeatability of lower limb three-dimensional kinematics in patients with stroke
Yavuzer, G., Öken, Ö., Elhan, A. H., & Stam, H. J. (2007) · Gait & Posture · doi:10.1016/j.gaitpost.2006.12.016 · Cited by 134 · see citing works
Benchmarking of a full-body inertial motion capture system for clinical gait analysis
Cloete, T., & Scheffer, C. (2008) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2008.4650232 · Cited by 131 · see citing works
Development of a real-time three-dimensional spinal motion measurement system for clinical practice
Goodvin, C., Park, E. J., Huang, K. I., & Sakaki, K. D. R. (2006) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-006-0132-3 · Cited by 100 · see citing works
A portable system for collecting anatomical joint angles during stair ascent: A comparison with an optical tracking device
Bergmann, J. H., Mayagoitia, R. E., & Smith, I. C. (2009) · Dynamic Medicine · doi:10.1186/1476-5918-8-3 · Cited by 88 · see citing works
The epidemiology of ankle injuries occurring in English Football Association academies
Cloke, D. J., Spencer, S., Hodson, A., & Deehan, D. J. (2008) · British Journal of Sports Medicine · doi:10.1136/bjsm.2008.052050 · Cited by 71 · see citing works
Inter-operator reliability and prediction bands of a novel protocol to measure the coordinated movements of shoulder-girdle and humerus in clinical settings
Garofalo, P., Cutti, A. G., Filippi, M. V., Cavazza, S., Ferrari, A., Cappello, A., & Davalli, A. (2009) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-009-0454-z · Cited by 65 · see citing works
The effect of an inclined landing surface on biomechanical variables during a jumping task
Hagins, M., Pappas, E., Kremenic, I. J., Orishimo, K. F., & Rundle, A. (2007) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2007.07.012 · Cited by 59 · see citing works
Repeatability of an off-the-shelf, full body inertial motion capture system during clinical gait analysis
Cloete, T., & Scheffer, C. (2010) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2010.5626196 · Cited by 51 · see citing works
Phase determination during normal running using kinematic data
Hreljac, A. P., & Stergiou, N. (2000) · Medical & Biological Engineering & Computing · doi:10.1007/bf02345744 · Cited by 47 · see citing works
Gender Differences in Landing Mechanics Vary Depending on the Type of Landing
Butler, R. J., Willson, J. D., Fowler, D., & Queen, R. M. (2012) · Clinical Journal of Sport Medicine · doi:10.1097/jsm.0b013e318259efa0 · Cited by 43 · see citing works
Estimation of Lower Limb Joint Angles during Walking Using Extended Kalman Filtering
Young, D., d'Orey, S., Opperman, R. A., Hainley, C. J., & Newman, D. J. (2010) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-642-14515-5_336 · Cited by 8 · see citing works

Flagged first, then by citations

Sorted by citations

Trends Supporting the In-Field Use of Wearable Inertial Sensors for Sport Performance Evaluation: A Systematic Review
Camomilla, V., Bergamini, E., Fantozzi, S., & Vannozzi, G. (2018) · Sensors · doi:10.3390/s18030873 · Cited by 601 · see citing works
Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review
Poitras, I., Dupuis, F., Bielmann, M., Campeau-Lecours, A., Mercier, C., Bouyer, L., & Roy, J.-S. (2019) · Sensors · doi:10.3390/s19071555 · Cited by 309 · see citing works
Exploring the Role of Wearable Technology in Sport Kinematics and Kinetics: A Systematic Review
Adesida, Y., Papi, E., & McGregor, A. H. (2019) · Sensors · doi:10.3390/s19071597 · Cited by 288 · see citing works
Validity of inertial measurement units for tracking human motion: a systematic review
Ghattas, J., & Jarvis, D. N. (2021) · Sports Biomechanics · doi:10.1080/14763141.2021.1990383 · Cited by 37 · see citing works
Measurement of Ankle Joint Movements Using IMUs during Running
Kim, B. H., Hong, S. H., Oh, I., Lee, Y. W., Kee, R. I., & Lee, S. Y. (2021) · Sensors · doi:10.3390/s21124240 · Cited by 33 · see citing works
An IoT-Based Motion Tracking System for Next-Generation Foot-Related Sports Training and Talent Selection
Lu, S., Zhang, X., Wang, J., Wang, Y., Fan, M., & Zhou, Y. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/9958256 · Cited by 30 · see citing works
Validation of Spatiotemporal and Kinematic Measures in Functional Exercises Using a Minimal Modeling Inertial Sensor Methodology
Hindle, B. R., Keogh, J., & Lorimer, A. V. (2020) · Sensors · doi:10.3390/s20164586 · Cited by 23 · see citing works
Validity and reliability of inertial measurement units measurements for running kinematics in different foot strike pattern runners
Zeng, Z., Liu, Y., Li, P., & Wang, L. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2022.1005496 · Cited by 19 · see citing works
Insurance and wearables as tools in managing risk in sports: Determinants of technology take-up and propensity to insure and share data
Saliba, B., Spiteri, J., & Cortis, D. (2021) · The Geneva Papers on Risk and Insurance Issues and Practice · doi:10.1057/s41288-021-00250-6 · Cited by 9 · see citing works
Closing the Wearable Gap-Part VII: A Retrospective of Stretch Sensor Tool Kit Development for Benchmark Testing
Talegaonkar, P., Saucier, D. N., Carroll, W., Peranich, P., Parker, E., Middleton, C., Davarzani, S., Turner, A. J., Persons, A. K., Casey, L., et al. (2020) · Electronics · doi:10.3390/electronics9091457 · Cited by 9 · see citing works
Neurocognitive function influences dynamic postural stability strategies in healthy collegiate athletes
Porter, K. H., Quintana, C. P., Morelli, N., Heebner, N. R., Winters, J. D., Han, D. Y., & Hoch, M. C. (2021) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2021.07.012 · Cited by 6 · see citing works
Comparison of lower limb segment forces during running on artificial turf and natural grass
McMurtry, S., & Fiedler, G. (2019) · Journal of Rehabilitation and Assistive Technologies Engineering · doi:10.1177/2055668319835701 · Cited by 6 · see citing works
A functional calibration protocol for ankle plantar-dorsiflexion estimate using magnetic and inertial measurement units: Repeatability and reliability assessment
Mascia, G., Brasiliano, P., Feo, P. D., Cereatti, A., & Camomilla, V. (2022) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2022.111202 · Cited by 4 · see citing works
Determining the minimum number of steps required for reliable kinetic, kinematic, gait variability, and VO2 parameters in outdoor running
Padulo, J., Scurati, R., Baldo, S., Esposito, F., & Peyré-Tartaruga, L. A. (2025) · British Medical Bulletin · doi:10.1093/bmb/ldaf025 · Cited by 3 · see citing works
BIOMECHANICAL STUDY OF MUSCLE MOVEMENT IN THE PROCESS OF FOOTBALL TECHNICAL TRAINING
Yue, Y., & Yang, Y. (2020) · Journal of Mechanics in Medicine and Biology · doi:10.1142/s0219519419500829 · Cited by 3 · see citing works
Measuring variation in vertical ground reaction force for football boot midsoles, playing surfaces and football specific movementsPreprint
Keshvari, B., Mitternacht, J., & Senner, V. (2022) · Research Square · doi:10.21203/rs.3.rs-1614221/v1 · Cited by 2 · see citing works
DigiTech use in enhancing effective teaching of Health and Physical Education
Dube, A., & Ishmael, D. (2020) · International Journal of Sport Exercise and Health Research · doi:10.31254/sportmed.4106

Development and Evaluation of Instrumented Soccer Equipment to Collect Ankle Joint Kinematics in the Field
Akins, J. S. (2013) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 1 · see citing works
Reliability and Repeatability of ACL Quick Check®: A Methodology for on Field Lower Limb Joint Kinematics and Kinetics Assessment in Sport Applications
Guiotto, A., Ciniglio, A., Spolaor, F., Pavan, D., Cibin, F., Scaldaferro, A., & SAWACHA, Z. (2021) · Sensors · doi:10.3390/s22010259 · Cited by 8 · see citing works
RELIABILITY OF KNEE JOINT MEASURES IN A CUTTING MOVEMENT
Stephenson, M., Leissring, S. K., Bellovary, B. N., Wolfe, A., Glendenning, C., Purdy, E., Hagner, B., Petushek, E. J., & Jensen, R. L. (2012) · ISBS - Conference Proceedings Archive · Cited by 1 · see citing works
The intra- and inter-rater reliability of the Soccer Injury Movement sscreen (SIMS)
McCunn, R., der Fünten, K. A., Govus, A. D., Julian, R., Schimpchen, J., & Meyer, T. (2017) · University of Bedfordshire Repository (University of Bedfordshire)
Test-Retest Reliability of Ankle Injury Risk Factors
Baumhauer, J. F., Alosa, D. M., Renström, P. A. F. H., Trevino, S. G., & Beynnon, B. D. (1995) · The American Journal of Sports Medicine · doi:10.1177/036354659502300509 · Cited by 47 · see citing works

Authors: Akins, J. S., Heebner, N. R., Lovalekar, M., & Sell, T. C.
Affiliations: University of Pittsburgh (US)
Corresponding author: Akins, Jonathan S.
ORCID: Akins, Jonathan S.
Heebner, Nicholas R.
Lovalekar, Mita
Sell, Timothy C.
Venue: Journal of Applied Biomechanics
Publisher: Human Kinetics
Published: 2015-06
Volume: 31
Issue: 3
Pages: 195-201
ISSN: 1065-8483 (ISSN-L)
1543-2688
DOI: 10.1123/jab.2014-0191
OpenAlex: W2163980277
Cited by: 17
References: 39
Citations by year: 2025: 1 · 2022: 3 · 2021: 5 · 2020: 4 · 2019: 3 · 2018: 1
FWCI: 0.17
Type: journal article
Language: en
Open access: closed
Locations: Journal of Applied Biomechanics (publishedVersion)
PubMed (publishedVersion)
Funders: International Business Machines Corporation
Topics: Physical Sciences › Engineering › Biomedical Engineering › Lower Extremity Biomechanics and Pathologies
Health Sciences › Medicine › Orthopedics and Sports Medicine › Foot and Ankle Surgery
Physical Sciences › Engineering › Biomedical Engineering › Sports Dynamics and Biomechanics
Keywords: inertial sensors, ankle kinematics, football injuries, test-retest reliability, concurrent validity, sagittal plane, shin guards, soccer shoes, lower extremity injury prevention
MeSH terms: Adult, Ankle Joint, Equipment Design, Humans, Male, Protective Devices, Sensitivity and Specificity, Shoes, Soccer, Reproducibility of Results, Range of Motion, Articular, Monitoring, Ambulatory, Equipment Failure Analysis, Sports Equipment, Accelerometry

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Reliability and validity of instrumented soccer equipment

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks