Cited by 133Physical Activity and HealthContext-Aware Activity Recognition SystemsSports Performance and Training

Criterion-Validity of Commercially Available Physical Activity Tracker to Estimate Step Count, Covered Distance and Energy Expenditure during Sports Conditions

Open access
Wahl, Yvonne, Düking, Peter, Droszez, Anna, Wahl, Patrick, Mester, Joachim·2017·Frontiers in Physiology

Abstract

Background: In the past years, there was an increasing development of physical activity tracker (Wearables). For recreational people, testing of these devices under walking or light jogging conditions might be sufficient. For (elite) athletes, however, scientific trustworthiness needs to be given for a broad spectrum of velocities or even fast changes in velocities reflecting the demands of the sport. Therefore, the aim was to evaluate the validity of eleven Wearables for monitoring step count, covered distance and energy expenditure (EE) under laboratory conditions with different constant and varying velocities. Methods: Twenty healthy sport students (10 men, 10 women) performed a running protocol consisting of four 5 min stages of different constant velocities (4.3; 7.2; 10.1; 13.0 km·h-1), a 5 min period of intermittent velocity, and a 2.4 km outdoor run (10.1 km·h-1) while wearing eleven different Wearables (Bodymedia Sensewear, Beurer AS 80, Polar Loop, Garmin Vivofit, Garmin Vivosmart, Garmin Vivoactive, Garmin Forerunner 920XT, Fitbit Charge, Fitbit Charge HR, Xaomi MiBand, Withings Pulse Ox). Step count, covered distance, and energy expenditure were evaluated by comparing each Wearable with a criterion method (Optogait system and manual counting for step count, treadmill for covered distance and indirect calorimetry for EE). Results: All Wearables, except Bodymedia Sensewear, Polar Loop, and Beurer AS80, revealed good validity (small MAPE, good ICC) for all constant and varying velocities for monitoring step count. For covered distance, all Wearables showed a very low ICC (< 0.1) and high MAPE (up to 50%), revealing no good validity. The measurement of EE was acceptable for the Garmin, Fitbit and Withings Wearables (small to moderate MAPE), while Bodymedia Sensewear, Polar Loop, and Beurer AS80 showed a high MAPE up to 56% for all test conditions. Conclusion: In our study, most Wearables provide an acceptable level of validity for step counts at different constant and intermittent running velocities reflecting sports conditions. However, the covered distance, as well as the EE could not be assessed validly with the investigated Wearables. Consequently, covered distance and EE should not be monitored with the presented Wearables, in sport specific conditions.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fphys.2017.00725

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The Bodymedia Sensewear showed good reliability during outdoor walking (ICC=0.82) but poor reliability during various treadmill walking speeds (ICC=0.18 to 0.27).

    “The Bodymedia Sensewear showed good reliability during outdoor walking (ICC=0.82); however, poor reliability was observed during various treadmill walking speeds (ICC=0.18 to 0.27) [80].”

    From Consumer-based wearable activity trackers increase physical activity participation: systematic review and meta-analysis (2019) · cites this paper as [80]

    Results Table 1 reports low Bodymedia Sensewear step-count ICCs at treadmill speeds, including 0.18 at 4.3 km/h and 0.27 at 10.1 km/h. But the Methods describe the outdoor condition as a run, not a walk, and the Statistical analysis defines ICC as agreement with a criterion measure for validity, not test–retest reliability. The retrieved passages do not establish the claimed outdoor ICC of 0.82. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Fitbit One, Zip and Charge HR, Jawbone Up, LumoBack, and Withings Pulse have all demonstrated excellent test-retest reliability for step count (ICC >.90).

    “Fitbit One, Zip and Charge HR, Jawbone Up, LumoBack, and Withings Pulse have all demonstrated excellent test-retest reliability for step count (Intraclass Correlation Coefficient [ICC] >.90) [78-80]”

    From Consumer-based wearable activity trackers increase physical activity participation: systematic review and meta-analysis (2019) · cites this paper as [80]

    The Results (Step count; page unavailable) report good-to-excellent step-count ICCs for some tested wearables, including Fitbit Charge HR and Withings Pulse Ox. But the Statistical analysis section (page unavailable) defines those ICCs as agreement with a criterion measure, not test-retest reliability. The Instruments section does not list Fitbit One, Zip, Jawbone Up, or LumoBack among the devices tested. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • Xiaomi data were not analyzed in a single indirect calorimetry study owing to the lack of data [53].

    “Xiaomi data were not analyzed in a single indirect calorimetry study owing to the lack of data [53].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 26 · Cited by 133

Authors
Wahl, Y., Düking, P., Droszez, A., Wahl, P., & Mester, J.
Affiliations
  • German Sport University Cologne (DE)
  • University of Würzburg (DE)
Corresponding author
Wahl, Yvonne
Venue
Frontiers in Physiology
Published
2017-09-22
Volume
8
Pages
725-725
ISSN
1664-042X (ISSN-L)
OpenAlex
W2757059201
Cited by
133
References
26
Citations by year
2026: 8 · 2025: 9 · 2024: 12 · 2023: 19 · 2022: 14 · 2021: 17 · 2020: 24 · 2019: 18 · 2018: 11 · 2017: 1
FWCI
10.91
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Frontiers in Physiology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Physiology › Physical Activity and Health
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Health Sciences › Medicine › Orthopedics and Sports Medicine › Sports Performance and Training
Keywords
wearable activity trackers, wearable devices, criterion validity, step count, energy expenditure, running speed, intermittent operation, Garmin, Fitbit, OptoGait, indirect calorimetry, sports monitoring

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review