Recommendations for determining the validity of consumer wearable and smartphone step count: expert statement and checklist of the INTERLIVE network
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Consumer wearable and smartphone devices provide an accessible means to objectively measure physical activity (PA) through step counts. With the increasing proliferation of this technology, consumers, practitioners and researchers are interested in leveraging these devices as a means to track and facilitate PA behavioural change. However, while the acceptance of these devices is increasing, the validity of many consumer devices have not been rigorously and transparently evaluated. The Towards Intelligent Health and Well-Being Network of Physical Activity Assessment (INTERLIVE) is a joint European initiative of six universities and one industrial partner. The consortium was founded in 2019 and strives to develop best-practice recommendations for evaluating the validity of consumer wearables and smartphones. This expert statement presents a best-practice consumer wearable and smartphone step counter validation protocol. A two-step process was used to aggregate data and form a scientific foundation for the development of an optimal and feasible validation protocol: (1) a systematic literature review and (2) additional searches of the wider literature pertaining to factors that may introduce bias during the validation of these devices. The systematic literature review process identified 2897 potential articles, with 85 articles deemed eligible for the final dataset. From the synthesised data, we identified a set of six key domains to be considered during design and reporting of validation studies: target population, criterion measure, index measure, validation conditions, data processing and statistical analysis. Based on these six domains, a set of key variables of interest were identified and a ‘basic’ and ‘advanced’ multistage protocol for the validation of consumer wearable and smartphone step counters was developed. The INTERLIVE consortium recommends that the proposed protocol is used when considering the validation of any consumer wearable or smartphone step counter. Checklists have been provided to guide validation protocol development and reporting. The network also provide guidance for future research activities, highlighting the imminent need for the development of feasible alternative ‘gold-standard’ criterion measures for free-living validation. Adherence to these validation and reporting standards will help ensure methodological and reporting consistency, facilitating comparison between consumer devices. Ultimately, this will ensure that as these devices are integrated into standard medical care, consumers, practitioners, industry and researchers can use this technology safely and to its full potential.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
2011 Compendium of Physical Activities: A Second Update of Codes and MET Values
AINSWORTH, B. E., HASKELL, W. L., HERRMANN, S. D., MECKES, N., BASSETT, D. R., TUDOR-LOCKE, C., GREER, J. L., VEZINA, J., WHITT-GLOVER, M. C., & LEON, A. S. (2011) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31821ece12 · Cited by 6,317
Systematic review of the validity and reliability of consumer-wearable activity trackers
Evenson, K. R., Goto, M. M., & Furberg, R. D. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0314-1 · Cited by 1,232
Large-scale physical activity data reveal worldwide activity inequality
Althoff, T., Sosič, R., Hicks, J. L., King, A. C., Delp, S. L., & Leskovec, J. (2017) · Nature · doi:10.1038/nature23018 · Cited by 1,000
Brickwood, K.-J., Watson, G., O'Brien, J., & Williams, A. D. (2019) · JMIR mHealth and uHealth · doi:10.2196/11819 · Cited by 689
Association of daily step count and step intensity with mortality among US adults
Saint-Maurice, P. F., Troiano, R. P., Bassett, D. R., Graubard, B. I., Carlson, S. A., Shiroma, E. J., Fulton, J. E., & Matthews, C. E. (2020) · JAMA · doi:10.1001/jama.2020.1382 · Cited by 660
Association of Step Volume and Intensity With All-Cause Mortality in Older Women
Lee, I.-M., Shiroma, E. J., Kamada, M., Bassett, D. R., Matthews, C. E., & Buring, J. E. (2019) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2019.0899 · Cited by 604
A Youth Compendium of Physical Activities: Activity Codes and Metabolic Intensities
BUTTE, N. F., WATSON, K. B., RIDLEY, K., ZAKERI, I. F., MCMURRAY, R. G., PFEIFFER, K. A., CROUTER, S. E., HERRMANN, S. D., BASSETT, D. R., LONG, A., et al. (2018) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001430 · Cited by 365
Hall, K. S., Hyde, E. T., Bassett, D. R., Carlson, S. A., Carnethon, M. R., Ekelund, U., Evenson, K. R., Galuska, D. A., Kraus, W. E., Lee, I.-M., et al. (2020) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-00978-9 · Cited by 361
Self-citation
Cited by
Doherty, C., Baldwin, M., Keogh, A., Caulfield, B., & Argent, R. (2024) · Sports Medicine · doi:10.1007/s40279-024-02077-2 · Cited by 133
Self-citationAsh, G. I., Stults-Kolehmainen, M., Busa, M. A., Gaffey, A. E., Angeloudis, K., Muniz-Pardos, B., Gregory, R., Huggins, R. A., Redeker, N. S., Weinzimer, S. A., et al. (2021) · Sports Medicine · doi:10.1007/s40279-021-01543-5 · Cited by 41
Bridging Gaps in Wearable Technology for Exercise and Health Professionals: A Brief Review
Schumann, M., & Doherty, C. (2024) · International Journal of Sports Medicine · doi:10.1055/a-2376-6332 · Cited by 26
“The abundance of factors that affect the signal quality of optical and strain sensors incorporated in consumer wearable devices have been summarized in two recent publications by the INTERLIVE-network [32, 33], an initiative to which the primary author has significantly con - tributed.”
Self-citationSmall, S. R., Chan, S., Walmsley, R., Fritsch, L. V., Acquah, A., Mertes, G., Feakins, B. G., Creagh, A., Strange, A., Matthews, C. E., et al. (2023) · doi:10.1101/2023.02.20.23285750 · Cited by 22
Keogh, A., Argent, R., Doherty, C., Duignan, C., Fennelly, O., Purcell, C., Johnston, W., & Caulfield, B. (2024) · Sensors · doi:10.3390/s24123780 · Cited by 14
Self-citation
Metadata
- Authors
- Johnston, W., Judice, P. B., Molina García, P., Mühlen, J. M., Lykke Skovgaard, E., Stang, J., Schumann, M., Cheng, S., Bloch, W., Brønd, J. C., Ekelund, U., Grøntved, A., Caulfield, B., Ortega, F. B., & Sardinha, L. B.
- Venue
- British Journal of Sports Medicine
- Publisher
- BMJ
- Published
- 2020-12-24
- Volume
- 55
- Issue
- 14
- Pages
- 780-793
- ISSN
- 0306-3674 (ISSN-L)
- 1473-0480
- OpenAlex
- W3117183341
- Cited by
- 128
- References
- 16
- FWCI
- 6.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Recommendations for determining the validity of consumer wearable and smartphone step count: expert statement and checklist of the INTERLIVE network. https://app.cochat.ai/papers/10.1136/bjsports-2020-103147
- The paper
- Johnston, W., Judice, P. B., Molina García, P., Mühlen, J. M., Lykke Skovgaard, E., Stang, J., Schumann, M., Cheng, S., Bloch, W., Brønd, J. C., Ekelund, U., Grøntved, A., Caulfield, B., Ortega, F. B., & Sardinha, L. B. (2021). Recommendations for determining the validity of consumer wearable and smartphone step count: expert statement and checklist of the INTERLIVE network. British Journal of Sports Medicine. https://doi.org/10.1136/bjsports-2020-103147
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.