The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study
Open accessAbstract
BACKGROUND: Technological advances have seen a burgeoning industry for accelerometer-based wearable activity monitors targeted at the consumer market. The purpose of this study was to determine the convergent validity of a selection of consumer-level accelerometer-based activity monitors. METHODS: 21 healthy adults wore seven consumer-level activity monitors (Fitbit One, Fitbit Zip, Jawbone UP, Misfit Shine, Nike Fuelband, Striiv Smart Pedometer and Withings Pulse) and two research-grade accelerometers/multi-sensor devices (BodyMedia SenseWear, and ActiGraph GT3X+) for 48-hours. Participants went about their daily life in free-living conditions during data collection. The validity of the consumer-level activity monitors relative to the research devices for step count, moderate to vigorous physical activity (MVPA), sleep and total daily energy expenditure (TDEE) was quantified using Bland-Altman analysis, median absolute difference and Pearson's correlation. RESULTS: All consumer-level activity monitors correlated strongly (r > 0.8) with research-grade devices for step count and sleep time, but only moderately-to-strongly for TDEE (r = 0.74-0.81) and MVPA (r = 0.52-0.91). Median absolute differences were generally modest for sleep and steps (<10% of research device mean values for the majority of devices) moderate for TDEE (<30% of research device mean values), and large for MVPA (26-298%). Across the constructs examined, the Fitbit One, Fitbit Zip and Withings Pulse performed most strongly. CONCLUSIONS: In free-living conditions, the consumer-level activity monitors showed strong validity for the measurement of steps and sleep duration, and moderate valid for measurement of TDEE and MVPA. Validity for each construct ranged widely between devices, with the Fitbit One, Fitbit Zip and Withings Pulse being the strongest performers.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Fitbit One, Zip and Charge HR, Jawbone Up, LumoBack, and Withings Pulse have all demonstrated excellent test-retest reliability for step count (ICC >.90).
“Fitbit One, Zip and Charge HR, Jawbone Up, LumoBack, and Withings Pulse have all demonstrated excellent test-retest reliability for step count (Intraclass Correlation Coefficient [ICC] >.90) [78-80]”
From Consumer-based wearable activity trackers increase physical activity participation: systematic review and meta-analysis (2019) · cites this paper as [78]
Table 2 (Results; page unavailable) reports step-count ICCs above .90 for Fitbit One and Zip, Jawbone UP, and Withings Pulse. Those ICCs compare the monitors with reference devices; they are not test-retest reliability results. The Methods list neither Fitbit Charge HR nor LumoBack among the devices tested. (LLM, conf=0.88)
Experimental — accuracy not yet measuredNine studies (22 comparisons) examined energy expenditure in free-living settings compared with doubly labeled water and accelerometry.
“Nine studies (22 comparisons) examined energy expenditure in free-living settings compared with the criterion measures of doubly labeled water [104] and accelerometry [29,49,79,101,131,172,174,175].”
From Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review (2020) · cites this paper as [131]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Calibration of the Computer Science and Applications, Inc. accelerometer
FREEDSON, P. S., MELANSON, E., & SIRARD, J. (1998) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-199805000-00021 · Cited by 3,825 · see citing works
International Standards for Anthropometric Assessment (2006)
Marfell-Jones, M., Olds, T., Stewart, A. D., & Carter, L. (2006) · VUBIR (Vrije Universiteit Brussel) · Cited by 2,608 · see citing works
Self-citationvan Hees, V. T., Gorzelniak, L., Dean‐Leon, E., Eder, M., Pias, M. R., Taherian, S., Ekelund, U., Renström, F., Franks, P. W., Horsch, A., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061691 · Cited by 937 · see citing works
Petruzzello, S. J., Landers, D. M., Hatfield, B. D., Kubitz, K. A., & Salazar, W. (1991) · Sports Medicine · doi:10.2165/00007256-199111030-00002 · Cited by 908 · see citing works
Validity of 10 Electronic Pedometers for Measuring Steps, Distance, and Energy Cost
CROUTER, S. E., SCHNEIDER, P. L., KARABULUT, M., & BASSETT, D. R. (2003) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000078932.61440.a2 · Cited by 899 · see citing works
Maher, C. A., Lewis, L. K., Ferrar, K., Marshall, S., De Bourdeaudhuij, I., & Vandelanotte, C. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2952 · Cited by 733 · see citing works
Self-citationMeasuring and Influencing Physical Activity with Smartphone Technology: A Systematic Review
Roig, J. B., Gilson, N. D., Puig-Ribera, A. M., Contreras-Espinosa, R. S., & Trost, S. G. (2014) · Sports Medicine · doi:10.1007/s40279-014-0142-5 · Cited by 554 · see citing works
Craft, L. L., & Landers, D. M. (1998) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.20.4.339 · Cited by 480 · cited 1× · see citing works
“Background Physical activity has important health benefits, including reducing the risk of cardiovascular disease, some cancers, type-2 diabetes, osteoporosis, anxiety and depression [1-3].”
BackgroundAccuracy of Armband Monitors for Measuring Daily Energy Expenditure in Healthy Adults
Johannsen, D. L., Calabro, M. A., Stewart, J. W., Franke, W. D., Rood, J. C., & Welk, G. J. (2010) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3181e0b3ff · Cited by 424 · see citing works
Validity of Consumer-Based Physical Activity Monitors
LEE, J.-M., KIM, Y., & WELK, G. J. (2014) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000287 · Cited by 401 · cited 7× · see citing works
“Lee, Kim and Welk [16] examined the validity of eight consumer-level devices for”
BackgroundResultInfluentialComparison of Pedometer and Accelerometer Accuracy under Controlled Conditions
LE MASURIER, G. C., & TUDOR-LOCKE, C. (2003) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000064996.63632.10 · Cited by 360 · see citing works
Validation of the Fitbit One activity monitor device during treadmill walking
Takacs, J., Pollock, C. L., Guenther, J. R., Bahar, M., Napier, C., & Hunt, M. A. (2013) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2013.10.241 · Cited by 322 · see citing works
Blair, S. N., & Connelly, J. C. (1996) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1996.10607943 · Cited by 312 · see citing works
Movement toward a novel activity monitoring device
Montgomery-Downs, H. E., Insana, S. P., & Bond, J. A. (2012) · Sleep and Breathing · doi:10.1007/s11325-011-0585-y · Cited by 301 · see citing works
van Hees, V. T., Renström, F., Wright, A., Gradmark, A., Catt, M., Chen, K. Y., Löf, M., Bluck, L. J. C., Pomeroy, J. J., Wareham, N. J., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022922 · Cited by 289 · see citing works
Motion Sensor Accuracy under Controlled and Free-Living Conditions
Masurier, G. C. L., Lee, S. M., & Tudor-Locke, C. E. (2004) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000126777.50188.73 · Cited by 229 · see citing works
Comparison of Four ActiGraph Accelerometers during Walking and Running
John, D., Tyo, B. M., & Bassett, D. R. (2010) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3181b3af49 · Cited by 183 · see citing works
Accuracy of 2 Activity Monitors in Detecting Steps in People With Stroke and Traumatic Brain Injury
Fulk, G. D., Combs, S. A., Danks, K. A., Nirider, C. D., Raja, B., & Reisman, D. S. (2014) · Physical Therapy · doi:10.2522/ptj.20120525 · Cited by 182 · see citing works
Buckworth, J., Lee, R. E., Regan, G. R., Schneider, L., & DiClemente, C. C. (2006) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2006.06.007 · Cited by 172 · see citing works
A Comparison of Energy Expenditure Estimation of Several Physical Activity Monitors
Dannecker, K. L., Sazonova, N. A., Melanson, E. L., Sazonov, E. E., & Browning, R. C. (2013) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e318299d2eb · Cited by 124 · see citing works
Influence of Speed and Step Frequency during Walking and Running on Motion Sensor Output
Rowlands, A. V., Stone, M. R., & Eston, R. G. (2007) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e318031126c · Cited by 121 · see citing works
Self-citationComparison of two Actigraph models for assessing free-living physical activity in Indian adolescents
Corder, K., Brage, S., Ramachandran, A., Snehalatha, C., Wareham, N., & Ekelund, U. (2007) · Journal of Sports Sciences · doi:10.1080/02640410701283841 · Cited by 120 · see citing works
O’Driscoll, D. M., Turton, A. R., Copland, J. M., Strauss, B. J., & Hamilton, G. S. (2012) · Sleep And Breathing · doi:10.1007/s11325-012-0662-x · Cited by 87 · see citing works
Sleep estimation using BodyMedia′s SenseWear™ armband in patients with obstructive sleep apnea
BaHammam, A. S., & Sharif, M. (2013) · Annals of Thoracic Medicine · doi:10.4103/1817-1737.105720 · Cited by 87 · see citing works
Assessing Energy Expenditure in Male Endurance Athletes
Koehler, K., BRAUN, H., de Marées, M., Fusch, G., Fusch, C., & Schaenzer, W. (2010) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31820750f5 · Cited by 71 · see citing works
Bornstein, D. B., Beets, M. W., Byun, W., Welk, G. J., Bottai, M., Dowda, M. C., & Pate, R. R. (2011) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2011.03.013 · Cited by 67 · see citing works
Farooqi, N., Slinde, F., Håglin, L., & Sandström, T. (2013) · Physiological Reports · doi:10.1002/phy2.150 · Cited by 32 · see citing works
Chen, A., Karolczak‐Bayatti, M., Sweeney, M., Treumann, A., Morrissey, K., Ulrich, S. M., Europe‐Finner, G. N., & Taggart, M. J. (2013) · Physiological Reports · doi:10.1002/phy2.127 · Cited by 25 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Systematic review of the validity and reliability of consumer-wearable activity trackers
Evenson, K. R., Goto, M. M., & Furberg, R. D. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0314-1 · Cited by 1,232 · see citing works
Panel, C. C., Watson, N. F., Badr, M. S., Belenky, G., Bliwise, D. L., Buxton, O. M., Buysse, D., Dinges, D. F., Gangwisch, J., Grandner, M. A., et al. (2015) · Sleep · doi:10.5665/sleep.4886 · Cited by 906 · see citing works
Yin, J., Jin, X., Shan, Z., Li, S., Huang, H., Li, P., Peng, X., Peng, Z., Yu, K., Bao, W., et al. (2017) · Journal of the American Heart Association · doi:10.1161/jaha.117.005947 · Cited by 721 · see citing works
Fuller, D., Colwell, E., Low, J., Orychock, K., Tobin, M. A., Simango, B., Buote, R., Van Heerden, D., Luan, H., Cullen, K., et al. (2020) · JMIR mHealth and uHealth · doi:10.2196/18694 · Cited by 715 · see citing works
Brickwood, K.-J., Watson, G., O'Brien, J., & Williams, A. D. (2019) · JMIR mHealth and uHealth · doi:10.2196/11819 · Cited by 690 · see citing works
Accuracy of Fitbit Devices: Systematic Review and Narrative Syntheses of Quantitative Data
Feehan, L. M., Geldman, J., Sayre, E. C., Park, C., Ezzat, A. M., Yoo, J. Y., Hamilton, C. B., & Li, L. C. (2018) · JMIR mHealth and uHealth · doi:10.2196/10527 · Cited by 616 · see citing works
Watson, N. F., Badr, M. S., Belenky, G., Bliwise, D. L., Buxton, O. M., Buysse, D., Dinges, D. F., Gangwisch, J., Grandner, M. A., Kushida, C., et al. (2015) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.4950 · Cited by 568 · see citing works
Henriksen, A., Haugen Mikalsen, M., Woldaregay, A. Z., Muzny, M., Hartvigsen, G., Hopstock, L. A., & Grimsgaard, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9157 · Cited by 542 · see citing works
Reliability and validity of ten consumer activity trackers
Kooiman, T. J. M., Dontje, M. L., Sprenger, S. R., Krijnen, W. P., van der Schans, C. P., & de Groot, M. (2015) · BMC Sports Science, Medicine and Rehabilitation · doi:10.1186/s13102-015-0018-5 · Cited by 360 · see citing works
Accuracy of Heart Rate Watches: Implications for Weight Management
Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisløff, U., & Coombes, J. S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154420 · Cited by 336 · see citing works
Mantua, J., Gravel, N., & Spencer, R. (2016) · Sensors · doi:10.3390/s16050646 · Cited by 314 · see citing works
Baron, K. G., Duffecy, J., Berendsen, M. A., Cheung Mason, I., Lattie, E. G., & Manalo, N. C. (2018) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2017.12.002 · Cited by 186 · see citing works
Users' experiences of wearable activity trackers: a cross-sectional study
Maher, C., Ryan, J., Ambrosi, C., & Edney, S. (2017) · BMC Public Health · doi:10.1186/s12889-017-4888-1 · Cited by 180 · see citing works
Self-citationWearable Devices for Precision Medicine and Health State Monitoring
Jeong, I. C., Bychkov, D., & Searson, P. C. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2871638 · Cited by 155 · see citing works
Sushames, A., Edwards, A., Thompson, F., McDermott, R., & Gebel, K. (2016) · PLOS ONE · doi:10.1371/journal.pone.0161224 · Cited by 152 · see citing works
Evaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review
McCallum, C., Rooksby, J., & Gray, C. M. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9054 · Cited by 126 · see citing works
Chowdhury, E. A., Western, M. J., Nightingale, T. E., Peacock, O. J., & Thompson, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0171720 · Cited by 118 · see citing works
Adams, M. A., Hurley, J. C., Todd, M., Bhuiyan, N., Jarrett, C. L., Tucker, W. J., Hollingshead, K. E., & Angadi, S. S. (2017) · BMC Public Health · doi:10.1186/s12889-017-4197-8 · Cited by 110 · see citing works
Gamifying Accelerometer Use Increases Physical Activity Levels of Sedentary Office Workers
Gremaud, A. L., Carr, L. J., Simmering, J. E., Evans, N. J., Cremer, J. F., Segre, A. M., Polgreen, L. A., & Polgreen, P. M. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.117.007735 · Cited by 89 · see citing works
“98) in free living conditions.(29) Through the Fitbit application programming interface and our custom-built texting platform, our team was”
MethodConcurrent Validity of Wearable Activity Trackers Under Free-Living Conditions
Brooke, S. M., An, H.-S., Kang, S.-K., Noble, J. M., Berg, K. E., & Lee, J.-M. (2017) · Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000001571 · Cited by 79 · see citing works
Hickey, A. M., & Freedson, P. S. (2016) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2016.02.006 · Cited by 77 · see citing works
Liang, Z., & Chapa-Martell, M. A. (2019) · JMIR mHealth and uHealth · doi:10.2196/13384 · Cited by 76 · see citing works
Identification and Classification of Usage Patterns in Long-Term Activity Tracking
Meyer, J., Wasmann, M., Heuten, W., El Ali, A., & Boll, S. C. J. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025690 · Cited by 72 · see citing works
Vandelanotte, C., Duncan, M. J., Maher, C. A., Schoeppe, S., Rebar, A. L., Power, D. A., Short, C. E., Doran, C. M., Hayman, M. J., & Alley, S. J. (2018) · Journal of Medical Internet Research · doi:10.2196/11321 · Cited by 68 · see citing works
Self-citationLeth, S., Hansen, J., Nielsen, O., & Dinesen, B. (2017) · Sensors · doi:10.3390/s17010211 · Cited by 64 · see citing works
Degroote, L., Hamerlinck, G., Poels, K., Maher, C., Crombez, G., De Bourdeaudhuij, I., Vandendriessche, A., Curtis, R. G., & DeSmet, A. (2020) · JMIR mhealth and uhealth · doi:10.2196/16674 · Cited by 60 · see citing works
Lynch, C., Bird, S., Lythgo, N., & Selva-Raj, I. (2020) · American Journal of Health Promotion · doi:10.1177/0890117119895204 · Cited by 58 · see citing works
Vetrovsky, T., Siranec, M., Marencakova, J., Tufano, J. J., Capek, V., Bunc, V., & Belohlavek, J. (2019) · PLOS ONE · doi:10.1371/journal.pone.0222569 · Cited by 53 · see citing works
Braakhuis, H., Berger, M., & Bussmann, J. (2019) · Journal of Rehabilitation Medicine · doi:10.2340/16501977-2522 · Cited by 51 · see citing works
Gruwez, A., Libert, W., Ameye, L., & Bruyneel, M. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.03.008 · Cited by 45 · see citing works
Duncan, M. J., Vandelanotte, C., Trost, S. G., Rebar, A. L., Rogers, N., Burton, N. W., Murawski, B., Rayward, A., Fenton, S., & Brown, W. J. (2016) · BMC Public Health · doi:10.1186/s12889-016-3256-x · Cited by 43 · see citing works
Pal, D., Vanijja, V., Arpnikanondt, C., Zhang, X., & Papasratorn, B. (2019) · IEEE Access · doi:10.1109/access.2019.2917061 · Cited by 39 · see citing works
Shelley, J., Fairclough, S. J., Knowles, Z. R., Southern, K. W., McCormack, P., Dawson, E. A., Graves, L. E. F., & Hanlon, C. (2018) · BMC Pediatrics · doi:10.1186/s12887-018-1301-x · Cited by 31 · see citing works
Validation of the Fitbit One® for physical activity measurement at an upper torso attachment site
Diaz, K. M., Krupka, D. J., Chang, M. J., Shaffer, J. A., Ma, Y., Goldsmith, J., Schwartz, J. E., & Davidson, K. W. (2016) · BMC Research Notes · doi:10.1186/s13104-016-2020-8 · Cited by 29 · see citing works
Comparison of wrist-worn and hip-worn activity monitors under free living conditions
Hargens, T. A., Deyarmin, K. N., Snyder, K. M., Mihalik, A. G., & Sharpe, L. E. (2017) · Journal of Medical Engineering & Technology · doi:10.1080/03091902.2016.1271046 · Cited by 30 · see citing works
Accuracy of Consumer Monitors for Estimating Energy Expenditure and Activity Type
WOODMAN, J. A., CROUTER, S. E., BASSETT, D. R., FITZHUGH, E. C., & BOYER, W. R. (2017) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001090 · Cited by 29 · see citing works
Validation study of Polar V800 accelerometer
Hernández-Vicente, A., Santos-Lozano, A., De Cocker, K., & Garatachea, N. (2016) · Annals of Translational Medicine · doi:10.21037/atm.2016.07.16 · Cited by 23 · see citing works
Shah, Y., Dunn, J., Huebner, E., & Landry, S. (2017) · Computers in Industry · doi:10.1016/j.compind.2017.01.003 · Cited by 18 · see citing works
Investigating Wearable Technology for Fatigue Identification in the Workplace
Griffiths, C., Bowen, J., & Hinze, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67684-5_22 · Cited by 13 · see citing works
Quality of Experience Evaluation of Smart-Wearables: A Mathematical Modelling Approach
Pal, D., Triyason, T., Varadarajan, V., & Zhang, X. (2019) · 2019 IEEE 35th International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew.2019.00-32 · Cited by 10 · see citing works
Occupational physical activity in brewery and office workers
Thompson, J. F., Severson, R. L., & Rosecrance, J. C. (2018) · Journal of Occupational and Environmental Hygiene · doi:10.1080/15459624.2018.1492136 · Cited by 9 · see citing works
- Authors
- Ferguson, T., Rowlands, A. V., Olds, T., & Maher, C.
- Affiliations
- University of South Australia (AU)
- Corresponding author
- Maher, Carol
- Venue
- International Journal of Behavioral Nutrition and Physical Activity
- Published
- 2015-03-27
- Volume
- 12
- Issue
- 1
- Pages
- 42-42
- ISSN
- 1479-5868 (ISSN-L)
- PMC
- PMC4416251
- OpenAlex
- W2097760682
- Cited by
- 468
- References
- 28
- Citations by year
- 2026: 17 · 2025: 10 · 2024: 16 · 2023: 17 · 2022: 28 · 2021: 37 · 2020: 55 · 2019: 74 · 2018: 68 · 2017: 80 · 2016: 56 · 2015: 10
- FWCI
- 52.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- International Journal of Behavioral Nutrition and Physical Activity (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UniSA Research Outputs Repository (University of South Australia) (submittedVersion, other-oa)
- Figshare (submittedVersion, cc-by)
- Leicester Research Archive (University of Leicester) (submittedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Physiology › Physical Activity and Health
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- wearable accelerometers, convergent validity, step count, moderate-to-vigorous physical activity, sleep duration, total energy expenditure, Fitbit, free-living conditions
- MeSH terms
- Adult, Cross-Sectional Studies, Energy Metabolism, Female, Humans, Male, Middle Aged, Motor Activity, Sleep, Reproducibility of Results, Exercise, Monitoring, Ambulatory, Young Adult, Actigraphy, Accelerometry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review