Use of Natural Spoken Language With Automated Mapping of Self-reported Food Intake to Food Composition Data for Low-Burden Real-time Dietary Assessment: Method Comparison Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Background: Self-monitoring food intake is a cornerstone of national recommendations for health, but existing apps for this purpose are burdensome for users and researchers, which limits use. Objective: We developed and pilot tested a new app (COCO Nutritionist) that combines speech understanding technology with technologies for mapping foods to appropriate food composition codes in national databases, for lower-burden and automated nutritional analysis of self-reported dietary intake. Methods: COCO was compared with the multiple-pass, interviewer-administered 24-hour recall method for assessment of energy intake. COCO was used for 5 consecutive days, and 24-hour dietary recalls were obtained for two of the days. Participants were 35 women and men with a mean age of 28 (range 20-58) years and mean BMI of 24 (range 17-48) kg/m2. Results: There was no significant difference in energy intake between values obtained by COCO and 24-hour recall for days when both methods were used (mean 2092, SD 1044 kcal versus mean 2030, SD 687 kcal, P=.70). There were also no significant differences between the methods for percent of energy from protein, carbohydrate, and fat (P=.27-.89), and no trend in energy intake obtained with COCO over the entire 5-day study period (P=.19). Conclusions: This first demonstration of a dietary assessment method using natural spoken language to map reported foods to food composition codes demonstrates a promising new approach to automate assessments of dietary intake.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Nutritionix has been widely used as an NLP nutrition tracking system in prior research [52,53].”
From Gamified optimized diabetes management with artificial intelligence-powered rural telehealth intervention (GODART): protocol for an optimization pilot and feasibility trial (2025) · cites this paper as [53]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Resnick, P., & Varian, H. R. (1997) · Communications of the ACM · doi:10.1145/245108.245121 · Cited by 3,772
Elfhag, K., & Rössner, S. (2005) · Obesity Reviews · doi:10.1111/j.1467-789x.2005.00170.x · Cited by 1,343
Addressing Current Criticism Regarding the Value of Self-Report Dietary Data
Subar, A. F., Freedman, L. S., Tooze, J. A., Kirkpatrick, S. I., Boushey, C., Neuhouser, M. L., Thompson, F. E., Potischman, N., Guenther, P. M., Tarasuk, V., et al. (2015) · The Journal of Nutrition · doi:10.3945/jn.115.219634 · Cited by 1,047
An overview of USDA's Dietary Intake Data System
Raper, N., Perloff, B., Ingwersen, L., Steinfeldt, L., & Anand, J. (2004) · Journal of Food Composition and Analysis · doi:10.1016/j.jfca.2004.02.013 · Cited by 653
Eldridge, A. L., Piernas, C., Illner, A.-K., Gibney, M. J., Gurinović, M. A., De Vries, J. H. M., & Cade, J. E. (2018) · Nutrients · doi:10.3390/nu11010055 · Cited by 216
A review of the use of information and communication technologies for dietary assessment
Ngo, J., Engelen, A., Molag, M., Roesle, J., García-Segovia, P., & Serra-Majem, L. (2009) · British Journal of Nutrition · doi:10.1017/s0007114509990638 · Cited by 179 · cited 1×
“Mobile phone–based apps are widespread and include features like food imaging and portion guides [4-6].”
Rollo, M. E., Ash, S., Lyons-Wall, P., & Russell, A. (2011) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2011.100906 · Cited by 95
Ross, K. M., & Wing, R. R. (2016) · Obesity · doi:10.1002/oby.21536 · Cited by 93
What Are They Really Eating? A Review on New Approaches to Dietary Intake Assessment and Validation
Rollo, M. E., Williams, R. L., Burrows, T. L., Kirkpatrick, S. I., Bucher, T., & Collins, C. E. (2016) · Current Nutrition Reports · doi:10.1007/s13668-016-0182-6 · Cited by 86
Cited by
The Role of Artificial Intelligence in Nutrition Research: A Scoping Review
Sosa-Holwerda, A., Park, O.-H., Albracht-Schulte, K., Niraula, S., Thompson, L., & Oldewage-Theron, W. (2024) · Nutrients · doi:10.3390/nu16132066 · Cited by 114
“Taylor, S. (2021) China [35] To develop an AI-based app to map foods on national (U.”
BackgroundMethodInfluentialArtificial Intelligence Applications to Measure Food and Nutrient Intakes: Scoping Review
Zheng, J., Wang, J., Shen, J., & An, R. (2024) · Journal of Medical Internet Research · doi:10.2196/54557 · Cited by 127
Xing, W., Gao, W., Zhao, Z., Xu, X., Bu, H., Su, H., Mao, G., & Chen, J. (2023) · Journal of Translational Medicine · doi:10.1186/s12967-023-04321-1 · Cited by 73
Phalle, A., & Gokhale, D. (2025) · Frontiers in Nutrition · doi:10.3389/fnut.2025.1518466 · Cited by 70
Liu, Y., Yin, T., Mi, H., Fang, C., & Peng, S. (2024) · Clinical Oral Investigations · doi:10.1007/s00784-024-05561-1 · Cited by 11
Metadata
- Authors
- Taylor, S., Korpusik, M., Das, S., Gilhooly, C., Simpson, R., Glass, J., & Roberts, S.
- Affiliations
- Tufts University (US)
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Corresponding author
- Roberts, Susan
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-12-06
- Volume
- 23
- Issue
- 12
- Pages
- e26988
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8691405
- OpenAlex
- W3212461621
- Cited by
- 26
- References
- 19
- Citations by year
- 2026: 8 · 2025: 4 · 2024: 5 · 2023: 9
- FWCI
- 3.93
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Nursing › Nutrition and Dietetics › Nutrition, Health and Food Behavior
- Health Sciences › Health Professions › Health Information Management › Innovation in Digital Healthcare Systems
- Keywords
- self-reported dietary intake, speech recognition, food composition tables, 24-hour dietary recall, energy intake, method comparison
- MeSH terms
- Adult, Energy Intake, Diet, Eating, Female, Humans, Language, Male, Middle Aged, Young Adult, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
