The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
NutriNet: A Deep Learning Food and Drink Image Recognition System for Dietary Assessment
Open accessAbstract
Automatic food image recognition systems are alleviating the process of food-intake estimation and dietary assessment. However, due to the nature of food images, their recognition is a particularly challenging task, which is why traditional approaches in the field have achieved a low classification accuracy. Deep neural networks have outperformed such solutions, and we present a novel approach to the problem of food and drink image detection and recognition that uses a newly-defined deep convolutional neural network architecture, called NutriNet. This architecture was tuned on a recognition dataset containing 225,953 512 × 512 pixel images of 520 different food and drink items from a broad spectrum of food groups, on which we achieved a classification accuracy of 86.72%, along with an accuracy of 94.47% on a detection dataset containing 130,517 images. We also performed a real-world test on a dataset of self-acquired images, combined with images from Parkinson’s disease patients, all taken using a smartphone camera, achieving a top-five accuracy of 55%, which is an encouraging result for real-world images. Additionally, we tested NutriNet on the University of Milano-Bicocca 2016 (UNIMIB2016) food image dataset, on which we improved upon the provided baseline recognition result. An online training component was implemented to continually fine-tune the food and drink recognition model on new images. The model is being used in practice as part of a mobile app for the dietary assessment of Parkinson’s disease patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
(2016) · Cited by 31,590
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
(2010) · Cited by 8,261
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
A method for solving the convex programming problem with convergence rate O(1/k^2)
Nesterov, Y. E. (1983) · Доклады Академии наук · Cited by 2,662
Food-101 – Mining Discriminative Components with Random Forests
Bossard, L., Guillaumin, M., & Van Gool, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_29 · Cited by 2,072
Recognition of Multiple-Food Images by Detecting Candidate Regions
Matsuda, Y., Hoashi, H., & Yanai, K. (2012) · 2012 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2012.157 · Cited by 362
Some Improvements on Deep Convolutional Neural Network Based Image Classification
Howard, A. G. (2013) · arXiv · doi:10.48550/arxiv.1312.5402 · Cited by 356
Food image recognition using deep convolutional network with pre-training and fine-tuning
Yanai, K., & Kawano, Y. (2015) · 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2015.7169816 · Cited by 333
Food Detection and Recognition Using Convolutional Neural Network
Kagaya, H., Aizawa, K., & Ogawa, M. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654970 · Cited by 301
DeepFood: Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment
Liu, C., Cao, Y., Luo, Y., Chen, G., Vokkarane, V., & Ma, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-39601-9_4 · Cited by 289
Food Recognition: A New Dataset, Experiments, and Results
Ciocca, G., Napoletano, P., & Schettini, R. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636441 · Cited by 266
Automatic Expansion of a Food Image Dataset Leveraging Existing Categories with Domain Adaptation
Kawano, Y., & Yanai, K. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16199-0_1 · Cited by 264
Food recognition using statistics of pairwise local features
Yang, S., Chen, M., Pomerleau, D., & Sukthankar, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539907 · Cited by 263
PFID: Pittsburgh fast-food image dataset
Chen, M., Dhingra, K., Wu, W., Yang, L., Sukthankar, R., & Yang, J. (2009) · 2009 16th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2009.5413511 · Cited by 249
A Food Recognition System for Diabetic Patients Based on an Optimized Bag-of-Features Model
Anthimopoulos, M. M., Gianola, L., Scarnato, L., Diem, P., & Mougiakakou, S. G. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2308928 · Cited by 222
Food/Non-food Image Classification and Food Categorization using Pre-Trained GoogLeNet Model
Singla, A., Yuan, L., & Ebrahimi, T. (2016) · Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary Management · doi:10.1145/2986035.2986039 · Cited by 212
Food image recognition with deep convolutional features
Kawano, Y., & Yanai, K. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication · doi:10.1145/2638728.2641339 · Cited by 209
Food Image Recognition Using Very Deep Convolutional Networks
Hassannejad, H., Matrella, G., Ciampolini, P., De Munari, I., Mordonini, M., & Cagnoni, S. (2016) · Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary Management · doi:10.1145/2986035.2986042 · Cited by 198
A food image recognition system with Multiple Kernel Learning
Joutou, T., & Yanai, K. (2009) · 2009 16th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2009.5413400 · Cited by 186
Food Recognition for Dietary Assessment Using Deep Convolutional Neural Networks
Christodoulidis, S., Anthimopoulos, M., & Mougiakakou, S. G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23222-5_56 · Cited by 89
Tanno, R., Okamoto, K., & Yanai, . (2016) · International Workshop on Multimedia Assisted Dietary Management (MADiMa) · doi:10.1145/2986035.2986044 · Cited by 46
Cited by
Application of Deep Learning in Food: A Review
Zhou, L., Zhang, C., Liu, F., Qiu, Z., & He, Y. (2019) · Comprehensive Reviews in Food Science and Food Safety · doi:10.1111/1541-4337.12492 · Cited by 564
Deep Learning and Medical Diagnosis: A Review of Literature
Bakator, M., & Radosav, D. (2018) · Multimodal Technologies and Interaction · doi:10.3390/mti2030047 · Cited by 510
Liu, Y., Pu, H., & Sun, D.-W. (2021) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2021.04.042 · Cited by 441
Precision nutrition: A systematic literature review
Kirk, D., Catal, C., & Tekinerdogan, B. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104365 · Cited by 238
Malik, H., Farooq, M. S., Khelifi, A., Abid, A., Nasir Qureshi, J., & Hussain, M. (2020) · IEEE Access · doi:10.1109/access.2020.3004766 · Cited by 104
Metadata
- Authors
- Mezgec, S., & Koroušić Seljak, B.
- Venue
- Nutrients
- Publisher
- MDPI AG
- Published
- 2017-06-27
- Volume
- 9
- Issue
- 7
- Pages
- 657
- ISSN
- 2072-6643 (ISSN-L)
- OpenAlex
- W2643943583
- Cited by
- 268
- References
- 32
- FWCI
- 8.31
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.