The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Food Recognition: A New Dataset, Experiments, and Results
Abstract
We propose a new dataset for the evaluation of food recognition algorithms that can be used in dietary monitoring applications. Each image depicts a real canteen tray with dishes and foods arranged in different ways. Each tray contains multiple instances of food classes. The dataset contains 1027 canteen trays for a total of 3616 food instances belonging to 73 food classes. The food on the tray images has been manually segmented using carefully drawn polygonal boundaries. We have benchmarked the dataset by designing an automatic tray analysis pipeline that takes a tray image as input, finds the regions of interest, and predicts for each region the corresponding food class. We have experimented with three different classification strategies using also several visual descriptors. We achieve about 79% of food and tray recognition accuracy using convolutional-neural-networks-based features. The dataset, as well as the benchmark framework, are available to the research community.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,290
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
DOUGLAS, D. H., & PEUCKER, T. K. (1973) · Cartographica · doi:10.3138/fm57-6770-u75u-7727 · Cited by 4,229
Texture features for browsing and retrieval of image data
Manjunath, B. S., & Ma, W. Y. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.531803 · Cited by 3,727
Bag-of-visual-words and spatial extensions for land-use classification
Yang, Y., & Newsam, S. (2010) · Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1869790.1869829 · Cited by 2,969
MatConvNet: Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444
Food-101 – Mining Discriminative Components with Random Forests
Bossard, L., Guillaumin, M., & Van Gool, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_29 · Cited by 2,072
Unsupervised segmentation of color-texture regions in images and video
Deng, Y., & Manjunath, B. S. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.946985 · Cited by 1,389
An iterative procedure for the polygonal approximation of plane curves
Ramer, U. (1972) · Computer Graphics and Image Processing · doi:10.1016/s0146-664x(72)80017-0 · Cited by 1,372
Imbalanced Learning: Foundations, Algorithms, and Applications
(2013) · Wiley eBooks · doi:10.1002/9781118646106 · Cited by 831
CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval
Chatzichristofis, S. A., & Boutalis, Y. S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-79547-6_30 · Cited by 459
Recognition of Multiple-Food Images by Detecting Candidate Regions
Matsuda, Y., Hoashi, H., & Yanai, K. (2012) · 2012 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2012.157 · Cited by 362
The Use of Mobile Devices in Aiding Dietary Assessment and Evaluation
Zhu, F., Bosch, M., Woo, I., Kim, S., Boushey, C. J., Ebert, D. S., & Delp, E. J. (2010) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2010.2051471 · Cited by 355 · cited 2×
“Examples of such systems are FoodLog [14], DietCam [15], Menu-Match [16], FoodCam [17], and those described in [10], [18], and [19].”
BackgroundExploiting local features from deep networks for image retrieval
Ng, J. Y.-H., Yang, F., & Davis, L. S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301272 · Cited by 344
Food Detection and Recognition Using Convolutional Neural Network
Kagaya, H., Aizawa, K., & Ogawa, M. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654970 · Cited by 301
Classification with color and texture: jointly or separately?
Mäenpää, T., & Pietikäinen, M. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2003.11.011 · Cited by 289
Automatic Expansion of a Food Image Dataset Leveraging Existing Categories with Domain Adaptation
Kawano, Y., & Yanai, K. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16199-0_1 · Cited by 264
Food recognition using statistics of pairwise local features
Yang, S., Chen, M., Pomerleau, D., & Sukthankar, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539907 · Cited by 263
PFID: Pittsburgh fast-food image dataset
Chen, M., Dhingra, K., Wu, W., Yang, L., Sukthankar, R., & Yang, J. (2009) · 2009 16th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2009.5413511 · Cited by 249
Measuring Calorie and Nutrition From Food Image
Pouladzadeh, P., Shirmohammadi, S., & Al-Maghrabi, R. (2014) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2014.2303533 · Cited by 247
DietCam: Automatic dietary assessment with mobile camera phones
Kong, F., & Tan, J. (2012) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2011.07.003 · Cited by 239
A Food Recognition System for Diabetic Patients Based on an Optimized Bag-of-Features Model
Anthimopoulos, M. M., Gianola, L., Scarnato, L., Diem, P., & Mougiakakou, S. G. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2308928 · Cited by 222
Food image recognition with deep convolutional features
Kawano, Y., & Yanai, K. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication · doi:10.1145/2638728.2641339 · Cited by 209
FoodCam: A real-time food recognition system on a smartphone
Kawano, Y., & Yanai, K. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-014-2000-8 · Cited by 191
Recognition and volume estimation of food intake using a mobile device
Puri, M., Zhu, Z., Yu, Q., Divakaran, A., & Sawhney, H. (2009) · 2009 Workshop on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2009.5403087 · Cited by 191
A food image recognition system with Multiple Kernel Learning
Joutou, T., & Yanai, K. (2009) · 2009 16th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2009.5413400 · Cited by 186
Automatic Chinese food identification and quantity estimation
Chen, M.-Y., Yang, Y.-H., Ho, C.-J., Wang, S.-H., Liu, S.-M., Chang, E., Yeh, C.-H., & Ouhyoung, M. (2012) · SIGGRAPH Asia Technical Briefs · doi:10.1145/2407746.2407775 · Cited by 167
Real-Time Mobile Food Recognition System
Kawano, Y., & Yanai, K. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2013.5 · Cited by 160
Food calorie measurement using deep learning neural network
Pouladzadeh, P., Kuhad, P., Peddi, S. V. B., Yassine, A., & Shirmohammadi, S. (2016) · IEEE International Instrumentation and Measurement Technology Conference · doi:10.1109/i2mtc.2016.7520547 · Cited by 147
Image Recognition of 85 Food Categories by Feature Fusion
甫足, 創., Joutou, T., & Yanai, . (2010) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2010.51 · Cited by 137
Menu-Match: Restaurant-Specific Food Logging from Images
Beijbom, O., Joshi, N., Morris, D., Saponas, S., & Khullar, S. (2015) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2015.117 · Cited by 124
Combining global and local features for food identification in dietary assessment
Bosch, M., Zhu, F. M., Khanna, N., Boushey, C. J., & Delp, E. J. (2011) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2011.6115809 · Cited by 116
Leveraging Context to Support Automated Food Recognition in Restaurants
Bettadapura, V., Thomaz, E., Parnami, A., Abowd, G. D., & Essa, I. A. (2015) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2015.83 · Cited by 113
An interactive tool for manual, semi-automatic and automatic video annotation
Bianco, S., Ciocca, G., Napoletano, P., & Schettini, R. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2014.06.015 · Cited by 108
Self-citationFood image analysis: Segmentation, identification and weight estimation
He, Y., Xu, C., Khanna, N., Boushey, C. J., & Delp, E. J. (2013) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2013.6607548 · Cited by 102
Leveraging Context to Support Automated Food Recognition in Restaurants
Bettadapura, V., Thomaz, E., Parnami, A., Abowd, G. D., & Essa, I. A. (2015) · Cited by 95
Theoretical and experimental comparison of different approaches for color texture classification
Bianconi, F., Harvey, R., Southam, P., & Fernández, A. (2011) · Journal of Electronic Imaging · doi:10.1117/1.3651210 · Cited by 92
A Benchmark Dataset to Study the Representation of Food Images
Farinella, G. M., Allegra, D., & Stanco, F. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16199-0_41 · Cited by 85
Kawano, Y., & Yanai, . (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654869 · Cited by 85
Kitamura, K., Yamasaki, T., & Aizawa, K. (2009) · ACM Workshop on Multimedia for Cooking and Eating Activities (CEA) · doi:10.1145/1630995.1631001 · Cited by 84
Volume estimation using food specific shape templates in mobile image-based dietary assessment
Chae, J., Woo, I., Kim, S., Maciejewski, R., Zhu, F. M., Delp, E. J., Boushey, C. J., & Ebert, D. S. (2011) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.876669 · Cited by 82
Analysis of food images: Features and classification
He, Y., Xu, C., Khanna, N., Boushey, C. J., & Delp, E. J. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025555 · Cited by 82
Fast food recognition from videos of eating for calorie estimation
Wu, W., & Yang, J. (2009) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2009.5202718 · Cited by 82
Classifying food images represented as Bag of Textons
Farinella, G. M., Moltisanti, M., & Battiato, S. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7026055 · Cited by 71
Evaluating color texture descriptors under large variations of controlled lighting conditions
Cusano, C., Napoletano, P., & Schettini, R. (2015) · Journal of the Optical Society of America A · doi:10.1364/josaa.33.000017 · Cited by 67
Self-citationFood Recognition and Leftover Estimation for Daily Diet Monitoring
Ciocca, G., Napoletano, P., & Schettini, R. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23222-5_41 · Cited by 60
Self-citationPersonal dietary assessment using mobile devices
Mariappan, A., Bosch, M., Zhu, F. M., Boushey, C. J., Kerr, D. A., Ebert, D. S., & Delp, E. J. (2009) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.813556 · Cited by 57
Food Image Recognition with Convolutional Neural Networks
Zhang, W., Zhao, D., Gong, W., et al. (2015) · doi:10.1109/uic-atc-scalcom-cbdcom-iop.2015.139 · Cited by 50
A Novel SVM Based Food Recognition Method for Calorie Measurement Applications
Pouladzadeh, P., Villalobos, G., Almaghrabi, R., & Shirmohammadi, S. (2012) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew.2012.92 · Cited by 46
Food image classification using local appearance and global structural information
Nguyen, D. T., Zong, Z., Ogunbona, P., Probst, Y., & Li, W. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.03.017 · Cited by 45
Image orientation detection using LBP-based features and logistic regression
Ciocca, G., Cusano, C., & Schettini, R. (2013) · Multimedia Tools and Applications · doi:10.1007/s11042-013-1766-4 · Cited by 42
Self-citationFood Weight Estimation using Smartphone and Cutlery
Hippocrate, E. A. A., Suwa, H., Arakawa, Y., & Yasumoto, K. (2016) · doi:10.1145/2933566.2933568 · Cited by 33
A mobile phone user interface for image-based dietary assessment
Ahmad, Z., Khanna, N., Kerr, D. A., Boushey, C. J., & Delp, E. J. (2014) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2041334 · Cited by 22
Cooking Action Recognition with iVAT: An Interactive Video Annotation Tool
Bianco, S., Ciocca, G., Napoletano, P., Schettini, R., Margherita, R., Marini, G., & Pantaleo, G. (2013) · International Conference on Image Analysis and Processing · doi:10.1007/978-3-642-41184-7_64 · Cited by 18
Self-citationColour-based texture image classification using the complex wavelet transform
Barilla-Perez, M. E., & Spann, M. (2008) · International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE) · doi:10.1109/iceee.2008.4723449 · Cited by 17
Intensity and color descriptors for texture classification
Cusano, C., Napoletano, P., & Schettini, R. (2013) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2006070 · Cited by 16
Self-citationA Video Processing Approach to the Study of Obesity
Yao, N., Sclabassi, R. J., Liu, Q., Yang, J., Fernstrom, J. D., Fernstrom, M. H., & Sun, M. (2007) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2007.4285003 · Cited by 16
Cited by
Application of Deep Learning in Food: A Review
Zhou, L., Zhang, C., Liu, F., Qiu, Z., & He, Y. (2019) · Comprehensive Reviews in Food Science and Food Safety · doi:10.1111/1541-4337.12492 · Cited by 564
Deep learning in food category recognition
Zhang, Y., Deng, L., Zhu, H., Wang, W., Ren, Z., Zhou, Q., Lu, S., Sun, S., Zhu, Z., Gorriz, J. M., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101859 · Cited by 357
Min, W., Jiang, S., Liu, L., Rui, Y., & Jain, R. (2020) · ACM Computing Surveys · doi:10.1145/3329168 · Cited by 341
NutriNet: A Deep Learning Food and Drink Image Recognition System for Dietary Assessment
Mezgec, S., & Koroušić Seljak, B. (2017) · Nutrients · doi:10.3390/nu9070657 · Cited by 268
Large Scale Visual Food Recognition
Min, W., Wang, Z., Liu, Y., Luo, M., Kang, L., Wei, X., Wei, X., & Jiang, S. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3237871 · Cited by 253
Metadata
- Authors
- Ciocca, G., Napoletano, P., & Schettini, R.
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2017-05
- Volume
- 21
- Issue
- 3
- Pages
- 588-598
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W2560804113
- Cited by
- 266
- References
- 62
- FWCI
- 13.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.