A New Deep Learning-Based Food Recognition System for Dietary Assessment on An Edge Computing Service Infrastructure
The DOI matches its Crossref record; 53 of the 56 references it cites were found in a registry or an index.
Abstract
Literature has indicated that accurate dietary assessment is very important for assessing the effectiveness of weight loss interventions. However, most of the existing dietary assessment methods rely on memory. With the help of pervasive mobile devices and rich cloud services, it is now possible to develop new computer-aided food recognition system for accurate dietary assessment. However, enabling this future Internet of Things-based dietary assessment imposes several fundamental challenges on algorithm development and system design. In this paper, we set to address these issues from the following two aspects: (1) to develop novel deep learning-based visual food recognition algorithms to achieve the best-in-class recognition accuracy; (2) to design a food recognition system employing edge computing-based service computing paradigm to overcome some inherent problems of traditional mobile cloud computing paradigm, such as unacceptable system latency and low battery life of mobile devices. We have conducted extensive experiments with real-world data. Our results have shown that the proposed system achieved three objectives: (1) outperforming existing work in terms of food recognition accuracy; (2) reducing response time that is equivalent to the minimum of the existing approaches; and (3) lowering energy consumption which is close to the minimum of the state-of-the-art.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“At the end level, video capture devices, such as smartphones and surveillance cameras are responsible for video capture, media data compression [102], image preprocessing, and image segmentation [103].”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [103]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Research works printed but not linked: 4
- goodfellow, 2016, Deep Learning
- 10.1109/CVPR.2005.177 · DOI · Paper page
- matsuda, 0, Multiple-food recognition considering co-occurrence employing manifold ranking, Proc 21st Int Conf Pattern Recognit, 2017
- 10.1109/5.726791 · DOI · Paper page
Cited by
Items 301–332 of 332
2018 Index IEEE Transactions on Services Computing Vol. 11
(2019) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2019.2893552
王, 莹. (2019) · Software Engineering and Applications · doi:10.12677/sea.2019.86045
A distributed e-health management model with edge computing in healthcare framework
Majumder, D., & Kumar, S. M. (2022) · Cardiometry · doi:10.18137/cardiometry.2022.22.444455
Spadotto, D., & Cugnasca, C. E. (2022) · Anais do Encontro Nacional de Engenharia de Produção · doi:10.14488/enegep2022_tn_wpg_383_1894_43809
Chen, Y., Zhang, N., Wu, Y., & Shen, S. (2022) · Wireless networks · doi:10.1007/978-3-031-16822-2_1
Edge-Cloud Collaboration Architecture for Efficient Web-Based Cognitive Services
Wang, Z., & Ko, I. (2023) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp57234.2023.00028 · Cited by 2
“In [7], Liu et al. optimized the Internet-based diet evaluation system, and they mainly focused on three improvements: 1) improving the accuracy of food identification.”
Glucose Monitoring using Deep Learning
Swathi, M. C., Khan, A., Sree, B. V., Pratyusha, C., & Ghouse, M. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.54179
Integração Machine to Machine no contexto da Indústria 4.0.
de Salles, R. M. (2022) · doi:10.11606/d.3.2022.tde-10052023-133832
Visual Food Intake Monitoring System for Diabetes Management
Jadoonanan, A., & Rocke, S. (2023) · International Conference on Bio-engineering for Smart Technologies (BioSMART) · doi:10.1109/biosmart58455.2023.10162044
“In much of the literature to date, food classification has been the most explored task [12,13].”
BackgroundDe Giusti, A. E., Naiouf, M., Chichizola, F., Rucci, E., & De Giusti, L. C. (2023) · Facultad de Informática (UNLP) eBooks · doi:10.35537/10915/155281 · Cited by 2
Dynamic Involvement of Deep Learning and Big Data in Smart Cities
Shah, N., Kapoor, A., Gupta, N., Agarwal, V., & Jindal, M. (2023) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9789815136173123010007
Survey on Edge Computing and Its’ Usage in Various Fields
(2023) · American Journal Of Advanced Computing · doi:10.15864/ajac.22015
Smartphone Based Food Classification: Applications, Challenges, and Future Prospects for Diabetics
Crystal, A. A., Valero, M., & Nino, V. (2023) · IEEE International Conference on Smart Communities: Improving Quality of Life using AI, Robotics and IoT (HONET) · doi:10.1109/honet59747.2023.10374965
“Preprocessing the input image improves the representation of food photos for classification by addressing issues such as lighting conditions, orientation, color distribution, distortion, and blur, which can impact classification accuracy negatively [23].”
BackgroundOccupational Health Service Platform Architecture based on IoT and Edge Computing
Sun, K., Kim, S. H., & Do, H. (2023) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc58733.2023.10392370 · Cited by 1
“Besides of medical detection, a research in general health management has also been proposed, such as identifying different foods for diet analysis [8].”
McDonald's food target recognition and calorie display based on YOLOv5 algorithm
Zhang, Y. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/39/20230566
“Chang Liu et al. propose a classification method based on deep learning, and integrated other image analysis algorithms into a real-time computing system based on edge computing to improve recognition accuracy and reduce response time [21].”
BackgroundMethodKatiya, A., Rathod, A., Kate, V., & Nigam, N. (2024) · Qeios · doi:10.32388/uffbsr
“Lie et al. [9] introduced innovative algorithms for visual food recognition, employing deep learning techniques to surpass existing accuracy standards.”
BackgroundData ecosystem framework proposal to implement Food Informatics systems in agri-food chains
Garzón, W. A. O., Cárdenas-Roa, H., Bustos-Vanegas, J. D., & Andrade-Navia, J. M. (2025) · Data & Metadata · doi:10.56294/dm2025572
Non-Redundant Feature Extraction in Mobile Edge Computing
Chen, X., Wang, Q., & Ding, C. (2025) · IEEE Access · doi:10.1109/access.2025.3552479
“For example, Liu et al. [21] propose to first preprocess the data on the edge server, including cropping, grayscale, etc., and then upload the processed image data to the cloud server for feature matching.”
Katiya, A., Rathod, A., Kate, V., & Nigam, N. (2024) · Qeios · doi:10.32388/uffbsr.2
Chu, T.-T., Labiod, M. A., Augustin, B., & Mellouk, A. (2025) · Wiley eBooks · doi:10.1002/9781394388608.refs
Velásquez, R. M. A., Dreyfus, B. D., & Rosendo, E. J. G. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-96798-6_19
Sanitha, P. C., Parveen, S. N., Shaik, T., Shanmugapriya, M. M., Kalaivani, T., & Senthilkumar, R. (2025) · International Conference on Intelligent Cyber Physical Systems and Internet of Things (ICoICI) · doi:10.1109/icoici65217.2025.11252549
“Liu et al.[8] proposed a deep learning model for dietary assessment with limited resource edge computing devices, showing the feasibility of dietary assessment even in donated resources or resource limited situations.”
GroupNL: Low-Resource and Robust CNN Design Over Cloud and Device
Ding, C., Xie, J., Zhang, J., Raza, S., Wang, S., & Cao, J. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3655770
“The user sends data and service requests to the cloud server, and after the cloud server processes thedata, it sends theresults totheusers [19], [20], [21], [22].”
Allerscan: An Edge-Cloud Hybrid, Real-Time Allergen-Safety Menu Scanner
Vidhya, P., Dharnisha, N., Kavinisha, K., Sakthi, M. M., & Sruthi, P. A. (2025) · International Conference on Emerging Applications of Material Science and Technology (ICEAMST) · doi:10.1109/iceamst67459.2025.11336114
“Secure User Authentication: Personalized login protects scan histories and sensitive dietary information [30].”
A Survey of Smart Nutrition Applications: From Food Recognition to Customized Exercise Plans
Sujan, A. T., Joshi, S. S., Kumar, Y. R. T., Karanth, K. V. U., Rani, K. P. A., & Gowrishankar, S. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-981-95-4161-4_10
Real-Time Food Quality Evaluation via SIFT and Edge Detection on Embedded Platforms
Uppala, A. R., Sreelatha, P., Farooqui, M. A., Pratheeksha Hegde, N., Karthikayen, A., & Sekar, S. D. (2025) · International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT) · doi:10.1109/icaiccit68829.2025.11433987
“For instance, in embedded systems with limited memory and processing power, the biggest challenge is getting high accuracy with the tools that are available [4].”
A Machine Learning Pipeline for Checking Junk Food Ingredients
Chaudhari, A. Y., Tale, T., Mundhada, S., Shinde, M., & Talekar, R. (2025) · IEEE Global Conference on Wireless Computing and Networking (GCWCN) · doi:10.1109/gcwcn66157.2025.11448340
“This[8] paper explores the categorization and ranking of food ingredients.”
Deep Neural Techniques for Monitoring the Quality of Agriculture Produce
Sureshkumar, R., Saravanan, M., S.V.Ramanan, Thenmozhi, M., Baby, V., & Sureshkumar, C. (2025) · International Conference on Smart Electronics and Communication (ICOSEC) · doi:10.1109/icosec67334.2025.11459547
“In terms of real-world applicability, Cao et al. [21] built an edge-based recognition system for dietary assessment, and Bosch et al. [11,12] combined global and local features to improve dietary image analysis.”
FoodCHA: Multi-Modal LLM Agent for Fine-Grained Food Analysis
Lee, W., Mekkoth, P., Tian, Y., Güngör, O., & Rosing, T. (2026) · International Symposium on Networks, Computers and Communications (ISNCC) · doi:10.1109/isncc70543.2026.11693901 · Cited by 1
Gümüş, S. (2026) · IEEE International Conference on Computing and Machine Intelligence (ICMI) · doi:10.1109/icmi68585.2026.11539822
“Combining mobile devices with cloud services can enhance the accuracy of evaluating different algorithmic techniques, including face recognition, age estimation, and more [6–8].”
Lu, Z., & Nicola, A. A. (2026) · Advances in Artificial Intelligence and Robotics Research · doi:10.4236/airr.2026.21002
Chu, T., Labiod, M. A., Augustin, B., & Mellouk, A. (2026) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2026.3712084
“…they are: Diabetes detection [47], [48], [49], Chikungunya outbreak detection [50], Activity classification [51], [52], [53], Arrhythmia anomaly detection [54], Voice disorder [55], Skin region classification [56], Stress type classification [47] and Food classification for diet assessment [57].”
Metadata
- Authors
- Liu, C., Cao, Y., Luo, Y., Chen, G., Vokkarane, V., Yunsheng, M., Chen, S., & Hou, P.
- Affiliations
- University of Massachusetts Lowell (US)
- George Mason University (US)
- Venue
- IEEE Transactions on Services Computing
- Published
- 2018-03-01
- Volume
- 11
- Issue
- 2
- Pages
- 249-261
- ISSN
- 1939-1374 (ISSN-L)
- OpenAlex
- W2585425668
- Cited by
- 333
- References
- 56
- Citations by year
- 2026: 8 · 2025: 22 · 2024: 35 · 2023: 46 · 2022: 51 · 2021: 59 · 2020: 58 · 2019: 32 · 2018: 19
- FWCI
- 20.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Services Computing (publishedVersion)
- The Journal of the American Medical Association (JAMA) Network (American Medical Association) (submittedVersion)
- Funders
- US National Science Foundation (NSF) of the United States (1547428, 1541434, 1524462, 1440737, 1229213)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Health Sciences › Health Professions › Health Information Management › Innovation in Digital Healthcare Systems
- Keywords
- food recognition, dietary assessment, deep learning, edge computing, mobile cloud computing, Internet of Things, weight loss interventions, system latency, energy consumption, mobile devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.