SwallowNet: Recurrent neural network detects and characterizes eating patterns
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Passively detecting and counting the number of swallows in food intake enables accurate detection of eating episodes in free-living participants, and aids in characterizing eating episodes. On average, the more food consumed, the greater the number of swallows; and swallows have been shown to positively correlate with caloric intake. While passive sensing measures have shown promise in recent years, they are yet to be used reliably to detect eating, impeding the development of timely intervention delivery that change poor eating behavior. This paper presents a novel integrated wearable necklace that comprises two piezoelectric sensors vertically positioned around the neck, an inertial motion unit, and long short-term memory (LSTM) neural networks to detect and count swallows. A unique correlation of derivative features creates candidate swallows. To reduce the FPR features are extracted using symmetric and asymmetric windows surrounding each candidate swallow to feed into a Random Forest classifier. Independently, a LSTM network is trained from raw data using automated feature learning methods. In an in-lab study comprising confounding activities of 10 participants, results show a 3.34 RMSE of swallow count using LSTM, and a 76.07% average F-measure of swallows, outperforming the Random Forest classifier. This system thus shows promise in accurately detecting and characterizing eating patterns, enabling passive detection of swallow count, and paving the way for timely interventions to prevent problematic eating.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Research works printed but not linked: 16
- 10.2186/prp.6.272 · doi:10.2186/prp.6.272
- 10.1371/journal.pone.0070850 · DOI
- madgwick, 2010, Automated calibration of an accelerometers, magnetometers and gyroscopes-a feasibility study, Technical Report Technical Report
- 10.1109/HIC.2014.7038877 · DOI
- 10.1109/TIT.1975.1055330 · DOI · Paper page
- hochreiter, 2001, Gradient Flow in Recurrent Nets The Difficulty of Learning Long-term Dependencies
- 10.1109/ICASSP.2013.6638947 · DOI · Paper page
- 10.1109/CVPR.2015.7298878 · DOI · Paper page
- 10.1109/ISWPC.2008.4556181 · DOI
- 10.1145/2594368.2594386 · DOI · Paper page
- 10.1109/BSN.2014.26 · DOI
- päßler, 2012, Food intake monitoring: an acoustical approach to automated food intake activity detection and classification of consumed food, Physiological Measurement, 33, 1073, 10.1088/0967-3334/33/6/1073 · DOI
- 10.1016/j.compbiomed.2015.01.005 · DOI
- amft, 2006, Methods for detection and classification of normal swallowing from muscle activation and sound, 2006 Pervasive Health Conference and Workshops, 1
- zhang, 2016, Machine learning algorithms applied to detect feeding gestures
- 10.1109/HIC.2014.7038877 · DOI
Cited by
Nweke, H. F., Teh, Y. W., Al-garadi, M. A., & Alo, U. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.03.056 · Cited by 930
Abedin, A., Ehsanpour, M., Shi, Q., Rezatofighi, H., & Ranasinghe, D. C. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448083 · Cited by 107
Towards deep clustering of human activities from wearables
Abedin, A., Motlagh, F., Shi, Q., Rezatofighi, H., & Ranasinghe, D. (2020) · Proceedings of the 2020 International Symposium on Wearable Computers · doi:10.1145/3410531.3414312 · Cited by 27
“erior performance of supervised deep neural networks in classification tasks has led to a shift towards the adoption of deep learning paradigms for recognizing human activities from raw wearable data [21, 24, 31, 38]. Researchers have explored CNNs [9, 34, 41, 42], RNNs [16, 19], and a combination of convolutional and…”
BackgroundLai, D. K.-H., Cheng, E. S.-W., So, B. P.-H., Mao, Y.-J., Cheung, S. M.-Y., Cheung, D. S. K., Wong, D. W.-C., & Cheung, J. C.-W. (2023) · Mathematics · doi:10.3390/math11143081 · Cited by 18
Metadata
- Authors
- Nguyen, D. T., Cohen, E., Pourhomayoun, M., & Alshurafa, N.
- Venue
- 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)
- Publisher
- IEEE
- Published
- 2017-03
- Pages
- 401-406
- OpenAlex
- W2611410710
- Cited by
- 25
- References
- 5
- FWCI
- 0.89
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.