NeckSense: A Multi-Sensor Necklace for Detecting Eating Activities in Free-Living Conditions
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
We present the design, implementation, and evaluation of a multi-sensor, low-power necklace, NeckSense, for automatically and unobtrusively capturing fine-grained information about an individual's eating activity and eating episodes, across an entire waking day in a naturalistic setting. NeckSense fuses and classifies the proximity of the necklace from the chin, the ambient light, the Lean Forward Angle, and the energy signals to determine chewing sequences, a building block of the eating activity. It then clusters the identified chewing sequences to determine eating episodes. We tested NeckSense on 11 participants with and 9 participants without obesity, across two studies, where we collected more than 470 hours of data in a naturalistic setting. Our results demonstrate that NeckSense enables reliable eating detection for individuals with diverse body mass index (BMI) profiles, across an entire waking day, even in free-living environments. Overall, our system achieves an F1-score of 81.6% in detecting eating episodes in an exploratory study. Moreover, our system can achieve an F1-score of 77.1% for episodes even in an all-day-long free-living setting. With more than 15.8 hours of battery life, NeckSense will allow researchers and dietitians to better understand natural chewing and eating behaviors. In the future, researchers and dietitians can use NeckSense to provide appropriate real-time interventions when an eating episode is detected or when problematic eating is identified.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nahum-Shani, I., Hekler, E. B., & Spruijt-Metz, D. (2015) · Health Psychology · doi:10.1037/hea0000306 · Cited by 568 · cited 1×
“ed towards curtailing eatingrelated disorders (e.g., obesity), have had little or no success in addressing the epidemic [33, 34, 38, 53]. Instead, researchers are proposing just-in-time interventions [15, 24, 31, 32] to test personalized interventions that are tailored to person-specific needs [43, 49]. Detecting eati…”
BackgroundPhysical activity interventions using mass media, print media, and information technology
Marcus, B., Owen, N., Forsyth, L., Cavill, N., & Fridinger, F. (1998) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(98)00079-8 · Cited by 333 · cited 1×
“rted by other researchers exploring chewing based activity detection [9]. In future we will explore techniques to overcome these challenges. 6 RELATED WORK Large-scale, whole population interventions [29], such as ad-campaigns targeted towards curtailing eatingrelated disorders (e.g., obesity), have had little or no s…”
BackgroundBodyScope: a wearable acoustic sensor for activity recognition
Yatani, K., & Truong, K. N. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370269 · Cited by 310 · cited 1×
“To reduce the burden on participants, several researchers have proposed the use of a front-, upward-, or downward-facing camera [9, 13, 26, 55, 56, 59] for validating their system’s performance.”
BackgroundThe efficacy of tailored interventions
Ryan, P., & Lauver, D. R. (2002) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2002.00331.x · Cited by 230 · cited 1×
“Instead, researchers are proposing just-in-time interventions [19, 28, 36, 37] to test personalized interventions that are tailored to person-specific needs [47, 54].”
BackgroundHow can weight‐loss app designers' best engage and support users? A qualitative investigation
Tang, J., Abraham, C., Stamp, E., & Greaves, C. (2015) · British Journal of Health Psychology · doi:10.1111/bjhp.12114 · Cited by 152 · cited 1×
“Instead, researchers are proposing just-in-time interventions [19, 28, 36, 37] to test personalized interventions that are tailored to person-specific needs [47, 54].”
BackgroundCharacterizing eating patterns: a comparison of eating occasion definitions
Leech, R. M., Worsley, A., Timperio, A., & McNaughton, S. A. (2015) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.115.114660 · Cited by 133
Research works printed but not linked: 54
- 10.1145/3027063.3053271 · DOI
- Alharbi Rawan, 2018, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 2, 3, Article 90
- Alharbi Rawan, 2019, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 3, 3, Article 72
- 10.1109/PERCOMW.2017.7917597 · DOI
- Alshurafa Nabil, 2019, Counting Bites With Bits: Expert Workshop Addressing Calorie and Macronutrient Intake Monitoring, Journal of Medical Internet Research (JMIR), 21
- 10.1109/BSN.2013.6575515 · DOI
- 10.1109/PCTHEALTH.2006.361624 · DOI · Paper page
- 10.1109/MPRV.2009.32 · DOI · Paper page
- Bedri Abdelkareem, 2017, Ishaan Grover, Temiloluwa Prioleau, Min Yan Beh, Mayank Goel, Thad Starner, and Gregory Abowd.
- 10.1145/2818346.2820767 · DOI
- Bell Brooke, 2020, Article 38
- 10.1080/11026480410000454 · DOI · Paper page
- 10.1145/3264902 · DOI
- 10.1145/2939672.2939785 · DOI · Paper page
- Chun Keum San, 2018, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 2, 1, Article 4
- 10.1111/j.1467-789X.2006.00234.x · DOI · Paper page
- Dong Yujie, 2012, A new method for measuring meal intake in humans via automated wrist motion tracking. Applied Psychophysiology and Biofeedback 37, 3
- Dong Yujie, 2014, Detecting periods of eating during free-living by tracking wrist motion, IEEE Journal of Biomedical and Health Informatics (JBHI), 18
- 10.1002/oby.21788 · DOI
- 10.1109/EMBC.2016.7591833 · DOI
- 10.1109/JBHI.2016.2640142 · DOI
- 10.1109/TBME.2014.2306773 · DOI · Paper page
- Friedman Jerome H, 2001, Greedy function approximation: a gradient boosting machine. Annals of statistics
- 10.1007/978-3-642-22300-6_39 · doi:10.1007/978-3-642-22300-6_39
- 10.1136/bmj.311.7011.986 · DOI · Paper page
- 10.1007/11853565_11 · DOI · Paper page
- 10.1093/ije/dys105 · DOI · Paper page
- Jaimes Luis G, 2015, Trends in mobile cyber-physical systems for health just-in time interventions, 10.1109/SECON.2015.7132887 · DOI
- 10.1002/eat.22924 · DOI · Paper page
- 10.1016/j.compbiomed.2015.01.005 · DOI
- 10.1109/BSN.2014.26 · DOI
- 10.1109/BSN.2012.11 · DOI · Paper page
- Mirtchouk Mark, 2017, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 1, 3, Article 85
- Nahum-Shani Inbal, 2015, S
- 10.1177/1359105303008001426 · DOI · Paper page
- 10.1080/10350330903438386 · DOI · Paper page
- 10.1109/ISWPC.2008.4556181 · DOI
- 10.1016/j.amepre.2012.11.007 · DOI · Paper page
- 10.1109/JBHI.2016.2625271 · DOI
- 10.1080/19325037.2016.1250018 · DOI
- 10.1177/0022034511416669 · doi:10.1177/0022034511416669
- 10.1145/2594368.2594386 · DOI · Paper page
- 10.1145/1278972.1278975 · DOI · Paper page
- 10.1016/j.jand.2013.09.017 · DOI
- 10.1109/WoWMoM.2018.8449755 · DOI
- 10.1109/PERCOMW.2015.7134103 · DOI · Paper page
- 10.1109/MPRV.2014.46 · DOI · Paper page
- Tada Akio, 2018, Association of mastication and factors affecting masticatory function with obesity in adults: a systematic review. BMC oral health 18, 1
- Thomaz Edison, ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp). https://doi.org/10
- Thomaz Edison, Proceedings of International SenseCam & Pervasive Imaging Conference (SenseCam). https://doi.org/10
- Thomaz Edison, International Conference on Intelligent User Interfaces (IUI). https://doi.org/10
- Tufano James T, 2005, Mobile eHealth interventions for obesity: a timely opportunity to leverage convergence trends, Journal of Medical Internet Research (JMIR), 7
- Zhang Rui, 2017, Monitoring chewing and eating in free-living using smart eyeglasses
- Shibo Zhang Rawan Alharbi Matthew Nicholson and Nabil Alshurafa. 2017. When Generalized Eating Detection Machine Learning Models Fail in the Field. In ACM International Joint Conference on Pervasive and Ubiquitous Computing and ACM International Symposium on Wearable Computers (UbiComp). https://doi.org/10.1145/3123024.3124409 Shibo Zhang Rawan Alharbi Matthew Nicholson and Nabil Alshurafa. 2017. When Generalized Eating Detection Machine Learning Models Fail in the Field. In ACM International Joint Conference on Pervasive and Ubiquitous Computing and ACM International Symposium on Wearable Computers (UbiComp). https://doi.org/10.1145/3123024.3124409 · doi:10.1145/3123024.3124409
Cited by
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“1b, there are a large number of off-the-shelf smart devices or prototypes under development today, including smartphones, smartwatches, smart glasses, smart rings [208], smart gloves [266], smart armbands [151], smart necklaces [64, 142, 328], smart shoes [106], and Etattoos [249].”
BackgroundSelf-citationDwivedi, R., Mehrotra, D., & Chandra, S. (2022) · Journal of Oral Biology and Craniofacial Research · doi:10.1016/j.jobcr.2021.11.010 · Cited by 413
Contrastive Predictive Coding for Human Activity Recognition
Haresamudram, H., Essa, I., & Plötz, T. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463506 · Cited by 150
“1 INTRODUCTION Body-worn movement sensors, such as accelerometers or full-fledged inertial measurement units (IMU), have been extensively utilized for a wide range of applications in mobile and ubiquitous computing, including but not limited to novel interaction paradigms [67, 82, 84], gesture recognition [83], eating…”
BackgroundSpatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition
Miao, S., Chen, L., & Hu, R. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3631415 · Cited by 23
Ray, S. J., Cherian, J., Liberty, A. M., Hammond, T. A., & Shireman, P. K. (2024) · doi:10.2196/preprints.67373 · Cited by 18
Ray, S. J., Cherian, J., Liberty, A. M., Hammond, T. A., & Shireman, P. K. (2025) · Journal of Medical Internet Research · doi:10.2196/67373 · Cited by 18
Technology to Automatically Record Eating Behavior in Real Life: A Systematic Review
Hiraguchi, H., Perone, P., Toet, A., Camps, G., & Brouwer, A.-M. (2023) · Sensors · doi:10.3390/s23187757 · Cited by 17
Zhang, B., Deng, K., Shen, J., Cai, L., Ratitch, B., Fu, H., & Guan, Y. (2022) · Journal of Medical Internet Research · doi:10.2196/27934 · Cited by 5
Metadata
- Authors
- Zhang, S., Zhao, Y., Nguyen, D. T., Xu, R., Sen, S., Hester, J., & Alshurafa, N.
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2020-06-15
- Volume
- 4
- Issue
- 2
- Pages
- 1-26
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W3034498051
- Cited by
- 92
- References
- 6
- FWCI
- 5.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.