The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
DeepEye: Resource Efficient Local Execution of Multiple Deep Vision Models using Wearable Commodity Hardware
Abstract
Wearable devices with built-in cameras present interesting opportunities for users to capture various aspects of their daily life and are potentially also useful in supporting users with low vision in their everyday tasks. However, state-of-the-art image wearables available in the market are limited to capturing images periodically and do not provide any real-time analysis of the data that might be useful for the wearers. In this paper, we present DeepEye - a match-box sized wearable camera that is capable of running multiple cloud-scale deep learn- ing models locally on the device, thereby enabling rich analysis of the captured images in near real-time without offloading them to the cloud. DeepEye is powered by a commodity wearable processor (Snapdragon 410) which ensures its wearable form factor. The software architecture for DeepEye addresses a key limitation with executing multiple deep learning models on constrained hardware, that is their limited runtime memory. We propose a novel inference software pipeline that targets the local execution of multiple deep vision models (specifically, CNNs) by interleaving the execution of computation-heavy convolutional layers with the loading of memory-heavy fully-connected layers. Beyond this core idea, the execution framework incorporates: a memory caching scheme and a selective use of model compression techniques that further minimizes memory bottlenecks. Through a series of experiments, we show that our execution framework outperforms the baseline approaches significantly in terms of inference latency, memory requirements and energy consumption.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
Learning both Weights and Connections for Efficient Neural Networks
Han, S., Pool, J., Tran, J., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1506.02626 · Cited by 1,481
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
Age and gender classification using convolutional neural networks
Levi, G., & Hassncer, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301352 · Cited by 1,151
SenseCam: A Retrospective Memory Aid
Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N., & Wood, K. (2006) · Lecture Notes in Computer Science · doi:10.1007/11853565_11 · Cited by 753
Detecting activities of daily living in first-person camera views
Pirsiavash, H., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248010 · Cited by 649
Multi-view Face Detection Using Deep Convolutional Neural Networks
Farfade, S. S., Saberian, M. J., & Li, L.-J. (2015) · Proceedings of the 5th ACM on International Conference on Multimedia Retrieval · doi:10.1145/2671188.2749408 · Cited by 572
Research works printed but not linked: 4
- 10.5555/1972512 · doi:10.5555/1972512
- N. D. Lane , S. Bhattacharya , C. Forlivesi , P. Georgiev , L. Jiao , L. Qendro ,, and F. Kawsar , " Deepx: A software accelerator for low-power deep learning inference on mobile devices," in IPSN 2016 . N. D. Lane, S. Bhattacharya, C. Forlivesi, P. Georgiev, L. Jiao, L. Qendro,, and F. Kawsar, "Deepx: A software accelerator for low-power deep learning inference on mobile devices," in IPSN 2016.
- 10.1109/ICCV.2015.275 · DOI · Paper page
- N. D. Lane , S. Bhattacharya , P. Georgiev , C. Forlivesi , L. Jiao , L. Qendro , and F. Kawsar , " Deepx: A software accelerator for low-power deep learning inference on mobile devices," in Proceedings of the 15th International Conference on Information Processing in Sensor Networks , 2016 . N. D. Lane, S. Bhattacharya, P. Georgiev, C. Forlivesi, L. Jiao, L. Qendro, and F. Kawsar, "Deepx: A software accelerator for low-power deep learning inference on mobile devices," in Proceedings of the 15th International Conference on Information Processing in Sensor Networks, 2016.
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
“DeepEye first segregates DNN layers of all tasks into two pools: convolution layers and fully connected layers.”
InfluentialEdge Assisted Real-time Object Detection for Mobile Augmented Reality
Liu, L., Li, H., & Gruteser, M. (2019) · The 25th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3300061.3300116 · Cited by 552
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“DeepEye [393] is a wearable camera capable of running five DL models on edge for image recognition tasks.”
BackgroundDistributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 408
UNPU: An Energy-Efficient Deep Neural Network Accelerator With Fully Variable Weight Bit Precision
Lee, J., Kim, C., Kang, S., Shin, D., Kim, S., & Yoo, H.-J. (2019) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2865489 · Cited by 335
Metadata
- Authors
- Mathur, A., Lane, N. D., Bhattacharya, S., Boran, A., Forlivesi, C., & Kawsar, F.
- Affiliations
- Nokia (United Kingdom) (GB)
- University College London (GB)
- Nokia (Ireland) (IE)
- Nokia (Belgium) (BE)
- Venue
- Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services
- Publisher
- ACM
- Published
- 2017-06-16
- Pages
- 68-81
- OpenAlex
- W2625157458
- Cited by
- 128
- References
- 40
- Citations by year
- 2025: 5 · 2024: 9 · 2023: 14 · 2022: 13 · 2021: 27 · 2020: 23 · 2019: 20 · 2018: 14 · 2017: 3
- FWCI
- 4.80
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Mobile Systems, Applications, and Services (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Keywords
- wearable cameras, low vision, on-device inference, convolutional neural networks, memory bottleneck, inference latency, memory caching, model compression, real-time image analysis, energy consumption
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: DeepEye: Resource Efficient Local Execution of Multiple Deep Vision Models using Wearable Commodity Hardware. https://app.cochat.ai/papers/10.1145/3081333.3081359
- The paper
- Mathur, A., Lane, N. D., Bhattacharya, S., Boran, A., Forlivesi, C., & Kawsar, F. (2017). DeepEye: Resource Efficient Local Execution of Multiple Deep Vision Models using Wearable Commodity Hardware. Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. https://doi.org/10.1145/3081333.3081359
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.