The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Reducto: On-Camera Filtering for Resource-Efficient Real-Time Video Analytics
Open accessAbstract
To cope with the high resource (network and compute) demands of real-time video analytics pipelines, recent systems have relied on frame filtering. However, filtering has typically been done with neural networks running on edge/backend servers that are expensive to operate. This paper investigates on-camera filtering, which moves filtering to the beginning of the pipeline. Unfortunately, we find that commodity cameras have limited compute resources that only permit filtering via frame differencing based on low-level video features. Used incorrectly, such techniques can lead to unacceptable drops in query accuracy. To overcome this, we built Reducto, a system that dynamically adapts filtering decisions according to the time-varying correlation between feature type, filtering threshold, query accuracy, and video content. Experiments with a variety of videos and queries show that Reducto achieves significant (51-97% of frames) filtering benefits, while consistently meeting the desired accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Accuracy is measured using the standard mAP metric [28] that evaluates, for each returned bounding box, whether the enclosed object is of the correct type and whether the bounding box has sufficiently large overlap (intersection over union) with the correct box.”
MethodMobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
A Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607 · cited 1×
“Furthermore, an on-camera approach can also sidestep the management and cost overheads of operating edge servers [52, 63].”
Background2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
Object Detection in 20 Years: A Survey
Zou, Z., Chen, K., Shi, Z., Guo, Y., & Ye, J. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3238524 · Cited by 3,689
A convolutional neural network cascade for face detection
Li, H., Lin, Z., Shen, X., Brandt, J., & Hua, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299170 · Cited by 1,390
Deep Convolutional Network Cascade for Facial Point Detection
Sun, Y., Wang, X., & Tang, X. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.446 · Cited by 1,382
A Review of Computer Vision Techniques for the Analysis of Urban Traffic
Buch, N., Velastin, S. A., & Orwell, J. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2119372 · Cited by 653
Evaluation of background subtraction techniques for video surveillance
Brutzer, S., Hoferlin, B., & Heidemann, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995508 · Cited by 622
A Survey on Visual Content-Based Video Indexing and Retrieval
Hu, W., Xie, N., Li, L., Zeng, X., & Maybank, S. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2109710 · Cited by 585
Vidal, A. R., Rebecq, H., Horstschaefer, T., & Scaramuzza, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2793357 · Cited by 541
Adaptive key frame extraction using unsupervised clustering
Zhuang, Y., Rui, Y., Huang, T. S., & Mehrotra, S. (2002) · Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269) · doi:10.1109/icip.1998.723655 · Cited by 505
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2016) · arXiv · doi:10.48550/arxiv.1612.08242 · Cited by 488
Chameleon: scalable adaptation of video analytics
Jiang, J., Ananthanarayanan, G., Bodik, P., Sen, S., & Stoica, I. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230574 · Cited by 467 · cited 8×
“We also compared Reducto with two systems that improve the efficiency of real-time video analytics pipelines, CloudSeg [57] and Chameleon [41].”
BackgroundMethodInfluentialDeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics
Ran, X., Chen, H., Zhu, X., Liu, Z., & Chen, J. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8485905 · Cited by 450
Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera
Kim, H., Leutenegger, S., & Davison, A. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_21 · Cited by 438
EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real Time
Rebecq, H., Horstschaefer, T., Gallego, G., & Scaramuzza, D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2645143 · Cited by 410
NoScope: optimizing neural network queries over video at scale
Kang, D., Emmons, J., Abuzaid, F., Bailis, P., & Zaharia, M. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137628.3137664 · Cited by 367
Han, S., Shen, H., Philipose, M., Agarwal, S., Wolman, A., & Krishnamurthy, A. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906396 · Cited by 367
Glimpse: Continuous, Real-Time Object Recognition on Mobile Devices
Chen, T. Y.-H., Ravindranath, L., Deng, S., Bahl, P., & Balakrishnan, H. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809711 · Cited by 358 · cited 10×
“To illustrate the limitations of static thresholds, we evaluated Glimpse [24] on 4 random videos in our dataset.”
BackgroundMethodResultInfluentialVideo summarization and scene detection by graph modeling
Ngo, C.-W., Ma, Y.-F., & Zhang, H.-J. (2005) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2004.841694 · Cited by 345
Choice of neighbor order in nearest-neighbor classification
Hall, P., Park, B. U., & Samworth, R. J. (2008) · The Annals of Statistics · doi:10.1214/07-aos537 · Cited by 329
(2017) · Networked Systems Design and Implementation · Cited by 329
Learning Complexity-Aware Cascades for Deep Pedestrian Detection
Cai, Z., Saberian, M., & Vasconcelos, N. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.384 · Cited by 326
Automatic Video Classification: A Survey of the Literature
Brezeale, D., & Cook, D. J. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.919173 · Cited by 298
VideoEdge: Processing Camera Streams using Hierarchical Clusters
Hung, C.-C., Ananthanarayanan, G., Bodik, P., Golubchik, L., Yu, M., Bahl, P., & Philipose, M. (2018) · 2018 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00016 · Cited by 287 · cited 1×
“VideoStorm [79] and Chameleon [41] profile pipeline knobs to identify cheap and accuracy-preserving configurations (§5), while VideoEdge [38] also considers placement plans over a hierarchy of clusters.”
BackgroundThe Design and Implementation of a Wireless Video Surveillance System
Zhang, T., Chowdhery, A., Bahl, P. (., Jamieson, K., & Banerjee, S. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790123 · Cited by 272
Real-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization
Rebecq, H., Horstschaefer, T., & Scaramuzza, D. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.16 · Cited by 263
Event-Based Visual Inertial Odometry
Zhu, A. Z., Atanasov, N., & Daniilidis, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.616 · Cited by 249
LAVEA: latency-aware video analytics on edge computing platform
Yi, S., Hao, Z., Zhang, Q., Zhang, Q., Shi, W., & Li, Q. (2017) · Proceedings of the Second ACM/IEEE Symposium on Edge Computing · doi:10.1145/3132211.3134459 · Cited by 244 · cited 2×
“DeepDecision [58] and MCDNN [34] treat resource scheduling as an optimization problem and maximize key metrics such as accuracy or latency, while LAVEA [78] allocates computation among multiple edge nodes, optimizing for latency.”
BackgroundNexus: a GPU cluster engine for accelerating DNN-based video analysis
Shen, H., Chen, L., Jin, Y., Zhao, L., Kong, B., Philipose, M., Krishnamurthy, A., & Sundaram, R. (2019) · Proceedings of the 27th ACM Symposium on Operating Systems Principles · doi:10.1145/3341301.3359658 · Cited by 232
AdaFrame: Adaptive Frame Selection for Fast Video Recognition
Wu, Z., Xiong, C., Ma, C.-Y., Socher, R., & Davis, L. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00137 · Cited by 224
Scaling Video Analytics on Constrained Edge NodesPreprint
Canel, C., Kim, T., Zhou, G., Li, C., Lim, H., Andersen, D. G., Kaminsky, M., & Dulloor, S. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13536 · Cited by 206
Bandwidth-Efficient Live Video Analytics for Drones Via Edge Computing
Wang, J., Feng, Z., Chen, Z., George, S., Bala, M., Pillai, P., Yang, S.-W., & Satyanarayanan, M. (2018) · 2018 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00019 · Cited by 204
Low-latency visual odometry using event-based feature tracks
Kueng, B., Mueggler, E., Gallego, G., & Scaramuzza, D. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7758089 · Cited by 196
Event-based feature tracking with probabilistic data association
Zhu, A. Z., Atanasov, N., & Daniilidis, K. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989517 · Cited by 174
Tang, Z., Wang, G., Xiao, H., Zheng, A., & Hwang, J. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00022 · Cited by 156
Han, B., Qian, F., Ji, L., & Gopalakrishnan, V. (2016) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/2999572.2999606 · Cited by 153
Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems
(2015) · doi:10.1145/2809695 · Cited by 134
On optimum choice of k in nearest neighbor classification
Ghosh, A. K. (2005) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2005.06.007 · Cited by 125
Server-side object recognition and client-side object tracking for mobile augmented reality
Gammeter, S., Gassmann, A., Bossard, L., Quack, T., & Gool, L. V. (2010) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2010.5543248 · Cited by 108
Optasia: A Relational Platform for Efficient Large-Scale Video Analytics
Lu, Y., Chowdhery, A., & Kandula, S. (2016) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/2987550.2987564 · Cited by 96
Fast Object Detection in Compressed Video
Wang, S., Alibaba Group, Lu, H., & Deng, Z. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00720 · Cited by 93
Watching a Small Portion could be as Good as Watching All: Towards Efficient Video Classification
Fan, H., Xu, Z., Zhu, L., Yan, C. C., Ge, J., & Yang, Y. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/98 · Cited by 87
VStore: A Data Store for Analytics on Large Videos
Xu, T., Botelho, L. M., & Lin, F. X. (2019) · European Conference on Computer Systems · doi:10.1145/3302424.3303971 · Cited by 81
FixyNN: Efficient Hardware for Mobile Computer Vision via Transfer LearningPreprint
Whatmough, P. N., Zhou, C., Hansen, P. R., Venkataramanaiah, S. K., Seo, J.-S., & Mattina, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.11128 · Cited by 74
Cracking open the DNN black-box: Video Analytics with DNNs across the Camera-Cloud Boundary
Emmons, J., Fouladi, S., Ananthanarayanan, G., Venkataraman, S., Savarese, S., & Winstein, K. (2019) · doi:10.1145/3349614.3356023 · Cited by 73
Reinventing Video Streaming for Distributed Vision Analytics
Pakha, C., Chowdhery, A., & Jiang, J. (2018) · USENIX conference on Hot Topics in Cloud Ccomputing · Cited by 53
Neural Networks Meet Physical Networks: Distributed Inference Between Edge Devices and the Cloud
Chinchali, S. P., Cidon, E., Pergament, E., Chu, T., & Katti, S. (2018) · Proceedings of the 17th ACM Workshop on Hot Topics in Networks · doi:10.1145/3286062.3286070 · Cited by 46
CARN: Convolutional Anchored Regression Network for Fast and Accurate Single Image Super-Resolution
Li, Y., Agustsson, E., Gu, S., Timofte, R., & Gool, L. V. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11021-5_11 · Cited by 45
Self-citationA Low-Cost Edge Server Placement Strategy in Wireless Metropolitan Area Networks
Ren, Y., Zeng, F., Li, W., & Meng, L. (2018) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn.2018.8487438 · Cited by 44
ReXCam: Resource-Efficient, Cross-Camera Video Analytics at Enterprise Scale.Preprint
Jain, S., Jiang, J., Shu, Y., et al. (2018) · arXiv (Cornell University) · Cited by 12
Efficient Video Classification Using Fewer FramesPreprint
Bhardwaj, S., Srinivasan, M., & Khapra, M. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10640 · Cited by 5
Metadata
- Authors
- Li, Y., Padmanabhan, A., Zhao, P., Wang, Y., Xu, G. H., & Netravali, R.
- Venue
- Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication
- Publisher
- ACM
- Published
- 2020-07-30
- Pages
- 359-376
- OpenAlex
- W3046256272
- Cited by
- 269
- References
- 56
- FWCI
- 9.65
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.