NoScope: optimizing neural network queries over video at scale
Open accessThe DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Abstract
Recent advances in computer vision---in the form of deep neural networks---have made it possible to query increasing volumes of video data with high accuracy. However, neural network inference is computationally expensive at scale: applying a state-of-the-art object detector in real time (i.e., 30+ frames per second) to a single video requires a $4000 GPU. In response, we present N o S cope , a system for querying videos that can reduce the cost of neural network video analysis by up to three orders of magnitude via inference-optimized model search. Given a target video, object to detect, and reference neural network, N o S cope automatically searches for and trains a sequence, or cascade, of models that preserves the accuracy of the reference network but is specialized to the target video and are therefore far less computationally expensive. N o S cope cascades two types of models: specialized models that forego the full generality of the reference model but faithfully mimic its behavior for the target video and object; and difference detectors that highlight temporal differences across frames. We show that the optimal cascade architecture differs across videos and objects, so N o S cope uses an efficient cost-based optimizer to search across models and cascades. With this approach, N o S cope achieves two to three order of magnitude speed-ups (265-15,500x real-time) on binary classification tasks over fixed-angle webcam and surveillance video while maintaining accuracy within 1--5% of state-of-the-art neural networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“In recent times, however, deep neural networks (NNs) [40, 44, 58, 66, 67] have largely displaced classical computer”
BackgroundImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“NOSCOPE implements specialized NNs based on the AlexNet architecture [56] (filter doubling, dropout), using ReLU units for all the hidden layers and a softmax unit at the end to return a confidence for the class we are querying.”
MethodLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 19×
“However, even in this video, NOSCOPE can offer an 30× speedup over YOLOv2 with no loss in accuracy.”
BackgroundInfluentialMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 4×
“geNet 2012 [82]), a variety of SIFT-based bag-of-words classifiers (varying the SIFT parameters), and selective search with a SIFTbased classifier [63] (which performed well on PASCAL VOC [32]).”
BackgroundMethodInfluentialYOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892 · cited 2×
“We used YOLOv2 [80] as our reference model.”
MethodRapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300 · cited 2×
“One of the first cascades, the Viola-Jones detector [90], cascades traditional image processing features; if any classifier is confident about the output, the Viola-Jones cascade short-circuits evaluation, improving execution speed.”
Research works printed but not linked: 24
- Abadi D. J., 2005, CIDR
- Ba J., 2014, NIPS
- Bailis P., 2017, CIDR
- Benenson R., 2014, ECCV
- Chandrasekaran S., 2003, CIDR
- Chaudhuri S., 2007, VLDB
- Chen W., 2015, ICML
- Feichtenhofer C., 2016, NIPS
- 10.5555/2354409.2354978 · doi:10.5555/2354409.2354978
- Gibbs S., 1993, ICDE
- Goodfellow I., 2016, MIT Press
- Han S., 2016, ICLR
- Hinton G., 2014, NIPS
- Idreos S., 2007, CIDR
- Kraska T., 2013, CIDR
- Krizhevsky A., 2012, NIPS
- 10.5555/850924.851523 · doi:10.5555/850924.851523
- Metz C., 2017, Wired
- Patait A., 2016, 2016 GPU Technology Conference (https://goo.gl/Bdjdgm)
- Ren S., 2015, NIPS
- Yue-Hei Ng J., 2015, CVPR, 53
- Zhang H., 2017, NSDI
- Zhanget S., 2016, CVPR
- Zoph B., 2017, ICLR
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“NoScope [144] leverages two types of models rather than the standard model (such as YOLO”
MethodChameleon: scalable adaptation of video analytics
Jiang, J., Ananthanarayanan, G., Bodik, P., Sen, S., & Stoica, I. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230574 · Cited by 467
“Instead, we use an expensive golden configuration to provide the “ground truth”, following prior work [22, 24, 32].”
BackgroundMethodEfficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
SPINN: synergistic progressive inference of neural networks over device and cloud
Laskaridis, S., Venieris, S. I., Almeida, M., Leontiadis, I., & Lane, N. D. (2020) · Proceedings of the 26th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3372224.3419194 · Cited by 310
Autonomous Vehicles Enabled by the Integration of IoT, Edge Intelligence, 5G, and Blockchain
Biswas, A., & Wang, H.-C. (2023) · Sensors · doi:10.3390/s23041963 · Cited by 274
Reducto: On-Camera Filtering for Resource-Efficient Real-Time Video Analytics
Li, Y., Padmanabhan, A., Zhao, P., Wang, Y., Xu, G. H., & Netravali, R. (2020) · Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication · doi:10.1145/3387514.3405874 · Cited by 269
Nexus: a GPU cluster engine for accelerating DNN-based video analysis
Shen, H., Chen, L., Jin, Y., Zhao, L., Kong, B., Philipose, M., Krishnamurthy, A., & Sundaram, R. (2019) · Proceedings of the 27th ACM Symposium on Operating Systems Principles · doi:10.1145/3341301.3359658 · Cited by 232
Server-Driven Video Streaming for Deep Learning Inference
Du, K., Pervaiz, A., Yuan, X., Chowdhery, A., Zhang, Q., Hoffmann, H., & Jiang, J. (2020) · Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication · doi:10.1145/3387514.3405887 · Cited by 243
Bandwidth-Efficient Live Video Analytics for Drones Via Edge Computing
Wang, J., Feng, Z., Chen, Z., George, S., Bala, M., Pillai, P., Yang, S.-W., & Satyanarayanan, M. (2018) · 2018 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00019 · Cited by 204
Mobile Video Object Detection with Temporally-Aware Feature Maps
Zhu, M., & Liu, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00596 · Cited by 160
Kang, D. D., Bailis, P. D., & Zaharia, M. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3372716.3372725 · Cited by 209
“We evaluate BLAZEIT on a variety of queries on four video streams that are widely used in studying video analytics [9, 37, 40, 46, 70] and two new video streams.”
BackgroundMethodInfluentialSelf-citationDocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing
Shankar, S., Chambers, T., Shah, T., Parameswaran, A., & Wu, E. (2025) · Proceedings of the VLDB Endowment · doi:10.14778/3746405.3746426 · Cited by 189
AutoFocus: Efficient Multi-Scale Inference
Najibi, M., Singh, B., & Davis, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00984 · Cited by 137
Network offloading policies for cloud robotics: a learning-based approach
Chinchali, S., Sharma, A., Harrison, J., Elhafsi, A., Kang, D., Pergament, E., Cidon, E., Katti, S., & Pavone, M. (2021) · Autonomous Robots · doi:10.1007/s10514-021-09987-4 · Cited by 117
Self-citationServing DNNs like Clockwork: Performance Predictability from the Bottom Up
Gujarati, A., Karimi, R. J., Alzayat, S., Hao, W., Kaufmann, A., Vigfússon, Ý., & Mace, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02464 · Cited by 70
“Increasingly, modern ML applications are composed of pipelines or cascades of DNNs [27, 35, 36, 52].”
BackgroundEdge Intelligence: A Review of Deep Neural Network Inference in Resource-Limited Environments
Ngo, D., Park, H.-C., & Kang, B. (2025) · Electronics · doi:10.3390/electronics14122495 · Cited by 154
Resource Management in Mobile Edge Computing: A Comprehensive Survey
Zhang, X., & Debroy, S. (2023) · ACM Computing Surveys · doi:10.1145/3589639 · Cited by 137
Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniques
Xu, R., Razavi, S., & Zheng, R. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3323091 · Cited by 134
Accelerating Machine Learning Inference with Probabilistic Predicates
Lu, Y., Chowdhery, A., Kandula, S., & Chaudhuri, S. (2018) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3183713.3183751 · Cited by 136
Distream: scaling live video analytics with workload-adaptive distributed edge intelligence
Zeng, X., Fang, B., Shen, H., & Zhang, M. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3430721 · Cited by 135
Rafiki: machine learning as an analytics service system
Wang, W., Gao, J., Zhang, M., Wang, S., Chen, G., Ng, T. K., Ooi, B. C., Shao, J., & Reyad, M. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3282495.3282499 · Cited by 118
MacroBase: Prioritizing Attention in Fast Data
Bailis, P., Gan, E., Madden, S., Narayanan, D., Rong, K., & Suri, S. (2017) · Proceedings of the 2017 ACM International Conference on Management of Data · doi:10.1145/3035918.3035928 · Cited by 99
Self-citationEkya: Continuous Learning of Video Analytics Models on Edge Compute ServersPreprint
Bhardwaj, R., Xia, Z., Ananthanarayanan, G., Jiang, J., Karianakis, N., Shu, Y., Hsieh, K., Bahl, V., & Stoica, I. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10557 · Cited by 122
Online Model Distillation for Efficient Video Inference
Mullapudi, R. T., Chen, S., Zhang, K., Ramanan, D., & Fatahalian, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00367 · Cited by 96
“While early explorations of distillation focused on approximating the output of a large model over the entire original data distribution, our work, like other recent work from the systems community [21], leverages distillation to create highly compact, domain-specialized models that need only mimic the teacher for a d…”
BackgroundSpatula: Efficient cross-camera video analytics on large camera networks
Jain, S., Zhang, X., Zhou, Y., Ananthanarayanan, G., Jiang, J., Shu, Y., Bahl, P., & Gonzalez, J. E. (2020) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec50012.2020.00016 · Cited by 117
AI on the edge: a comprehensive review
Su, W., Li, L., Liu, F., He, M., & Liang, X. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10141-4 · Cited by 105
MobiSR: Efficient On-Device Super-Resolution through Heterogeneous Mobile Processors
Lee, R., Venieris, S. I., Dudziak, Ł., Bhattacharya, S., & Lane, N. D. (2019) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3300061.3345455 · Cited by 94
“Fromasystemsperspective,apartfromtask-agnosticframeworks for executing deep neural networks on mobile platforms[17,24,35,42,48],researcheffortshavemainlyfocused in the direction of 1) cascade systems [13, 20, 28, 33, 46, 59], 2) early-exit classifiers [21, 29, 49] and 3) specialized accelerators for CNNs [43, 51] and…”
BackgroundOn-Chip Optical Convolutional Neural NetworksPreprint
Bagherian, H., Skirlo, S. A., Shen, Y., Meng, H., Čeperić, V., & Marin Soljacic, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03303 · Cited by 96
SurveilEdge: Real-time Video Query based on Collaborative Cloud-Edge Deep Learning
Wang, S., Yang, S., & Zhao, C. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155284 · Cited by 98
Effective and Efficient Dropout for Deep Convolutional Neural NetworksPreprint
Cai, S., Shu, Y., Chen, G., Ooi, B. C., Wang, W., & Zhang, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.03392 · Cited by 104
Foreground Gating and Background Refining Network for Surveillance Object Detection
Fu, Z., Chen, Y., Yong, H., Jiang, R., Zhang, L., & Hua, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2922095 · Cited by 82
Kodan: Addressing the Computational Bottleneck in Space
Denby, B., Chintalapudi, K. K., Chandra, R., Lucia, B., & Noghabi, S. A. (2023) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3582016.3582043 · Cited by 78
Mainstream: dynamic stem-sharing for multi-tenant video processing
Jiang, A. H., Wong, D., Canel, C., Tang, L., Misra, I., Kaminsky, M., Kozuch, M. A., Pillai, P. S., Andersen, D. G., & Ganger, G. R. (2018) · USENIX Annual Technical Conference · Cited by 108
Blockchain-based Collaborative Edge Intelligence for Trustworthy and Real-Time Video Surveillance
Zhang, M., Cao, J., Sahni, Y., Chen, Q., Jiang, S., & Yang, L. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3203397 · Cited by 79
MIRIS: Fast Object Track Queries in Video
Bastani, F., He, S., Balasingam, A., Gopalakrishnan, K., Alizadeh, M., Balakrishnan, H., Cafarella, M., Kraska, T., & Madden, S. R. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3389692 · Cited by 98
Scaling Video Analytics Systems to Large Camera Deployments
Jain, S., Ananthanarayanan, G., Jiang, J., Shu, Y., & Gonzalez, J. E. (2019) · IEEE Workshop on Mobile Computing Systems and Applications (WMCSA) · doi:10.1145/3301293.3302366 · Cited by 80
Towards scalable edge-native applications
Wang, J., Feng, Z., George, S., Iyengar, R., Pillai, P. S., & Satyanarayanan, M. (2019) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3318216.3363308 · Cited by 75
VStore: A Data Store for Analytics on Large Videos
Xu, T., Botelho, L. M., & Lin, F. X. (2019) · European Conference on Computer Systems · doi:10.1145/3302424.3303971 · Cited by 81
Cracking open the DNN black-box: Video Analytics with DNNs across the Camera-Cloud Boundary
Emmons, J., Fouladi, S., Ananthanarayanan, G., Venkataraman, S., Savarese, S., & Winstein, K. (2019) · doi:10.1145/3349614.3356023 · Cited by 73
Self-citationVaBUS: Edge-Cloud Real-Time Video Analytics via Background Understanding and Subtraction
Wang, H., Li, Q., Sun, H., Chen, Z., Hao, Y., Peng, J., Yuan, Z., Fu, J., & Jiang, Y. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3221995 · Cited by 66
Real-Time Video Inference on Edge Devices via Adaptive Model Streaming
Khani, M., Hamadanian, P., Nasr-Esfahany, A., & Alizadeh, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00453 · Cited by 83
A survey on deep learning for challenged networks: Applications and trends
Bochie, K., Gilbert, M. S., Gantert, L., Barbosa, M. S. M., Medeiros, D. S. V., & Campista, M. E. M. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103213 · Cited by 66
“ral network architecture more suited for a given inference task [193].”
Collaborative edge and cloud neural networks for real-time video processing
Grulich, P. M., & Nawab, F. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3229863.3236256 · Cited by 66
LegoDNN: block-grained scaling of deep neural networks for mobile vision
Han, R., Zhang, Q., Liu, C. H., Wang, G., Tang, J., & Chen, L. Y. (2021) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3447993.3483249 · Cited by 71
Physical Representation-Based Predicate Optimization for a Visual Analytics Database
Anderson, M. R., Cafarella, M., Ros, G., & Wenisch, T. F. (2019) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2019.00132 · Cited by 88
Lee, R., Venieris, S. I., & Lane, N. D. (2021) · ACM Computing Surveys · doi:10.1145/3469094 · Cited by 73
ODIN: automated drift detection and recovery in video analytics
Suprem, A., Arulraj, J. J. P., Pu, C., & Ferreira, J. E. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3407790.3407837 · Cited by 68
Arithmetic-intensity-guided fault tolerance for neural network inference on GPUs
Kosaian, J., & Rashmi, K. V. (2021) · Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1145/3458817.3476184 · Cited by 53
“the widely-cited NoScope video analytics system [47] have FP16 aggregate arithmetic intensities of 15–53, even with large batch size.”
BackgroundMethodInfluentialApproximate query service on autonomous IoT cameras
Xu, M., Zhang, X., Liu, Y., Huang, G., Liu, X., & Lin, F. X. (2020) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3386901.3388948 · Cited by 61
“the-art object detectors are neural networks (NN). We choose a set of generic, popular detectors as listed in Table 3. Note that: i) We are aware of object detectors specialized for particular videos [60] which are compatible with our design. We motivate and validate our design with generic, well-known detectors for e…”
BackgroundMethodInfluentialJointly optimizing preprocessing and inference for DNN-based visual analytics
Kang, D. D., Mathur, A., Veeramacheneni, T., Bailis, P. D., & Zaharia, M. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3425879.3425881 · Cited by 64
Self-citationIDK Cascades: Fast Deep Learning by Learning not to OverthinkPreprint
Wang, X., Luo, Y., Crankshaw, D., Tumanov, A., Yu, F., & Gonzalez, J. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.00885 · Cited by 71
Edge Intelligence for Smart Grid: A Survey on Application Potentials
Gooi, H. B., Wang, T., & Tang, Y. (2023) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2022.02210 · Cited by 78
Abacus: A Cost-Based Optimizer for Semantic Operator Systems
Russo, M., Liu, C., Sudhir, S., Vitagliano, G., Cafarella, M., Kraska, T., & Madden, S. R. (2026) · Proceedings of the VLDB Endowment · doi:10.14778/3796195.3796215 · Cited by 57
Couper: DNN model slicing for visual analytics containers at the edge
Hsu, K.-J., Bhardwaj, K., & Gavrilovska, A. (2019) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3318216.3363309 · Cited by 65
Rekall: Specifying Video Events using Compositions of Spatiotemporal LabelsPreprint
Fu, D. Y., Crichton, W., Hong, J. W., Yao, X., Zhang, H., Truong, A., Narayan, A., Agrawala, M., Ré, C., & Fatahalian, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02993 · Cited by 52
Zhang, J., Liang, X., Wang, M., Yang, L., & Zhuo, L. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.03.102 · Cited by 49
Approximate selection with guarantees using proxies
Kang, D. D., Gan, E., Bailis, P. D., Hashimoto, T., & Zaharia, M. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3407790.3407804 · Cited by 67
Self-citationRESPIRE: Reducing Spatial–Temporal Redundancy for Efficient Edge-Based Industrial Video Analytics
Dai, X., Yang, P., Zhang, X., Dai, Z., & Yu, L. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3162598 · Cited by 48
Edge-Assisted On-Device Model Update for Video Analytics in Adverse Environments
Kong, Y., Yang, P., & Cheng, Y. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612585 · Cited by 53
Cascade^CNN: Pushing the Performance Limits of Quantisation in Convolutional Neural Networks
Kouris, A., Venieris, S. I., & Bouganis, C.-S. (2018) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2018.00034 · Cited by 56
Inferring Generative Model Structure with Static Analysis
Varma, P., He, B. D., Bajaj, P., Banerjee, I., Khandwala, N., Rubin, D. L., & Ré, C. (2017) · PubMed · doi:10.48550/arxiv.1709.02477 · Cited by 56
InFi: end-to-end learnable input filter for resource-efficient mobile-centric inference
Yuan, M., Zhang, L., He, F., Tong, X., & Li, X. (2022) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3495243.3517016 · Cited by 53
FiGO: Fine-Grained Query Optimization in Video Analytics
Cao, J., Sarkar, K., Hadidi, R., Arulraj, J. J. P., & Kim, H. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3517857 · Cited by 55
INFaaS: A Model-less and Managed Inference Serving SystemPreprint
Romero, F., Li, Q., Yadwadkar, N. J., & Kozyrakis, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13348 · Cited by 44
EdgeVision: Towards Collaborative Video Analytics on Distributed Edges for Performance Maximization
Gao, G., Dong, Y., Wang, R., & Zhou, X. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3385678 · Cited by 42
Reinventing Video Streaming for Distributed Vision Analytics
Pakha, C., Chowdhery, A., & Jiang, J. (2018) · USENIX conference on Hot Topics in Cloud Ccomputing · Cited by 53
ApproxNet: Content and Contention-Aware Video Object Classification System for Embedded Clients
Xu, R., Kumar, R., Wang, P., Bai, P., Meghanath, G., Chaterji, S., Mitra, S., & Bagchi, S. (2021) · ACM Transactions on Sensor Networks · doi:10.1145/3463530 · Cited by 43
“NoScope [35] targeted to reduce the computation cost of video analytics queries on servers by leveraging a specialized model trained on a small subset of videos.”
Survey: Exploiting Data Redundancy for Optimization of Deep Learning
Chen, J.-A., Niu, W., Ren, B., Wang, Y., & Shen, X. (2022) · ACM Computing Surveys · doi:10.1145/3564663 · Cited by 48
VidCEP: Complex Event Processing Framework to Detect Spatiotemporal Patterns in Video Streams
Yadav, P., & Curry, E. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006018 · Cited by 37
LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems
Phani, A., Rath, B., & Böehm, M. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3452788 · Cited by 55
“Examples are function result caching in Clipper [29] (e.g., caching frequently translated words), CSE across prediction programs in PRETZEL [61], and short-circuiting via reference labels in NoScope [56].”
BackgroundModel Assertions for Monitoring and Improving ML ModelsPreprint
Kang, D. D., Raghavan, D., Bailis, P. D., & Zaharia, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01668 · Cited by 64
Self-citationEVA: A Symbolic Approach to Accelerating Exploratory Video Analytics with Materialized Views
Xu, Z., Kakkar, G. T., Arulraj, J. J. P., & Ramachandran, U. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3526142 · Cited by 36
FedVision: Federated Video Analytics With Edge Computing
Deng, Y., Han, T., & Ansari, N. (2020) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2020.2996184 · Cited by 36
Recurrent Residual Module for Fast Inference in Videos
Pan, B., Lin, W., Fang, X., Huang, C., Zhou, B., & Lu, C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00166 · Cited by 40
Wang, L., Lü, K., Zhang, N., Qu, X., Wang, J., Wan, J., Li, G., & Xiao, J. Z. (2023) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac56929.2023.10247821 · Cited by 37
Perceiving Motion From Dynamic Memory for Vehicle Detection in Surveillance Videos
Liu, W., Liao, S., & Hu, W. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2906195 · Cited by 33
“For object detection in surveillance videos, recently, the NoScope system [33] is proposed, which is composed of several separate modules.”
MethodKoudas, N., Li, R., & Xarchakos, I. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/icde48307.2020.00115 · Cited by 38
Scheduling Massive Camera Streams to Optimize Large-Scale Live Video Analytics
Rong, C., Wang, J. H., Liu, J., Wang, J., Li, F., & Huang, X. (2021) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2021.3125359 · Cited by 40
Edge-Assisted Real-Time Video Analytics With Spatial–Temporal Redundancy Suppression
Wang, Z., He, X., Zhang, Z., Zhang, Y., Cao, Z. Z., Cheng, W., Wang, W., & Cui, Y. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3224750 · Cited by 34
Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning
Nan, Y., Jiang, S., & Li, M. (2023) · ACM Transactions on Sensor Networks · doi:10.1145/3624478 · Cited by 42
“Many video analytics systems support adapting conigurations dynamically in an online manner[1, 12, 20, 22, 23, 25, 47, 63].”
BackgroundIncremental and Approximate Inference for Faster Occlusion-based Deep CNN Explanations
Nakandala, S., Kumar, A., & Papakonstantinou, Y. (2019) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3299869.3319874 · Cited by 32
Mistify: Automating {DNN} Model Porting for On-Device Inference at the Edge
Guo, P., Hu, B., & Hu, W. (2021) · Networked Systems Design and Implementation · Cited by 77
CLONE: Collaborative Learning on the Edges
Lu, S., Yao, Y., & Shi, W. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030278 · Cited by 31
Optimizing Video Analytics with Declarative Model Relationships
Romero, F., Hauswald, J., Partap, A., Kang, D. D., Zaharia, M., & Kozyrakis, C. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3570690.3570695 · Cited by 46
Self-citationMoon, J., Kum, S., & Lee, S. (2019) · Sensors · doi:10.3390/s19143038 · Cited by 37
Infrastructure for Usable Machine Learning: The Stanford DAWN ProjectPreprint
Bailis, P. D., Olukotun, K., Ré, C., & Zaharia, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07538 · Cited by 36
Self-citationAccelerating approximate aggregation queries with expensive predicates
Kang, D. D., Guibas, J., Bailis, P. D., Hashimoto, T., Sun, Y., & Zaharia, M. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3476249.3476285 · Cited by 43
Self-citationMultimodal Event Processing: A Neural-Symbolic Paradigm for the Internet of Multimedia Things
Curry, E., Salwala, D., Dhingra, P., Pontes, F. A., & Yadav, P. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3143171 · Cited by 31
MacroBase: Prioritizing Attention in Fast Data
Abuzaid, F., Bailis, P. D., Ding, J., Gan, E., Madden, S. R., Narayanan, D., Rong, K., & Suri, S. (2018) · ACM Transactions on Database Systems · doi:10.1145/3276463 · Cited by 35
Self-citationOptimizing machine learning inference queries with correlative proxy models
Yang, Z., Wang, Z., Huang, Y., Lu, Y., Li, C., & Wang, X. S. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3547305.3547310 · Cited by 40
Data Management in Machine Learning Systems
Böehm, M., Kumar, A., & Yang, J. (2019) · Synthesis lectures on data management · doi:10.1007/978-3-031-01869-5 · Cited by 41
A Fast Filtering Mechanism to Improve Efficiency of Large-Scale Video Analytics
Zhang, C., Cao, Q., Jiang, H., Zhang, W., Li, J., & Yao, J. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2970413 · Cited by 33
Visor: Privacy-Preserving Video Analytics as a Cloud ServicePreprint
Poddar, R., Ananthanarayanan, G., Setty, S., Volos, S., & Popa, R. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09628 · Cited by 68
A Serverless Cloud-Fog Platform for DNN-Based Video Analytics with Incremental LearningPreprint
Zhang, H., Shen, M., Huang, Y., Wen, Y., Luo, Y., Gao, G., & Guan, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03012 · Cited by 31
Anatomizing Deep Learning Inference in Web Browsers
Wang, Q., Jiang, S., Chen, Z., Cao, X., Li, Y., Li, A., Ma, Y., Cao, T., & Liu, X. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3688843 · Cited by 34
TASTI: Semantic Indexes for Machine Learning-based Queries over Unstructured Data
Kang, D. D., Guibas, J., Bailis, P. D., Hashimoto, T., & Zaharia, M. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3517897 · Cited by 44
Self-citationOrca: Scalable Temporal Graph Neural Network Training with Theoretical Guarantees
Li, Y., Shen, Y., Chen, L., & Yuan, M. (2023) · Proceedings of the ACM on Management of Data · doi:10.1145/3588737 · Cited by 33
“Such techniques have been adopted in a wide range of ML lifecycle management systems such as data versioning [10, 11], model management [42, 61], feature selection [44, 56, 57, 74], model training [43, 64], model diagnosis [60], and model serving [17, 33, 36].”
A Streaming Cloud Platform for Real-Time Video Processing on Embedded Devices
Zhang, W., Sun, H., Zhao, D., Xu, L., Liu, X., Ning, H., Zhou, J., Guo, Y., & Yang, S. (2019) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2019.2894621 · Cited by 33
“[32] proposed NOSCOPE targeting querying large scale of videos.”
BackgroundKim, W., & Youn, C. (2020) · IEEE Access · doi:10.1109/access.2020.3004571 · Cited by 30
Metadata
- Authors
- Kang, D., Emmons, J., Abuzaid, F., Bailis, P., & Zaharia, M.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the VLDB Endowment
- Published
- 2017-08
- Volume
- 10
- Issue
- 11
- Pages
- 1586-1597
- ISSN
- 2150-8097 (ISSN-L)
- OpenAlex
- W2752236330
- Cited by
- 367
- References
- 97
- Citations by year
- 2026: 23 · 2025: 33 · 2024: 35 · 2023: 40 · 2022: 60 · 2021: 49 · 2020: 45 · 2019: 53 · 2018: 28 · 2017: 1
- FWCI
- 14.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-sa
- Locations
- Proceedings of the VLDB Endowment (publishedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
- Keywords
- object detection, inference optimization, model search, cascade model, cost-based optimization, real-time video analysis, surveillance video, webcam video, binary classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.