NoScope: optimizing neural network queries over video at scale
Open accessThe DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Abstract
Recent advances in computer vision---in the form of deep neural networks---have made it possible to query increasing volumes of video data with high accuracy. However, neural network inference is computationally expensive at scale: applying a state-of-the-art object detector in real time (i.e., 30+ frames per second) to a single video requires a $4000 GPU. In response, we present N o S cope , a system for querying videos that can reduce the cost of neural network video analysis by up to three orders of magnitude via inference-optimized model search. Given a target video, object to detect, and reference neural network, N o S cope automatically searches for and trains a sequence, or cascade, of models that preserves the accuracy of the reference network but is specialized to the target video and are therefore far less computationally expensive. N o S cope cascades two types of models: specialized models that forego the full generality of the reference model but faithfully mimic its behavior for the target video and object; and difference detectors that highlight temporal differences across frames. We show that the optimal cascade architecture differs across videos and objects, so N o S cope uses an efficient cost-based optimizer to search across models and cascades. With this approach, N o S cope achieves two to three order of magnitude speed-ups (265-15,500x real-time) on binary classification tasks over fixed-angle webcam and surveillance video while maintaining accuracy within 1--5% of state-of-the-art neural networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“In recent times, however, deep neural networks (NNs) [40, 44, 58, 66, 67] have largely displaced classical computer”
BackgroundImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“NOSCOPE implements specialized NNs based on the AlexNet architecture [56] (filter doubling, dropout), using ReLU units for all the hidden layers and a softmax unit at the end to return a confidence for the class we are querying.”
MethodLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 19×
“However, even in this video, NOSCOPE can offer an 30× speedup over YOLOv2 with no loss in accuracy.”
BackgroundInfluentialMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 4×
“geNet 2012 [82]), a variety of SIFT-based bag-of-words classifiers (varying the SIFT parameters), and selective search with a SIFTbased classifier [63] (which performed well on PASCAL VOC [32]).”
BackgroundMethodInfluentialYOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892 · cited 2×
“We used YOLOv2 [80] as our reference model.”
MethodRapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300 · cited 2×
“One of the first cascades, the Viola-Jones detector [90], cascades traditional image processing features; if any classifier is confident about the output, the Viola-Jones cascade short-circuits evaluation, improving execution speed.”
Research works printed but not linked: 24
- Abadi D. J., 2005, CIDR
- Ba J., 2014, NIPS
- Bailis P., 2017, CIDR
- Benenson R., 2014, ECCV
- Chandrasekaran S., 2003, CIDR
- Chaudhuri S., 2007, VLDB
- Chen W., 2015, ICML
- Feichtenhofer C., 2016, NIPS
- 10.5555/2354409.2354978 · doi:10.5555/2354409.2354978
- Gibbs S., 1993, ICDE
- Goodfellow I., 2016, MIT Press
- Han S., 2016, ICLR
- Hinton G., 2014, NIPS
- Idreos S., 2007, CIDR
- Kraska T., 2013, CIDR
- Krizhevsky A., 2012, NIPS
- 10.5555/850924.851523 · doi:10.5555/850924.851523
- Metz C., 2017, Wired
- Patait A., 2016, 2016 GPU Technology Conference (https://goo.gl/Bdjdgm)
- Ren S., 2015, NIPS
- Yue-Hei Ng J., 2015, CVPR, 53
- Zhang H., 2017, NSDI
- Zhanget S., 2016, CVPR
- Zoph B., 2017, ICLR
Cited by
Items 201–300 of 469
Task Cascades for Efficient Unstructured Data Processing
Shankar, S., Zeighami, S., & Parameswaran, A. (2026) · Proceedings of the ACM on Management of Data · doi:10.1145/3786702 · Cited by 13
Ranked Window Query Retrieval over Video Repositories
Chen, Y., Yu, X., & Koudas, N. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00253 · Cited by 11
Predictive and Near-Optimal Sampling for View Materialization in Video Databases
Xu, Y., Zhang, D., Zhang, S., Wu, S., Feng, Z., & Chen, G. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3639274 · Cited by 13
CACTUS: Dynamically Switchable Context-aware micro-Classifiers for Efficient IoT Inference
Rastikerdar, M. M., Huang, J., Fang, S., Guan, H., & Ganesan, D. (2024) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3643832.3661888 · Cited by 14
SkyQuery: an aerial drone video sensing platform
Bastani, F., He, S., Jiang, Z., Bastani, O., & Madden, S. R. (2021) · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · doi:10.1145/3486607.3486750 · Cited by 9
Video-zilla: An Indexing Layer for Large-Scale Video Analytics
Hu, B., Guo, P., & Hu, W. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3517840 · Cited by 13
“Existing large-scale video analytics systems tackle the daunting scalability prospects by leveraging the inherent redundancy within video feeds [37, 43, 45].”
BackgroundMethodInfluentialComAI: Enabling Lightweight, Collaborative Intelligence by Retrofitting Vision DNNs
Jayarajah, K., Wanniarachchige, D., Abdelzaher, T., & Misra, A. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796769 · Cited by 14
RTCoInfer: Real-Time Collaborative CNN Inference for Stream Analytics on Ubiquitous Images
Zhang, Z., Yang, S., Zhao, C., Ren, X., Yu, H., Han, Q., & Guo, S. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242730 · Cited by 10
Owl: A Pre-and Post-processing Framework for Video Analytics in Low-light Surroundings
Zhang, R.-X., Li, C., Wu, C., Huang, T., & Sun, L. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10229059 · Cited by 10
Concerto: Client-server Orchestration for Real-Time Video Analytics
Li, C., Zhang, R.-X., Huang, T., Jia, L., & Sun, L. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611770 · Cited by 10
Spatialyze: A Geospatial Video Analytics System with Spatial-Aware Optimizations
Kittivorawong, C., Ge, Y., Helal, Y., & Cheung, A. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3665844.3665846 · Cited by 11
RAVAS: Interference-Aware Model Selection and Resource Allocation for Live Edge Video Analytics
Rahmanian, A. A., Ali-Eldin, A., Tesfatsion, S. K., Skubic, B., Gustafsson, H., Shenoy, P. J., & Elmroth, E. (2023) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3583740.3628443 · Cited by 10
Honarparvar, S., Saeedi, S., Liang, S. H. L., & Squires, J. (2021) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi10020081 · Cited by 9
Task-agnostic Indexes for Deep Learning-based Queries over Unstructured Data.Preprint
Kang, D. D., Guibas, J., Bailis, P. D., Hashimoto, T., & Zaharia, M. (2020) · arXiv (Cornell University) · Cited by 13
Self-citationCoral-Pie: A Geo-Distributed Edge-compute Solution for Space-Time Vehicle Tracking
Xu, Z., Shah, H. S., & Ramachandran, U. (2020) · International Middleware Conference · doi:10.1145/3423211.3425686 · Cited by 9
Yang, Y., Lee, S., & Lee, J. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.03.013 · Cited by 10
SplitStream: Distributed and workload-adaptive video analytics at the edge
Liang, Y., Zhang, S., & Wu, J. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.103866 · Cited by 8
Novas: Tackling Online Dynamic Video Analytics With Service Adaptation at Mobile Edge Servers
Zhang, L., Zhu, H., Fei, W., Li, Y., Zhang, M., Cao, J., & Guo, M. (2024) · IEEE Transactions on Computers · doi:10.1109/tc.2024.3416675 · Cited by 12
ChatCam: Embracing LLMs for Contextual Chatting-to-Camera with Interest-Oriented Video Summarization
Xiao, K., Gao, Y. C., Li, F., Xu, W., Chen, P., & Dong, W. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699731 · Cited by 9
Performance characterization of video analytics workloads in heterogeneous edge infrastructures
Rivas-Barragan, D., Guim, F., Polo, J., & Carrera, D. (2021) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6317 · Cited by 8
Towards memory-efficient inference in edge video analytics
Padmanabhan, A., Iyer, A. P., Ananthanarayanan, G., Shu, Y., Karianakis, N., Xu, G. H., & Netravali, R. (2021) · doi:10.1145/3477083.3480150 · Cited by 9
“In addition, our vision of model merging is complementary to existing systems that directly optimize the computation (not memory) required in video analytics pipelines through improved job scheduling strategies, approximation tolerance, and tuning pipeline configurations [17, 25, 37].”
BackgroundQuery-driven video event processing for the internet of multimedia things
Yadav, P., Salwala, D., Pontes, F. A., Dhingra, P., & Curry, E. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3476311.3476360 · Cited by 8
“NoScope [6] focuses on fast binary object detection using specialized DNN trained on archived video.”
MethodImage reconstruction attacks on distributed machine learning models
Benkraouda, H., & Nahrstedt, K. (2021) · doi:10.1145/3488659.3493779 · Cited by 8
Video Object Detection Base on RGB and Optical Flow Analysis
Zhang, S., Wang, T., Wang, C., Wang, Y., Shan, G., & Snoussi, H. (2019) · 2019 2nd China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI) · doi:10.1109/cchi.2019.8901921 · Cited by 7
“We also skipped frames to speed up the algorithm and enhance the performance[6].”
MethodScaleDoc: Scaling LLM-based Predicates over Large Document Collections
Zhang, H., Hui, Y., Liu, Y., & Zhang, H. (2026) · Proceedings of the ACM on Management of Data · doi:10.1145/3802106 · Cited by 9
InFi: End-to-End Learning to Filter Input for Resource-Efficiency in Mobile-Centric Inference
Yuan, M., Zhang, L., He, F., Tong, X., Song, M.-H., Xu, Z., & Li, X. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3275981 · Cited by 10
Think before You Leap: Content-Aware Low-Cost Edge-Assisted Video Semantic Segmentation
Yan, M., Wang, Y., Xiao, X., Luo, Z., He, J., & Wang, W. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3613808 · Cited by 7
TVM: A Tile-based Video Management Framework
Zhong, T., Zhang, Z.-W., Lu, G., Yuan, Y., Wang, Y.-P., & Wang, G.-R. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3636218.3636224 · Cited by 7
Usas: A Sustainable Continuous-Learning´ Framework for Edge Servers
Mishra, C. S., Sampson, J., Kandemir, M., Narayanan, V., & Das, C. R. (2024) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca57654.2024.00073 · Cited by 14
“These tailored models enable accurate inference with high throughput and reduced resource footprint, with some compressed models having approximately 50 × fewer parameters [30], but with a greater susceptibility to data drift [42], [55].”
OctopInf: Workload-Aware Inference Serving for Edge Video Analytics
Nguyen, T.-T., Liebe, L., Tau, N.-Q., Wu, Y., Cheng, J., & Lee, D. (2025) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom64205.2025.00032 · Cited by 13
Simulation of an electronic equipment control method based on an improved neural network algorithm
Liu, H., & Wang, W. (2022) · Energy Reports · doi:10.1016/j.egyr.2022.09.034 · Cited by 7
Space-Time Vehicle Tracking at the Edge of the Network
Xu, Z., Sinha, S., Shah Harshil, S., & Ramachandran, U. (2019) · doi:10.1145/3349614.3356025 · Cited by 7
“NoScope [6] uses a generalized expensive model to automatically train a specialized model on the target video stream.”
BackgroundCollaborative Edge-Cloud and Edge-Edge Video Analytics
Gazzaz, S., & Nawab, F. (2019) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3357223.3366024 · Cited by 7
Understanding the potential of server-driven edge video analytics
Zhang, Q., Du, K., Agarwal, N., Netravali, R., & Jiang, J. (2022) · IEEE Workshop on Mobile Computing Systems and Applications (WMCSA) · doi:10.1145/3508396.3512872 · Cited by 8
MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera ConfigurationsPreprint
Wong, M. H., Ramanujam, M., Balakrishnan, G., & Netravali, R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.02101 · Cited by 11
Aero: Adaptive Query Processing of ML Queries
Kakkar, G. T., Cao, J., Sengupta, A., Arulraj, J. J. P., & Kim, H. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3725408 · Cited by 9
EdgeTA: Neuron-Grained Scaling of Foundation Models in Edge-Side Retraining
Zhang, Q., Han, R., Liu, C. H., Wang, G., Guo, S., & Chen, L. Y. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3504859 · Cited by 7
Multi-server Multi-user Game at Edges for Heterogeneous Video Analytics
Chen, Y., Zhang, S., Jin, Y., Qian, Z., & Lu, S. (2022) · International Conference on Communications · doi:10.1109/icc45855.2022.9839250 · Cited by 6
LENS: Bandwidth-efficient video analytics with adaptive super resolution
Shan, M., Zhang, S., Xiao, M., & Zhao, Y. (2022) · Computer Networks · doi:10.1016/j.comnet.2022.109392 · Cited by 6
DoveDB: A Declarative and Low-Latency Video Database
Xiao, Z., Zhang, D., Li, H., Wu, S., Tan, K., & Chen, G. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3611540.3611582 · Cited by 6
“Systems like NoScope [7] and TAHOMA [1] adopt the idea of designing a lightweight proxy model to replace the slow-running oracle model, with tolerable accuracy degradation.”
MethodMixer: efficiently understanding and retrieving visual content at web-scale
Qin, A., Xiao, M., Wu, Y., Huang, X., & Zhang, X. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3476311.3476371 · Cited by 8
The Design and Implementation of Low-Latency Prediction Serving Systems
Crankshaw, D. (2019) · eScholarship (California Digital Library) · Cited by 14
A Survey of Performance Optimization in Neural Network-Based Video Analytics SystemsPreprint
Ibrahim, N. B., Maurya, P., Jafari, O., & Nagarkar, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.14195 · Cited by 6
ReXCam: Resource-Efficient, Cross-Camera Video Analytics at Scale
Jain, S., Zhang, X., Zhou, Y., Ananthanarayanan, G., Jiang, J., Shu, Y., & Gonzalez, J. (2018) · arXiv · doi:10.48550/arxiv.1811.01268 · Cited by 5
“Proposed techniques include parameter and filter pruning [28, 39], compact architecture design [33, 41], knowledge distillation [30, 27, 18], and model specialization [37, 31].”
BackgroundMethodA Development of Cloud Based Robotics Design Networks for Industry Applications
Sathi, G., Varshney, N., Sharma, P., Punitha, B. J., Sundar, R., & SubbaRao, S. P. V. (2024) · International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) · doi:10.1109/icacite60783.2024.10616950 · Cited by 5
Towards Efficient Object Re-Identification with a Novel Cloud-Edge Collaborative Framework
Wang, C., Yang, Y., Qi, M., Zhang, H., & Ma, H. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i7.32818 · Cited by 5
ViEdge: Video Analytics on Distributed Edge
Hou, X., Guan, Y., & Han, T. (2025) · ACM Transactions on Internet of Things · doi:10.1145/3742794 · Cited by 5
“Other works [5, 7, 11, 23, 28, 31, 50] consider the offloading from cameras to server through network and improve the efficiency of offloading; (2) Local (on-board device): The video analytics are executed by the camera’s local device [3, 12, 44].”
Optimizing Video Selection LIMIT Queries with Commonsense Knowledge
He, W., Sabek, I., Lou, Y., & Cafarella, M. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3654621.3654639 · Cited by 5
RegionFilter: Region-aware video filtering mechanism on resource-constrained edge nodes
Chen, T., Bu, Y., Zeng, Y. W., Xie, L., & Lu, S. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110624 · Cited by 5
Biathlon: Harnessing Model Resilience for Accelerating ML Inference Pipelines
Chang, C., Lo, E., & Ye, C. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3675034.3675052 · Cited by 7
Pontes, F. A., Schukat, M., & Curry, E. (2024) · IEEE Access · doi:10.1109/access.2024.3520807 · Cited by 7
MAST: Towards Efficient Analytical Query Processing on Point Cloud Data
Li, J., Yuan, H., Cong, G., Kiah, H. M., & Zhang, S. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3709702 · Cited by 5
Zhao, M., Liu, S., Wu, F., & Chen, G. (2025) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3715014.3722044 · Cited by 8
Aggressive Energy Reduction for Video Inference with Software-only Strategies
Gonçalves, L. R., de Moura, R. F., & Carro, L. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358174 · Cited by 5
“In order to optimize video inference, NoScope [17] trains shallow NNs as specialized models of a target network.”
BackgroundA distributed system for large-scale n-gram language models at Tencent
Long, Q., Wang, W., Deng, J., Liu, S., Huang, W., Chen, F., & Liu, S. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3352063.3352136 · Cited by 5
TQVS: Temporal Queries over Video Streams in Action
Chen, Y., Yu, X., & Koudas, N. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3384693 · Cited by 5
Optimizing Queries over Video via Lightweight Keypoint-based Object Detection
Dong, J., Yuan, J., Li, L., Zhong, X., & Liu, W. (2020) · International Conference on Multimedia Retrieval · doi:10.1145/3372278.3390714 · Cited by 5
“NoScope [10] trains specialized detectors that gives up all generality, but greatly greatly simplifies the detector.”
BackgroundA Case for Camera-as-a-Service
Xu, M., Liu, Y., & Liu, X. (2021) · IEEE Pervasive Computing · doi:10.1109/mprv.2021.3052532 · Cited by 5
Xarchakos, Y., & Koudas, N. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00216 · Cited by 5
RATS: Robust Automated Tracking and Segmentation of Similar Instances
Kopácsi, L., Dobolyi, Á., Fóthi, Á., Keller, D. W., Varga, V., & Lörincz, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86365-4_41 · Cited by 5
Why Is the Video Analytics Accuracy Fluctuating, and What Can We Do About It?
Paul, S., Rao, K., Coviello, G., Sankaradas, M., Po, O., Hu, Y., & Chakradhar, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25056-9_28 · Cited by 5
Solar-powered Parking Analytics System Using Deep Reinforcement Learning
Rezaei, Y., Khan, T., Lee, S., & Mossé, D. (2023) · ACM Transactions on Sensor Networks · doi:10.1145/3584949 · Cited by 5
Track Merging for Effective Video Query Processing
Chao, D., Chen, Y., Koudas, N., & Yu, X. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00020 · Cited by 7
MaskSearch: Querying Image Masks at Scale
He, D., Zhang, J., Daum, M., Ratner, A., & Bałazińska, M. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00184 · Cited by 5
Supporting Video Queries on Zero-Streaming Cameras.Preprint
Xu, M., Xu, T., Liu, Y., Liu, X., Huang, G., & Lin, F. X. (2019) · arXiv (Cornell University) · Cited by 7
Scaling Video Analytics Systems to Large Camera DeploymentsPreprint
Jain, S., Ananthanarayanan, G., Jiang, J., Shu, Y., & Gonzalez, J. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02318 · Cited by 7
CodecSight: Leveraging Video Codec Signals for Efficient Streaming VLM InferencePreprint
Zou, Y., Chen, Y., Chen, W., Rajan, A., Park, J., Nitin, S., Tao, L., Romero, F., & Ustiugov, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.06036 · Cited by 6
Bandwidth on a Budget: Real-Time Configuration for Edge Video Analysis
Chen, S., Deng, J., Tao, X., Xie, X. N., Tan, R., Hong, T., & Liu, X. (2025) · IEEE Transactions on Computers · doi:10.1109/tc.2025.3603711 · Cited by 4
Déjà Vu: Efficient Video-Language Query Engine with Learning-Based Inter-Frame Computation Reuse
Hwang, J., Kim, D., Lee, S., Kim, Y., Heo, G., Kim, H., Jeong, Y., Meaza, T., Park, E., Ahn, J., et al. (2025) · Proceedings of the VLDB Endowment · doi:10.14778/3748191.3748195 · Cited by 9
Ma, X., Tang, J., & Bai, Y. D. (2023) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed57927.2023.10129395 · Cited by 4
OneAdapt: Fast Adaptation for Deep Learning Applications via Backpropagation
Du, K., Liu, Y., Hao, Y., Zhang, Q., Wang, H., Huang, Y., Ananthanarayanan, G., & Jiang, J. (2023) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3620678.3624653 · Cited by 9
Zhang, L., Zhu, H., Li, Y., Shen, J., & Guo, M. (2024) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3673038.3673081 · Cited by 7
Towards End-to-End Latency Guarantee in MEC Live Video Analytics with App-RAN Mutual Awareness
Yi, J., Lee, G., Jeong, M., Shin, S. H., Kim, D., & Lee, Y. (2025) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3711875.3729139 · Cited by 8
A Practical Person Monitoring System for City Security
Eda, T., Muramatsu, S., Mikami, K., & Xu, S. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639168 · Cited by 4
“To achieve a higher level of capacity and higher performance, specific models may be feasible for avoiding unnec- essarily DL inferencing such as that in NoScope [6].”
BackgroundInfluentialDeluceva: Delta-Based Neural Network Inference for Fast Video Analytics
Wang, J., & Bałazińska, M. (2020) · International Conference on Scientific and Statistical Database Management · doi:10.1145/3400903.3400930 · Cited by 6
mmFilter: Language-Guided Video Analytics at the Edge
Hu, Z., Ye, N., Phillips, C., Capes, T., & Mohomed, I. (2020) · International Middleware Conference · doi:10.1145/3429357.3430518 · Cited by 4
Maze: A Cost-Efficient Video Deduplication System at Web-scale
Qin, A., Xiao, M., Huang, B., & Zhang, X. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548145 · Cited by 5
Rev: A Video Engine for Object Re-identification at the City Scale
Xu, T., Shen, K., Fu, Y. L., Shi, H., & Lin, F. X. (2022) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec54971.2022.00022 · Cited by 6
Marshalling Model Inference in Video Streams
Chao, D., Koudas, N., & Yu, X. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00110 · Cited by 5
WiseCam: Wisely Tuning Wireless Pan-Tilt Cameras for Cost-Effective Moving Object Tracking
Jinlong, E., He, L., Li, Z., & Liu, Y. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10228926 · Cited by 9
“Focus [33] and NoScope [34] improve the efficiency of video analytics pipelines by filtering out frames that lack relevant information for query.”
BackgroundData Management for ML-Based Analytics and Beyond
Kang, D. D., Guibas, J., Bailis, P. D., Hashimoto, T., Sun, Y., & Zaharia, M. (2024) · ACM / IMS Journal of Data Science · doi:10.1145/3611093 · Cited by 5
Self-citationAdaConfigure: Reinforcement Learning-Based Adaptive Configuration for Video Analytics Services
He, Z., Wang, Y., Tang, C., Wang, Z., Zhu, W., Guo, C., & Chen, Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98358-1_20 · Cited by 4
ECORE: Energy-Conscious Optimized Routing for Deep Learning Models at the Edge
Alqahtani, D. K., Rodriguez, M. A., Cheema, M. A., Rezatofighi, H., & Toosi, A. N. (2026) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom67906.2026.11524531 · Cited by 5
ECSAM: An Edge-cloud Video Analytics Architecture for the Segment Anything Model
Lu, R., Shi, S., & Wang, D. (2025) · doi:10.1145/3769696.3771216 · Cited by 3
DiVE: Differential Video Encoding for Online Edge-assisted Video Analytics on Mobile Agents
Shen, J., Zhu, H., Zhang, L., Li, Y., Chang, S., Wu, J., & Guo, M. (2025) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs63083.2025.00032 · Cited by 3
Energy-Efficient Autonomous Driving With Adaptive Perception and Robust Decision
Xia, Y., Liang, Z., Deng, L., Zhao, Y., Su, H., & Zheng, K. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00057 · Cited by 3
Video analytics from edge to server
Cao, J., Hadidi, R., Arulraj, J. J. P., & Kim, H. (2019) · International Conference on Hardware/Software Codesign and System Synthesis · doi:10.1145/3349567.3351733 · Cited by 3
“Noscope [5] instead uses model specialization in which multiple optimized models are created for different tasks to filter out low probable data.”
Large-Scale Video Analytics Through Object-Level Consolidation
Rivas, D., Guim, F., Polo, J., Berral, J. L., & Carrera, D. (2022) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-06371-8_11 · Cited by 3
CVF: Cross-Video Filtration on the Edge
Rahmanian, A. A., Amin, S., Gustafsson, H., & Ali-Eldin, A. (2024) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3625468.3647627 · Cited by 3
Hybrid Evaluation for Occlusion-based Explanations on CNN Inference Queries
Ding, G., Xu, C., & Qian, W. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00078 · Cited by 3
LOVO: Efficient Complex Object Query in Large-Scale Video Datasets
Liu, Y., Peng, Y., Zhou, H., Liu, H., Lu, X., Lou, J., Wu, C., Zhao, W., & Li, J. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00148 · Cited by 3
Foreground Gated Network for Surveillance Object Detection
Fu, Z., Zhou, C., Yong, H., Jiang, R., Tian, X., Chen, Y., & Hua, X. (2018) · IEEE International Conference on Multimedia Big Data · doi:10.1109/bigmm.2018.8499396 · Cited by 5
“NoScope [13] proposes an extremely fast framework for surveillance object detection.”
BackgroundDataset Culling: Towards Efficient Training of Distillation-Based Domain Specific Models
Yoshioka, K., Lee, E. H., Wong, S. S., & Horowitz, M. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803462 · Cited by 5
“[4] utilized this idea in a model cascade, [5] pushed this idea to the extreme by training frequently with extremely-small student models, and [6] used unlabeled data to augment the student dataset.”
BackgroundMethodXarchakos, I., & Koudas, N. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3094997 · Cited by 6
Kiaei, S., Honarparvar, S., Saeedi, S., & Liang, S. H. L. (2021) · IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON) · doi:10.1109/iemcon53756.2021.9623141 · Cited by 4
Zebra: A novel method for optimizing text classification query in overload scenario
Yu, T., He, Z., Yang, Z., Ye, F., Fan, Y., Jing, Y., Zhang, K., & Wang, X. S. (2022) · World Wide Web · doi:10.1007/s11280-022-01061-y · Cited by 3
“Many video query processing data platforms or engines including BlazeIt [19], MIRIS [4], NoScope [18], probabilistic predicates [29], SVQ [42], etc, have been proposed to accelerate the execution of video analytics in recent years.”
Everest: A Top-K Deep Video Analytics System
Lai, Z., Liu, C., Han, C., Zhang, P., Lo, E., & Kao, B. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3520151 · Cited by 3
CrispSearch: low-latency on-device language-based image retrieval
Hu, Z., Xiao, L., Kemertas, M., Phillips, C., Mohomed, I., & Fazly, A. (2022) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3524273.3528181 · Cited by 3
RETRACTED: TRUST: A Novel Framework for Vehicle Trajectory Recovery from Urban-Scale Videos
Ji, W., & Chen, X. (2022) · Sensors · doi:10.3390/s22249948 · Cited by 3
“NoScope [3] is a pioneering work that uses smaller but faster-dedicated networks for target detection, but with lower efficiency.”
BackgroundRetractedClass Specialized Knowledge Distillation
Wang, L., Rhodes, A. D., & Feng, W. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26284-5_24 · Cited by 3
Metadata
- Authors
- Kang, D., Emmons, J., Abuzaid, F., Bailis, P., & Zaharia, M.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the VLDB Endowment
- Published
- 2017-08
- Volume
- 10
- Issue
- 11
- Pages
- 1586-1597
- ISSN
- 2150-8097 (ISSN-L)
- OpenAlex
- W2752236330
- Cited by
- 367
- References
- 97
- Citations by year
- 2026: 23 · 2025: 33 · 2024: 35 · 2023: 40 · 2022: 60 · 2021: 49 · 2020: 45 · 2019: 53 · 2018: 28 · 2017: 1
- FWCI
- 14.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-sa
- Locations
- Proceedings of the VLDB Endowment (publishedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
- Keywords
- object detection, inference optimization, model search, cascade model, cost-based optimization, real-time video analysis, surveillance video, webcam video, binary classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.