The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
NoScope: optimizing neural network queries over video at scale
Open accessAbstract
Recent advances in computer vision---in the form of deep neural networks---have made it possible to query increasing volumes of video data with high accuracy. However, neural network inference is computationally expensive at scale: applying a state-of-the-art object detector in real time (i.e., 30+ frames per second) to a single video requires a $4000 GPU. In response, we present N o S cope , a system for querying videos that can reduce the cost of neural network video analysis by up to three orders of magnitude via inference-optimized model search. Given a target video, object to detect, and reference neural network, N o S cope automatically searches for and trains a sequence, or cascade, of models that preserves the accuracy of the reference network but is specialized to the target video and are therefore far less computationally expensive. N o S cope cascades two types of models: specialized models that forego the full generality of the reference model but faithfully mimic its behavior for the target video and object; and difference detectors that highlight temporal differences across frames. We show that the optimal cascade architecture differs across videos and objects, so N o S cope uses an efficient cost-based optimizer to search across models and cascades. With this approach, N o S cope achieves two to three order of magnitude speed-ups (265-15,500x real-time) on binary classification tasks over fixed-angle webcam and surveillance video while maintaining accuracy within 1--5% of state-of-the-art neural networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“In recent times, however, deep neural networks (NNs) [40, 44, 58, 66, 67] have largely displaced classical computer”
BackgroundImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“NOSCOPE implements specialized NNs based on the AlexNet architecture [56] (filter doubling, dropout), using ReLU units for all the hidden layers and a softmax unit at the end to return a confidence for the class we are querying.”
MethodLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 19×
“However, even in this video, NOSCOPE can offer an 30× speedup over YOLOv2 with no loss in accuracy.”
BackgroundInfluentialMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 4×
“geNet 2012 [82]), a variety of SIFT-based bag-of-words classifiers (varying the SIFT parameters), and selective search with a SIFTbased classifier [63] (which performed well on PASCAL VOC [32]).”
BackgroundMethodInfluentialYOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892 · cited 2×
“We used YOLOv2 [80] as our reference model.”
MethodRapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300 · cited 2×
“One of the first cascades, the Viola-Jones detector [90], cascades traditional image processing features; if any classifier is confident about the output, the Viola-Jones cascade short-circuits evaluation, improving execution speed.”
Research works printed but not linked: 24
- Abadi D. J., 2005, CIDR
- Ba J., 2014, NIPS
- Bailis P., 2017, CIDR
- Benenson R., 2014, ECCV
- Chandrasekaran S., 2003, CIDR
- Chaudhuri S., 2007, VLDB
- Chen W., 2015, ICML
- Feichtenhofer C., 2016, NIPS
- 10.5555/2354409.2354978 · doi:10.5555/2354409.2354978
- Gibbs S., 1993, ICDE
- Goodfellow I., 2016, MIT Press
- Han S., 2016, ICLR
- Hinton G., 2014, NIPS
- Idreos S., 2007, CIDR
- Kraska T., 2013, CIDR
- Krizhevsky A., 2012, NIPS
- 10.5555/850924.851523 · doi:10.5555/850924.851523
- Metz C., 2017, Wired
- Patait A., 2016, 2016 GPU Technology Conference (https://goo.gl/Bdjdgm)
- Ren S., 2015, NIPS
- Yue-Hei Ng J., 2015, CVPR, 53
- Zhang H., 2017, NSDI
- Zhanget S., 2016, CVPR
- Zoph B., 2017, ICLR
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“NoScope [144] leverages two types of models rather than the standard model (such as YOLO”
MethodChameleon: scalable adaptation of video analytics
Jiang, J., Ananthanarayanan, G., Bodik, P., Sen, S., & Stoica, I. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230574 · Cited by 467
“Instead, we use an expensive golden configuration to provide the “ground truth”, following prior work [22, 24, 32].”
BackgroundMethodEfficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
SPINN: synergistic progressive inference of neural networks over device and cloud
Laskaridis, S., Venieris, S. I., Almeida, M., Leontiadis, I., & Lane, N. D. (2020) · Proceedings of the 26th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3372224.3419194 · Cited by 310
Metadata
- Authors
- Kang, D., Emmons, J., Abuzaid, F., Bailis, P., & Zaharia, M.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the VLDB Endowment
- Published
- 2017-08
- Volume
- 10
- Issue
- 11
- Pages
- 1586-1597
- ISSN
- 2150-8097 (ISSN-L)
- OpenAlex
- W2752236330
- Cited by
- 367
- References
- 97
- Citations by year
- 2026: 23 · 2025: 33 · 2024: 35 · 2023: 40 · 2022: 60 · 2021: 49 · 2020: 45 · 2019: 53 · 2018: 28 · 2017: 1
- FWCI
- 14.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-sa
- Locations
- Proceedings of the VLDB Endowment (publishedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
- Keywords
- object detection, inference optimization, model search, cascade model, cost-based optimization, real-time video analysis, surveillance video, webcam video, binary classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: NoScope: optimizing neural network queries over video at scale. https://app.cochat.ai/papers/10.14778/3137628.3137664
- The paper
- Kang, D., Emmons, J., Abuzaid, F., Bailis, P., & Zaharia, M. (2017). NoScope: optimizing neural network queries over video at scale. Proceedings of the VLDB Endowment. https://doi.org/10.14778/3137628.3137664
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.