CoChat

Object Detection in 20 Years: A Survey

Open access
Zou, Zhengxia, Chen, Keyan, Shi, Zhenwei, Guo, Yuhong, Ye, Jieping · 2023 · Proceedings of the IEEE

The DOI matches its Crossref record; 307 of the 307 references it cites were found in a registry or an index; 84 of the 192 sources its claims cite were checked for support.

Abstract

Object detection, as of one the most fundamental and challenging problems in computer vision, has received great attention in recent years. Over the past two decades, we have seen a rapid technological evolution of object detection and its profound impact on the entire computer vision field. If we consider today’s object detection technique as a revolution driven by deep learning, then, back in the 1990s, we would see the ingenious thinking and long-term perspective design of early computer vision. This article extensively reviews this fast-moving research field in the light of technical evolution, spanning over a quarter-century’s time (from the 1990s to 2022). A number of topics have been covered in this article, including the milestone detectors in history, detection datasets, metrics, fundamental building blocks of the detection system, speedup techniques, and recent state-of-the-art detection methods.

Overview

CoChat Summary

TL;DR

This survey reviews two decades of object detection research (1990s–2022), tracing the transition from handcrafted-feature detectors to deep-learning-based two-stage, one-stage, and transformer detectors. It organizes the field around milestone detectors, datasets and metrics, key building blocks (multi-scale detection, context, hard negative mining, loss functions, NMS), speed-up techniques, and recent advances.

Key findings

  • The field splits into a "traditional object detection period (before 2014)" and a "deep learning based detection period (after 2014)"; RCNN raised VOC07 mAP from 33.7% (DPM-v5) to 58.5%, SPPNet reached VOC07 mAP=59.2% at >20× faster than R-CNN, Fast RCNN reached 70.0% mAP at >200× faster than R-CNN, and Faster RCNN reached COCO mAP@.5=42.7%, VOC07 mAP=73.2% at 17fps.
  • One-stage detectors traded some accuracy for speed: YOLO ran at 155fps with VOC07 mAP=52.7% (enhanced version 45fps, 63.4%), SSD reached COCO mAP@.5=46.5% at 59fps, and RetinaNet's focal loss brought one-stage accuracy to COCO mAP@.5=59.1%.
  • Keypoint- and transformer-based detectors pushed accuracy further: CornerNet COCO mAP@.5=57.8%, CenterNet 61.1%, and Deformable DETR 71.9% on MS-COCO; the paper notes the top-10 COCO detection methods are all transformer-based.
  • Datasets scaled dramatically: VOC07 has 5k train images/12k objects, VOC12 11k/27k, MS-COCO-17 164k images and 897k annotated objects over 80 categories, and Open Images 1,910k images with 15,440k boxes over 600 categories. Evaluation moved from miss-rate vs. FPPW to FPPI, then to AP/mAP, with MS-COCO averaging over IoU thresholds 0.5–0.95.

Methods

  • Design: a narrative literature survey spanning roughly a quarter-century (1990s to 2022), structured around technical evolution rather than a systematic/quantitative review protocol.
  • Coverage: milestone detectors (VJ, HOG, DPM, RCNN, SPPNet, Fast/Faster RCNN, FPN, YOLO, SSD, RetinaNet, CornerNet, CenterNet, DETR), datasets and metrics, technical building blocks, speed-up techniques, and recent advances (rotation/scale robustness, backbones, localization, segmentation loss, adversarial training, weakly supervised detection, domain adaptation).
  • Analysis: qualitative synthesis of reported detector accuracies and speeds, with figures/tables summarizing dataset statistics and accuracy trends; no new experiments are conducted.

Limitations

  • The paper states no explicit limitations section; it frames its scope as presenting the evolution of technologies "while neglecting their technical specifics," and notes that the evolution order shown in figures is primarily to assist reader understanding and "may have temporal overlap."
  • Evident from the text: as a survey it reports no original experiments or controlled benchmarks, so the cited mAP/speed figures come from the original papers and are not independently verified; the coverage is also selective (milestone detectors and selected recent advances) rather than exhaustive.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/jproc.2023.3238524

Cites

307 of 307 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

55 Valid · 18 Not valid · 32 Not checked · 50 Own results and interpretations

50 more claims · 21 with their cited sources checked

Create a free account to see all 155 claims and to verify the 2 references still open.

See all claims — free account
  • It may state two separate claims as one. 40
  • Probably not a substantial claim. 83
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Research works printed but not linked: 9

  1. 10.5555/3045118.3045336 · doi:10.5555/3045118.3045336
  2. Girshick, 2023, Discriminatively Trained Deformable Part Models, Release 5
  3. 10.1109/TPAMI.2016.2577031 · DOI · Paper page
  4. Krasin, 2017, OpenImages: A Public Dataset for Large-Scale Multi-Label and Multi-Class Image Classification
  5. Alexe, What is an object, 73
  6. Müller, When does label smoothing help, 32, 1
  7. 10.1109/CVPR.2016.308 · DOI · Paper page
  8. 10.5555/2969033.2969125 · doi:10.5555/2969033.2969125
  9. 10.1109/ICCV.2017.244 · DOI · Paper page

Cited by

See all 3,689

Metadata

Authors
Zou, Z., Chen, K., Shi, Z., Guo, Y., & Ye, J.
Affiliations
  • Shanghai Artificial Intelligence Laboratory (CN)
  • Carleton University (CA)
  • Alibaba Group (China) (CN)
Venue
Proceedings of the IEEE
Published
2023-03
Volume
111
Issue
3
Pages
257-276
ISSN
  • 0018-9219 (ISSN-L)
  • 1558-2256
OpenAlex
W4320002812
Cited by
3,689
References
272
Citations by year
2026: 610 · 2025: 1013 · 2024: 940 · 2023: 541
FWCI
280.65
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the IEEE (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (62125102)
  • National Key Research and Development Program of China
  • Fundamental Research Funds for the Central Universities
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
Keywords
object detection, evaluation metrics, deep learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.