The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
AO2-DETR: Arbitrary-Oriented Object Detection Transformer
Open accessAbstract
Arbitrary-oriented object detection (AOOD) is a challenging task to detect objects in the wild with arbitrary orientations and cluttered arrangements. Existing approaches are mainly based on anchor-based boxes or dense points, which rely on complicated hand-designed processing steps and inductive bias, such as anchor generation, transformation, and non-maximum suppression reasoning. Recently, the emerging transformer-based approaches view object detection as a direct set prediction problem that effectively removes the need for hand-designed components and inductive biases. In this paper, we propose an Arbitrary-Oriented Object DEtection TRansformer framework, termed AO2-DETR, which comprises three dedicated components. More precisely, an oriented proposal generation mechanism is proposed to explicitly generate oriented proposals, which provides better positional priors for pooling features to modulate the cross-attention in the transformer decoder. An adaptive oriented proposal refinement module is introduced to extract rotation-invariant region features and eliminate the misalignment between region features and objects. And a rotation-aware set matching loss is used to ensure the one-to-one matching process for direct set prediction without duplicate predictions. Our method considerably simplifies the overall pipeline and presents a new AOOD paradigm. Comprehensive experiments on several challenging datasets show that our method achieves superior performance on the AOOD task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
The Hungarian method for the assignment problem
Kuhn, H. W. (1955) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800020109 · Cited by 13,120
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
Deformable DETR: Deformable Transformers for End-to-End Object Detection
Zhu, X., Su, W., Lu, L., Li, B., Wang, X., & Dai, J. (2020) · arXiv · doi:10.48550/arxiv.2010.04159 · Cited by 6,027 · cited 5×
“Recently, transformer-based detectors [14], [15], [16], [17] have been promoted as being dynamic, atten-”
BackgroundMethodInfluentialDOTA: A Large-Scale Dataset for Object Detection in Aerial Images
Xia, G.-S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00418 · Cited by 3,414
Learning RoI Transformer for Oriented Object Detection in Aerial Images
Ding, J., Xue, N., Long, Y., Xia, G.-S., & Lu, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00296 · Cited by 1,666
Hybrid Task Cascade for Instance Segmentation
Chen, K., Pang, J., Wang, J., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., Shi, J., Ouyang, W., et al. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00511 · Cited by 1,587 · cited 2×
“OBB [18], Mask R-CNN OBB [47], and HTC [48] by a large margin.”
BackgroundInfluentialOriented R-CNN for Object Detection
Xie, X., Cheng, G., Wang, J., Yao, X., & Han, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00350 · Cited by 1,351
RepPoints: Point Set Representation for Object Detection
Yang, Z., Liu, S., Hu, H., Wang, L., & Lin, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00975 · Cited by 1,307
Arbitrary-Oriented Scene Text Detection via Rotation Proposals
Ma, J., Shao, W., Ye, H., Wang, L., Wang, H., Zheng, Y., & Xue, X. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2818020 · Cited by 1,260
Conditional DETR for Fast Training Convergence
Meng, D., Chen, X., Fan, Z., Zeng, G., Li, H., Yuan, Y., Sun, L., & Wang, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00363 · Cited by 1,055
SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects
Yang, X., Yang, J., Yan, J., Zhang, Y., Zhang, T., Guo, Z., Sun, X., & Fu, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00832 · Cited by 1,044
Align Deep Features for Oriented Object Detection
Han, J., Ding, J., Li, J., & Xia, G.-S. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3062048 · Cited by 1,039
Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection
Xu, Y., Fu, M., Wang, Q., Wang, Y., Chen, K., Xia, G.-S., & Bai, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2974745 · Cited by 1,014
ReDet: A Rotation-equivariant Detector for Aerial Object Detection
Han, J., Ding, J., Xue, N., & Xia, G.-S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00281 · Cited by 939
A High Resolution Optical Satellite Image Dataset for Ship Recognition and Some New Baselines
Liu, Z., Yuan, L., Weng, L., & Yang, Y. (2017) · Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0006120603240331 · Cited by 686
Arbitrary-Oriented Object Detection with Circular Smooth Label
Yang, X., & Yan, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58598-3_40 · Cited by 644
Oriented RepPoints for Aerial Object Detection
Li, W., Chen, Y., Hu, K., & Zhu, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00187 · Cited by 556
IoU Loss for 2D/3D Object Detection
Zhou, D., Fang, J., Song, X., Guan, C., Yin, J., Dai, Y., & Yang, R. (2019) · 2019 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2019.00019 · Cited by 474
Liu, Z., Wang, H., Weng, L., & Yang, Y. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2565705 · Cited by 439
Dynamic Refinement Network for Oriented and Densely Packed Object Detection
Pan, X., Ren, Y., Sheng, K., Dong, W., Yuan, H., Guo, X., Ma, C., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01122 · Cited by 410
DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR
Liu, S., Li, F., Zhang, H., Yang, X., Qi, X., Su, H., Zhu, J. J., & Zhang, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.12329 · Cited by 391
Dynamic Anchor Learning for Arbitrary-Oriented Object Detection
Ming, Q., Zhou, Z., Miao, L., Zhang, H., & Li, L. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16336 · Cited by 373
Shape-Adaptive Selection and Measurement for Oriented Object Detection
Hou, L., Lu, K., Xue, J., & Li, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19975 · Cited by 298
Toward Arbitrary-Oriented Ship Detection With Rotated Region Proposal and Discrimination Networks
Zhang, Z., Guo, W., Zhu, S., & Yu, W. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2856921 · Cited by 295
Zhou, X., Wang, D., & Krähenbühl, P. (2019) · arXiv · doi:10.48550/arxiv.1904.07850 · Cited by 288
Learning Center Probability Map for Detecting Objects in Aerial Images
Wang, J., Yang, W., Li, H.-C., Zhang, H., & Xia, G.-S. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3010051 · Cited by 274
Computational neuroimaging and population receptive fields
Wandell, B. A., & Winawer, J. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.03.009 · Cited by 240
Precise Detection in Densely Packed Scenes
Goldman, E., Herzig, R., Eisenschtat, A., Goldberger, J., & Hassner, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00537 · Cited by 227
Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss
Yang, X., Yan, J., Ming, Q., Wang, W., Zhang, X., & Tian, Q. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.11952 · Cited by 199
Learning a Rotation Invariant Detector with Rotatable Bounding Box
Liu, L., Pan, Z., & Lei, B. (2017) · arXiv · doi:10.48550/arxiv.1711.09405 · Cited by 166 · cited 1×
“Method BL2 RC1&RC2 [47] R2PN [21] RRD [48] RoI Transformer [9] Gliding Vertex [26] R3Det [7] DRN [3] CenterMap [49] mAP 55.”
MethodRefineDet++: Single-Shot Refinement Neural Network for Object Detection
Zhang, S., Wen, L., Lei, Z., & Li, S. Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2986402 · Cited by 134
Anchor DETR: Query Design for Transformer-Based Object DetectionPreprint
Wang, Y., Zhang, X., Yang, T., & Sun, J. Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.07107 · Cited by 131
Lin, Y., Feng, P., Guan, J., Wang, W., & Chambers, J. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00969 · Cited by 129
FCOSR: A Simple Anchor-Free Rotated Detector for Aerial Object Detection
Li, Z., Hou, B., Wu, Z., Ren, B., & Yang, C. (2023) · Remote Sensing · doi:10.3390/rs15235499 · Cited by 108
Self-citationHigh-Quality R-CNN Object Detection Using Multi-Path Detection Calibration Network
Chen, X., Li, H., Wu, Q., Ngan, K. N., & Xu, L. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2987465 · Cited by 91
Joint Anchor-Feature Refinement for Real-Time Accurate Object Detection in Images and Videos
Chen, X., Yu, J., Kong, S., Wu, Z., & Wen, L. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2980876 · Cited by 77
Self-citationConvex-Hull Feature Adaptation for Oriented and Densely Packed Object Detection
Guo, Z., Zhang, X., Liu, C., Ji, X., Jiao, J., & Ye, Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3140248 · Cited by 61
DARDet: A Dense Anchor-Free Rotated Object Detector in Aerial Images
Zhang, F., Wang, X., Zhou, S., & Wang, Y. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3122924 · Cited by 43
DAFNe: A One-Stage Anchor-Free Approach for Oriented Object DetectionPreprint
Lang, S., Ventola, F., & Kersting, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06148 · Cited by 34
Predicting Arbitrary-Oriented Objects as Points in Remote Sensing Images
Wang, J., Yang, L., & Li, F. (2021) · Remote Sensing · doi:10.3390/rs13183731 · Cited by 15
Cited by
Large Selective Kernel Network for Remote Sensing Object Detection
Li, Y., Hou, Q., Zheng, Z., Cheng, M.-M., Yang, J., & Li, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01540 · Cited by 893
Poly Kernel Inception Network for Remote Sensing Detection
Cai, X., Lai, Q., Wang, Y., Wang, W., Sun, Z., & Yao, Y. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02617 · Cited by 548
Transformers in Remote Sensing: A Survey
Aleissaee, A. A., Kumar, A., Anwer, R. M., Khan, S., Cholakkal, H., Xia, G.-S., & Khan, F. S. (2023) · Remote Sensing · doi:10.3390/rs15071860 · Cited by 417
Advancing Plain Vision Transformer Toward Remote Sensing Foundation Model
Wang, D., Zhang, Q., Xu, Y., Zhang, J., Du, B., Tao, D., & Zhang, L. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3222818 · Cited by 287
Std-net: spatio-temporal decomposition network for video demoiréing with sparse transformers
Niu, Y., Xu, R., Lin, Z., & Liu, W. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3386604 · Cited by 12
Metadata
- Authors
- Dai, L., Liu, H., Tang, H., Wu, Z., & Song, P.
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2023-05
- Volume
- 33
- Issue
- 5
- Pages
- 2342-2356
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W4312335509
- Cited by
- 276
- References
- 49
- FWCI
- 16.19
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.