Ship Detection and Tracking in Inland Waterways Using Improved YOLOv3 and Deep SORT
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Ship detection and tracking is an important task in video surveillance in inland waterways. However, ships in inland navigation are faced with accidents such as collisions. For collision avoidance, we should strengthen the monitoring of navigation and the robustness of the entire system. Hence, this paper presents ship detection and tracking of ships using the improved You Only Look Once version 3 (YOLOv3) detection algorithm and Deep Simple Online and Real-time Tracking (Deep SORT) tracking algorithm. Three improvements are made to the YOLOv3 target detection algorithm. Firstly, the Kmeans clustering algorithm is used to optimize the initial value of the anchor frame to make it more suitable for ship application scenarios. Secondly, the output classifier is modified to a single Softmax classifier to suit our ship dataset which has three ship categories and mutual exclusion. Finally, Soft Non-Maximum Suppression (Soft-NMS) is introduced to solve the deficiencies of the Non-Maximum Suppression (NMS) algorithm when screening candidate frames. Results showed the mean Average Precision (mAP) and Frame Per Second (FPS) of the improved algorithm are increased by about 5% and 2, respectively, compared with the existing YOLOv3 detecting Algorithm. Then the improved YOLOv3 is applied in Deep Sort and the performance result of Deep Sort showed that, it has greater performance in complex scenes, and is robust to interference such as occlusion and camera movement, compared to state of art algorithms such as KCF, MIL, MOSSE, TLD, and Median Flow. With this improvement, it will help in the safety of inland navigation and protection from collisions and accidents.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Deep SORT uses spatial and temporal features in videos for locating the exact object tracking and it maintains the object IDs [47].”
From Visual Detection of Traffic Incident through Automatic Monitoring of Vehicle Activities (2024) · cites this paper as [47]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
(2016) · Cited by 31,590
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
YOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Simple online and realtime tracking with a deep association metric
Wojke, N., Bewley, A., & Paulus, D. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296962 · Cited by 5,286
Visual object tracking using adaptive correlation filters
Bolme, D., Beveridge, J. R., Draper, B. A., & Lui, Y. M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539960 · Cited by 3,406 · cited 5×
“The two challenges introduced by our algorithm have been depicted again in the improved Deep Sort; there, larger processing time of 53 s and memory usage of 1.68 GB was demonstrated contrary to the existing techniques such as MOSSE and MIL which used about 22 s and 1.4 GB memory size.”
MethodInfluentialKalal, Z., Mikolajczyk, K., & Matas, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.239 · Cited by 3,285
Visual tracking with online Multiple Instance Learning
Babenko, B., Yang, M.-H., & Belongie, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206737 · Cited by 1,770
Forward-Backward Error: Automatic Detection of Tracking Failures
Kalal, Z., Mikolajczyk, K., & Matas, J. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.675 · Cited by 818
The Support Vector Method of Function Estimation
Vapnik, V. (1998) · Nonlinear Modeling · doi:10.1007/978-1-4615-5703-6_3 · Cited by 630
A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection
Jiao, J., Zhang, Y., Sun, H., Yang, X., Gao, X., Hong, W., Fu, K., & Sun, X. (2018) · IEEE Access · doi:10.1109/access.2018.2825376 · Cited by 299
DRBox-v2: An Improved Detector With Rotatable Boxes for Target Detection in SAR Images
An, Q., Pan, Z., Liu, L., & You, H. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2920534 · Cited by 162
Simple Online and Realtime Tracking with a Deep Association Metric
Wojke, N., Bewley, A., & Paulus, D. W. R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07402 · Cited by 110
Empirical Inference: Festschrift in Honor of Vladimir N. Vapnik
Schölkopf, B., Vovk, V., & Luo, Z. (2013) · Springer eBooks · doi:10.1007/978-3-642-41136-6 · Cited by 98
Ship Target Detection Algorithm Based on Improved Faster R-CNN
Liang, Q., Li, B., Chen, L., Wang, W., Dong, L., Jia, X., Huang, J., Ge, C., Xue, G., & Wang, D. (2019) · Electronics · doi:10.3390/electronics8090959 · Cited by 91
A Lightweight Feature Optimizing Network for Ship Detection in SAR Image
Zhang, X., Wang, H., Xu, C., Lv, Y., Fu, C., Xiao, H., & He, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2943241 · Cited by 68
Scalable Inverse Reinforcement Learning Through Multifidelity Bayesian Optimization
Imani, M., & Ghoreishi, S. F. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3051012 · Cited by 62
Li, K., Huang, Z., Cheng, Y.-C., & Lee, C. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854454 · Cited by 61
Ship Detection Using Deep Convolutional Neural Networks for PolSAR Images
Fan, W., Zhou, F., Bai, X., Tao, M., & Tian, T. (2019) · Remote Sensing · doi:10.3390/rs11232862 · Cited by 56
Huang, Z., Sui, B., Wen, J., & Jiang, G. (2020) · Complexity · doi:10.1155/2020/1520872 · Cited by 44
Song, J., Kim, D., & Kang, K. (2020) · Remote Sensing · doi:10.3390/rs12091443 · Cited by 42
Examination of automatic detection and tracking of ships on camera image in marine environment
Naoya, K., Yamamoto, S., & Hashimoto, T. (2016) · Techno-Ocean · doi:10.1109/techno-ocean.2016.7890748 · Cited by 21
Paz, J., Julian, V., VILLARRUBIA, G., Marreiros, G., & Nováis, P. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-61118-1 · Cited by 21
Dong, Z. H., & Lin, B. (2020) · International Journal of Remote Sensing · doi:10.1080/01431161.2019.1706781 · Cited by 20
Feature Extraction for Object Recognition and Image Classification
Tiwari, A., Goswami, A., & Saraswat, M. (2013) · Cited by 16
A ship target tracking algorithm based on deep learning and multiple features
Zhang, Y., Shu, J., Hu, L., Zhou, Q., & Du, Z. (2020) · International Conference on Machine Vision · doi:10.1117/12.2559945 · Cited by 13
A Novel Region Selection Algorithm for Auto-focusing Method Based on Depth from Focus
Chen, J., Chen, D. Q., & Meng, S. H. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-68527-4_11 · Cited by 6
Research works printed but not linked: 1
- Sun, D.-W. (2016). Chapter 4—Object Classification Methods. Computer Vision Technology for Food Quality Evaluation, Academic Press. [2nd ed.].
Cited by
Rekavandi, A. M., Xu, L., Boussaïd, F., Seghouane, A., Hoefs, S., & Bennamoun, M. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3530678 · Cited by 161
An Image-Based Benchmark Dataset and a Novel Object Detector for Water Surface Object Detection
Zhou, Z., Sun, J., Yu, J., Liu, K., Duan, J., Chen, L., & Chen, C. L. P. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.723336 · Cited by 100
Liu, T., Pang, B., Zhang, L., Yang, W., & Sun, X. (2021) · Journal of Marine Science and Engineering · doi:10.3390/jmse9070753 · Cited by 92
DeepSORT: Real Time & Multi-Object Detection and Tracking with YOLO and TensorFlow
Pujara, A., & Bhamare, M. (2022) · International Conference on Augmented Intelligence and Sustainable Systems (ICAISS) · doi:10.1109/icaiss55157.2022.10011018 · Cited by 59
ShipYOLO: An Enhanced Model for Ship Detection
Han, X., Zhao, L., Ning, Y., & Hu, J. (2021) · Journal of Advanced Transportation · doi:10.1155/2021/1060182 · Cited by 67
Metadata
- Authors
- Jie, Y., Leonidas, L., Mumtaz, F., & Ali, M.
- Affiliations
- Department of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
- Quaid-i-Azam University (PK)
- Venue
- Symmetry
- Publisher
- MDPI AG
- Published
- 2021-02-12
- Volume
- 13
- Issue
- 2
- Pages
- 308
- ISSN
- 2073-8994 (ISSN-L)
- OpenAlex
- W3130098432
- Cited by
- 44
- References
- 37
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 8 · 2023: 10 · 2022: 10 · 2021: 5
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Symmetry (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Key Research and Development Project of China (2020YFB1710800)
- National Nature Science Foundation of China (51879211)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Keywords
- ship detection, vessel tracking, inland waterways, YOLOv3, DeepSORT, Soft-NMS, non-maximum suppression, collision avoidance, video surveillance, occlusion robustness, navigation safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.