Ship Detection and Tracking in Inland Waterways Using Improved YOLOv3 and Deep SORT
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Ship detection and tracking is an important task in video surveillance in inland waterways. However, ships in inland navigation are faced with accidents such as collisions. For collision avoidance, we should strengthen the monitoring of navigation and the robustness of the entire system. Hence, this paper presents ship detection and tracking of ships using the improved You Only Look Once version 3 (YOLOv3) detection algorithm and Deep Simple Online and Real-time Tracking (Deep SORT) tracking algorithm. Three improvements are made to the YOLOv3 target detection algorithm. Firstly, the Kmeans clustering algorithm is used to optimize the initial value of the anchor frame to make it more suitable for ship application scenarios. Secondly, the output classifier is modified to a single Softmax classifier to suit our ship dataset which has three ship categories and mutual exclusion. Finally, Soft Non-Maximum Suppression (Soft-NMS) is introduced to solve the deficiencies of the Non-Maximum Suppression (NMS) algorithm when screening candidate frames. Results showed the mean Average Precision (mAP) and Frame Per Second (FPS) of the improved algorithm are increased by about 5% and 2, respectively, compared with the existing YOLOv3 detecting Algorithm. Then the improved YOLOv3 is applied in Deep Sort and the performance result of Deep Sort showed that, it has greater performance in complex scenes, and is robust to interference such as occlusion and camera movement, compared to state of art algorithms such as KCF, MIL, MOSSE, TLD, and Median Flow. With this improvement, it will help in the safety of inland navigation and protection from collisions and accidents.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Deep SORT uses spatial and temporal features in videos for locating the exact object tracking and it maintains the object IDs [47].”
From Visual Detection of Traffic Incident through Automatic Monitoring of Vehicle Activities (2024) · cites this paper as [47]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 9×
“It includes RCNN [10], Fast R-CNN [11], and Faster R-CNN [12].”
BackgroundMethodInfluentialDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · cited 4×
“Fusion features based on HOG, SIFT (Scale-Invariant Feature Transform) and gray histogram features were extracted for ships.”
BackgroundInfluentialYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 4×
“It includes YOLO [13], YOLOv2 [14], YOLOv3 [15], and SSD [16].”
BackgroundMethodInfluentialHistograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · cited 2×
“Fusion features based on HOG, SIFT (Scale-Invariant Feature Transform) and gray histogram features were extracted for ships.”
BackgroundRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
(2016) · Cited by 31,590
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939 · cited 3×
“Multi-scale prediction For multi-scale prediction,YOLOv3 draws on the idea of the FPN algorithm [29] to predict in three scales, that is, the detection layer is used to detect on three feature maps of different sizes, and the step size is 32, 16, and 8.”
MethodInfluentialGirshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 3×
“It includes YOLO [13], YOLOv2 [14], YOLOv3 [15], and SSD [16].”
BackgroundMethod
Research works printed but not linked: 2
- Du, C.-J.; He, H.-J.; Sun, D.-W. Chapter 4-Object Classification Methods. In Computer Vision Technology for Food Quality Evaluation, 2nd ed.; Sun, D.-W., Ed.; Academic Press: San Diego, CA, USA, 2016; pp. 87-110, ISBN 978-0-12-802232-0.
- De Paz, J.F., Julián, V., Villarrubia, G., Marreiros, G., Novais, P., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 9-17.
Cited by
Rekavandi, A. M., Xu, L., Boussaïd, F., Seghouane, A., Hoefs, S., & Bennamoun, M. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3530678 · Cited by 161
“The components of the YOLOv3 network have been improved by Jie et al. [216] to achieve higher precision and recall values.”
An Image-Based Benchmark Dataset and a Novel Object Detector for Water Surface Object Detection
Zhou, Z., Sun, J., Yu, J., Liu, K., Duan, J., Chen, L., & Chen, C. L. P. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.723336 · Cited by 101
“Moreover, Jie et al. (2021) improved yolov3 to detect ships in inland waterways, the mAP and FPS of the improved method increased by about 5 and 2%.”
BackgroundMethodLiu, T., Pang, B., Zhang, L., Yang, W., & Sun, X. (2021) · Journal of Marine Science and Engineering · doi:10.3390/jmse9070753 · Cited by 96
“[38] modified the network classifier based on YOLO v3, and introduced the Soft-NMS algorithm.”
MethodDeepSORT: Real Time & Multi-Object Detection and Tracking with YOLO and TensorFlow
Pujara, A., & Bhamare, M. (2022) · International Conference on Augmented Intelligence and Sustainable Systems (ICAISS) · doi:10.1109/icaiss55157.2022.10011018 · Cited by 59
“1: Flow Diagram of Basic steps in Object Tracking [22].”
BackgroundShipYOLO: An Enhanced Model for Ship Detection
Han, X., Zhao, L., Ning, Y., & Hu, J. (2021) · Journal of Advanced Transportation · doi:10.1155/2021/1060182 · Cited by 67
Metadata
- Authors
- Jie, Y., Leonidas, L., Mumtaz, F., & Ali, M.
- Affiliations
- Department of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
- Quaid-i-Azam University (PK)
- Venue
- Symmetry
- Publisher
- MDPI AG
- Published
- 2021-02-12
- Volume
- 13
- Issue
- 2
- Pages
- 308
- ISSN
- 2073-8994 (ISSN-L)
- OpenAlex
- W3130098432
- Cited by
- 44
- References
- 37
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 8 · 2023: 10 · 2022: 10 · 2021: 5
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Symmetry (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Key Research and Development Project of China (2020YFB1710800)
- National Nature Science Foundation of China (51879211)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Keywords
- ship detection, vessel tracking, inland waterways, YOLOv3, DeepSORT, Soft-NMS, non-maximum suppression, collision avoidance, video surveillance, occlusion robustness, navigation safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.