Vehicle Tracking Using Surveillance With Multimodal Data Fusion
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Vehicle location prediction or vehicle tracking is a significant topic within connected vehicles. This task, however, is difficult if merely a single modal data is available, probably causing biases and impeding the accuracy. With the development of sensor networks in connected vehicles, multimodal data are becoming accessible. Therefore, we propose a framework for vehicle tracking with multimodal data fusion. Specifically, we fuse the results of two modalities, images and velocities, in our vehicle-tracking task. Images, being processed in the module of vehicle detection, provide visual information about the features of vehicles, whereas velocity estimation can further evaluate the possible locations of the target vehicles, which reduces the number of candidates being compared, decreasing the time consumption and computational cost. Our vehicle detection model is designed with a color-faster R-CNN, whose inputs are both the texture and color of the vehicles. Meanwhile, velocity estimation is achieved by the Kalman filter, which is a classical method for tracking. Finally, a multimodal data fusion method is applied to integrate these outcomes so that vehicle-tracking tasks can be achieved. Experimental results suggest the efficiency of our methods, which can track vehicles using a series of surveillance cameras in urban areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Fog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
An introduction to multisensor data fusion
Hall, D. L., & Llinas, J. (1997) · Proceedings of the IEEE · doi:10.1109/5.554205 · Cited by 2,629
Understanding Smart Cities: An Integrative Framework
Chourabi, H., Nam, T., Walker, S., Gil-Garcia, J. R., Mellouli, S., Nahon, K., Pardo, T. A., & Scholl, H. J. (2012) · 2012 45th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2012.615 · Cited by 2,599 · cited 1×
“The final target agrees with the connected vehicles, IoV, and urban computing, which is the establishment of smart cities [33] to improve the quality of our lives.”
BackgroundMultimodal Data Fusion: An Overview of Methods, Challenges, and Prospects
Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296 · cited 1×
“data fusion [6] to combine the knowledge from different aspects, so that a more comprehensive and accurate result can”
BackgroundMultimodal fusion for multimedia analysis: a survey
Atrey, P. K., Hossain, M. A., El Saddik, A., & Kankanhalli, M. S. (2010) · Multimedia Systems · doi:10.1007/s00530-010-0182-0 · Cited by 1,279
Toward Scalable Systems for Big Data Analytics: A Technology Tutorial
Hu, H., Wen, Y., Chua, T.-S., & Li, X. (2014) · IEEE Access · doi:10.1109/access.2014.2332453 · Cited by 1,099 · cited 1×
“Multimodal data fusion is one critical technology in the era of big data [7], where data contain variety, velocity, and other characteristics.”
BackgroundInternet of vehicles: From intelligent grid to autonomous cars and vehicular clouds
Gerla, M., Lee, E.-K., Pau, G., & Lee, U. (2014) · 2014 IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot.2014.6803166 · Cited by 828
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2016) · arXiv · doi:10.48550/arxiv.1612.08242 · Cited by 488
Data fusion in intelligent transportation systems: Progress and challenges – A survey
Faouzi, N.-E. E., Leung, H., & Kurian, A. (2011) · Information Fusion · doi:10.1016/j.inffus.2010.06.001 · Cited by 444 · cited 1×
“With knowing the outstanding capability of deep learning method, we consider multimodal deep learning [9], which seems to be promising solution for intelligent transportation systems [10], gathering more comprehensive information and”
MethodHe, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
Cited by
A multi-sensor data fusion enabled ensemble approach for medical data from body sensor networks
Muzammal, M., Talat, R., Sodhro, A. H., & Pirbhulal, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.06.021 · Cited by 311
A comparative review on multi-modal sensors fusion based on deep learning
Tang, Q., Liang, J., & Zhu, F. (2023) · Signal Processing · doi:10.1016/j.sigpro.2023.109165 · Cited by 280
Vehicle Detection and Tracking in Adverse Weather Using a Deep Learning Framework
Hassaballah, M., Kenk, M. A., Muhammad, K., & Minaee, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3014013 · Cited by 275
Yolo-3DMM for Simultaneous Multiple Object Detection and Tracking in Traffic Scenarios
Liu, L., Song, X., Song, H., Sun, S., Han, X.-F., Akhtar, N., & Mian, A. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3360875 · Cited by 38
“Computational efficiency of vehicle detection is considered critical in traffic monitoring and intelligent surveillance [19], [20].”
BackgroundDeep Learning Approaches for Vehicle and Pedestrian Detection in Adverse Weather
Zaman, M., Saha, S., Zohrabi, N., & Abdelwahed, S. (2023) · 2023 IEEE Transportation Electrification Conference & Expo (ITEC) · doi:10.1109/itec55900.2023.10187020 · Cited by 13
Metadata
- Authors
- Zhang, Y., Song, B., Du, X., & Guizani, M.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2018-07
- Volume
- 19
- Issue
- 7
- Pages
- 2353-2361
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2789294806
- Cited by
- 73
- References
- 17
- FWCI
- 4.49
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.