Detecting, Tracking and Counting People Getting On/Off a Metropolitan Train Using a Standard Video Camera
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
The main source of delays in public transport systems (buses, trams, metros, railways) takes place in their stations. For example, a public transport vehicle can travel at 60 km per hour between stations, but its commercial speed (average en-route speed, including any intermediate delay) does not reach more than half of that value. Therefore, the problem that public transport operators must solve is how to reduce the delay in stations. From the perspective of transport engineering, there are several ways to approach this issue, from the design of infrastructure and vehicles to passenger traffic management. The tools normally available to traffic engineers are analytical models, microscopic traffic simulation, and, ultimately, real-scale laboratory experiments. In any case, the data that are required are number of passengers that get on and off from the vehicles, as well as the number of passengers waiting on platforms. Traditionally, such data has been collected manually by field counts or through videos that are then processed by hand. On the other hand, public transport networks, specially metropolitan railways, have an extensive monitoring infrastructure based on standard video cameras. Traditionally, these are observed manually or with very basic signal processing support, so there is significant scope for improving data capture and for automating the analysis of site usage, safety, and surveillance. This article shows a way of collecting and analyzing the data needed to feed both traffic models and analyze laboratory experimentation, exploiting recent intelligent sensing approaches. The paper presents a new public video dataset gathered using real-scale laboratory recordings. Part of this dataset has been annotated by hand, marking up head locations to provide a ground-truth on which to train and evaluate deep learning detection and tracking algorithms. Tracking outputs are then used to count people getting on and off, achieving a mean accuracy of 92% with less than 0.15% standard deviation on 322 mostly unseen dataset video sequences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, A., Wang, C.-Y., & Liao, H.-Y. M. (2020) · arXiv · doi:10.48550/arxiv.2004.10934 · Cited by 10,307
High-Speed Tracking with Kernelized Correlation Filters
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345390 · Cited by 5,753
Simple online and realtime tracking with a deep association metric
Wojke, N., Bewley, A., & Paulus, D. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296962 · Cited by 5,286
Simple online and realtime tracking
Bewley, A., Ge, Z., Ott, L., Ramos, F., & Upcroft, B. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533003 · Cited by 4,433
CenterNet: Keypoint Triplets for Object Detection
Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., & Tian, Q. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00667 · Cited by 4,079
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918 · cited 1×
“For simplicity, precision, recall, F1 and MOTA (Multi Object Tracking Accuracy) defined in Bernardin, and Stiefelhagen [17] have been used.”
MethodFast Human Detection Using a Cascade of Histograms of Oriented Gradients
Zhu, Q., Yeh, M.-C., Cheng, K.-T., & Avidan, S. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.119 · Cited by 1,399
Research works printed but not linked: 53
- Batty, 2015, Challenges and opportunities in developing urban modal shift, Travel Behav. Soc., 2, 109, 10.1016/j.tbs.2014.12.001 · DOI
- Stead, D., and Pojani, D. (2017). The urban transport crisis in emerging economies: A comparative overview. The Urban Transport Crisis in Emerging Economies, Springer. · doi:10.1007/978-3-319-43851-1_14
- Carroll, 2019, Measuring the potential emission reductions from a shift towards public transport, Transp. Res. Part D Transp. Environ., 73, 338, 10.1016/j.trd.2019.07.010 · doi:10.1016/j.trd.2019.07.010
- Saleh, 2015, Study on the separated bus lanes effectiveness in city centres: A case study in Edinburgh and Bialystok, World J. Sci. Technol. Sustain. Dev., 2, 257, 10.1108/WJSTSD-06-2015-0033 · doi:10.1108/wjstsd-06-2015-0033
- Shalaby, 1999, Simulating performance impacts of bus lanes and supporting measures, J. Transp. Eng., 125, 390, 10.1061/(ASCE)0733-947X(1999)125:5(390) · doi:10.1061/(asce)0733-947x(1999)125:5(390
- Agrawal, 2013, Shared-use bus priority lanes on city streets: Approaches to access and enforcement, J. Public Transp., 16, 2, 10.5038/2375-0901.16.4.2 · doi:10.5038/2375-0901.16.4.2
- Nguyen, 2019, Impediments to the bus rapid transit implementation in developing countries–a typical evidence from Hanoi, Int. J. Urban Sci., 23, 464, 10.1080/12265934.2019.1577747 · doi:10.1080/12265934.2019.1577747
- Malomo, 2020, Factors Influencing Non-compliance Behaviour of Unauthorised Drivers on Bus Rapid Transit Lanes in Lagos Metropolis, Adv. Soc. Sci. Res. J., 7, 1
- Zegers, 2010, Influence of platform height, door width, and fare collection on bus dwell time: Laboratory evidence for Santiago de Chile, Transp. Res. Rec. J. Transp. Res. Board, 2143, 59, 10.3141/2143-08 · doi:10.3141/2143-08
- 2018, Speed management efficacy on national roads–early experiences of sectional speed system functioning in Podlaskie voivodship, Transp. Probl., 13, 5, 10.20858/tp.2018.13.2.1 · doi:10.20858/tp.2018.13.2.1
- Hadavi, 2020, Analyzing passenger and freight vehicle movements from automatic-Number plate recognition camera data, Eur. Transp. Res. Rev., 12, 1, 10.1186/s12544-020-00405-x · DOI
- Fernandez, R. (2011, January 10–12). Experimental study of bus boarding and alighting times. Proceedings of the European Transport Conference, Glasgow, Scotland.
- Yin, 2010, Quantitative evaluation of different aspects of motion trackers under various challenges, Br. Mach. Vis. Assoc., 2010, 1
- Everingham, 2010, The pascal visual object classes (voc) challenge, Int. J. Comput. Vis., 88, 303, 10.1007/s11263-009-0275-4 · DOI · Paper page
- Lealtaixé, L., Milan, A., Reid, I., Roth, S., and Schindler, K. (2015). MOT Challenge 2015: Towards a Benchmark for Multi-Target Tracking. arXiv.
- Stauffer, C., and Grimson, W.E.L. (1999, January 23–25). Adaptive background mixture models for real-time tracking. Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), Fort Collins, CO, USA.
- Zivkovic, Z. (2004, January 26–26). Improved adaptive Gaussian mixture model for background subtraction. Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004, Cambridge, UK. · DOI · Paper page
- Hu, 2013, A novel approach for crowd video monitoring of subway platforms, Opt.-Int. J. Light Electron Opt., 124, 5301, 10.1016/j.ijleo.2013.03.057 · doi:10.1016/j.ijleo.2013.03.057
- Li, M., Zhang, Z., Huang, K., and Tan, T. (2008, January 8–11). Estimating the number of people in crowded scenes by mid based foreground segmentation and head-shoulder detection. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA. · DOI · Paper page
- Gavrila, D., and Giebel, J. (2001, January 8–14). Virtual sample generation for template-based shape matching. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, Kauai, HI, USA.
- Munder, 2008, Pedestrian detection and tracking using a mixture of view-based shape–texture models, IEEE Trans. Intell. Transp. Syst., 9, 333, 10.1109/TITS.2008.922943 · DOI · Paper page
- Bueno, 2011, Face recognition using histograms of oriented gradients, Pattern Recognit. Lett., 32, 1598, 10.1016/j.patrec.2011.01.004 · DOI · Paper page
- Chen, 2016, Vision-based traffic surveys in urban environments, J. Electron. Imaging, 25, 051206, 10.1117/1.JEI.25.5.051206 · DOI
- Benenson, R., Omran, M., Hosang, J., and Schiele, B. (2014, January 6–12). Ten years of pedestrian detection, what have we learned?. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland. · DOI · Paper page
- Brunetti, 2018, Computer vision and deep learning techniques for pedestrian detection and tracking: A survey, Neurocomputing, 300, 17, 10.1016/j.neucom.2018.01.092 · DOI · Paper page
- Soviany, P., and Ionescu, R.T. (2018). Optimizing the Trade-off between Single-Stage and Two-Stage Object Detectors using Image Difficulty Prediction. arXiv. · DOI · Paper page
- Guo, 2020, A Fast Occluded Passenger Detector Based on MetroNet and Tiny MetroNet, Inf. Sci., 534, 16, 10.1016/j.ins.2020.05.009 · DOI
- Liu, 2019, Metro Passenger Flow Statistics Based on YOLOv3, Proceedings of the IOP Conference Series: Materials Science and Engineering, Volume 688, 044025, 10.1088/1757-899X/688/4/044025 · doi:10.1088/1757-899x/688/4/044025
- Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems 28 (NIPS 2015), Montreal, QC, Canada.
- Wang, T., Zhang, X., Yuan, L., and Feng, J. (2019, January 16). Few-shot adaptive faster R-CNN. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. · DOI
- Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA. · DOI · Paper page
- Girshick, R. (2015). Fast R-CNN. arXiv. · DOI · Paper page
- Espinosa, J.E., Velastín, S.A., and Branch, J.W. (2020). Detection of Motorcycles in Urban Traffic Using Video Analysis: A Review. IEEE Trans. Intell. Transp. Syst. · DOI
- Espinosa, J.E., Velastin, S.A., and Branch, J.W. (2018). Motorcycle detection and classification in urban Scenarios using a model based on Faster R-CNN. arXiv. · DOI
- Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
- Yilmaz, A., Javed, O., and Shah, M. (2006). Object tracking: A survey. ACM Comput. Surv., 38. · DOI · Paper page
- Ojha, S., and Sakhare, S. (2015, January 8–10). Image processing techniques for object tracking in video surveillance—A survey. Proceedings of the 2015 International Conference on Pervasive Computing (ICPC), Pune, India. · DOI · Paper page
- Bagherpour, 2012, Upper body tracking using KLT and Kalman filter, Procedia Comput. Sci., 13, 185, 10.1016/j.procs.2012.09.127 · DOI
- Cong, 2010, People detection and re-identification in complex environments, IEICE Trans. Inf. Syst., 93, 1761, 10.1587/transinf.E93.D.1761 · doi:10.1587/transinf.e93.d.1761
- Coniglio, C., Meurie, C., Lézoray, O., and Berbineau, M. (2015, January 26–29). A graph based people silhouette segmentation using combined probabilities extracted from appearance, shape template prior, and color distributions. Proceedings of the International Conference on Advanced Concepts for Intelligent Vision Systems, Catania, Italy. · DOI
- Kuo, C.H., and Nevatia, R. (2011, January 20–25). How does person identity recognition help multi-person tracking?. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA. · DOI · Paper page
- Simonnet, D., Lewandowski, M., Velastin, S., Orwell, J., and Turkbeyler, E. (2012, January 7–13). Re-identification of pedestrians in crowds using dynamic time warping. Proceedings of the Computer Vision—ECCV 2012. Workshops and Demonstrations, Florence, Italy. · DOI
- Pedagadi, S., Orwell, J., Velastin, S., and Boghossian, B. (2013, January 23–28). Local fisher discriminant analysis for pedestrian re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA. · DOI
- Kalal, 2012, Tracking-learning-detection, IEEE Trans. Pattern Anal. Mach. Intell., 34, 1409, 10.1109/TPAMI.2011.239 · DOI · Paper page
- Hare, 2016, Struck: Structured output tracking with kernels, IEEE Trans. Pattern Anal. Mach. Intell., 38, 2096, 10.1109/TPAMI.2015.2509974 · DOI · Paper page
- Xiang, Y., Alahi, A., and Savarese, S. (2015, January 7–13). Learning to track: Online multi-object tracking by decision making. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile. · DOI · Paper page
- Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., Zhao, X., and Kim, T.K. (2014). Multiple object tracking: A literature review. arXiv.
- Shuo, 2018, Review of object tracking based on convolutional neural networks, Chin. High Technol. Lett., 3, 207
- Tan, M., and Le, Q.V. (2019). Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv.
- Wang, Y., Wang, C., Zhang, H., Dong, Y., and Wei, S. (2019). Automatic ship detection based on RetinaNet using multi-resolution Gaofen-3 imagery. Remote Sens., 11. · DOI · Paper page
- Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland. · DOI · Paper page
- Doermann, D., and Mihalcik, D. (2000, January 3–7). Tools and techniques for video performance evaluation. Proceedings of the Proceedings 15th International Conference on Pattern Recognition, ICPR-2000, Barcelona, Spain.
- Wolf, 2006, A critical view of context, Int. J. Comput. Vis., 69, 251, 10.1007/s11263-006-7538-0 · DOI
Cited by
A literature review of Artificial Intelligence applications in railway systems
Tang, R., De Donato, L., Bes̆inović, N., Flammini, F., Goverde, R. M. P., Lin, Z., Liu, R., Tang, T., Vittorini, V., & Wang, Z. (2022) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2022.103679 · Cited by 324
Radovan, A., Mršić, L., Đambić, G., & Mihaljević, B. (2024) · Eng · doi:10.3390/eng5040172 · Cited by 24
Video-based automatic people counting for public transport: On-bus versus off-bus deployment
McCarthy, C., Ghaderi, H., Martí, F., Jayaraman, P., & Dia, H. (2025) · Computers in Industry · doi:10.1016/j.compind.2024.104195 · Cited by 14
Boarding Alighting Counting in Different Transit Vehicles under Crowded Conditions
Rawat, N., Jeengar, K., Agarwal, A., & Kaur Chahal, R. J. (2024) · 2024 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT) · doi:10.1109/conecct62155.2024.10677074 · Cited by 2
Metadata
- Authors
- Velastin, S. A., Fernández, R., Espinosa, J. E., & Bay, A.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2020-11-02
- Volume
- 20
- Issue
- 21
- Pages
- 6251
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W3096739239
- Cited by
- 61
- References
- 16
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- FP7 People: Marie-Curie Actions (N600371)
- Ministerio de Economía, Industria y Competitividad, Gobierno de España (COFUND2013-51509)
- Ministerio de Educación, Cultura y Deporte (CEI-15-17)
- Fondo Nacional de Desarrollo Científico y Tecnológico (1120219, 1080381, 1140209 (OBSERVE))
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Detecting, Tracking and Counting People Getting On/Off a Metropolitan Train Using a Standard Video Camera. https://app.cochat.ai/papers/10.3390/s20216251
- The paper
- Velastin, S. A., Fernández, R., Espinosa, J. E., & Bay, A. (2020). Detecting, Tracking and Counting People Getting On/Off a Metropolitan Train Using a Standard Video Camera. Sensors. https://doi.org/10.3390/s20216251
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.