CoChat

Detecting, Tracking and Counting People Getting On/Off a Metropolitan Train Using a Standard Video Camera

Open access
Velastin, Sergio A., Fernández, Rodrigo, Espinosa, Jorge E., Bay, Alessandro · 2020 · Sensors
Cited by 61

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

Abstract

The main source of delays in public transport systems (buses, trams, metros, railways) takes place in their stations. For example, a public transport vehicle can travel at 60 km per hour between stations, but its commercial speed (average en-route speed, including any intermediate delay) does not reach more than half of that value. Therefore, the problem that public transport operators must solve is how to reduce the delay in stations. From the perspective of transport engineering, there are several ways to approach this issue, from the design of infrastructure and vehicles to passenger traffic management. The tools normally available to traffic engineers are analytical models, microscopic traffic simulation, and, ultimately, real-scale laboratory experiments. In any case, the data that are required are number of passengers that get on and off from the vehicles, as well as the number of passengers waiting on platforms. Traditionally, such data has been collected manually by field counts or through videos that are then processed by hand. On the other hand, public transport networks, specially metropolitan railways, have an extensive monitoring infrastructure based on standard video cameras. Traditionally, these are observed manually or with very basic signal processing support, so there is significant scope for improving data capture and for automating the analysis of site usage, safety, and surveillance. This article shows a way of collecting and analyzing the data needed to feed both traffic models and analyze laboratory experimentation, exploiting recent intelligent sensing approaches. The paper presents a new public video dataset gathered using real-scale laboratory recordings. Part of this dataset has been annotated by hand, marking up head locations to provide a ground-truth on which to train and evaluate deep learning detection and tracking algorithms. Tracking outputs are then used to count people getting on and off, achieving a mean accuracy of 92% with less than 0.15% standard deviation on 322 mostly unseen dataset video sequences.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s20216251

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 16 references

Research works printed but not linked: 53

  1. Batty, 2015, Challenges and opportunities in developing urban modal shift, Travel Behav. Soc., 2, 109, 10.1016/j.tbs.2014.12.001 · DOI
  2. Stead, D., and Pojani, D. (2017). The urban transport crisis in emerging economies: A comparative overview. The Urban Transport Crisis in Emerging Economies, Springer. · doi:10.1007/978-3-319-43851-1_14
  3. Carroll, 2019, Measuring the potential emission reductions from a shift towards public transport, Transp. Res. Part D Transp. Environ., 73, 338, 10.1016/j.trd.2019.07.010 · doi:10.1016/j.trd.2019.07.010
  4. Saleh, 2015, Study on the separated bus lanes effectiveness in city centres: A case study in Edinburgh and Bialystok, World J. Sci. Technol. Sustain. Dev., 2, 257, 10.1108/WJSTSD-06-2015-0033 · doi:10.1108/wjstsd-06-2015-0033
  5. Shalaby, 1999, Simulating performance impacts of bus lanes and supporting measures, J. Transp. Eng., 125, 390, 10.1061/(ASCE)0733-947X(1999)125:5(390) · doi:10.1061/(asce)0733-947x(1999)125:5(390
  6. Agrawal, 2013, Shared-use bus priority lanes on city streets: Approaches to access and enforcement, J. Public Transp., 16, 2, 10.5038/2375-0901.16.4.2 · doi:10.5038/2375-0901.16.4.2
  7. Nguyen, 2019, Impediments to the bus rapid transit implementation in developing countries–a typical evidence from Hanoi, Int. J. Urban Sci., 23, 464, 10.1080/12265934.2019.1577747 · doi:10.1080/12265934.2019.1577747
  8. Malomo, 2020, Factors Influencing Non-compliance Behaviour of Unauthorised Drivers on Bus Rapid Transit Lanes in Lagos Metropolis, Adv. Soc. Sci. Res. J., 7, 1
  9. Zegers, 2010, Influence of platform height, door width, and fare collection on bus dwell time: Laboratory evidence for Santiago de Chile, Transp. Res. Rec. J. Transp. Res. Board, 2143, 59, 10.3141/2143-08 · doi:10.3141/2143-08
  10. 2018, Speed management efficacy on national roads–early experiences of sectional speed system functioning in Podlaskie voivodship, Transp. Probl., 13, 5, 10.20858/tp.2018.13.2.1 · doi:10.20858/tp.2018.13.2.1
  11. Hadavi, 2020, Analyzing passenger and freight vehicle movements from automatic-Number plate recognition camera data, Eur. Transp. Res. Rev., 12, 1, 10.1186/s12544-020-00405-x · DOI
  12. Fernandez, R. (2011, January 10–12). Experimental study of bus boarding and alighting times. Proceedings of the European Transport Conference, Glasgow, Scotland.
  13. Yin, 2010, Quantitative evaluation of different aspects of motion trackers under various challenges, Br. Mach. Vis. Assoc., 2010, 1
  14. Everingham, 2010, The pascal visual object classes (voc) challenge, Int. J. Comput. Vis., 88, 303, 10.1007/s11263-009-0275-4 · DOI · Paper page
  15. Lealtaixé, L., Milan, A., Reid, I., Roth, S., and Schindler, K. (2015). MOT Challenge 2015: Towards a Benchmark for Multi-Target Tracking. arXiv.
  16. Stauffer, C., and Grimson, W.E.L. (1999, January 23–25). Adaptive background mixture models for real-time tracking. Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), Fort Collins, CO, USA.
  17. Zivkovic, Z. (2004, January 26–26). Improved adaptive Gaussian mixture model for background subtraction. Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004, Cambridge, UK. · DOI · Paper page
  18. Hu, 2013, A novel approach for crowd video monitoring of subway platforms, Opt.-Int. J. Light Electron Opt., 124, 5301, 10.1016/j.ijleo.2013.03.057 · doi:10.1016/j.ijleo.2013.03.057
  19. Li, M., Zhang, Z., Huang, K., and Tan, T. (2008, January 8–11). Estimating the number of people in crowded scenes by mid based foreground segmentation and head-shoulder detection. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA. · DOI · Paper page
  20. Gavrila, D., and Giebel, J. (2001, January 8–14). Virtual sample generation for template-based shape matching. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, Kauai, HI, USA.
  21. Munder, 2008, Pedestrian detection and tracking using a mixture of view-based shape–texture models, IEEE Trans. Intell. Transp. Syst., 9, 333, 10.1109/TITS.2008.922943 · DOI · Paper page
  22. Bueno, 2011, Face recognition using histograms of oriented gradients, Pattern Recognit. Lett., 32, 1598, 10.1016/j.patrec.2011.01.004 · DOI · Paper page
  23. Chen, 2016, Vision-based traffic surveys in urban environments, J. Electron. Imaging, 25, 051206, 10.1117/1.JEI.25.5.051206 · DOI
  24. Benenson, R., Omran, M., Hosang, J., and Schiele, B. (2014, January 6–12). Ten years of pedestrian detection, what have we learned?. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland. · DOI · Paper page
  25. Brunetti, 2018, Computer vision and deep learning techniques for pedestrian detection and tracking: A survey, Neurocomputing, 300, 17, 10.1016/j.neucom.2018.01.092 · DOI · Paper page
  26. Soviany, P., and Ionescu, R.T. (2018). Optimizing the Trade-off between Single-Stage and Two-Stage Object Detectors using Image Difficulty Prediction. arXiv. · DOI · Paper page
  27. Guo, 2020, A Fast Occluded Passenger Detector Based on MetroNet and Tiny MetroNet, Inf. Sci., 534, 16, 10.1016/j.ins.2020.05.009 · DOI
  28. Liu, 2019, Metro Passenger Flow Statistics Based on YOLOv3, Proceedings of the IOP Conference Series: Materials Science and Engineering, Volume 688, 044025, 10.1088/1757-899X/688/4/044025 · doi:10.1088/1757-899x/688/4/044025
  29. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems 28 (NIPS 2015), Montreal, QC, Canada.
  30. Wang, T., Zhang, X., Yuan, L., and Feng, J. (2019, January 16). Few-shot adaptive faster R-CNN. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. · DOI
  31. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA. · DOI · Paper page
  32. Girshick, R. (2015). Fast R-CNN. arXiv. · DOI · Paper page
  33. Espinosa, J.E., Velastín, S.A., and Branch, J.W. (2020). Detection of Motorcycles in Urban Traffic Using Video Analysis: A Review. IEEE Trans. Intell. Transp. Syst. · DOI
  34. Espinosa, J.E., Velastin, S.A., and Branch, J.W. (2018). Motorcycle detection and classification in urban Scenarios using a model based on Faster R-CNN. arXiv. · DOI
  35. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
  36. Yilmaz, A., Javed, O., and Shah, M. (2006). Object tracking: A survey. ACM Comput. Surv., 38. · DOI · Paper page
  37. Ojha, S., and Sakhare, S. (2015, January 8–10). Image processing techniques for object tracking in video surveillance—A survey. Proceedings of the 2015 International Conference on Pervasive Computing (ICPC), Pune, India. · DOI · Paper page
  38. Bagherpour, 2012, Upper body tracking using KLT and Kalman filter, Procedia Comput. Sci., 13, 185, 10.1016/j.procs.2012.09.127 · DOI
  39. Cong, 2010, People detection and re-identification in complex environments, IEICE Trans. Inf. Syst., 93, 1761, 10.1587/transinf.E93.D.1761 · doi:10.1587/transinf.e93.d.1761
  40. Coniglio, C., Meurie, C., Lézoray, O., and Berbineau, M. (2015, January 26–29). A graph based people silhouette segmentation using combined probabilities extracted from appearance, shape template prior, and color distributions. Proceedings of the International Conference on Advanced Concepts for Intelligent Vision Systems, Catania, Italy. · DOI
  41. Kuo, C.H., and Nevatia, R. (2011, January 20–25). How does person identity recognition help multi-person tracking?. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA. · DOI · Paper page
  42. Simonnet, D., Lewandowski, M., Velastin, S., Orwell, J., and Turkbeyler, E. (2012, January 7–13). Re-identification of pedestrians in crowds using dynamic time warping. Proceedings of the Computer Vision—ECCV 2012. Workshops and Demonstrations, Florence, Italy. · DOI
  43. Pedagadi, S., Orwell, J., Velastin, S., and Boghossian, B. (2013, January 23–28). Local fisher discriminant analysis for pedestrian re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA. · DOI
  44. Kalal, 2012, Tracking-learning-detection, IEEE Trans. Pattern Anal. Mach. Intell., 34, 1409, 10.1109/TPAMI.2011.239 · DOI · Paper page
  45. Hare, 2016, Struck: Structured output tracking with kernels, IEEE Trans. Pattern Anal. Mach. Intell., 38, 2096, 10.1109/TPAMI.2015.2509974 · DOI · Paper page
  46. Xiang, Y., Alahi, A., and Savarese, S. (2015, January 7–13). Learning to track: Online multi-object tracking by decision making. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile. · DOI · Paper page
  47. Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., Zhao, X., and Kim, T.K. (2014). Multiple object tracking: A literature review. arXiv.
  48. Shuo, 2018, Review of object tracking based on convolutional neural networks, Chin. High Technol. Lett., 3, 207
  49. Tan, M., and Le, Q.V. (2019). Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv.
  50. Wang, Y., Wang, C., Zhang, H., Dong, Y., and Wei, S. (2019). Automatic ship detection based on RetinaNet using multi-resolution Gaofen-3 imagery. Remote Sens., 11. · DOI · Paper page
  51. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland. · DOI · Paper page
  52. Doermann, D., and Mihalcik, D. (2000, January 3–7). Tools and techniques for video performance evaluation. Proceedings of the Proceedings 15th International Conference on Pattern Recognition, ICPR-2000, Barcelona, Spain.
  53. Wolf, 2006, A critical view of context, Int. J. Comput. Vis., 69, 251, 10.1007/s11263-006-7538-0 · DOI

Cited by

See all 61

Metadata

Authors
Velastin, S. A., Fernández, R., Espinosa, J. E., & Bay, A.
Venue
Sensors
Publisher
MDPI AG
Published
2020-11-02
Volume
20
Issue
21
Pages
6251
ISSN
1424-8220 (ISSN-L)
OpenAlex
W3096739239
Cited by
61
References
16
FWCI
2.82
Type
journal article
Language
en
Open access
gold
Funders
  • FP7 People: Marie-Curie Actions (N600371)
  • Ministerio de Economía, Industria y Competitividad, Gobierno de España (COFUND2013-51509)
  • Ministerio de Educación, Cultura y Deporte (CEI-15-17)
  • Fondo Nacional de Desarrollo Científico y Tecnológico (1120219, 1080381, 1140209 (OBSERVE))

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Detecting, Tracking and Counting People Getting On/Off a Metropolitan Train Using a Standard Video Camera. https://app.cochat.ai/papers/10.3390/s20216251
The paper
Velastin, S. A., Fernández, R., Espinosa, J. E., & Bay, A. (2020). Detecting, Tracking and Counting People Getting On/Off a Metropolitan Train Using a Standard Video Camera. Sensors. https://doi.org/10.3390/s20216251

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.