Engineering the Neural Automatic Passenger Counter
Open accessAbstract
Automatic passenger counting (APC) in public transportation has been approached with various machine learning and artificial intelligence methods since its introduction in the 1970s. It is mainly used for revenue sharing, which (in Germany alone) is in the billions annually and supply planning, which is essential for services of general interest. While equivalence testing is becoming more popular than difference detection (Student’s t-test), the former is much more difficult to pass to ensure low user risk. On the other hand, recent developments in artificial intelligence have led to algorithms that promise much higher counting quality (lower bias). However, gradient-based methods (including Deep Learning) typically run into local optima. In this work, we explore and exploit various aspects of machine learning to increase the reliability, performance, and counting quality of the Neural APC 3D depth video-based LSTM neural network. We perform a grid search with several fundamental parameters: the selection and size of the training set, which is similar to cross-validation, and the initial network weights and randomness during the training process. Using this experiment, we show how aggregation techniques such as ensemble quantiles can reduce bias, and we give an idea of the overall spread of the results. We utilize the test success chance, a simulative metric based on the empirical distribution. We also employ a post-training Monte Carlo quantization approach and introduce cumulative summation to turn counting into a stationary method and allow unbounded counts. All in all, our numerous additions provide a major quality increase to the NAPC.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Addressing challenges through preprocessing techniques, comprehensive training datasets, adherence to data privacy regulations, and strategic system design will be crucial for successful deployment and operation of these systems in public transport.
“Addressing these challenges through preprocessing techniques [102], comprehensive training datasets [103], adherence to data privacy regulations [104], and strategic system design will be crucial for the successful deployment and operation of these systems in public transport.”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [103]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · see citing works
(2014) · Cited by 33,419 · see citing works
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473 · see citing works
Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., et al. (2020) · Nature · doi:10.1038/s41586-020-2649-2 · Cited by 23,826 · see citing works
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466 · see citing works
TensorFlow: A system for large-scale machine learningPreprint
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.5555/3026877.3026899 · Cited by 16,369 · see citing works
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325 · see citing works
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898 · see citing works
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951 · see citing works
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260 · see citing works
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259 · see citing works
Ensembling neural networks: Many could be better than all
Zhou, Z.-H., Wu, J., & Tang, W. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(02)00190-x · Cited by 1,964 · see citing works
Computer-Intensive Methods in Statistics
Diaconis, P. W., & Efron, B. (1983) · Scientific American · doi:10.1038/scientificamerican0583-116 · Cited by 1,157 · see citing works
Fixed Point Quantization of Deep Convolutional Networks
Lin, D. D., Talathi, S. S., & Annapureddy, V. S. (2015) · arXiv · doi:10.48550/arxiv.1511.06393 · Cited by 684 · see citing works
An ARIMA-Model-Based Approach to Seasonal Adjustment
Hillmer, S. C., & Tiao, G. C. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477767 · Cited by 455 · see citing works
Ensemble deep learning for regression and time series forecasting
Qiu, X., Zhang, L., Ren, Y., Suganthan, P. N., & Amaratunga, G. A. J. (2014) · doi:10.1109/ciel.2014.7015739 · Cited by 393 · see citing works
Towards Unified INT8 Training for Convolutional Neural Network
Zhu, F., Gong, R., Yu, F., Liu, X., Wang, Y., Li, Z., Yang, X., & Yan, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00204 · Cited by 162 · see citing works
Individual differences among deep neural network models
Mehrer, J., Spoerer, C. J., Kriegeskorte, N., & Kietzmann, T. C. (2020) · Nature Communications · doi:10.1038/s41467-020-19632-w · Cited by 133 · see citing works
Tsoumakas, G., Partalas, I., & Vlahavas, I. P. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-03999-7_1 · Cited by 132 · see citing works
The effects of quantization on multilayer neural networks
Dündar, G., & Rose, K. H. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.471364 · Cited by 97 · see citing works
Challenges for the Repeatability of Deep Learning Models
Alahmari, S. S., Goldgof, D. B., Mouton, P. R., & Hall, L. (2020) · IEEE Access · doi:10.1109/access.2020.3039833 · Cited by 80 · see citing works
Ensemble Pruning Based on Objection Maximization With a General Distributed Framework
Bian, Y., Wang, Y., Yao, Y., & Chen, H. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2945116 · Cited by 55 · see citing works
An experimental comparison of periodic timetabling models
Siebert, M., & Goerigk, M. (2013) · Computers & Operations Research · doi:10.1016/j.cor.2013.04.002 · Cited by 54 · see citing works
Self-citationMonotonicity results for h-discrete fractional operators and application
Suwan, I., Owies, S., & Abdeljawad, T. (2018) · Advances in Difference Equations · doi:10.1186/s13662-018-1660-5 · Cited by 53 · see citing works
A Replication Crisis in Methodological Research?
Boulesteix, A., Hoffmann, S., Charlton, A., & Seibold, H. (2020) · Significance · doi:10.1111/1740-9713.01444 · Cited by 43 · see citing works
Seidel, R., Jahn, N., Seo, S., Goerttler, T., & Obermayer, K. (2022) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2021.3139393 · Cited by 28 · see citing works
Self-citationValidation of automatic passenger counting: introducing the t-test-induced equivalence test
Siebert, M., & Ellenberger, D. (2019) · Transportation · doi:10.1007/s11116-019-09991-9 · Cited by 21 · see citing works
Self-citationA TOF-based automatic passenger counting approach in public transportation systems
Klauser, D., Bärwolff, G., & Schwandt, H. (2015) · AIP conference proceedings · doi:10.1063/1.4913168 · Cited by 9 · see citing works
Flagged first, then by citations
1 of the 32 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Radovan, A., Mršić, L., Đambić, G., & Mihaljević, B. (2024) · Eng · doi:10.3390/eng5040172 · Cited by 24 · see citing works
Paganelli, M. G., Gallo, M., Massenio, P. R., & Naso, D. (2025) · IEEE Access · doi:10.1109/access.2025.3597327 · Cited by 4 · see citing works
Ellenberger, D., & Siebert, M. (2023) · Transportmetrica A Transport Science · doi:10.1080/23249935.2023.2267702 · Cited by 2 · see citing works
Self-citationReal-Time AI-Powered Occupancy Monitoring for Modern Jeepneys in Bacolod City, Philippines
Daba-ay, M. A., Bibangco, E. J. P., Javier, R. K. T., & Moncera, C. J. A. (2025) · International Conference on Data Science and Its Applications (ICoDSA) · doi:10.1109/icodsa67155.2025.11157597 · Cited by 2 · see citing works
Enhancing Public Transport Management with Deep Learning and IoT-Based Monitoring
Paganelli, M. G., Gallo, M., Massenio, P. R., & Naso, D. (2025) · International Conference on Traffic and Logistic Engineering (ICTLE) · doi:10.1109/ictle67020.2025.11203545
AutoDetect: Automatic Detection of Passenger in AC Train
Shinde, V., & Bide, P. J. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-33535-7_2
- Authors
- Jahn, N., & Siebert, M.
- Corresponding author
- Siebert, Michael
- Venue
- Engineering Applications of Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2022-09
- Volume
- 114
- Pages
- 105148
- ISSN
- 0952-1976 (ISSN-L)
- OpenAlex
- W4221147603
- Cited by
- 6
- References
- 32
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 1 · 2023: 1
- FWCI
- 0.41
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Engineering Applications of Artificial Intelligence (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- European Regional Development Fund (10166961)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- automatic passenger counting, public transport, LSTM neural network, grid search, bias mitigation, revenue sharing, equivalence testing, training data selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review