The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Prediction and behavioral analysis of travel mode choice: A comparison of machine learning and logit models
Open accessAbstract
Some recent studies have shown that machine learning can achieve higher predictive accuracy than logit models. However, existing studies rarely examine behavioral outputs (e.g., marginal effects and elasticities) that can be derived from machine-learning models and compare the results with those obtained from logit models. In other words, there has not been a comprehensive comparison between logit models and machine learning that covers both prediction and behavioral analysis, two equally important subjects in travel-behavior study. This paper addresses this gap by examining the key differences in model development, evaluation, and behavioral interpretation between logit and machine-learning models for mode-choice modeling. We empirically evaluate the two approaches using stated-preference survey data. Consistent with the literature, this paper finds that the best-performing machine-learning model, random forest, has significantly higher predictive accuracy than multinomial logit and mixed logit models. The random forest model and the two logit models largely agree on several aspects of the behavioral outputs, including variable importance and the direction of association between independent variables and mode choice. However, we find that the random forest model produces behaviorally unreasonable arc elasticities and marginal effects when these behavioral outputs are computed from a standard approach. After the introduction of some modifications that overcome the limitations of tree-based models, the results are improved to some extent. There appears to be a tradeoff between predictive accuracy and behavioral soundness when choosing between machine learning and logit models in mode-choice modeling.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Modern Applied Statistics with S
Venables, W. N., & Ripley, B. D. (2002) · Statistics and Computing · doi:10.1007/978-0-387-21706-2 · Cited by 24,305
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
(1992) · Cited by 23,431
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Conditional logit analysis of qualitative choice behavior
McFadden, D. L. (1972) · eScholarship (California Digital Library) · Cited by 14,203
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
Building Predictive Models in R Using the caret Package
Kuhn, M. (2008) · Journal of Statistical Software · doi:10.18637/jss.v028.i05 · Cited by 8,863
Cragg, J. G., & Zarembka, P. (1975) · The Canadian Journal of Economics · doi:10.2307/134075 · Cited by 8,342
Discrete Choice Methods with Simulation
Train, K. E. (2001) · doi:10.1017/cbo9780511805271 · Cited by 7,784
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
A comparison of methods for multiclass support vector machines
Hsu, C.-W., & Lin, C.-J. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.991427 · Cited by 6,838
Discrete Choice Analysis: Theory and Application to Travel Demand.
Uncles, M. D., Ben-Akiva, M., & Lerman, S. R. (1987) · The Journal of the Operational Research Society · doi:10.2307/2582065 · Cited by 5,527
Mixed MNL models for discrete response
McFadden, D., & Train, K. (2000) · Journal of Applied Econometrics · doi:10.1002/1099-1255(200009/10)15:5<447::aid-jae570>3.0.co;2-1 · Cited by 4,322
A comparison of event models for naive bayes text classification
McCallum, A., & Nigam, K. (1998) · Cited by 3,289
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917
Applied choice analysis a primer
Hensher, D. A., Rose, J. M., & Greene, W. H. (2005) · Cited by 2,619
Modern Applied Statistics with S Fourth edition
Venables, W. N., & Ripley, B. D. (2002) · Cited by 2,538
Definitions, methods, and applications in interpretable machine learning
Murdoch, W. J., Singh, C., Kumbier, K., Abbasi-Asl, R., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900654116 · Cited by 2,167
The Mixed Logit model: The state of practice
Hensher, D. A., & Greene, W. H. (2003) · Transportation · doi:10.1023/a:1022558715350 · Cited by 2,047
Machine Learning: An Applied Econometric Approach
Mullainathan, S., & Spiess, J. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.87 · Cited by 1,989
Multicollinearity in Regression Analysis: The Problem Revisited
Farrar, D. E., & Glauber, R. R. (1967) · The Review of Economics and Statistics · doi:10.2307/1937887 · Cited by 1,932
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924
Goldstein, A., Kapelner, A., Bleich, J., & Pitkin, E. (2015) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2014.907095 · Cited by 1,861
Probability Estimates for Multi-class Classification by Pairwise Coupling
Wu, T., Lin, C., & Weng, R. C. (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1016791 · Cited by 1,468
Gevrey, M., Dimopoulos, I., & Lek, S. (2003) · Ecological Modelling · doi:10.1016/s0304-3800(02)00257-0 · Cited by 1,248
Probability Estimates for Multi-class Classification by Pairwise Coupling
Wu, T., Lin, C., Weng, R. C., & Singer, Y. (2003) · Cited by 989
Forecasting new product penetration with flexible substitution patterns
Brownstone, D., & Train, K. (1998) · Journal of Econometrics · doi:10.1016/s0304-4076(98)00057-8 · Cited by 850
Karlaftis, M. G., & Vlahogianni, E. I. (2011) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2010.10.004 · Cited by 826
Generalized Boosted Models: A guide to the gbm package
Ridgeway, G. K. (2006) · Cited by 814
Beyond prediction: using big data for policy problems
Athey, S. (2017) · Science · doi:10.1126/science.aal4321 · Cited by 575
Misc Functions of the Department of Statistics, ProbabilityTheory Group (Formerly: E1071), TU Wien
MEYER, D. A., Dimitriadou, E., Hornik, K., Weingessel, A., & Leisch, F. (2015) · Cited by 523
Applying a random forest method approach to model travel mode choice behavior
Cheng, L., Chen, X., De Vos, J., Lai, X., & Witlox, F. (2019) · Travel Behaviour and Society · doi:10.1016/j.tbs.2018.09.002 · Cited by 490
Venables, W. N., & Ripley, B. D. (2002) · Statistics and Computing · doi:10.1007/978-0-387-21706-2_14 · Cited by 468
Causal Interpretations of Black-Box Models
Zhao, Q., & Hastie, T. (2021) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2019.1624293 · Cited by 462
A comparative study of machine learning classifiers for modeling travel mode choice
Hagenauer, J., & Helbich, M. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.01.057 · Cited by 424
Meta-analysis of UK values of travel time: An update
Abrantes, P. A. L., & Wardman, M. R. (2011) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2010.08.003 · Cited by 326
Interpretable machine learning a guide for making black box models explainable
Molnar, C. (2022) · Cited by 313
Six Approaches to Calculating Standardized Logistic Regression Coefficients
Menard, S. (2004) · The American Statistician · doi:10.1198/000313004x946 · Cited by 294
Understanding ridesplitting behavior of on-demand ride services: An ensemble learning approach
Chen, X. (., Zahiri, M., & Zhang, S. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2016.12.018 · Cited by 252 · cited 1×
“Most previous mode choice studies only examined a subset of these models (Chen et al., 2017; Omrani, 2015; Wang and Ross, 2018; Xie et al., 2003).”
MethodYan, X., Levine, J., & Zhao, X. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.07.029 · Cited by 225
Self-citationWang, F., & Ross, C. L. (2018) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.1177/0361198118773556 · Cited by 213
Work Travel Mode Choice Modeling with Data Mining: Decision Trees and Neural Networks
Xie, C., Lu, J., & Parkany, E. (2003) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.3141/1854-06 · Cited by 209
Iseki, H., & Taylor, B. D. (2009) · Transport Reviews · doi:10.1080/01441640902811304 · Cited by 196
Transfer penalties in multimodal public transport networks
Garcia-Martinez, A., Jiménez, R. C., Jara-Diaz, S. R., Chowdhury, S., & de Cáceres, A. M. (2018) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2018.01.016 · Cited by 158
Predicting Travel Mode of Individuals by Machine Learning
Omrani, H. (2015) · Transportation Research Procedia · doi:10.1016/j.trpro.2015.09.037 · Cited by 149
Travel Mode Choice Modeling with Support Vector Machines
Zhang, Y., & Xie, Y. (2008) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2076-16 · Cited by 127
MEYER, D. A., Dimitriadou, E., Hornik, K., Weingessel, A., & Leisch, F. (2020) · Cited by 120
Golshani, N., Shabanpour, R., Mahmoudifard, S. M., Derrible, S., & Mohammadian, A. (2017) · Travel Behaviour and Society · doi:10.1016/j.tbs.2017.09.003 · Cited by 115
Airline itinerary choice modeling using machine learning
Lhéritier, A., Bocamazo, M., Delahaye, T., & Acuna-Agost, R. (2019) · Journal of Choice Modelling · doi:10.1016/j.jocm.2018.02.002 · Cited by 114
Rasouli, S., & Timmermans, H. J. P. (2014) · European journal of transport and infrastructure research · doi:10.18757/ejtir.2014.14.4.3045 · Cited by 73
Pattern recognition and machine learning
Gerhardt, L. A. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100578 · Cited by 65
IMPROVING STABILITY OF DECISION TREES
Last, M., Maimon, O., & Minkov, E. (2002) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001402001599 · Cited by 65
Prediction of Individual Travel Mode with Evidential Neural Network Model
Omrani, H., Charif, O., Gerber, P., Awasthi, A., & Trigano, P. (2013) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2399-01 · Cited by 52
Lindner, A., Pitombo, C. S., & Cunha, A. L. (2016) · Travel Behaviour and Society · doi:10.1016/j.tbs.2016.08.003 · Cited by 52
Wong, M., Farooq, B., & Bilodeau, G.-A. (2017) · Journal of Choice Modelling · doi:10.1016/j.jocm.2017.11.003 · Cited by 43
Metadata
- Authors
- Zhao, X., Yan, X., Yu, A., & Van Hentenryck, P.
- Venue
- Travel Behaviour and Society
- Publisher
- Elsevier BV
- Published
- 2020-07
- Volume
- 20
- Pages
- 22-35
- ISSN
- 2214-367X (ISSN-L)
- OpenAlex
- W3006958671
- Cited by
- 405
- References
- 61
- FWCI
- 39.37
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.