The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
A Review on Bilevel Optimization: From Classical to Evolutionary Approaches and Applications
Open accessAbstract
Bilevel optimization is defined as a mathematical program, where an optimization problem contains another optimization problem as a constraint. These problems have received significant attention from the mathematical programming community. Only limited work exists on bilevel problems using evolutionary computation techniques; however, recently there has been an increasing interest due to the proliferation of practical applications and the potential of evolutionary algorithms in tackling these problems. This paper provides a comprehensive review on bilevel optimization from the basic principles to solution strategies; both classical and evolutionary. A number of potential application problems are also discussed. To offer the readers insights on the prominent developments in the field of bilevel optimization, we have performed an automated text-analysis of an extended list of papers published on bilevel optimization to date. This paper should motivate evolutionary computation researchers to pay more attention to this practical yet challenging area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Decisions with Multiple Objectives: Preferences and Value Tradeoffs.
Tsoukias, A., Keeney, R. L., & Raiffa, H. (1994) · The Journal of the Operational Research Society · doi:10.2307/2584151 · Cited by 8,370
Blei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516
Theory of Games and Economic Behavior
Wald, A., Neumann, J. V., & Morgenstern, O. (1947) · The Review of Economics and Statistics · doi:10.2307/1925651 · Cited by 2,329
Decisions with Multiple Objectives: Preferences and Value Tradeoffs.
Smith, A. F. M., Keeney, R. L., & Raiffa, H. (1977) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2345300 · Cited by 2,305
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
The Theory of Incentives: The Principal-Agent Model
Laffont, J.-J., & Martimort, D. (2002) · Princeton University Press eBooks · doi:10.1515/9781400829453 · Cited by 2,106
The Theory of Incentives: The Principal-Agent Model
Laffont, J., & Martimort, D. (2001) · Toulouse 1 Capitole Publications (Université Toulouse I Capitole) · Cited by 2,067
Review of Metamodeling Techniques in Support of Engineering Design Optimization
Wang, G. G., & Shan, S. (2007) · Journal of Mechanical Design · doi:10.1115/1.2429697 · Cited by 1,706
An overview of bilevel optimization
Colson, B., Marcotte, P., & Savard, G. (2007) · Annals of Operations Research · doi:10.1007/s10479-007-0176-2 · Cited by 1,409
Optimization of Structural Topology, Shape, and Material
Bendsøe, M. P. (1995) · Springer eBooks · doi:10.1007/978-3-662-03115-5 · Cited by 1,362
A Representation and Economic Interpretation of a Two-Level Programming Problem
Fortuny‐Amat, J., & McCarl, B. A. (1981) · Journal of the Operational Research Society · doi:10.1057/jors.1981.156 · Cited by 1,174
Practical Bilevel Optimization
Bard, J. F. (1998) · Nonconvex Optimization and Its Applications · doi:10.1007/978-1-4757-2836-1 · Cited by 930
Defending Critical Infrastructure
Brown, G. G., Carlyle, M. W., Salmerón, J., & Wood, R. K. (2006) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.1060.0252 · Cited by 788
Models and algorithms for road network design: a review and some new developments
Yang, H., & H. Bell, M. G. (1998) · Transport Reviews · doi:10.1080/01441649808717016 · Cited by 722
Executive Compensation and Principal-Agent Theory
Garen, J. E. (1994) · Journal of Political Economy · doi:10.1086/261967 · Cited by 610
Chemical Reaction Equilibrium Analysis: Theory and Algorithms
Smith, W. R., & Missen, R. W. (1982) · Medical Entomology and Zoology · Cited by 466
From human to humanoid locomotion—an inverse optimal control approach
Mombaur, K., Truong, A., & Laumond, J.-P. (2010) · Autonomous Robots · doi:10.1007/s10514-009-9170-7 · Cited by 442
Chemical reaction equilibrium analysis: Theory and algorithms
Flowers, G. C. (1983) · Geochimica et Cosmochimica Acta · doi:10.1016/0016-7037(83)90196-5 · Cited by 436
Traffic signal timing optimisation based on genetic algorithm approach, including drivers’ routing
Ceylan, H., & Bell, M. G. H. (2004) · Transportation Research Part B: Methodological · doi:10.1016/s0191-2615(03)00015-8 · Cited by 337
Bilevel programming in traffic planning: Models, methods and challenge
Migdalas, A. (1995) · Journal of Global Optimization · doi:10.1007/bf01099649 · Cited by 229
Hierarchical optimization: An introduction
Anandalingam, G., & Friesz, T. L. (1992) · Annals of Operations Research · doi:10.1007/bf02098169 · Cited by 229
A Bilevel Model for Toll Optimization on a Multicommodity Transportation Network
Brotcorne, L., Labbé, M., Marcotte, P., & Savard, G. (2001) · Transportation Science · doi:10.1287/trsc.35.4.345.10433 · Cited by 205
Linear bilevel programming solution by genetic algorithm
Hejazi, S. R., Memariani, A., Jahanshahloo, G. R., & Sepehri, M. M. (2002) · Computers & Operations Research · doi:10.1016/s0305-0548(01)00066-1 · Cited by 201
The steepest descent direction for the nonlinear bilevel programming problem
Savard, G., & Gauvin, J. (1994) · Operations Research Letters · doi:10.1016/0167-6377(94)90086-8 · Cited by 191
LeBlanc, L. J., & Boyce, D. E. (1986) · Transportation Research Part B Methodological · doi:10.1016/0191-2615(86)90021-4 · Cited by 186
Deb, K., & Sinha, A. (2010) · Evolutionary Computation · doi:10.1162/evco_a_00015 · Cited by 177
Self-citationSolving Bilevel Multi-Objective Optimization Problems Using Evolutionary Algorithms
Deb, K., & Sinha, A. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01020-0_13 · Cited by 167
Self-citationBilevel model for production–distribution planning solved by using ant colony optimization
Calvete, H. I., Galé, C., & Oliveros, M.-J. (2010) · Computers & Operations Research · doi:10.1016/j.cor.2010.05.007 · Cited by 152
Designing Multimodal Freight Transport Networks: A Heuristic Approach and Applications
Yamada, T., Frazila, R. B., Castro, J. T., & Taniguchi, E. (2009) · Transportation Science · doi:10.1287/trsc.1080.0250 · Cited by 151
Stochastic multi-objective models for network design problem
Chen, A., Kim, J., Lee, S., & Kim, Y.-C. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.06.048 · Cited by 136
Küçükaydın, H., Aras, N., & Altınel, İ. K. (2010) · European Journal of Operational Research · doi:10.1016/j.ejor.2010.08.009 · Cited by 114
Inverse optimal control for deterministic continuous-time nonlinear systems
Johnson, M., Aghasadeghi, N., & Bretl, T. W. (2013) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2013.6760325 · Cited by 107
Complexity Issues in Bilevel Linear Programming
Deng, X. (1998) · Nonconvex optimization and its applications · doi:10.1007/978-1-4613-0307-7_6 · Cited by 106
The principal/agent paradigm: Its relevance to various functional fields
van Ackere, A. (1993) · European Journal of Operational Research · doi:10.1016/0377-2217(93)90234-e · Cited by 99
Differential evolution for bilevel programming
Angelo, J. S., Krempser, E., & Barbosa, H. J. C. (2013) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2013.6557606 · Cited by 93
A Deployed Quantal Response-Based Patrol Planning System for the U.S. Coast Guard
An, B., Ordóñez, F., Tambe, M., Shieh, E., Yang, R., Baldwin, C., DiRenzo, J., Moretti, K., Maule, B., & Meyer, G. (2013) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.2013.0700 · Cited by 92
Stochastic bilevel programming in structural optimization
Christiansen, S. H., Patriksson, M., & Wynter, L. (2001) · Structural and Multidisciplinary Optimization · doi:10.1007/s001580100115 · Cited by 83
Efficient Evolutionary Algorithm for Single-Objective Bilevel OptimizationPreprint
Sinha, A., Malo, P., & Deb, K. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1303.3901 · Cited by 80
Self-citationWein, L. M. (2009) · Operations Research · doi:10.1287/opre.1090.0695 · Cited by 80
Imitating human reaching motions using physically inspired optimization principles
Albrecht, S., Ramírez-Amaro, K., Ugalde, F. R., Weikersdorfer, D., Leibold, M., Ulbrich, M., & Beetz, M. (2011) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2011.6100856 · Cited by 79
Model Selection via Bilevel Optimization
Bennett, K. P., Hu, J. F., Ji, X., Kunapuli, G., & Pang, J. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2006.1716345 · Cited by 77
Efficient implementation of heuristics for the continuous network design problem
Marcotte, P., & Marquis, G. (1992) · Annals of Operations Research · doi:10.1007/bf02098178 · Cited by 71
Jiang, Y. L., Li, X., Huang, C., & Wu, X. (2012) · Applied Mathematics and Computation · doi:10.1016/j.amc.2012.10.010 · Cited by 70
Bi-Level Optimization Model for Public Transportation Network Redesign Problem
Fan, W. D., & Machemehl, R. B. (2011) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2263-17 · Cited by 62
A study on the use of heuristics to solve a bilevel programming problem
Angelo, J. S., & Barbosa, H. J. C. (2015) · International Transactions in Operational Research · doi:10.1111/itor.12153 · Cited by 62
Spatial Targeting of Agri-Environmental Policy Using Bilevel Evolutionary Optimization
Whittaker, G., Färe, R. G., Grosskopf, S., Barnhart, B., Bostian, M., Mueller-Warrant, G. W., & Griffith, S. (2014) · Omega · doi:10.1016/j.omega.2016.01.007 · Cited by 62
Bilevel Optimization and Machine Learning
Bennett, K. P., Kunapuli, G., Hu, J. F., & Pang, J. (2008) · Springer eBooks · doi:10.1007/978-3-540-68860-0_2 · Cited by 57
Ren, G., Huang, Z., Cheng, Y., Zhao, X., & Zhang, Y. (2012) · Journal of Advanced Transportation · doi:10.1002/atr.1211 · Cited by 52
Bostian, M., Whittaker, G., Barnhart, B., Färe, R. G., & Grosskopf, S. (2015) · Water Resources and Economics · doi:10.1016/j.wre.2015.06.002 · Cited by 44
Bilevel Multi-objective Optimization Problem Solving Using Progressively Interactive EMO
Sinha, A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19893-9_19 · Cited by 36
Self-citationEvolutionary Bilevel Optimization for Complex Control Tasks
Liang, J., & Miikkulainen, R. P. (2015) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2739480.2754732 · Cited by 35
Necessary Optimality Conditions and a New Approach to Multiobjective Bilevel Optimization Problems
Gadhi, N. A., & Dempe, S. (2012) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-012-0046-1 · Cited by 30
Cited by
Meta-Learning in Neural Networks: A Survey
Hospedales, T., Antoniou, A., Micaelli, P., & Storkey, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05439 · Cited by 886
Meta-Learning in Neural Networks: A Survey
Hospedales, T. M., Antoniou, A., Micaelli, P., & Storkey, A. J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3079209 · Cited by 886
Local flexibility markets: Literature review on concepts, models and clearing methods
Jin, X., Wu, Q., & Jia, H. (2020) · Applied Energy · doi:10.1016/j.apenergy.2019.114387 · Cited by 373
Mnemonics Training: Multi-Class Incremental Learning Without Forgetting
Liu, Y., Su, Y., Liu, A.-A., Schiele, B., & Sun, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01226 · Cited by 309
Carbon tax incentive policy towards air passenger transport carbon emissions reduction
Qiu, R., Xu, J., Xie, H., Zeng, Z., & Lv, C. (2020) · Transportation Research Part D: Transport and Environment · doi:10.1016/j.trd.2020.102441 · Cited by 83
Metadata
- Authors
- Sinha, A., Malo, P., & Deb, K.
- Venue
- IEEE Transactions on Evolutionary Computation
- Published
- 2018-04
- Volume
- 22
- Issue
- 2
- Pages
- 276-295
- ISSN
- 1089-778X (ISSN-L)
- 1941-0026
- OpenAlex
- W2614367549
- Cited by
- 904
- References
- 52
- FWCI
- 40.67
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.