The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics
Abstract
The reality gap, which often makes controllers evolved in simulation inefficient once transferred onto the physical robot, remains a critical issue in evolutionary robotics (ER). We hypothesize that this gap highlights a conflict between the efficiency of the solutions in simulation and their transferability from simulation to reality: the most efficient solutions in simulation often exploit badly modeled phenomena to achieve high fitness values with unrealistic behaviors. This hypothesis leads to the transferability approach, a multiobjective formulation of ER in which two main objectives are optimized via a Pareto-based multiobjective evolutionary algorithm: 1) the fitness; and 2) the transferability, estimated by a simulation-to-reality (STR) disparity measure. To evaluate this second objective, a surrogate model of the exact STR disparity is built during the optimization. This transferability approach has been compared to two reality-based optimization methods, a noise-based approach inspired from Jakobi's minimal simulation methodology and a local search approach. It has been validated on two robotic applications: 1) a navigation task with an e-puck robot; and 2) a walking task with a 8-DOF quadrupedal robot. For both experimental setups, our approach successfully finds efficient and well-transferable controllers only with about ten experiments on the physical robot.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 14,918
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
A two-dimensional interpolation function for irregularly-spaced data
Shepard, D. (1968) · Proceedings of the 1968 23rd ACM national conference on - · doi:10.1145/800186.810616 · Cited by 5,079
Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines
Nolfi, S., & Floreano, D. (2000) · The MIT Press eBooks · doi:10.7551/mitpress/2889.001.0001 · Cited by 1,513
A comprehensive survey of fitness approximation in evolutionary computation
Jin, Y. (2005) · Soft Computing · doi:10.1007/s00500-003-0328-5 · Cited by 1,229
The e-puck, a Robot Designed for Education in Engineering
Francesco Mondada, C., Michael Bonani, C., Raemy, X., Pugh, J., Cianci, C. M., Klaptocz, A., Magnenat, S., Zufferey, J., Floreano, D., & Martinoli, A. (2009) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 785
Inertial navigation systems for mobile robots
Barshan, B., & Durrant-Whyte, H. F. (1995) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.388775 · Cited by 723
Resilient Machines Through Continuous Self-Modeling
Bongard, J., Zykov, V., & Lipson, H. (2006) · Science · doi:10.1126/science.1133687 · Cited by 709
Visual odometry for ground vehicle applications
Nistér, D., Naroditsky, O., & Bergen, J. (2006) · Journal of Field Robotics · doi:10.1002/rob.20103 · Cited by 634
Noise and the reality gap: The use of simulation in evolutionary robotics
Jakobi, N., Husbands, P., & Harvey, I. (1995) · Lecture Notes in Computer Science · doi:10.1007/3-540-59496-5_337 · Cited by 631
Policy gradient reinforcement learning for fast quadrupedal locomotion
Kohl, N., & Stone, P. (2004) · IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 · doi:10.1109/robot.2004.1307456 · Cited by 564
An Application of Reinforcement Learning to Aerobatic Helicopter Flight
Abbeel, P., Coates, A., Quigley, M., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0006 · Cited by 535
Evolving Mobile Robots in Simulated and Real Environments
Miglino, O., Lund, H. H., & Nolfi, S. (1995) · Artificial Life · doi:10.1162/artl.1995.2.4.417 · Cited by 358
CONSTRAINT-HANDLING USING AN EVOLUTIONARY MULTIOBJECTIVE OPTIMIZATION TECHNIQUE
Coello, C. A. C. (2000) · Civil Engineering and Environmental Systems · doi:10.1080/02630250008970288 · Cited by 352
Evolutionary Robotics and the Radical Envelope-of-Noise Hypothesis
Jakobi, N. (1997) · Adaptive Behavior · doi:10.1177/105971239700600205 · Cited by 264
How to Evolve Autonomous Robots: Different Approaches in Evolutionary Robotics
Nolfi, S., Floreano, D., Miglino, O., & Francesco Mondada, C. (1994) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-010111550 · Cited by 226
Evolutionary neurocontrollers for autonomous mobile robots
Floreano, D., & Mondada, F. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00082-3 · Cited by 206
Explorations in design space: unconventional electronics design through artificial evolution
Thompson, A., Layzell, P., & Zebulum, R. S. (1999) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.788489 · Cited by 201
A Robust Visual Odometry and Precipice Detection System Using Consumer-grade Monocular Vision
Campbell, J. D., Sukthankar, R., Nourbakhsh, I., & Pahwa, A. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2005.1570639 · Cited by 163
Multi-Objective Optimization Using Surrogates
Voutchkov, I. I., & Keane, A. J. (2010) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-12775-5_7 · Cited by 143
Nonlinear System Identification Using Coevolution of Models and Tests
Bongard, J., & Lipson, H. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.850293 · Cited by 130
Evolving robust gaits with AIBO
Hornby, G. S., Takamura, S., Yokono, J., Hanagata, O., Yamamoto, T., & Fujita, M. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2000.846489 · Cited by 126
Structure optimization of neural networks for evolutionary design optimization
H�sken, M., Jin, Y., & Sendhoff, B. (2003) · Soft Computing · doi:10.1007/s00500-003-0330-y · Cited by 123
Crossing the reality gap in evolutionary robotics by promoting transferable controllers
Koos, S., Mouret, J.-B., & Doncieux, S. (2010) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1830483.1830505 · Cited by 116
Self-citationDecoupled control of posture and trajectory of the hybrid wheel-legged robot hylos
Grand, C., Amar, F. B., Plumet, F., & Bidaud, P. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2004.1302528 · Cited by 90
Combining Simulation and Reality in Evolutionary Robotics
Zagal, J. C., & Ruíz-del-Solar, J. (2007) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-007-9149-6 · Cited by 77
Running across the reality gap: Octopod locomotion evolved in a minimal simulation
Jakobi, N. (1998) · Lecture notes in computer science · doi:10.1007/3-540-64957-3_63 · Cited by 72
Evolutionary Techniques in Physical Robotics
Pollack, J. B., Lipson, H., Ficici, S., Funes, P., Hornby, G., & Watson, R. A. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-46406-9_18 · Cited by 71
Rational radial basis function interpolation with applications to antenna design
Jakobsson, S., Andersson, B., & Edelvik, F. (2009) · Journal of Computational and Applied Mathematics · doi:10.1016/j.cam.2009.08.058 · Cited by 67
Using behavioral exploration objectives to solve deceptive problems in neuro-evolution
Mouret, J.-B., & Doncieux, S. (2009) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1569901.1569988 · Cited by 67
Self-citationAutonomous Autorotation of an RC Helicopter
Abbeel, P., Coates, A., Hunter, T., & Ng, A. (2009) · Springer tracts in advanced robotics · doi:10.1007/978-3-642-00196-3_45 · Cited by 64
Behavioral diversity measures for Evolutionary Robotics
Doncieux, S., & Mouret, J.-B. (2010) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2010.5586100 · Cited by 62
Self-citationEvolution of Plastic Control Networks
Floreano, D., & Urzelai, J. (2001) · Autonomous Robots · doi:10.1023/a:1012459627968 · Cited by 61
Evolutionary robotics: A survey of applications and problems
Meyer, J.-A., Husbands, P., & Harvey, I. R. (1998) · Lecture notes in computer science · doi:10.1007/3-540-64957-3_61 · Cited by 59
Once More Unto the Breach: Co-evolving a robot and its simulator
Bongard, J., & Lipson, H. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/1429.003.0011 · Cited by 46
Artificial evolution of the morphology and kinematics in a flapping-wing mini-UAV
de Margerie, E., Mouret, J.-B., Doncieux, S., & Meyer, J.-A. (2007) · Bioinspiration & Biomimetics · doi:10.1088/1748-3182/2/4/002 · Cited by 46
Self-citationBecerra, J. A., & Duro, R. J. (2009) · IGI Global eBooks · doi:10.4018/978-1-59904-849-9.ch092 · Cited by 26
Evolutionary Robotics, Anticipation and the Reality Gap
Hartland, C., & Bredèche, N. (2006) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2006.340190 · Cited by 23
Automatic system identification based on coevolution of models and tests
Koos, S., Mouret, J.-B., & Doncieux, S. (2009) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2009.4982995 · Cited by 21
Self-citationHow to promote generalisation in evolutionary robotics: the ProGAb approach
Pinville, T., Koos, S., Mouret, J.-B., & Doncieux, S. (2011) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2001576.2001612 · Cited by 18
Self-citationRobustness analysis of evolutionary controller tuning using real systems
Góngora, M., Passow, B. N., & Hopgood, A. A. (2009) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2009.4983001 · Cited by 16
Self-organizing Robot Teams Using Asynchronous Situated Co-evolution
Prieto, A., Bellas, F., Becerra, J. A., Priego, B., & Duro, R. J. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15193-4_53 · Cited by 1
Cited by
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124
“[22].”
A Systematic Review of Perception System and Simulators for Autonomous Vehicles Research
Rosique, F., Navarro, P. J., Fernández, C., & Padilla, A. (2019) · Sensors · doi:10.3390/s19030648 · Cited by 469
A scalable pipeline for designing reconfigurable organisms
Kriegman, S., Blackiston, D., Levin, M., & Bongard, J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910837117 · Cited by 461
Evolutionary Robotics: What, Why, and Where to
Doncieux, S., Bredeche, N., Mouret, J.-B., & Eiben, A. E. (. (2015) · Frontiers in Robotics and AI · doi:10.3389/frobt.2015.00004 · Cited by 275
Self-citationBongard, J. C. (2013) · Communications of the ACM · doi:10.1145/2492007.2493883 · Cited by 260
Metadata
- Authors
- Koos, S., Mouret, J.-B., & Doncieux, S.
- Venue
- IEEE Transactions on Evolutionary Computation
- Published
- 2013-02
- Volume
- 17
- Issue
- 1
- Pages
- 122-145
- ISSN
- 1089-778X (ISSN-L)
- 1941-0026
- OpenAlex
- W1978161072
- Cited by
- 272
- References
- 43
- FWCI
- 15.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.