A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot
The DOI matches its Crossref record; 60 of the 62 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Ideally, a robot executing an active SLAM algorithm should evaluate every possible action in the robot and map space, but the computational complexity of the evaluation grows exponentially with the search space which proves to be computationally intractable in real applications [24, 169].”
From Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age (2016) · cites this paper as [169]
Citations
Cites
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
(1995) · Cited by 10,558
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070 · cited 4×
“The objective of Bayesian optimization is to find the minimum of the cost function with as few cost evaluations as possible [Kushner (1964); Jones et al (1998); Locatelli (1997); Mockus et al (1978)].”
BackgroundMethodInfluentialPredictive Control With Constraints
Maciejowski, J. M. (2001) · Cambridge University Engineering Department Publications Database · Cited by 4,368
Simultaneous localization and mapping: part I
Durrant-Whyte, H., & Bailey, T. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1638022 · Cited by 4,199
Predictive control with constraints
Camacho, E. F. (2003) · Automatica · doi:10.1016/s0005-1098(03)00056-6 · Cited by 3,530
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Optimization—Theory and Applications
Cesari, L. (1983) · Springer eBooks · doi:10.1007/978-1-4613-8165-5 · Cited by 2,559
Simultaneous localization and mapping (SLAM): part II
Bailey, T., & Durrant-Whyte, H. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1678144 · Cited by 2,554
Marker tracking and HMD calibration for a video-based augmented reality conferencing system
Kato, H., & Billinghurst, M. (2003) · Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99) · doi:10.1109/iwar.1999.803809 · Cited by 2,194 · cited 1×
“The map is built using fiducial landmarks with the ARToolkit Tracker of Kato and Billinghurst (1999).”
Method
Research works printed but not linked: 2
- Gablonsky, J. (2001). Modification of the DIRECT algorithm. PhD thesis, Department of Mathematics, North Carolina State University, Raleigh, North Carolina.
- Martinez-Cantin, R., de Freitas, N., Doucet, A., & Castellanos, J. (2007b). Active policy learning for robot planning and exploration under uncertainty. In Robotics: science and systems (RSS), 2007. · DOI · Paper page
Cited by
Items 201–216 of 216
Topological Bayesian Optimization with Persistence DiagramsPreprint
Shiraishi, T., Le, T., Kashima, H., & Yamada, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09722
“For example, it is used for automated tuning of hyperparameters in machine learning models [21], path planning of mobile robots [15] and finding the optimal set of sensors [8].”
MethodAn Evaluation of Information Sharing Parking Guidance Policies Using a Bayesian ApproachPreprint
Wu, X., Balkumar, K., Luo, Q., Hampshire, R. C., & Saigal, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04845
“proposed a Bayesian optimization method for a mobile robot planning its path for optimal sensing of the environment under time constraints (7).”
MethodRandom searchers cope with cognitive errors and uncertainty better than path plannersPreprint
Campos, D., Méndez, V., Palmer, J. R. B., Cristín, J., & Bartumeus, F. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.06.239269
“; Martinez-Cantin et al., 2009; Kagan, 2015).”
Relevant positioning of a mobile robot using a particle filter design approach
Grami, T., & Tlili, A. S. (2020) · IEEE International Conference on Advanced Systems and Emergent Technologies (IC_ASET) · doi:10.1109/ic_aset49463.2020.9318257
Osorio, C. R., & Andrés, J. (2021)
Scaling Bayesian Optimization With Game TheoryPreprint
Mathesen, L., Pedrielli, G., & Smith, R. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03790 · Cited by 1
“Among surrogate-based approaches, Bayesian optimization has been quite successful [14, 15, 16, 17], with several applications such as machine learning, automatic algorithm design [18, 19, 20], and robotics [21, 22].”
MethodThe Application of Zig-Zag Sampler in Sequential Markov Chain Monte CarloPreprint
Yu, H., & Nakamura, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.10210
“ESTIMATING signal from a series of noisy observations is an crucial assignment in many applications, especially in the weather fields and multi-target tracking [1] [2] [3].”
The Application of Zig-Zag Sampler in Sequential Markov Chain Monte Carlo
Han, Y., & Nakamura, K. (2025) · Journal of Information Processing · doi:10.2197/ipsjjip.33.231
Efficiently exploring for human robot interaction: partially observable Poisson processes
Jovan, F., Tomy, M., Hawes, N., & Wyatt, J. (2022) · Autonomous Robots · doi:10.1007/s10514-022-10070-9
“Martinez-Cantin et al. (2009) give a POMDP formulation of active visual mapping, use direct policy search to find a solution, and use Monte Carlo simulation to generate imaginary observations and action outcomes during optimization.”
MethodA Hierarchical SLAM Framework Based on Deep Reinforcement Learning for Active Exploration
Xue, Y., Chen, W., & Zhang, L. (2023) · Lecture notes in electrical engineering · doi:10.1007/978-981-99-0479-2_87
A Review on Bayesian Meta-Learning for Robot Mapping and NavigationPreprint
Nayak, S. K., & Pal, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4673996
Marcos, M., Mur-Labadia, L., & Martínez-Cantín, R. (2025) · PLoS ONE · doi:10.1371/journal.pone.0335853 · Cited by 2
“Examples include hyperparameter tuning for neural networks [47], robust policy search, planning, and motion in robotics [20,48,49], autonomous systems [12], game agent optimization [50], aircraft design [51], physics modeling and simulation [52], biochemistry [53], ecology [54], and medicine…”
Confidence-Controlled Exploration: Efficient Sparse-Reward Policy Learning for Robot Navigation
Patel, B., Weerakoon, K., Suttle, W. A., Koppel, A., Sadler, B. M., Zhou, T., Manocha, D., & Bedi, A. S. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246149 · Cited by 3
“To balance exploration and exploitation, prior work has used the uncertainty of a surrogate cost function estimation from the visual field of view [30] and a world model in model-based RL [31], [32].”
Modelisation Visuelle d'un Objet Inconnu par un Robot Humanoide Autonome
Foissotte, T. (2010) · theses.fr (ABES) · doi:10.70675/76167425ze98bz4958z9ed2zc4299e534bb5
Micro-Data Reinforcement Learning for Adaptive Robots
Chatzilygeroudis, K. I. (2018) · theses.fr (ABES) · doi:10.70675/7990d9edz7f40z4344z9318z6da4e46000c0 · Cited by 2
Surrogate models for the analysis of friction induced vibrations under uncertainty
Sadet, J. (2022) · theses.fr (ABES) · doi:10.70675/45acd65bz658cz41c2z8760z2e77918f0a85
Metadata
- Authors
- Martinez-Cantin, R., de Freitas, N., Brochu, E., Castellanos, J., & Doucet, A.
- Affiliations
- University of British Columbia (CA)
- Universidad de Zaragoza (ES)
- Corresponding author
- Brochu, Eric
- ORCID
- Castellanos, José
- Venue
- Autonomous Robots
- Published
- 2009-08
- Volume
- 27
- Issue
- 2
- Pages
- 93-103
- ISSN
- 0929-5593 (ISSN-L)
- 1573-7527
- OpenAlex
- W2096649264
- Cited by
- 217
- References
- 62
- Citations by year
- 2025: 6 · 2024: 9 · 2023: 15 · 2022: 11 · 2021: 27 · 2020: 27 · 2019: 13 · 2018: 20 · 2017: 9 · 2016: 17 · 2015: 13 · 2014: 8 · 2013: 11 · 2012: 11
- FWCI
- 11.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Autonomous Robots (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Keywords
- online path planning, exploration-exploitation balance, Bayesian optimization, partially observable Markov decision processes, mobile robot localization, visual guidance, real-time planning, active vision, sequential design, dynamic sensing, sensor calibration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.