A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot
The DOI matches its Crossref record; 59 of the 62 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Ideally, a robot executing an active SLAM algorithm should evaluate every possible action in the robot and map space, but the computational complexity of the evaluation grows exponentially with the search space which proves to be computationally intractable in real applications [24, 169].”
From Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age (2016) · cites this paper as [169]
Citations
Cites
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
(1995) · Cited by 10,558
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070 · cited 4×
“The objective of Bayesian optimization is to find the minimum of the cost function with as few cost evaluations as possible [Kushner (1964); Jones et al (1998); Locatelli (1997); Mockus et al (1978)].”
BackgroundMethodInfluentialPredictive Control With Constraints
Maciejowski, J. M. (2001) · Cambridge University Engineering Department Publications Database · Cited by 4,368
Simultaneous localization and mapping: part I
Durrant-Whyte, H., & Bailey, T. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1638022 · Cited by 4,199
Predictive control with constraints
Camacho, E. F. (2003) · Automatica · doi:10.1016/s0005-1098(03)00056-6 · Cited by 3,530
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Optimization—Theory and Applications
Cesari, L. (1983) · Springer eBooks · doi:10.1007/978-1-4613-8165-5 · Cited by 2,559
Simultaneous localization and mapping (SLAM): part II
Bailey, T., & Durrant-Whyte, H. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1678144 · Cited by 2,554
Marker tracking and HMD calibration for a video-based augmented reality conferencing system
Kato, H., & Billinghurst, M. (2003) · Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99) · doi:10.1109/iwar.1999.803809 · Cited by 2,194 · cited 1×
“The map is built using fiducial landmarks with the ARToolkit Tracker of Kato and Billinghurst (1999).”
Method
Research works printed but not linked: 2
- Gablonsky, J. (2001). Modification of the DIRECT algorithm. PhD thesis, Department of Mathematics, North Carolina State University, Raleigh, North Carolina.
- Martinez-Cantin, R., de Freitas, N., Doucet, A., & Castellanos, J. (2007b). Active policy learning for robot planning and exploration under uncertainty. In Robotics: science and systems (RSS), 2007. · DOI · Paper page
Cited by
Items 101–200 of 216
Balancing Search and Estimation in Random Search Based Stochastic Simulation Optimization
Zhu, C., Xu, J., Chen, C., Lee, L. H., & Hu, J.-Q. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2522094 · Cited by 17
“Concepts from Bayesian optimization may prove to be useful in this line of extension [24], [25].”
BackgroundNguyen, T. D., Gupta, S., Rana, S., & Venkatesh, S. (2018) · International Journal of Data Science and Analysis · doi:10.1007/s41060-018-0119-9 · Cited by 34
“Apart from hyperparameter tuning, Bayesian optimization has also been used for optimal sensor placement [5], for gait design [12] and optimal path planning [13], etc.”
MethodNakath, D., Clemens, J., & Rachuy, C. (2019) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-019-01103-0 · Cited by 17
“Further notable works in this field are [12, 13, 53, 88].”
BackgroundLearning rewards from exploratory demonstrations using probabilistic temporal ranking
Burke, M., Lu, K., Angelov, D., Straižys, A., Innes, C., Subr, K., & Ramamoorthy, S. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10120-w · Cited by 20
“GP’s and Bayesian optimisation are often used together, with a GP acting as the surrogate model for a Bayesian optimisation planner, as in the mobile robot path planning approaches of Martinez-Cantin et al. (2009) and Marchant et al. (2014).”
MethodActive target search for high dimensional robotic systems
Radmard, S., & Croft, E. A. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9539-8 · Cited by 15
“In Martinez-Cantin et al. (2009) a state variance cost function is approximated by samples over a horizon of τ while Bayesian optimization is used to minimize the number of queries to find the optimal path (policy).”
MethodNovel First Order Bayesian Optimization with an Application to Reinforcement Learning
Prabuchandran, K. J., Penubothula, S., Kamanchi, C., & Bhatnagar, S. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01896-w · Cited by 21
Physics-Prior Bayesian Neural Networks in Semiconductor Processing
Chen, C. H., Parashar, P., Akbar, C., Fu, S. M., Syu, M.-Y., & Lin, A. S. (2019) · IEEE Access · doi:10.1109/access.2019.2940130 · Cited by 14
Behavior Decision of Mobile Robot With a Neurophysiologically Motivated Reinforcement Learning Model
Wang, D., Chen, S., Hu, Y., Liu, L., & Wang, H. (2020) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3035778 · Cited by 13
“Besides the above directed action selection policies, other directed policies, such as POMDP [25], Kullback-Leibler divergence [26], etc, are also utilized to address the exploration–exploitation tradeoff.”
MethodA Multi-Objective Bayesian Optimization Approach Using the Weighted Tchebycheff Method
Biswas, A., Fuentes, C., & Hoyle, C. (2021) · Journal of Mechanical Design · doi:10.1115/1.4051787 · Cited by 17
Wingate, D., Diuk, C., O’Donnell, T. J., Tenenbaum, J. B., & Gershman, S. J. (2013) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 14
Guez, A., & Pineau, J. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509969 · Cited by 14
“In an attempt to address some of these challenges, researchers have studied the problem of autonomous exploration for SLAM [9], [10], [11], [12], [13], [14].”
BackgroundBiswas, A., Vasudevan, R. K., Ziatdinov, M. A., & Kalinin, S. V. (2023) · Machine Learning Science and Technology · doi:10.1088/2632-2153/acb316 · Cited by 17
“This approach has been widely used in these machine learning problems [20] – [24].”
Sensor Selection for Crowdsensing Dynamical Systems
Schnitzler, F., Yu, J. Y., & Mannor, S. (2015) · International Conference on Artificial Intelligence and Statistics · Cited by 13
Elreedy, D., Atiya, A. F., & Shaheen, S. I. (2021) · Soft Computing · doi:10.1007/s00500-021-06047-y · Cited by 14
Li, R., Shikhov, I., & Arns, C. H. (2021) · Physical Review Applied · doi:10.1103/physrevapplied.15.054003 · Cited by 12
Flexible Behavioral Decision Making of Mobile Robot in Dynamic Environment
Zhu, J., Wang, D., & Si, J. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3149602 · Cited by 14
“Other traditional index, however, either require fine-tuning parameters (e.g., (cid:2) -greedy [28], Softmax, and the cuckoo action-selection method [1]), or require huge calculation to converge to optimality (e.g., the Bayesian method [23]).”
MethodBiswas, A., & Hoyle, C. (2021) · Journal of Mechanical Design · doi:10.1115/1.4049742 · Cited by 15
Variational Bayesian Optimization for Runtime Risk-Sensitive Control
Kuindersma, S., Grupen, R. A., & Barto, A. G. (2012) · Robotics: Science and Systems · doi:10.15607/rss.2012.viii.026 · Cited by 12
“Recently there has been increased interest in applying Bayesian optimization (BO) algorithms to solve model-free policy search problems [17, 19, 20, 33, 28, 13].”
BackgroundInteractive Bayesian optimization : learning user preferences for graphics and animation
Brochu, E. (2011) · cIRcle (University of British Columbia) · doi:10.14288/1.0051462 · Cited by 31
Self-citationRobust expected improvement for Bayesian optimization
Christianson, R. B., & Gramacy, R. B. (2023) · IISE Transactions · doi:10.1080/24725854.2023.2275166 · Cited by 14
“We do not mean robust to out-liers (Martinez-Cantin et al. , 2009) as may arise when noisy, leptokurtic simulators f are involved (Beland and Nair, 2017) – though we shall have some thoughts on this setup later.”
Reinforcement Learning-based Adaptive Trajectory Planning for AUVs in Under-ice Environments
Wang, C., Wei, L., Wang, Z., Song, M., & Mahmoudian, N. (2018) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceans.2018.8604754 · Cited by 12
“• The developed algorithm is non-myopic and for multiple AUVs, while most existing works on non-myopic planning consider only a single vehicle [13]–[15].”
BackgroundNOMU: Neural Optimization-based Model UncertaintyPreprint
Heiss, J., Weissteiner, J., Wutte, H., Seuken, S., & Teichmann, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13640 · Cited by 21
“In recent years, BO has been successfully applied in practice to a wide range of problems, including robotics [27], sensor networks [33], and drug development [12].”
BackgroundA decision-making method based on Bayesian optimization algorithm for small modular reactor
Zhang, B., Peng, M., Cheng, S., & Sun, L. (2020) · Kerntechnik · doi:10.1515/kern-2020-850208 · Cited by 11
Non-parametric probabilistic load flow using Gaussian process learning
Pareek, P., Wang, C., & Nguyen, H. D. (2021) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2021.132941 · Cited by 10
Ceiling vision-based active SLAM framework for dynamic and wide-open environments
An, S.-Y., Lee, L.-K., & Oh, S. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9453-0 · Cited by 12
“The process of ‘explore and exploit’ is considered as a single unit behavior and consists of two stages; exploration and exploitation (Martinez-Cantin et al. 2009).”
BackgroundMimura, S., Masuda, T., Miyamoto, S., & Tanabe, K. (2025) · Chemical Engineering Journal Advances · doi:10.1016/j.ceja.2025.100929 · Cited by 11
BoFL: bayesian optimized local training pace control for energy efficient federated learning
Guo, H., Gu, H., Yang, Z., Wang, X., Lee, E. K., Chandramoorthy, N., Eilam, T., Chen, D., & Nahrstedt, K. (2022) · International Middleware Conference · doi:10.1145/3528535.3565244 · Cited by 12
“BO has been applied across multiple fields, i.e., A/B Testing [10, 37], robotics motion planing [46, 50], drug discovery [62], cherry picking cloud configurations [4], and more recently as an important ingredient for neural architecture search [32, 34, 72], which automates the process of neural…”
MethodOptimizing gaze direction in a visual navigation task
Välimäki, T., & Ritala, R. K. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487276 · Cited by 7
“Recently [11] discusses an active sensing problem, where a robot must decide the direction of focus of its vision system while moving along a fixed trajectory, and proposes a solution via an approximate open-loop feedback control.”
BackgroundRakicevic, N., & Kormushev, P. S. (2019) · Autonomous Robots · doi:10.1007/s10514-019-09842-7 · Cited by 10
Uncertainty-driven active view planning in feature-based monocular vSLAM
Dai, X.-Y., Meng, Q., & Jin, S. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107459 · Cited by 7
Automatic Classification of Sleep Stages Based on Raw Single-Channel EEG
Xu, K., Xia, S., & Li, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60639-8_30 · Cited by 8
Active Learning for Autonomous Intelligent Agents: Exploration, Curiosity, and InteractionPreprint
Lopes, M. C., & Montesano, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.1497 · Cited by 11
“In (Martinez-Cantin et al., 2009; Martinez-Cantin et al., 2010) the authors want to learn a dynamical model of a robot arm, or a good map of the environment, with the minimum amount of data.”
BackgroundMulti-Step Look-Ahead Optimization Methods for Dynamic Pricing With Demand Learning
Elreedy, D., Atiya, A. F., & Shaheen, S. I. (2021) · IEEE Access · doi:10.1109/access.2021.3087577 · Cited by 6
“The exploration-exploitation trade-off is studied in various fields including: dynamic pricing ( [14], [24], [27], [35]), evolutionary optimization [21], and sequential optimization [48].”
BackgroundReview of Research on Multi-robot Visual Simultaneous Localization and Mapping
Hesheng, Y., Shuo, P., Xu, L., & Bo, H. (2022) · Journal of Mechanical Engineering · doi:10.3901/jme.2022.11.011 · Cited by 8
NAVS: A Neural Attention-Based Visual SLAM for Autonomous Navigation in Unknown 3D Environments
Wu, Y., Chen, N., Fan, G., Yang, D., Rao, L., Cheng, S., Song, X., & Ma, Y. (2024) · Neural Processing Letters · doi:10.1007/s11063-024-11502-6 · Cited by 7
“Some studies define the active SLAM problem as an approximation of a partially observable Markov decision process (POMDP) [31, 32].”
Overcoming occlusions in eye-in-hand visual search
Radmard, S., Meger, D., Croft, E. A., & Little, J. J. (2012) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2012.6315690 · Cited by 6
“optimization is a suitable tool to find multiple minima through an exploration-exploitation mechanism [11].”
Learning Viewpoint Planning in Active Recognition on a Small Sampling Budget: A Kriging Approach
Defretin, J., Marzat, J., & Piet-Lahanier, H. (2010) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.32 · Cited by 6
“In [7], Kriging and Bayesian optimization have been used to address a simultaneous localization and mapping problem under time and energy constraints.”
MethodAutoOED: Automated Optimal Experiment Design PlatformPreprint
Tian, Y., Luković, M. K., Erps, T., Foshey, M., & Matusik, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.05959 · Cited by 6
Exploration–exploitation model of moth-inspired olfactory navigation
Lazebnik, T., Golov, Y., Gurka, R., Harari, A. R., & Liberzon, A. (2024) · Journal of The Royal Society Interface · doi:10.1098/rsif.2023.0746 · Cited by 5
“From a computational point of view, EE is useful as a model for optimization and search tasks [66, 67].”
BackgroundBandit-Inspired Memetic Algorithms for solving Quadratic Assignment Problems
Puglierin, F., Drugan, M. M., & Wiering, M. (2013) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2013.6557814 · Cited by 5
“Achieving a good compromise between the two extremes is not a problem found only in meta-heuristics; it is in fact common in reinforcement learning [12], planning [17] and dealing with imperfect knowledge in general.”
BackgroundCappelletti, L., Petrini, A., Gliozzo, J., Casiraghi, E., Schubach, M., Kircher, M., & Valentini, G. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04582-5 · Cited by 6
Opening Design using Bayesian Optimization
Vitsas, N., Evangelou, I., Παπαϊωάννου, Γ., & Gkaravelis, A. (2023) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2023.06.001 · Cited by 5
Tamiya, S., & Yamasaki, H. (2021) · arXiv (Cornell University) · Cited by 5
Global estimation in constrained environments
Kobilarov, M., Marsden, J. E., & Sukhatme, G. S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911423558 · Cited by 4
“A related approach (Martinez-Cantin et al., 2009) aimed at on-line active sensing employs Bayesian optimization, i.”
BackgroundMethodActive SLAM over Continuous Trajectory and Control: A Covariance-Feedback Approach
Koga, S., Asgharivaskasi, A., & Atanasov, N. (2022) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc53348.2022.9867507 · Cited by 6
“While almost all of the literature in active SLAM have employed a discretized control space planning, [19] has developed an online path planning method for active SLAM under a continuous control space by a Bayesian optimization for updating a parameter in a control policy.”
Navigation Under Uncertainty Based on Active SLAM Concepts
Carrillo, H., & Castellanos, J. A. (2015) · Studies in systems, decision and control · doi:10.1007/978-3-319-26327-4_9 · Cited by 4
Self-citationGlobal Optimization for Resource Allocation in a Networked-Surveillance Radar
Freitas, A. D., Focke, R. W., Beyers, C., & de Villiers, P. (2019) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011303 · Cited by 4
“The use of RSM in sensor selection [18], and robot path planning [19] show the utility of this technique towards similar problems.”
MethodRobust Policy Search for Robot Navigation
Garcia-Barcos, J., & Martínez-Cantín, R. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3060408 · Cited by 6
“In fact, Bayesian optimization has been already used in some robotics and reinforcement learning setups, such as robot walking [7], [8], [9], control [10], [11], planning [12], [13], grasping [14], [15], [16] and damage recovery [17].”
BackgroundMethodRisk-aware Meta-level Decision Making for Exploration Under Uncertainty
Ott, J., Kim, S. K., Bouman, A., Peltzer, O., Sobue, M., Delecki, H., Kochenderfer, M. J., Burdick, J. W., & Agha–mohammadi, A. (2024) · International Conference on Control, Decision and Information Technologies (CoDIT) · doi:10.1109/codit62066.2024.10708134 · Cited by 8
“Indelman et al. [45] and Martinez-Cantin et al. [46] integrated a policy search scheme under the Gaussian belief assumption, and Lauri and Ritala [47] expanded this using the POMCP solver.”
MethodApproximate Recursive Bayesian Filtering methods for robot visual search
Radmard, S., & Croft, E. A. (2011) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2011.6181596 · Cited by 4
“Recursive Bayesian Filtering (RBF) algorithms have been used to generate the optimal search paths for various applications such as unmanned aerial vehicles searching for a lost target at sea and camera mounted mobile robots searching for a target [8] [9].”
MethodMulti-robot simultaneous localization and uncertainty reduction on maps (MR-SLURM)
Rekleitis, I. M. (2013) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2013.6739630 · Cited by 4
“In this paper we use the more traditional metric of the trace of the covariance matrix [22], [23]; E = √ trace(P).”
MethodRegret Bounds for Deterministic Gaussian Process BanditsPreprint
de Freitas, N., Smola, A. J., & Zoghi, M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1203.2177 · Cited by 4
Learning robotic ultrasound scanning using probabilistic temporal ranking.Preprint
Burke, M., Lu, K., Angelov, D., Straižys, A., Innes, C., Subr, K., & Ramamoorthy, S. (2020) · arXiv (Cornell University) · Cited by 4
Predictive representations for sequential decision making under uncertainty
Boularias, A. (2010) · MPG.PuRe (Max Planck Society) · Cited by 4
Bi-Level Image-Guided Ergodic Exploration with Applications to Planetary Rovers
Wittemyer, E., & Abraham, I. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341437 · Cited by 3
“Navigation tasks using visual sensor information have ranged from obstacle avoidance and safe navigation [19], [20] to information maximization [21], [22].”
BackgroundBayesian Optimization for Robust Robotic Grasping Using a Sensorized Compliant Hand
Sierra, J. G.-L., Martin, A. E. H., Sundaram, A. M., Martínez-Cantín, R., & Roa, M. A. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3475914 · Cited by 3
“In particular,workingwithanapproachbasedsolelyontactile detection,withnoexternalsensorforshaperecognition,allows ustoconfrontBOwiththeuncertaintyintroducedbyrealistic sensors,foranalyticallymeasuringthestabilityofthegrasp.”
Collaborative Bayesian Optimization via Wasserstein Barycenters
Zhan, D., Zhang, H., Righter, R., Zheng, Z., & Anderson, J. (2025) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc57313.2025.11312220 · Cited by 3
“In numerous engineering applications, including materials design [1], control engineering [2], robotics [3] and machine learning parameter tuning [4], one must solve optimization problems where either the objective function is costly to evaluate, or, is unknown and only oracle access is available.”
BOWL: Bayesian Optimization for Weight Learning in Probabilistic Soft Logic
Srinivasan, S., Farnadi, G., & Getoor, L. C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i06.6589 · Cited by 3
“BO is an effective approach for optimization of black-box functions (Li-zotte et al. 2007; Martinez-Cantin et al. 2009; Srinivas et al. 2012; Brochu, Brochu, and de Freitas 2010) and GPR is a non-parametric Bayesian approach that is often used to approximate arbitrary functions.”
MethodEnhanced Global Optimization With Parallel Global and Local Structures for Real-Time Control Systems
Meng, Q., Wang, H., Wang, S., & Ng, S. H. (2023) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3277888 · Cited by 3
“Efficient control of these real-time systems requires effective responses to system changes over time, and the objective function f ( x ) is usually continuous and possibly multi-modal [1], [2].”
BackgroundSpacecraft State Estimation Using Neural Radiance Fields
Heintz, A. M., & Peck, M. A. (2023) · Journal of Guidance Control and Dynamics · doi:10.2514/1.g006946 · Cited by 6
Diessner, M., Wilson, K. J., & Whalley, R. D. (2024) · Data-Centric Engineering · doi:10.1017/dce.2024.40 · Cited by 6
Response Surface Modeling for Networked Radar Resource Allocation
Freitas, A. D., Focke, R. W., & de Villiers, P. (2018) · International Conference on Information Fusion (FUSION) · doi:10.23919/icif.2018.8455815 · Cited by 3
“The efficient use of resources for robot path planning and sensing is achieved using a RSM in [13].”
MethodGras, G., Seneci, C., Γιαταγάνας, Π., & Yang, G. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460588 · Cited by 3
“Bayesian optimization has been successfully used in a number of mobile robotic applications such as gait optimization for bipedal locomotion [5], gait adaptation after incurring damage in a 6-legged robot [6], gaze planning [7], and path planning [8].”
MethodOn-line Planning on Active SLAM-Based Robot Olfaction for Gas Distribution Mapping
Soegiarto, D., Trilaksono, B. R., Adiprawita, W., Idris, E. M., & Nugraha, Y. P. (2018) · IEEE Asia-Pacific Conference on Geoscience, Electronics and Remote Sensing Technology (AGERS) · doi:10.1109/agers.2018.8554199 · Cited by 3
“Martinez-Cantin [15] using the Partially Observably Markov Decision Process (POMDP).”
BackgroundMethodAdaptive Sampling with Mobile Sensor Networks
Huang, S. (2012) · Digital Commons - Michigan Tech (Michigan Technological University) · doi:10.37099/mtu.dc.etds/477 · Cited by 3
“Active SLAM has been studied for single mobile sensors in [42, 43, 44, 45, 46, 47, 48].”
BackgroundMethodAn Evaluation of Information Sharing Parking Guidance Policies Using a Bayesian ApproachPreprint
Wu, X., Balkumar, K., Luo, Q., Hampshire, R. C., & Saigal, R. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2869942 · Cited by 3
Intelligent and Secure Underwater Acoustic Communication Networks
Wang, C. (2018) · Digital Commons - Michigan Tech (Michigan Technological University) · doi:10.37099/mtu.dc.etdr/694 · Cited by 3
Active Offline Policy SelectionPreprint
Konyushkova, K., Chen, Y., Paine, T. L., Gülçehre, Ç., Păduraru, C., Mankowitz, D. J., Denil, M., & de Freitas, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10251 · Cited by 5
“BO has been used successfully in many applications including experimental design [4], robotics [40, 41], hyper-parameter optimization [57, 25, 11], preference learning and interactive machine learning [8, 7].”
MethodA Bandit-Inspired Memetic Algorithm for Quadratic Assignment Problems
Puglierin, F. (2012) · Utrecht University Repository (Utrecht University) · Cited by 3
Alternating Optimisation and Quadrature for Robust Control
Paul, S., Chatzilygeroudis, K. I., Ciosek, K., Mouret, J.-B., Osborne, M. A., & Whiteson, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11687 · Cited by 2
“Two commonly used acquisition functions are expected improvement (EI) (Močkus 1975; Jones, Schonlau, and Welch 1998) and upper confidence bound (UCB) (Cox and John 1992; 1997).”
BackgroundA random chemical reaction algorithm based on double containers for robot path planning
Yang, Q., Yang, Z. X., Hu, G., & Du, W. (2017) · IEEE International Conference on Progress in Informatics and Computing · doi:10.1109/pic.2017.8359581 · Cited by 2
Analyzing Human Search Behavior When Subjective Returns are Unobservable
Nakazato, S., Yang, B., & Shimokawa, T. (2023) · Computational Economics · doi:10.1007/s10614-023-10388-1 · Cited by 4
“…Bayes, generally has the advantage of predicting return functions with relatively high accuracy, even with few training samples and can be naturally extended to contextual and continuum-armed bandit problems (Martinez-Cantin et al., 2009; Srinivas et al., 2009, 2012; Williams & Rasmussen, 1995).”
Limitations of Simultaneous Multiagent Learning in Nonstationary Environments
Noda, I. (2013) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat.2013.125 · Cited by 2
“The exploration ratio has signi.cant in.uence on multiagent learning (MAL).”
BackgroundA lasso-based sparse knowledge gradient policy for sequential optimal learning
Li, Y., Liu, H., & Powell, W. B. (2016) · International Conference on Artificial Intelligence and Statistics · Cited by 2
Biswas, A., Fuentes, C., & Hoyle, C. J. (2022) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4054480 · Cited by 2
A taxonomy of weight learning methods for statistical relational learning
Srinivasan, S., Dickens, C., Augustine, E., Farnadi, G., & Getoor, L. C. (2021) · Machine Learning · doi:10.1007/s10994-021-06069-5 · Cited by 2
“BO is an effective approach for optimization of black-box functions (Lizotte et al. 2007; Martinez-Cantin et al. 2009; Srinivas et al. 2012; Brochu et al. 2010) and GPR is a non-parametric Bayesian approach that is often used to approximate arbitrary functions.”
MethodBayesian optimization of gradient trajectory for parallel‐transmit pulse design
Zhang, M., & Rodgers, C. T. (2024) · Magnetic Resonance in Medicine · doi:10.1002/mrm.30007 · Cited by 2
“Bayesian optimization is an emerging method for global optimization, 20 capable of solving design problems in a wide range of fields including robotics, 21 reinforcement learning, 22 and drug discovery.”
MethodHuman-Robot Collaborative Remote Object Search
Miura, J., Kadekawa, S., 近嵐, 公., & Sugiyama, J. (2015) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-08338-4_71 · Cited by 2
“Exploration planning [1, 2] is a viewpoint planning for making a description of the whole workspace.”
BackgroundBayesian optimisation with prior reuse for motion planning in robot soccer
Agarwalla, A., Jain, A., Manohar, K., Saxena, A., & Mukhopadhyay, J. (2018) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3152494.3152502 · Cited by 2
“In [24], [23] and [38], authors propose an active learning algorithm for online robot path planning and reducing uncertainty in its state and environment under a time constraint.”
BackgroundBiswas, A., & Hoyle, C. (2020) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2020-22116 · Cited by 2
Alternating Optimisation and Quadrature for Robust Reinforcement Learning.Preprint
Paul, S., Ciosek, K., Osborne, M. A., & Whiteson, S. (2016) · arXiv (Cornell University) · Cited by 2
A Successive-Elimination Approach to Adaptive Robotic SensingPreprint
Rolf, E., Fridovich-Keil, D., Simchowitz, M., Recht, B., & Tomlin, C. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.10611 · Cited by 2
“Planning for information maximization-based methods typically proceeds with a receding horizon [9, 12, 5, 13, 14].”
BackgroundMethodOccupancy Map Building through Bayesian ExplorationPreprint
Francis, G., Ott, L., Marchant, R., & Ramos, F. T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00227 · Cited by 2
“Martinez-Cantin et al. (2007) and more recently Martinez-Cantin et al. (2009) utilised Bayesian optimisation to find control policies that minimise the state error of a robot and landmarks.”
BackgroundMethodComparison of High-Dimensional Bayesian Optimization Algorithms on BBOBPreprint
Santoni, M. L., Raponi, E., Leone, R. D., & Doerr, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.00890 · Cited by 2
“…et al., 2021], biology, engineering and design [Lam et al., 2018; Raponi et al., 2019, 2021], robotics [Calandra et al., 2016; Junge et al., 2020; Martinez-Cantin et al., 2009], algorithm configuration [Hutter et al., 2011], hyperparameter tuning [Klein et al., 2017; Nguyen, 2019; Turner et al.,…”
Creative Adaptation through Learning
Cully, A. (2015) · theses.fr (ABES) · doi:10.70675/f17594caz64c7z42b0z815czd4caac624298 · Cited by 4
Efficient Bayesian Function Optimization of Evolving Material Manufacturing Processes
Rubin, D., Nguyen, D., Vellanki, P., Li, C., Rana, S., Thompson, N., Gupta, S., Pringle, K. M., Subianto, S., Venkatesh, S., et al. (2019) · ACS Omega · doi:10.1021/acsomega.9b02439 · Cited by 1
Information-Aware Powered Descent Guidance for Entry, Descent and Landing
Hayner, C. R., Pavlasek, N., Leung, K., Acikmese, B. A., & Carson, J. M. (2025) · AIAA SciTech Forum · doi:10.2514/6.2025-1896 · Cited by 2
Automatic guided vehicles (AGVs) in the rail transit intelligent manufacturing environment
Liu, H. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-822968-2.00004-8 · Cited by 2
Lévy Flight Foraging Hypothesis-based Autonomous Large-scale Memoryless Search under Sparse Rewards
Alexis, K. (2020) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero47225.2020.9172790 · Cited by 1
Zhang, C., Márquez, F. P. G., & Zhang, L. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-99666-2.00007-1 · Cited by 1
Planning for multiple measurement channels in a continuous-state POMDP
Lauri, M., & Ritala, R. K. (2013) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-013-9361-y · Cited by 1
“Some problems, such as spatial motion planning [17, 18] or robot localization [34] problems, are naturally defined on continuous state spaces.”
BackgroundMethodBOhance: Bayesian Optimization for Content Enhancement
Mittal, T., Swaminathan, V., Sarkhel, S., Sinha, R., Arbour, D. T., Mitra, S., & Manocha, D. (2021) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism52913.2021.00010 · Cited by 2
Hedging Strategies for Bayesian OptimizationPreprint
Brochu, E., Hoffman, M. D., & de Freitas, N. (2010) · arXiv (Cornell University) · Cited by 1
Self-citationLearning rewards for robotic ultrasound scanning using probabilistic temporal rankingPreprint
Burke, M., Lu, K., Angelov, D., Straižys, A., Innes, C., Subr, K., & Ramamoorthy, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.01240 · Cited by 1
“GPs and Bayesian optimisation are often used together, with a GP acting as the surrogate model for a Bayesian optimisation planner, as in the mobile robot path planning approaches of [29] and [27].”
MethodExtending the Range of Drone-based Delivery Services by ExplorationPreprint
Au, T.-C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.09367 · Cited by 1
“[23] studied an optimal sensing scenario in which the robot’s objective is to gather sensing”
BayesOpt: A Library for Bayesian optimization with Robotics ApplicationsPreprint
Martínez-Cantín, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.0671
Neuroevolution of Sequential Behavior in Multi-Goal Navigation Task
Muratov, S., Lakhman, K., & Lakhman, M. (2014) · Conference on Artificial Life (ALIFE) · doi:10.1162/978-0-262-32621-6-ch125
New approach in modelling of the patients behavior in Primary Health Care (PHC)
Bauer, W. (2015) · Automatyka/Automatics · doi:10.7494/automat.2015.19.1.17
Lévy Flight Foraging Hypothesis-based Autonomous Memoryless Search Under Sparse RewardsPreprint
Papachristos, C., & Alexis, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.04825
Aprendizado Bayesiano aplicado ao controle de veículos autônomos de grande porte
da Rocha, F. H. M. (2018) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.18.2018.tde-06072018-112445 · Cited by 1
Metadata
- Authors
- Martinez-Cantin, R., de Freitas, N., Brochu, E., Castellanos, J., & Doucet, A.
- Affiliations
- University of British Columbia (CA)
- Universidad de Zaragoza (ES)
- Corresponding author
- Brochu, Eric
- ORCID
- Castellanos, José
- Venue
- Autonomous Robots
- Published
- 2009-08
- Volume
- 27
- Issue
- 2
- Pages
- 93-103
- ISSN
- 0929-5593 (ISSN-L)
- 1573-7527
- OpenAlex
- W2096649264
- Cited by
- 217
- References
- 62
- Citations by year
- 2025: 6 · 2024: 9 · 2023: 15 · 2022: 11 · 2021: 27 · 2020: 27 · 2019: 13 · 2018: 20 · 2017: 9 · 2016: 17 · 2015: 13 · 2014: 8 · 2013: 11 · 2012: 11
- FWCI
- 11.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Autonomous Robots (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Keywords
- online path planning, exploration-exploitation balance, Bayesian optimization, partially observable Markov decision processes, mobile robot localization, visual guidance, real-time planning, active vision, sequential design, dynamic sensing, sensor calibration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.