The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Transfer in Reinforcement Learning: A Framework and a Survey
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 4×
“Unlike other learning paradigms (see Pan and Yang (2010) for a review of the possible settings in supervised learning), an RL problem is defined by different elements such as the dynamics and the reward, and the tasks in M may differ in a number of possible ways depending on the similarities and…”
BackgroundInfluentialWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
Prediction, Learning, and Games
Cesa-Bianchi, N., & Lugosi, G. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546921 · Cited by 3,162
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
Schema induction and analogical transfer
Gick, M. L., & Holyoak, K. J. (1983) · Cognitive Psychology · doi:10.1016/0010-0285(83)90002-6 · Cited by 3,010 · cited 1×
“On the other hand, taking inspiration from studies in psychology and neuroscience (Gentner et al, 2003; Gick and Holyoak, 1983), the transfer point of view, where learning tasks are assumed to be related and knowledge is retained and transferred, is considered as the most suitable perspective to design effective techn…”
BackgroundConvex multi-task feature learning
Argyriou, A., Evgeniou, T., & Pontil, M. (2008) · Machine Learning · doi:10.1007/s10994-007-5040-8 · Cited by 1,528
Transfer Learning for Reinforcement Learning Domains: A Survey
Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,488
Tree-Based Batch Mode Reinforcement Learning
Ernst, D., Geurts, P., & Wehenkel, L. A. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1088690 · Cited by 1,352
International Encyclopedia of Education
(1986) · Oxford Review of Education · doi:10.1080/0305498860120107 · Cited by 1,258
The International Encyclopedia of Education
Batho, G. R., Husen, T., & Postlethwaite, T. N. (1994) · British Journal of Educational Studies · doi:10.2307/3121682 · Cited by 1,250
The influence of improvement in one mental function upon the efficiency of other functions. (I).
Woodworth, R. S., & Thorndike, E. L. (1901) · Psychological Review · doi:10.1037/h0074898 · Cited by 1,223
Transfer of Learning: Cognition, Instruction, and Reasoning
Haskell, R. E. (2011) · Cited by 951
Learning and transfer: A general role for analogical encoding.
Gentner, D., Loewenstein, J., & Thompson, L. (2003) · Journal of Educational Psychology · doi:10.1037/0022-0663.95.2.393 · Cited by 865
Near-optimal Regret Bounds for Reinforcement Learning
Jaksch, T., Ortner, R., & Auer, P. L. (2010) · Cited by 784
A Model of Inductive Bias Learning
Baxter, J. (2000) · Cited by 730
Intrinsically Motivated Reinforcement Learning
Singh, S., Barto, A. G., & Chentanez, N. (2005) · doi:10.21236/ada440280 · Cited by 610
A model of inductive bias learning
Baxter, J. (2000) · Journal of Artificial Intelligence Research · doi:10.1613/jair.731 · Cited by 582
Finite-Time Bounds for Fitted Value Iteration
Munos, R., & Szepesvári, C. (2008) · SZTAKI Publication Repository (Hungarian Academy of Sciences) · doi:10.5555/1390681.1390708 · Cited by 474
Automatic Discovery of Subgoals in Reinforcement Learning using Diverse Density
McGovern, A., & Barto, A. G. (2001) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 418
Reinforcement Learning for RoboCup Soccer Keepaway
Stone, P., Sutton, R. S., & Kuhlmann, G. (2005) · Adaptive Behavior · doi:10.1177/105971230501300301 · Cited by 387
Mahadevan, S., & Maggioni, M. (2007) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.5555/1314498.1314570 · Cited by 374
Reinforcement learning with Gaussian processes
Engel, Y., Mannor, S., & Meir, R. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102377 · Cited by 335
Doncieux, S., Girard, B., Guillot, A., Hallam, J. C. T., Meyer, J.-A., & Mouret, J.-B. (2008) · Cited by 312
Peters, J., Vijayakumar, S., & Schaal, S. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564096_29 · Cited by 307
Shift of bias for inductive concept learning
Utgoff, P. E. (1984) · Cited by 279
Learning from Multiple Sources
Crammer, K., Kearns, M., & Wortman, J. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0045 · Cited by 266
Multi-task reinforcement learning: a hierarchical Bayesian approach
Wilson, A., Fern, A., Ray, S., & Tadepalli, P. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273624 · Cited by 261
Identifying useful subgoals in reinforcement learning by local graph partitioning
Şimşek, Ö., Wolfe, A. P., & Barto, A. G. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102454 · Cited by 238
Building portable options: skill transfer in reinforcement learning
Konidaris, G., & Barto, A. G. (2007) · Cited by 220
Antos, A., Szepesvári, C., & Munos, R. (2008) · Machine Learning · doi:10.1007/s10994-007-5038-2 · Cited by 219
Q-Cut—Dynamic Discovery of Sub-goals in Reinforcement Learning
Menache, I., Mannor, S., & Shimkin, N. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-36755-1_25 · Cited by 218
Thorndike, E. L., & Woodworth, R. S. (1901) · Psychological Review · doi:10.1037/h0071280 · Cited by 200
Transfer Learning via Inter-Task Mappings for Temporal Difference Learning
Taylor, M. E., Stone, P., & Liu, Y. (2007) · doi:10.5555/1314498.1314569 · Cited by 195
Autonomous shaping: knowledge transfer in reinforcement learning
Konidaris, G., & Barto, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143906 · Cited by 184
Transfer of samples in batch reinforcement learning
Lazaric, A., Restelli, M., & Bonarini, A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390225 · Cited by 163
Self-citationTransferring Instances for Model-Based Reinforcement Learning
Taylor, M. E., Jong, N. K., & Stone, P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87481-2_32 · Cited by 139
Transfer via inter-task mappings in policy search reinforcement learning
Taylor, M. E., Whiteson, S., & Stone, P. (2007) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1329125.1329170 · Cited by 136
REGAL: A Regularization based Algorithm for Reinforcement Learning in Weakly Communicating MDPsPreprint
Bartlett, P. L., & Tewari, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2661 · Cited by 132
Behavior transfer for value-function-based reinforcement learning
Taylor, M. E., & Stone, P. (2005) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1082473.1082482 · Cited by 123
Multi-task Reinforcement Learning in Partially Observable Stochastic Environments
Li, H., Liao, X., & Carin, L. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577109 · Cited by 111
Autonomous transfer for reinforcement learning
Taylor, M. E., Kuhlmann, G., & Stone, P. (2008) · doi:10.5555/1402383.1402427 · Cited by 111
Farahmand, A. M., Ghavamzadeh, M., Mannor, S., & Szepesvári, C. (2008) · Cited by 110
A notion of task relatedness yielding provable multiple-task learning guarantees
Ben-David, S., & Schuller, R. (2008) · Machine Learning · doi:10.1007/s10994-007-5043-5 · Cited by 103
General game learning using knowledge transfer
Banerjee, B., & Stone, P. (2007) · Cited by 103
Using Advice to Transfer Knowledge Acquired in One Reinforcement Learning Task to Another
Torrey, L. A., Walker, T., SHAVLIK, J. W., & Maclin, R. (2005) · Lecture notes in computer science · doi:10.1007/11564096_40 · Cited by 103
Accelerating Reinforcement Learning by Composing Solutions of Automatically Identified Subtasks
Drummond, C. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.904 · Cited by 102
Bayesian Multi-Task Reinforcement Learning
Lazaric, A., & Ghavamzadeh, M. (2010) · Cited by 97
Self-citationTransfer in variable-reward hierarchical reinforcement learning
Mehta, N., Natarajan, S., Tadepalli, P. V., & Fern, A. (2008) · Machine Learning · doi:10.1007/s10994-008-5061-y · Cited by 96
Improving action selection in MDP's via knowledge transfer
Sherstov, A. A., & Stone, P. (2005) · National Conference on Artificial Intelligence · Cited by 79
Accelerating Reinforcement Learning by Composing Solutions of Automatically Identified Subtasks
Drummond, C. (2002) · Cited by 76
Transfer of Experience Between Reinforcement Learning Environments with Progressive Difficulty
Madden, M. G., & Howley, T. (2004) · Artificial Intelligence Review · doi:10.1023/b:aire.0000036264.95672.64 · Cited by 75
Value functions for RL-based behavior transfer: a comparative study
Taylor, M. E., Stone, P., & Liu, Y. (2005) · Cited by 69
Using Homomorphisms to transfer options across continuous reinforcement learning domains
Soni, V. D., & Singh, S. P. (2006) · Cited by 63
Skill Acquisition Via Transfer Learning and Advice Taking
Torrey, L. A., SHAVLIK, J. W., Walker, T., & Maclin, R. (2006) · Lecture notes in computer science · doi:10.1007/11871842_41 · Cited by 60
Structure in the Space of Value Functions
Foster, D. J., & Dayan, P. (2002) · Machine Learning · doi:10.1023/a:1017944732463 · Cited by 54
An experts algorithm for transfer learning
Talvitie, E., & Singh, S. P. (2007) · Cited by 47
Relativized options: choosing the right transformation
Ravindran, B., & Barto, A. G. (2003) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 47
Proto-transfer Learning in Markov Decision Processes Using Spectral Methods
Ferguson, K., & Mahadevan, S. (2006) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 46
Effective control knowledge transfer through learning skill and representation hierarchies
Asadi, M., & Huber, M. (2007) · Cited by 42
Representation Transfer for Reinforcement Learning
Taylor, M. E., & Stone, P. (2007) · National Conference on Artificial Intelligence · Cited by 34
Incremental Skill Acquisition for Self-motivated Learning Animats
Bonarini, A., Lazaric, A., & Restelli, M. (2006) · Lecture notes in computer science · doi:10.1007/11840541_30 · Cited by 22
Self-citationDiscovering hierarchy in reinforcement learning
Hengst, B. (2003) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/21510 · Cited by 14
Requirements for Machine Lifelong Learning
Silver, D. L., & Poirier, R. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73053-8_31 · Cited by 12
Cited by
A survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987
Transfer Learning in Deep Reinforcement Learning: A Survey
Zhu, Z., Lin, K., Jain, A. K., & Zhou, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3292075 · Cited by 861
“As pioneer surveys for TL in RL, neither [11] nor [12] covered recent research over the last decade.”
BackgroundMethodReinforcement Learning: State-of-the-Art
(2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3 · Cited by 691
Q-Learning Algorithms: A Comprehensive Classification and Applications
Jang, B., Kim, M., Harerimana, G., & Kim, J. W. (2019) · IEEE Access · doi:10.1109/access.2019.2941229 · Cited by 635
Model-based Reinforcement Learning: A Survey
M. Moerland, T., Broekens, J., Plaat, A., & M. Jonker, C. (2023) · Foundations and Trends in Machine Learning · doi:10.1561/2200000086 · Cited by 524
Metadata
- Authors
- Lazaric, A.
- Venue
- Adaptation, Learning, and Optimization
- Publisher
- Springer Berlin Heidelberg
- Published
- 2012
- Pages
- 143-173
- ISSN
- 1867-4534 (ISSN-L)
- 1867-4542
- OpenAlex
- W158722652
- Cited by
- 256
- References
- 66
- FWCI
- 10.93
- Type
- book chapter
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.