Incentivizing Exploration In Reinforcement Learning With Deep Predictive Models
Open accessThe DOI matches its OpenAlex record; 15 of the 15 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
(2006) · Cited by 3,624
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161 · cited 3×
“We evaluate our approach on 14 games from the Arcade Learning Environment [22].”
MethodInfluentialNear-Optimal Reinforcement Learning in Polynomial Time
Kearns, M., & Singh, S. (2002) · Machine Learning · doi:10.1023/a:1017984413808 · Cited by 792
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303765208377 · Cited by 467
An analysis of model-based Interval Estimation for Markov Decision Processes
Strehl, A. L., & Littman, M. L. (2008) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2007.08.009 · Cited by 428 · cited 3×
“We are interested in finding a policy π : S × A → [0 , 1] that maximizes the expected reward over all time.”
BackgroundMethodDeep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning
Guo, X., Singh, S. P., Lee, H., Lewis, R. L., & Wang, X. (2014) · neural information processing systems · Cited by 368
Practical Reinforcement Learning in Continuous Spaces
Smart, W. D., & Kaelbling, L. P. (2000) · Cited by 244
Exploration in Model-based Reinforcement Learning by Empirically Estimating Learning ProgressPreprint
Lopes, M. C., Lang, T., Toussaint, M., & Oudeyer, P. (2012) · Cited by 206
Exploration in metric state spaces
Kakade, S. M., Kearns, M. J., & Langford, J. C. (2003) · ScholarlyCommons (University of Pennsylvania) · Cited by 107
Efficient Bayes-Adaptive Reinforcement Learning using Sample-Based Search
Guez, A., Silver, D., & Dayan, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.3109 · Cited by 85
Exploration in relational domains for model-based reinforcement learning
Lang, T., Toussaint, M., & Kersting, K. (2012) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · doi:10.5555/2503308.2503360 · Cited by 66
Variance-Based Rewards for Approximate Bayesian Reinforcement LearningPreprint
Sorg, J., Singh, S. P., & Lewis, R. L. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1203.3518 · Cited by 52
Nonparametric Bayesian Policy Priors for Reinforcement Learning
Doshi‐Velez, F., Wingate, D., Roy, N., & Tenenbaum, J. B. (2010) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 40
Cited by
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
“Although deep neural networks can potentially produce very complex and rich models [81, 112, 27], sometimes simpler, more data-efficient methods are preferable [34].”
InfluentialA Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
“…proposed methods for playing Atari with deep reinforcement learning, including deep Q-networks (DQN) (Mnih et al., 2013; 2015; Guo et al., 2014; Stadie et al., 2015; Nair et al., 2015; Bellemare et al., 2016), and the Double DQN algorithm (van Hasselt et al., 2016), which is the current…”
MethodBuilding machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Metadata
- Authors
- Stadie, B. C., Levine, S., & Abbeel, P.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2015-07-03
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1507.00814
- OpenAlex
- W779494576
- Cited by
- 280
- References
- 15
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.