The Eighty Five Percent Rule for optimal learning
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Researchers and educators have long wrestled with the question of how best to teach their clients be they humans, non-human animals or machines. Here, we examine the role of a single variable, the difficulty of training, on the rate of learning. In many situations we find that there is a sweet spot in which training is neither too easy nor too hard, and where learning progresses most quickly. We derive conditions for this sweet spot for a broad class of learning algorithms in the context of binary classification tasks. For all of these stochastic gradient-descent based learning algorithms, we find that the optimal error rate for training is around 15.87% or, conversely, that the optimal training accuracy is about 85%. We demonstrate the efficacy of this ‘Eighty Five Percent Rule’ for artificial neural networks used in AI and biologically plausible neural networks thought to describe animal learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
The origins of intelligence in children.
Piaget, J. (1952) · doi:10.1037/11494-000 · Cited by 10,687
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 4×
“More generally, our work closely to the Region of Proximal Learning and Desirable Difficulty frameworks in education [25–27] and Curriculum Learning and Self-Paced Learning [7, 8] in computer science.”
BackgroundMethodInfluentialMaass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
Self-citationLearning and development in neural networks: the importance of starting small
Elman, J. L. (1993) · Cognition · doi:10.1016/0010-0277(93)90058-4 · Cited by 1,988
Newsome, W., & Pare, E. (1988) · The Journal of Neuroscience · doi:10.1523/jneurosci.08-06-02201.1988 · Cited by 1,615
Cited by
Predicting Game Difficulty and Churn Without Players
Roohi, S., Relas, A., Takatalo, J., Heiskanen, H., & Hämäläinen, P. (2020) · Proceedings of the Annual Symposium on Computer-Human Interaction in Play · doi:10.1145/3410404.3414235 · Cited by 34
“, in artificial neurons, also posits a flow-channel style difficulty model [47], identifying 85% success rate as optimal.”
BackgroundThe Memory Paradox: Why Our Brains Need Knowledge in an Age of AI
Oakley, B., Johnston, M., Chen, K., Jung, E., & Sejnowski, T. (2025) · doi:10.2139/ssrn.5250447 · Cited by 31
Adaptation to stressors: Hormesis as a framework for human performance
Hill, Y., Kiefer, A. W., Oudejans, R. R. D., Baetzner, A. S., & Den Hartigh, R. J. R. (2024) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2024.101073 · Cited by 17
Metadata
- Authors
- Wilson, R. C., Shenhav, A., Straccia, M., & Cohen, J. D.
- Venue
- Nature Communications
- Published
- 2019-11-05
- Volume
- 10
- Issue
- 1
- Pages
- 4646-4646
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W2988893955
- Cited by
- 119
- References
- 14
- FWCI
- 5.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Eighty Five Percent Rule for optimal learning. https://app.cochat.ai/papers/10.1038/s41467-019-12552-4
- The paper
- Wilson, R. C., Shenhav, A., Straccia, M., & Cohen, J. D. (2019). The Eighty Five Percent Rule for optimal learning. Nature Communications. https://doi.org/10.1038/s41467-019-12552-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.