Value-Consistent Representation Learning for Data-Efficient Reinforcement Learning
Open accessAbstract
Deep reinforcement learning (RL) algorithms suffer severe performance degradation when the interaction data is scarce, which limits their real-world application. Recently, visual representation learning has been shown to be effective and promising for boosting sample efficiency in RL. These methods usually rely on contrastive learning and data augmentation to train a transition model for state prediction, which is different from how the model is used in RL--performing value-based planning. Accordingly, the learned representation by these visual methods may be good for recognition but not optimal for estimating state value and solving the decision problem. To address this issue, we propose a novel method, called value-consistent representation learning (VCR), to learn representations that are directly related to decision-making. More specifically, VCR trains a model to predict the future state (also referred to as the ''imagined state'') based on the current one and a sequence of actions. Instead of aligning this imagined state with a real state returned by the environment, VCR applies a $Q$-value head on both states and obtains two distributions of action values. Then a distance is computed and minimized to force the imagined state to produce a similar action value prediction as that by the real state. We develop two implementations of the above idea for the discrete and continuous action spaces respectively. We conduct experiments on Atari 100K and DeepMind Control Suite benchmarks to validate their effectiveness for improving sample efficiency. It has been demonstrated that our methods achieve new state-of-the-art performance for search-free RL algorithms.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 3× · see citing works
“Actor loss, critic loss, and Value-Consistent loss are optimized separately by three Adam optimizers [24], where the batch size for the actor-critic update is 512 and the batch size for VCR update is 128.”
MethodInfluentialHuman-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 6× · see citing works
“Later, Data-Efficient Rainbow (van Hasselt, Hessel, and Aslanides 2019) and OTRainbow (Kielak 2020) show that Rainbow DQN with hyperparameter tuning can be a strong baseline for the low-data regime by simply increasing the number of steps in multi-step return and allowing more frequent parameter update.”
BackgroundInfluentialA simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857 · see citing works
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,821 · see citing works
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846 · cited 4× · see citing works
“In contrastive learning, prediction head, which only follows the online branch, introduces asymmetry into the network architecture to avoid collapsed solutions (Grill et al. 2020).”
BackgroundInfluentialThe Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161 · cited 5× · see citing works
“Specifically, we choose Atari 100K [4, 22] for discrete control tasks and DeepMind Control 100K Suite [38] for continuous suite.”
MethodInfluentialSoft Actor-Critic Algorithms and Applications
Haarnoja, T., Zhou, A., Hartikainen, K., Tucker, G., Ha, S., Tan, J., Kumar, V., Zhu, H., Gupta, A., Abbeel, P., et al. (2018) · arXiv · doi:10.48550/arxiv.1812.05905 · Cited by 1,994 · cited 6× · see citing works
“We demonstrate the effectiveness of the idea with two concrete implementations based on Rainbow DQN (Hessel et al. 2018) and Soft Actor-Critic (SAC) (Haarnoja et al. 2018).”
BackgroundMethodInfluentialRainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846 · cited 8× · see citing works
“Later, Data-Efficient Rainbow (van Hasselt, Hessel, and Aslanides 2019) and OTRainbow (Kielak 2020) show that Rainbow DQN with hyperparameter tuning can be a strong baseline for the low-data regime by simply increasing the number of steps in multi-step return and allowing more frequent parameter update.”
BackgroundMethodInfluentialMastering Atari, Go, chess and shogi by planning with a learned model
Schrittwieser, J., Antonoglou, I., Hubert, T., Simonyan, K., Sifre, L., Schmitt, S., Guez, A., Lockhart, E., Hassabis, D., Graepel, T., et al. (2020) · RePEc: Research Papers in Economics · Cited by 1,310 · see citing works
Multi-Task Learning as Multi-Objective Optimization
Sener, O., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1810.04650 · Cited by 852 · cited 3× · see citing works
“The above , which adopt the same form with n -step estimation of Q -learning to mitigate possible gradient conflict in multi-task learning(Sener and Koltun 2018; Yu et al. 2020; Jean, Firat, and Johnson 2019).”
BackgroundReinforcement Learning with Unsupervised Auxiliary TasksPreprint
Jaderberg, M., Mnih, V., Czarnecki, W. M., Schaul, T., Leibo, J. Z., Silver, D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05397 · Cited by 826 · cited 2× · see citing works
“To enable deep RL to go beyond virtual games and simulators, researchers explore the data efficiency issue from various perspectives, including model-based RL [16, 15, 22], auxiliary tasks [20, 41], self-supervised training for representation [25, 28, 33, 44, 29], etc.”
BackgroundLearning Latent Dynamics for Planning from Pixels
Hafner, D., Lillicrap, T., Fischer, I., Villegas, R., Ha, D., Lee, H., & Davidson, J. (2018) · arXiv · doi:10.48550/arxiv.1811.04551 · Cited by 708 · cited 4× · see citing works
“…deep RL to go beyond virtual games and simulators, researchers explore the data efficiency issue from various perspectives, including model-based RL (Hafner et al. 2019, 2020; Kaiser et al. 2020), auxiliary tasks (Jaderberg et al. 2016; Yarats et al. 2021; Laskin, Srinivas, and Abbeel 2020;…”
BackgroundMethodInfluentialNoisy Networks for ExplorationPreprint
Fortunato, M., Azar, M. G., Piot, B., Menick, J., Osband, I., Graves, A., Mnih, V., Munos, R., Hassabis, D., Pietquin, O., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10295 · Cited by 664 · cited 2× · see citing works
“For Q head, noisy parameters [11] are reserved because we verify that the noisy q-value output does not have any negative influence on ValueConsistent representation learning (see Appendix B.”
BackgroundDream to Control: Learning Behaviors by Latent Imagination
Hafner, D., Lillicrap, T., Ba, J., & Norouzi, M. (2019) · arXiv · doi:10.48550/arxiv.1912.01603 · Cited by 558 · cited 5× · see citing works
“…deep RL to go beyond virtual games and simulators, researchers explore the data efficiency issue from various perspectives, including model-based RL (Hafner et al. 2019, 2020; Kaiser et al. 2020), auxiliary tasks (Jaderberg et al. 2016; Yarats et al. 2021; Laskin, Srinivas, and Abbeel 2020;…”
BackgroundMethodInfluentialCURL: Contrastive Unsupervised Representations for Reinforcement LearningPreprint
Srinivas, A., Laskin, M., & Abbeel, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.04136 · Cited by 521 · cited 13× · see citing works
“…et al. 2016; Yarats et al. 2021; Laskin, Srinivas, and Abbeel 2020; Schwarzer et al. 2021), data augmentation (Yarats, Kostrikov, and Fergus 2021; Laskin et al. 2020 Despite its effectiveness, it solely focuses on learning discriminative state features, ignoring the fact that some information…”
BackgroundMethodInfluentialTassa, Y., Doron, Y., Muldal, A., Erez, T., Li, Y., Casas, D. D. L., Budden, D., Abdolmaleki, A., Merel, J., Lefrancq, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1801.00690 · Cited by 497 · cited 2× · see citing works
“Further, we empirically evaluate the performance of our VCR on boosting data efficiency in Atari 100K (Bellemare et al. 2013; Kaiser et al. 2020) and DeepMind Control Suite (Tassa et al. 2018).”
MethodTamar, A., Wu, Y., Thomas, G., Levine, S., & Abbeel, P. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/700 · Cited by 484 · cited 3× · see citing works
“Several empirically successful works like VPN [31], VIN [37] and MuZero [32] can be viewed as the instances that follow the value equivalence principle when considering diverse forms of Bellman operators and value approximations.”
BackgroundModel-Based Reinforcement Learning for Atari
Kaiser, L., Babaeizadeh, M., Milos, P., Osinski, B., Campbell, R. H., Czechowski, K., Erhan, D., Finn, C., Kozakowski, P., Levine, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1903.00374 · Cited by 467 · cited 14× · see citing works
“Specifically, we choose Atari 100K [4, 22] for discrete control tasks and DeepMind Control 100K Suite [38] for continuous suite.”
BackgroundMethodInfluentialReinforcement Learning with Augmented Data
Laskin, M., Lee, K., Stooke, A., Pinto, L., Abbeel, P., & Srinivas, A. (2020) · arXiv · doi:10.48550/arxiv.2004.14990 · Cited by 299 · cited 2× · see citing works
“Recently, leveraging computer vision techniques is drawing increasingly more attention from the community to boost representation learning in RL [40, 26, 41, 25, 33, 29, 43, 44, 42].”
BackgroundImage Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Kostrikov, I., Yarats, D., & Fergus, R. (2020) · arXiv · doi:10.48550/arxiv.2004.13649 · Cited by 267 · cited 18× · see citing works
“Recently, leveraging computer vision techniques is drawing increasingly more attention from the community to boost representation learning in RL [40, 26, 41, 25, 33, 29, 43, 44, 42].”
BackgroundMethodInfluentialAgent57: Outperforming the Atari Human BenchmarkPreprint
Badia, A. P., Piot, B., Kapturowski, S., Sprechmann, P., Vitvitskyi, A., Guo, D., & Blundell, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13350 · Cited by 216 · cited 2× · see citing works
“With the state-of-the-art RL algorithms, simple tasks such as video games in Arcade Learning Environment (Bellemare et al. 2013) require billions of frames to achieve human-level performance (Badia et al. 2020).”
BackgroundMethodThe Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2012) · arXiv · doi:10.48550/arxiv.1207.4708 · Cited by 187 · cited 5× · see citing works
“Specifically, we choose Atari 100K [4, 22] for discrete control tasks and DeepMind Control 100K Suite [38] for continuous suite.”
MethodInfluentialThe Predictron: End-To-End Learning and PlanningPreprint
Silver, D., van Hasselt, H. P., Hessel, M., Schaul, T., Guez, A., Harley, T., Dulac-Arnold, G., Reichert, D., Rabinowitz, N. C., Barreto, A. D. M. S., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.08810 · Cited by 187 · see citing works
Stochastic latent actor–critic: Deep reinforcement learning with a latent variable model
Lee, A. X., Nagabandi, A., Abbeel, P., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1907.00953 · Cited by 159 · cited 3× · see citing works
“In RL, except jointly optimizing network with RL loss, representation learning can also be used to pretrain the the encoder (Lee et al. 2020).”
MethodImage Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Yarats, D., Kostrikov, I., & Fergus, R. (2021) · International Conference on Learning Representations · Cited by 156 · see citing works
Deep Reinforcement Learning at the Edge of the Statistical Precipice
Agarwal, R., Schwarzer, M., Castro, P. S., Courville, A., & Bellemare, M. G. (2021) · arXiv · doi:10.48550/arxiv.2108.13264 · Cited by 142 · cited 5× · see citing works
“Besides, IQM has a smaller confidence interval (CI) and can detect a given improvement with far fewer runs [1].”
BackgroundMethodInfluentialValue Prediction NetworkPreprint
Oh, J., Singh, S. P., & Lee, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.03497 · Cited by 119 · cited 2× · see citing works
“Several empirically successful works like VPN (Oh, Singh, and Lee 2017), VIN (Tamar et al. 2016) and MuZero (Schrittwieser et al. 2020) can be viewed as the instances that follow the value equivalence principle when considering diverse forms of Bellman operators and value approximations.”
BackgroundImproving Sample Efficiency in Model-Free Reinforcement Learning from Images
Yarats, D., Zhang, A., Kostrikov, I., Amos, B., Pineau, J., & Fergus, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17276 · Cited by 108 · cited 7× · see citing works
“Recently, leveraging computer vision techniques is drawing increasingly more attention from the community to boost representation learning in RL [40, 26, 41, 25, 33, 29, 43, 44, 42].”
BackgroundMethodInfluentialData-Efficient Reinforcement Learning with Self-Predictive RepresentationsPreprint
Schwarzer, M., Anand, A., Goel, R., Hjelm, R. D., Courville, A. C., & Bachman, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05929 · Cited by 103 · cited 14× · see citing works
“More recently, SPR [33] and KSL [29] make a more sophisticated design by employing contrastive loss in transition model learning.”
BackgroundMethodInfluentialMastering Atari Games with Limited Data
Ye, W., Liu, S., Kurutach, T., Abbeel, P., & Gao, Y. (2021) · arXiv · doi:10.48550/arxiv.2111.00210 · Cited by 68 · cited 6× · see citing works
“Recently, leveraging computer vision techniques is drawing increasingly more attention from the community to boost representation learning in RL [40, 26, 41, 25, 33, 29, 43, 44, 42].”
BackgroundMethodInfluentialValue-Aware Loss Function for Model-based Reinforcement Learning
Farahmand, A. M., Barreto, A. D. M. S., & Nikovski, D. N. (2017) · PolyPublie (École Polytechnique de Montréal) · Cited by 46 · see citing works
Adaptive Scheduling for Multi-Task LearningPreprint
Jean, S., Fırat, O., & Johnson, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06434 · Cited by 38 · cited 3× · see citing works
“The above , which adopt the same form with n -step estimation of Q -learning to mitigate possible gradient conflict in multi-task learning(Sener and Koltun 2018; Yu et al. 2020; Jean, Firat, and Johnson 2019).”
BackgroundDo recent advancements in model-based deep reinforcement learning really improve data efficiency?Preprint
Kielak, K. (2019) · arXiv (Cornell University) · Cited by 29 · see citing works
PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement LearningPreprint
Yu, T., Lan, C., Zeng, W., Feng, M., Zhang, Z., & Chen, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04152 · Cited by 23 · cited 15× · see citing works
“As a follow-up, PlayVirtual (Yu et al. 2021) introduces a back-ward prediction model that enables the agent to imagine forward and backward to form a cycle.”
BackgroundMethodInfluentialIterative Value-Aware Model Learning
Farahmand, A. (2018) · PolyPublie (École Polytechnique de Montréal) · Cited by 22 · see citing works
The Value Equivalence Principle for Model-Based Reinforcement LearningPreprint
Grimm, C., Barreto, A. D. M. S., Singh, S. P., & Silver, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03506 · Cited by 19 · cited 5× · see citing works
“[13] come up with the value equivalence principle which forces the learned transition model to have the same Bellman operator updates with the real environment model conditioned on a set of value functions and policies.”
BackgroundInfluentialMuesli: Combining Improvements in Policy OptimizationPreprint
Hessel, M., Danihelka, I., Viola, F., Guez, A., Schmitt, S., Sifre, L., Weber, T., Silver, D., & van Hasselt, H. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06159 · Cited by 18 · cited 3× · see citing works
“Self-consistent models and values (Farquhar et al. 2021) boosts the performance of Muesli agent (Hessel et al. 2021) by encouraging a value function to satisfy the Bellman equation under a learned transition model and a learned policy.”
BackgroundFast and Data Efficient Reinforcement Learning from Pixels via Non-parametric Value Approximation
Long, A., Blair, A., & van Hoof, H. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20728 · Cited by 3 · see citing works
Learning Temporally-Consistent Representations for Data-Efficient Reinforcement LearningPreprint
McInroe, T., Schäfer, L., & Albrecht, S. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04935 · Cited by 2 · cited 5× · see citing works
“More recently, SPR [33] and KSL [29] make a more sophisticated design by employing contrastive loss in transition model learning.”
BackgroundMethodInfluentialSelf-Consistent Models and ValuesPreprint
Farquhar, G., Baumli, K., Marinho, Z., Filos, A., Hessel, M., van Hasselt, H. P., & Silver, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.12840 · Cited by 2 · cited 2× · see citing works
“Self-consistent models and values (Farquhar et al. 2021) boosts the performance of Muesli agent (Hessel et al. 2021) by encouraging a value function to satisfy the Bellman equation under a learned transition model and a learned policy.”
BackgroundGradient Surgery for Multi-Task Learning
Yu, T., Kumar, S., Gupta, A., Levine, S., Hausman, K., & Finn, C. (2020) · arXiv · doi:10.48550/arxiv.2001.06782 · cited 3×
“The above , which adopt the same form with n -step estimation of Q -learning to mitigate possible gradient conflict in multi-task learning(Sener and Koltun 2018; Yu et al. 2020; Jean, Firat, and Johnson 2019).”
Background
Flagged first, then by citations
4 of the 45 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Laskin, M.; Srinivas, A.; and Abbeel, P. 2020. Curl: Con- trastive unsupervised representations for reinforcement learn- ing. In ICML.
- van Hasselt, H. P.; Hessel, M.; and Aslanides, J. 2019. When to use parametric models in reinforcement learning? NeurIPS.
- NeurIPS.
Cited by
Sorted by citations
How Far is Video Generation from World Model: A Physical Law Perspective
Kang, B., Yue, Y., Lu, R., Lin, Z., Zhao, Y., Wang, K., Huang, G., & Feng, J. (2024) · arXiv · doi:10.48550/arxiv.2411.02385 · Cited by 7 · see citing works
“Previously, they often operated in an abstracted space and were used in reinforcement learning (Sutton, 2018) to enable planning (Silver et al., 2016; Schrittwieser et al., 2020) or facilitate policy learning through virtual interactions (Hafner et al., 2019; 2020; Yue et al., 2023).”
Self-citationDoes Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?
Yue, Y., Chen, Z., Lu, R., Zhao, A., Wang, Z., Yue, Y., Song, S., & Huang, G. (2025) · arXiv · doi:10.48550/arxiv.2504.13837 · Cited by 3 · see citing works
“Traditional RL such as AlphaGo Zero and the DQN series (Silver et al., 2017; Mnih et al., 2015; Yue et al., 2023) can continuously improve the performance of a policy in environments like Go and Atari games without an explicit upper bound .”
Self-citationEfficient Decision Sequence Modeling via Feature-LevelMasking
Zhang, X., Gao, Y., Hou, Y., et al. (2025) · doi:10.1145/3772429.3772438 · Cited by 1 · see citing works
Liu, X., Chen, Y., Li, H., & Zhao, D. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4380-4 · Cited by 1 · see citing works
“Different from most recent advanced methods (e.g., TACO [49], MLR [47], and VCR [48]), our LFS doesn’t rely on actions or re-wards to compute auxiliary objectives, having more application scenarios where actions are absent.”
InfluentialSample-Efficient Unsupervised Policy Cloning from Ensemble Self-Supervised Labeled Videos
Liu, X., Chen, Y., & Li, H. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127791
Li, D., Zhang, Q., Ma, Y., et al. (2025) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar65431.2025.11139421
- Authors
- Yue, Y., Kang, B., Xu, Z., Huang, G., & Yan, S.
- Affiliations
- Tsinghua University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Volume
- 37
- Issue
- 9
- Pages
- 11069-11077
- ISSN
- 2159-5399 (ISSN-L)
- arXiv
- 2206.12542
- OpenAlex
- W4382202869
- Semantic Scholar
- e3c598f5233d91f887edb626bb02ba86010a69c0
- Cited by
- 4
- References
- 45
- Citations by year
- 2025: 4
- FWCI
- 0.71
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Keywords
- data-efficient reinforcement learning, sample efficiency, visual representation learning, value-based planning, transition model
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
