The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Conformal prediction beyond exchangeability
Open accessAbstract
Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model fitting algorithm as a function of the data. However, exchangeability is often violated when predictive models are deployed in practice. For example, if the data distribution drifts over time, then the data points are no longer exchangeable; moreover, in such settings, we might want to use a nonsymmetric algorithm that treats recent observations as more relevant. This paper generalizes conformal prediction to deal with both aspects: we employ weighted quantiles to introduce robustness against distribution drift, and design a new randomization technique to allow for algorithms that do not treat data points symmetrically. Our new methods are provably robust, with substantially less loss of coverage when exchangeability is violated due to distribution drift or other challenging features of real data, while also achieving the same coverage guarantees as existing conformal prediction methods if the data points are in fact exchangeable. We demonstrate the practical utility of these new tools with simulations and real-data experiments on electricity and election forecasting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distribution-Free Predictive Inference for Regression
Lei, J., G’Sell, M., Rinaldo, A., Tibshirani, R. J., & Wasserman, L. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1307116 · Cited by 1,049
Self-citationConformal Prediction: A Gentle Introduction
Angelopoulos, A. N., & Bates, S. (2023) · Foundations and Trends in Machine Learning · doi:10.1561/2200000101 · Cited by 740
Predictive inference with the jackknife+
Barber, R. F., Candès, E. J., Ramdas, A., & Tibshirani, R. J. (2021) · The Annals of Statistics · doi:10.1214/20-aos1965 · Cited by 351
Self-citationDistribution Free Prediction Sets
Lei, J., Robins, J., & Wasserman, L. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.751873 · Cited by 282
Distribution-free Prediction Bands for Non-parametric Regression
Lei, J., & Wasserman, L. (2014) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12021 · Cited by 243
Conformalized Quantile Regression
Romano, Y., Patterson, E., & Candès, E. J. (2019) · arXiv · doi:10.48550/arxiv.1905.03222 · Cited by 236 · cited 2×
“Conformal prediction was pioneered by Vladimir Vovk and various collaborators in the early 2000s; the book by Vovk et al. [2005] details their advances and remains a critical resource.”
BackgroundSelf-citationConformal Prediction Under Covariate ShiftPreprint
Tibshirani, R. J., Barber, R. F., Candès, E. J., & Ramdas, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.06019 · Cited by 210
Self-citationVovk, V. (2015) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-013-9368-4 · Cited by 166
Conformal Inference of Counterfactuals and Individual Treatment Effects
Lei, L., & Candès, E. J. (2021) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12445 · Cited by 166
Self-citationTesting for outliers with conformal p-values
Bates, S., Candès, E. J., Lei, L., Romano, Y., & Sesia, M. (2023) · The Annals of Statistics · doi:10.1214/22-aos2244 · Cited by 165
Self-citation
Cited by
Lambert, B., Forbes, F., Doyle, S., Dehaene, H., & Dojat, M. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102830 · Cited by 269
Reliable Text-to-SQL with Adaptive Abstention
Chen, K., Chen, Y., Koudas, N., & Yu, X. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3709719 · Cited by 12
A Robust Conformal Framework for IoT-Based Predictive Maintenance
Moccardi, A., Conte, C., Chandra Ghosh, R., & Moscato, F. (2025) · Future Internet · doi:10.3390/fi17060244 · Cited by 12
Conformal Performance Range Prediction for Segmentation Output Quality Control
Wundram, A. M., Fischer, P., Muehlebach, M., Koch, L. M., & Baumgartner, C. F. (2024) · arXiv · doi:10.48550/arxiv.2407.13307 · Cited by 3
Metadata
- Authors
- Barber, R. F., Candès, E. J., Ramdas, A., & Tibshirani, R. J.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2023-04-01
- Volume
- 51
- Issue
- 2
- Pages
- 816-845
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W4380490520
- Cited by
- 305
- References
- 24
- FWCI
- 59.61
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Conformal prediction beyond exchangeability. https://app.cochat.ai/papers/10.1214/23-aos2276
- The paper
- Barber, R. F., Candès, E. J., Ramdas, A., & Tibshirani, R. J. (2023). Conformal prediction beyond exchangeability. The Annals of Statistics. https://doi.org/10.1214/23-aos2276
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.