The DOI matches its DataCite record; 25 of the 39 references it cites were found in a registry or an index.
A tutorial on conformal prediction
Open accessAbstract
Conformal prediction uses past experience to determine precise levels of confidence in new predictions. Given an error probability $ε$, together with a method that makes a prediction $\hat{y}$ of a label $y$, it produces a set of labels, typically containing $\hat{y}$, that also contains $y$ with probability $1-ε$. Conformal prediction can be applied to any method for producing $\hat{y}$: a nearest-neighbor method, a support-vector machine, ridge regression, etc. Conformal prediction is designed for an on-line setting in which labels are predicted successively, each one being revealed before the next is predicted. The most novel and valuable feature of conformal prediction is that if the successive examples are sampled independently from the same distribution, then the successive predictions will be right $1-ε$ of the time, even though they are based on an accumulating dataset rather than on independent datasets. In addition to the model under which successive examples are sampled independently, other on-line compression models can also use conformal prediction. The widely used Gaussian linear model is one of these. This tutorial presents a self-contained account of the theory of conformal prediction and works through several numerical examples. A more comprehensive treatment of the topic is provided in "Algorithmic Learning in a Random World", by Vladimir Vovk, Alex Gammerman, and Glenn Shafer (Springer, 2005).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It is a distribution‐free, post‐hoc framework that operates on saved model predictions, so it can be applied to any auto contouring algorithm without touching the model. 21”
From Uncertainty quantification of U‐Net based segmentation tool using conformal prediction (2026) · cites this paper as [20]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wu, Y., & Vapnik, V. N. (1999) · Technometrics · doi:10.2307/1271368 · Cited by 27,236 · cited 2×
“408–410 of his Statistical Learning Theory [27], support-vector machines grew out of the idea of separating two groups of examples with a hyperplane in a way that makes as few mistakes as possible—i.”
BackgroundTHE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227 · cited 1×
“1 Example: Classifying iris flowers In 1936 [11], R.”
BackgroundClarke, G., Draper, N. R., & Smith, H. (1968) · doi:10.2307/2004561 · Cited by 9,520
Testing Statistical Hypotheses
Casella, G., Olkin, I., & Fienberg, S. (2005) · Springer texts in statistics · doi:10.1007/0-387-27605-x · Cited by 3,209 · cited 1×
“, zn−1) can be framed as an application of the widely accepted Neyman-Pearson theory for hypothesis testing and confidence intervals [17].”
BackgroundProbabilistic Networks and Expert Systems
Pederson, S. P. (2001) · Technometrics · doi:10.1198/tech.2001.s564 · Cited by 2,023 · cited 1×
“Readers familiar with Bayes nets [4] will recognize this diagram as an example; conditional on each variable, a joint probability distribution is given for its children (the variables to which arrows from it point), and given the variable, its descendants are independent of its ancestors.”
BackgroundStatistical methods and scientific inference.
Snell, J., & Fisher, R. (1957) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2342557 · Cited by 1,819 · cited 1×
“This gives the following protocol: The Backward-Looking Betting Protocol Players: Joe, Bill KN := 1.”
MethodRyan, T. P. (1996) · Wiley series in probability and statistics · doi:10.1002/9780470382806 · Cited by 1,165 · cited 2×
“82; [21], pp.”
BackgroundOutline of a Theory of Statistical Estimation Based on the Classical Theory of Probability
Neyman, J. (1937) · Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences · doi:10.1098/rsta.1937.0005 · Cited by 1,087 · cited 1×
“Our concept of validity is consistent with a tradition that can be traced back to Jerzy Neyman’s introduction of confidence intervals for parameters in 1937 [19] and even to work by Laplace and others in the late 18th century.”
Student (1908) · doi:10.1007/978-1-4612-4380-9_4 · Cited by 965
Symmetric measures on Cartesian products
Hewitt, E., & Savage, L. J. (1955) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1955-0076206-8 · Cited by 784 · cited 1×
“On the other hand, as we have already said, it will make no difference if we replace the absolute difference d(z, z′) = |z − z′| with the squared difference d(z, z′) = (z − z′)2, thus squaring A.”
Background
Research works printed but not linked: 4
- Peter J. Bickel and Kjell A. Doksum. Mathematical Statistics: Basic Ideas and Selected Topics. Volume I. Prentice Hall, Upper Saddle River, New Jersey, second edition, 2001.
- Wahrscheinlichkeitstheorie, Fehlerausgleichung, Kollektivmasslehre. Teub- ner, Leipzig and Berlin, third edition, 2000.
- Per Martin-Löf. Repetitive structures and the relation between canonical and microcanonical distributions in statistics and statistical mechanics. In Ole E. Barndorff-Nielsen, Preben Blæsild, and Geert Schou, editors, Pro- ceedings of Conference on Foundational Questions in Statistical Inference, pages 271-294, Aarhus, 1974. Memoirs 1.
- G. A. F. Seber and A. J. Lee. Linear Regression Analysis. Wiley, Hoboken, NJ, second edition, 2003.
Cited by
Sorted by citations
Items 1,001–1,010 of 1,010
Scientific Table Data Extraction with Uncertainty Quantification
Ajayi, K. (2024) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3677389.3702616
“However, the existing study was limited to specific TSR models and datasets, leaving room for further exploration of more general UQ methods, such as Conformal Prediction [14].”
GANCQR: Estimating Prediction Intervals for Individual Treatment Effects with GANs
Wang, J., Wan, H., & Chen, X. (2024) · Online World Conference on Soft Computing in Industrial Applications · doi:10.1109/wsc63780.2024.10838943
“Conformal prediction (CP) (Vovk et al. 2005; Shafer and Vovk 2008) is a framework for distribution-free uncertainty quantification for regression and classification problems.”
Inductive Conformal Prediction under Data Scarcity: Exploring the Impacts of Nonconformity Measures
Kato, Y., Tax, D., & Loog, M. (2024) · arXiv.org · doi:10.48550/arxiv.2410.09894
“A key component of CP is the selection of the Nonconformity Measure (NCM), which quantifies how different a test sample is from the training data [6].”
BackgroundConformal prediction based on principal component analysis for high-dimensional outlier detection
Qian, X., Wu, J., & Lin, Y. (2024) · Other Conferences · doi:10.1117/12.3050772
Learning From Complementary Features
Sugiyama, K., & Uchida, M. (2024) · IEEE Access · doi:10.1109/access.2026.3665173
“Finally, in Section IV-D, we discuss the relationships between multiple CFs and explain how to utilize the observed CF values.”
RoCP-GNN: Robust Conformal Prediction for Graph Neural Networks in Node-Classification
Akansha, S. (2024) · arXiv.org · doi:10.48550/arxiv.2408.13825
Magazine Supply Optimization: A Case-Study
Nguyen, D., Ulianovici, A., Achour, S., Aubry, S., & Chesneau, N. (2024) · International Conference on Data Science and Advanced Analytics · doi:10.1109/dsaa61799.2024.10722827
Point Prediction for Streaming Data
Chanda, A., Vinodchandran, N. V., & Clarke, B. (2024) · arXiv.org · doi:10.48550/arxiv.2408.01318
Uncertainty Quantification of Cuffless Blood Pressure with Deep Evidential Regression Model
Shen, Z., Yao, S., Chen, Y.-F., & Ding, X. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/embc53108.2024.10782943
“To validate the performance of the epistemic uncertainty ( U ep ) estimated by the DER model, we employed the conformal prediction [15] that can generate a statistically rigorous UI for the estimation.”
Distribution-Free Predictive Inference under Unknown Temporal Drift
Han, E., Huang, C., & Wang, K. (2024) · arXiv.org · doi:10.48550/arxiv.2406.06516
“One of the most powerful tools for distribution-free predictive inference is conformal prediction , also called conformal inference (Papadopoulos et al., 2002; Vovk et al., 2005; Shafer and Vovk, 2008; Lei et al., 2018; Angelopoulos and Bates, 2023).”
Method
Metadata
- Authors
- Shafer, G., & Vovk, V.
- Affiliations
- Royal Holloway University of London (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2007
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 0706.3188
- OpenAlex
- W2171585602
- Cited by
- 655
- References
- 39
- Citations by year
- 2026: 6 · 2025: 89 · 2024: 86 · 2023: 71 · 2022: 50 · 2021: 72 · 2020: 71 · 2019: 39 · 2018: 23 · 2017: 18 · 2016: 21 · 2015: 14 · 2014: 19 · 2013: 20 · 2012: 18
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Royal Holloway Digital Repository (Royal Holloway University of London) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Keywords
- conformal prediction, prediction intervals, confidence intervals, online learning, independent and identically distributed data, linear Gaussian models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
