A conformal prediction approach to explore functional data
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
This paper applies conformal prediction techniques to compute simultaneous prediction bands and clustering trees for functional data. These tools can be used to detect outliers and clusters. Both our prediction bands and clustering trees provide prediction sets for the underlying stochastic process with a guaranteed finite sample behavior, under no distributional assumptions. The prediction sets are also informative in that they correspond to the high density region of the underlying process. While ordinary conformal prediction has high computational cost for functional data, we use the inductive conformal predictor, together with several novel choices of conformity scores, to simplify the computation. Our methods are illustrated on some real data examples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Functional Data Analysis for Sparse Longitudinal Data
Yao, F., Müller, H.-G., & Wang, J.-L. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001745 · Cited by 1,595
Algorithmic Learning in a Random World
(2005) · doi:10.1007/b106715 · Cited by 1,119
The Bagplot: A Bivariate Boxplot
Rousseeuw, P. J., Ruts, I., & Tukey, J. W. (1999) · The American Statistician · doi:10.2307/2686061 · Cited by 568
Conditional validity of inductive conformal predictors
Vovk, V. (2013) · Machine Learning · doi:10.1007/s10994-013-5355-6 · Cited by 225 · cited 2×
“Some recent development of inductive conformal methods, such as conditional validity, can be found in [25].”
Research works printed but not linked: 23
- Antoniadis, A., Xavier Brossat, J.C., Poggi, J.: Clustering functional data using wavelets. In: e-book of COMPSTAT, pp. 697–704. Springer (2010)
- Cheng, Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. 17(8), 790–799 (1995) · DOI · Paper page
- Cuevas, A., Febrero, M., Fraiman, R.: Robust estimation and classification for functional data via projection-based depth notions. Comput. Stat. 22, 481–496 (2007) · DOI
- Delaigle, A., Hall, P., Bathia, N.: Componentwise classification and clustering of functional data. Biometrika 99 (2012) · doi:10.1093/biomet/ass003
- Efromovich, S.: Nonparametric Curve Estimation: Methods, Theory and Applications. Springer Verlag (1999)
- Febrero, M., Galeano, P., González-Manteiga, W.: Outlier detection in functional data by depth measures, with application to identify abnormal nox levels. Environmetrics 19, 331–345 (2008) · DOI · Paper page
- Ferraty, F., Vieu, P.: Nonparametric Functional Data Analysis: Theory and Practice. Springer Verlag (2006)
- Gervini, D.: Detecting and handling outlying trajectories in irregularly sampled functional datasets. Ann. Appl. Stat. 3, 1758–1775 (2009) · DOI
- Hartigan, J.: Clustering Algorithms. John Wiley, New York (1975)
- Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning, 2nd edn. Springer (2009) · DOI · Paper page
- Hyndman, R.J., Shang, H.L.: Rainbow plots, bagplots, and boxplots for functional data. J. Comput. Graph. Stat. 19, 29–45 (2010) · DOI
- James, G.M., Sugar, C.A.: Clustering for sparsely sampled functional data. J. Am. Stat. Assoc. 98, 397–408 (2003) · DOI · Paper page
- Lei, J., Robins, J., Wasserman, L.: Efficient nonparametric conformal prediction regions. J. Am. Stat. Assoc. 108, 278–287 (2013) · DOI · Paper page
- Lei, J., Wasserman, L.: Distribution free prediction bands for nonparametric regression. J. R. Stat. Soc. Ser. B Stat. Methodol. (2013, to appear) · DOI · Paper page
- López-Pintado, S., Romo, J.: On the concept of depth for functional data. J. Am. Stat. Assoc. 104, 718–734 (2009) · DOI
- Papadopoulos, H.: Inductive conformal prediction: theory and application to neural networks. In: Fritzsche, P. (ed.) Tools in Artificial Intelligence, pp. 315–330. InTech, Chapters (2008) · DOI · Paper page
- Ramsay, J., Silverman, B.: Functional Data Analysis. New York: Springer (1997) · DOI · Paper page
- Rinaldo, A., Singh, A., Nugent, R., Wasserman, L.: Stability of density-based clustering. J. Mach. Learn. Res. 13, 905–948 (2012)
- Rinaldo, A., Wasserman, L.: Generalized density clustering. Ann. Stat. 38, 2678–2722 (2010) · DOI
- Shafer, G., Vovk, V.: A tutorial on conformal prediction. J. Mach. Learn. Res. 9, 371–421 (2008)
- Shi, J., Wang, B.: Curve prediction and clustering with mixtures of Gaussian process functional regression models. Stat. Comput. 18, 267–283 (2008) · DOI
- Sun, Y., Genton, M.G.: Functional boxplots. J. Comput. Graph. Stat. 20, 216–334 (2011)
- Tarpey, T., Kinateder, K.K.J.: Clustering functional data. J. Classif. 20, 93–114 (2003) · DOI · Paper page
Cited by
Distribution-Free Predictive Inference for Regression
Lei, J., G’Sell, M., Rinaldo, A., Tibshirani, R. J., & Wasserman, L. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1307116 · Cited by 1,049
“For example, Burnaev & Vovk (2014) considered low-dimensional least squares and ridge regression models.”
BackgroundSelf-citationConformal Prediction: A Gentle Introduction
Angelopoulos, A. N., & Bates, S. (2023) · Foundations and Trends in Machine Learning · doi:10.1561/2200000101 · Cited by 740
Distribution-free, Risk-controlling Prediction Sets
Bates, S., Angelopoulos, A., Lei, L., Malik, J., & Jordan, M. (2021) · Journal of the ACM · doi:10.1145/3478535 · Cited by 144
“A particularly convenient form of conformal prediction, known as split conformal prediction [8, 9], uses data splitting to generate prediction sets in a computationally efficient way; see also [10, 11] for generalizations that re-use data for improved statistical efficiency.”
BackgroundLearn then Test: Calibrating Predictive Algorithms to Achieve Risk Control
Angelopoulos, A. N., Bates, S., Candès, E. J., Jordan, M. I., & Lei, L. (2021) · arXiv · doi:10.48550/arxiv.2110.01052 · Cited by 100
Exact and Robust Conformal Inference Methods for Predictive Machine Learning With Dependent Data
Chernozhukov, V., Wüthrich, K., & Zhu, Y. (2018) · doi:10.1920/wp.cem.2018.1618 · Cited by 57
Metadata
- Authors
- Lei, J., Rinaldo, A., & Wasserman, L.
- Venue
- Annals of Mathematics and Artificial Intelligence
- Published
- 2013-09-19
- Volume
- 74
- Issue
- 1-2
- Pages
- 29-43
- ISSN
- 1012-2443 (ISSN-L)
- 1573-7470
- OpenAlex
- W1963600315
- Cited by
- 83
- References
- 4
- FWCI
- 1.43
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A conformal prediction approach to explore functional data. https://app.cochat.ai/papers/10.1007/s10472-013-9366-6
- The paper
- Lei, J., Rinaldo, A., & Wasserman, L. (2015). A conformal prediction approach to explore functional data. Annals of Mathematics and Artificial Intelligence. https://doi.org/10.1007/s10472-013-9366-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.