CoChat

A conformal prediction approach to explore functional data

Open access
Lei, Jing, Rinaldo, Alessandro, Wasserman, Larry · 2015 · Annals of Mathematics and Artificial Intelligence
Cited by 83

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

This paper applies conformal prediction techniques to compute simultaneous prediction bands and clustering trees for functional data. These tools can be used to detect outliers and clusters. Both our prediction bands and clustering trees provide prediction sets for the underlying stochastic process with a guaranteed finite sample behavior, under no distributional assumptions. The prediction sets are also informative in that they correspond to the high density region of the underlying process. While ordinary conformal prediction has high computational cost for functional data, we use the inductive conformal predictor, together with several novel choices of conformity scores, to simplify the computation. Our methods are illustrated on some real data examples.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10472-013-9366-6

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 23

  1. Antoniadis, A., Xavier Brossat, J.C., Poggi, J.: Clustering functional data using wavelets. In: e-book of COMPSTAT, pp. 697–704. Springer (2010)
  2. Cheng, Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. 17(8), 790–799 (1995) · DOI · Paper page
  3. Cuevas, A., Febrero, M., Fraiman, R.: Robust estimation and classification for functional data via projection-based depth notions. Comput. Stat. 22, 481–496 (2007) · DOI
  4. Delaigle, A., Hall, P., Bathia, N.: Componentwise classification and clustering of functional data. Biometrika 99 (2012) · doi:10.1093/biomet/ass003
  5. Efromovich, S.: Nonparametric Curve Estimation: Methods, Theory and Applications. Springer Verlag (1999)
  6. Febrero, M., Galeano, P., González-Manteiga, W.: Outlier detection in functional data by depth measures, with application to identify abnormal nox levels. Environmetrics 19, 331–345 (2008) · DOI · Paper page
  7. Ferraty, F., Vieu, P.: Nonparametric Functional Data Analysis: Theory and Practice. Springer Verlag (2006)
  8. Gervini, D.: Detecting and handling outlying trajectories in irregularly sampled functional datasets. Ann. Appl. Stat. 3, 1758–1775 (2009) · DOI
  9. Hartigan, J.: Clustering Algorithms. John Wiley, New York (1975)
  10. Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning, 2nd edn. Springer (2009) · DOI · Paper page
  11. Hyndman, R.J., Shang, H.L.: Rainbow plots, bagplots, and boxplots for functional data. J. Comput. Graph. Stat. 19, 29–45 (2010) · DOI
  12. James, G.M., Sugar, C.A.: Clustering for sparsely sampled functional data. J. Am. Stat. Assoc. 98, 397–408 (2003) · DOI · Paper page
  13. Lei, J., Robins, J., Wasserman, L.: Efficient nonparametric conformal prediction regions. J. Am. Stat. Assoc. 108, 278–287 (2013) · DOI · Paper page
  14. Lei, J., Wasserman, L.: Distribution free prediction bands for nonparametric regression. J. R. Stat. Soc. Ser. B Stat. Methodol. (2013, to appear) · DOI · Paper page
  15. López-Pintado, S., Romo, J.: On the concept of depth for functional data. J. Am. Stat. Assoc. 104, 718–734 (2009) · DOI
  16. Papadopoulos, H.: Inductive conformal prediction: theory and application to neural networks. In: Fritzsche, P. (ed.) Tools in Artificial Intelligence, pp. 315–330. InTech, Chapters (2008) · DOI · Paper page
  17. Ramsay, J., Silverman, B.: Functional Data Analysis. New York: Springer (1997) · DOI · Paper page
  18. Rinaldo, A., Singh, A., Nugent, R., Wasserman, L.: Stability of density-based clustering. J. Mach. Learn. Res. 13, 905–948 (2012)
  19. Rinaldo, A., Wasserman, L.: Generalized density clustering. Ann. Stat. 38, 2678–2722 (2010) · DOI
  20. Shafer, G., Vovk, V.: A tutorial on conformal prediction. J. Mach. Learn. Res. 9, 371–421 (2008)
  21. Shi, J., Wang, B.: Curve prediction and clustering with mixtures of Gaussian process functional regression models. Stat. Comput. 18, 267–283 (2008) · DOI
  22. Sun, Y., Genton, M.G.: Functional boxplots. J. Comput. Graph. Stat. 20, 216–334 (2011)
  23. Tarpey, T., Kinateder, K.K.J.: Clustering functional data. J. Classif. 20, 93–114 (2003) · DOI · Paper page

Cited by

See all 83

Metadata

Authors
Lei, J., Rinaldo, A., & Wasserman, L.
Venue
Annals of Mathematics and Artificial Intelligence
Published
2013-09-19
Volume
74
Issue
1-2
Pages
29-43
ISSN
  • 1012-2443 (ISSN-L)
  • 1573-7470
OpenAlex
W1963600315
Cited by
83
References
4
FWCI
1.43
Type
journal article
Language
en
Open access
green
Licence
www.springer.com/tdm (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.