The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Change-point detection in time-series data by relative density-ratio estimation
Open accessAbstract
The objective of change-point detection is to discover abrupt property changes lying behind time-series data. In this paper, we present a novel statistical change-point detection algorithm based on non-parametric divergence estimation between time-series samples from two retrospective segments. Our method uses the relative Pearson divergence as a divergence measure, and it is accurately and efficiently estimated by a method of direct density-ratio estimation. Through experiments on artificial and real-world datasets including human-activity sensing, speech, and Twitter messages, we demonstrate the usefulness of the proposed method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168 · cited 1×
“In the context of change-point detection, KLIEP was reported to outperform other approaches (Kawahara and Sugiyama, 2012) such as the one-class support vector machine (Sch¨olkopf et al., 2001; Desobry et al., 2005) and singular-spectrum analysis (Moskvina and Zhigljavsky, 2003b).”
MethodLearning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Williams, C. K. I. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s269 · Cited by 4,281
Pearson, K. (1900) · The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440009463897 · Cited by 4,069
Earthquake shakes Twitter users: real-time event detection by social sensors
Sakaki, T., Okazaki, M., & Matsuo, Y. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772777 · Cited by 3,640
Detection of Abrupt Changes: Theory and Application
Riedel, K. S. (1994) · Technometrics · doi:10.1080/00401706.1994.10485821 · Cited by 3,518
Adaptive Control Processes: A Guided Tour
Bellman, R. E. (1961) · doi:10.1515/9781400874668 · Cited by 2,802
Adaptive Control Processes: A Guided Tour.
Page, E. S., & Bellman, R. (1962) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2343225 · Cited by 2,185
Information-type measures of difference of probability distributions and indirect observation
Csiszár, I. (1967) · Studia Scientiarum Mathematicarum Hungarica · Cited by 1,332
An Introduction to the Bootstrap.
Kimber, A., Efron, B., & Tibshirani, R. J. (1994) · The Statistician · doi:10.2307/2348146 · Cited by 1,245
Adaptive Filtering and Change Detection
Gustafsson, F. (2001) · Wiley eBooks · doi:10.1002/0470841613 · Cited by 1,217
A General Class of Coefficients of Divergence of One Distribution from Another
Ali, S. M., & Silvey, S. D. (1966) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1966.tb00626.x · Cited by 1,205
Dataset Shift in Machine Learning
Adams, N. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2009.00624_10.x · Cited by 694
A Review and Comparison of Changepoint Detection Techniques for Climate Data
Reeves, J., Chen, J., Wang, X. L., Lund, R., & Lu, Q. Q. (2007) · Journal of Applied Meteorology and Climatology · doi:10.1175/jam2493.1 · Cited by 638 · cited 1×
“Retrospective change-point detection accommodates various applications that allow certain delays, for example, climate change detection (Reeves et al., 2007), genetic time-series analysis (Wang et al., 2011), signal segmentation (Basseville and Nikiforov, 1993), and intrusion detection in computer…”
BackgroundNonparametric Methods in Change-Point Problems
Brodsky, B. E., & Darkhovsky, B. S. (1993) · Springer eBooks · doi:10.1007/978-94-015-8163-9 · Cited by 625
Bayesian Online Changepoint Detection
Adams, R. P., & MacKay, D. J. C. (2007) · arXiv · doi:10.48550/arxiv.0710.3742 · Cited by 601
Streaming First Story Detection with application to Twitter
Petrović, S., Osborne, M., & Lavrenko, V. P. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 573
On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms
Yamanishi, K., Takeuchi, J.-I., Williams, G., & Milne, P. (2004) · Data Mining and Knowledge Discovery · doi:10.1023/b:dami.0000023676.72185.7c · Cited by 476
Event detection from time series data
Guralnik, V., & Srivastava, J. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312190 · Cited by 474
Density Ratio Estimation in Machine Learning
Sugiyama, M., Suzuki, T., & Kanamori, T. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139035613 · Cited by 431
Self-citationDirect importance estimation for covariate shift adaptation
Sugiyama, M., Suzuki, T., Nakajima, S., Kashima, H., von Bünau, P., & Kawanabe, M. (2008) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-008-0197-x · Cited by 426
Self-citationDiscriminative learning for differing training and test distributions
Bickel, S., Brückner, M., & Scheffer, T. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273507 · Cited by 387
Estimating Divergence Functionals and the Likelihood Ratio by Convex Risk Minimization
Nguyen, X., Wainwright, M. J., & Jordan, M. I. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2068870 · Cited by 379
Covariate Shift by Kernel Mean Matching
Gretton, A., Smola, A., Huang, J., Schmittfull, M., Borgwardt, K., & Schölkopf, B. (2008) · Dataset Shift in Machine Learning · doi:10.7551/mitpress/9780262170055.003.0008 · Cited by 378
A unifying framework for detecting outliers and change points from non-stationary time series data
Yamanishi, K., & Takeuchi, J.-I. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775148 · Cited by 281
An online kernel change detection algorithm
Desobry, F., Davy, M., & Doncarli, C. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.851098 · Cited by 271
A unifying framework for detecting outliers and change points from time series
Takeuchi, J., & Yamanishi, K. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.1599387 · Cited by 257
Density-ratio matching under the Bregman divergence: a unified framework of density-ratio estimation
Sugiyama, M., Suzuki, T., & Kanamori, T. (2011) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-011-0343-8 · Cited by 249
Self-citationA Least-squares Approach to Direct Importance Estimation
KanamoriTakafumi, HidoShohei, & SugiyamaMasashi (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755831 · Cited by 243
On-line unsupervised outlier detection using finite mixtures with discounting learning algorithms
Yamanishi, K., Takeuchi, J.-I., Williams, G., & Milne, P. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347160 · Cited by 226
An Algorithm Based on Singular Spectrum Analysis for Change-Point Detection
Moskvina, V., & Zhigljavsky, A. (2003) · Communications in Statistics - Simulation and Computation · doi:10.1081/sac-120017494 · Cited by 220
Henkel, R. (1976) · Sage eBooks · doi:10.4135/9781412986113 · Cited by 217
Sequential change‐point detection based on direct density‐ratio estimation
Kawahara, Y., & Sugiyama, M. (2012) · Statistical Analysis and Data Mining: The ASA Data Science Journal · doi:10.1002/sam.10124 · Cited by 190
Self-citationStatistical outlier detection using direct density ratio estimation
Hido, S., Tsuboi, Y., Kashima, H., Sugiyama, M., & Kanamori, T. (2011) · Knowledge and Information Systems · doi:10.1007/s10115-010-0283-2 · Cited by 173
Self-citationRelative Density-Ratio Estimation for Robust Distribution Comparison
Yamada, M., Suzuki, T., Kanamori, T., Hachiya, H., & Sugiyama, M. (2013) · Neural Computation · doi:10.1162/neco_a_00442 · Cited by 161
Self-citationStatistical analysis of kernel-based least-squares density-ratio estimation
Kanamori, T., Suzuki, T., & Sugiyama, M. (2011) · Machine Learning · doi:10.1007/s10994-011-5266-3 · Cited by 154
Self-citationHarchaoui, Z., Moulines, É., & Bach, F. (2008) · Cited by 135
Change-Point Detection in Time-Series Data Based on Subspace Identification
Kawahara, Y., Yairi, T., & Machida, K. (2007) · Proceedings · doi:10.1109/icdm.2007.78 · Cited by 113
Dual representation of φ-divergences and applications
Keziou, A. (2003) · Comptes Rendus Mathématique · doi:10.1016/s1631-073x(03)00215-2 · Cited by 66
Dimensionality reduction for density ratio estimation in high-dimensional spaces
Sugiyama, M., Kawanabe, M., & Chui, P. L. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.07.007 · Cited by 64
Self-citationSugiyama, M., Yamada, M., von Bünau, P., Suzuki, T., Kanamori, T., & Kawanabe, M. (2010) · Neural Networks · doi:10.1016/j.neunet.2010.10.005 · Cited by 59
Self-citationChange-P oint Detection of Climate Time Series by Nonparametric Method
Itoh, N. (2010) · Cited by 31
Nonparametric estimation of the likelihood ratio and divergence functionals
Nguyen, X., Wainwright, M. J., & Jordan, M. I. (2007) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2007.4557517 · Cited by 27
Sugiyama, M., Suzuki, T., Itoh, Y., Kanamori, T., & Kimura, M. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.04.003 · Cited by 26
Self-citationComputational complexity of kernel-based density-ratio estimation: a condition number analysis
Kanamori, T., Suzuki, T., & Sugiyama, M. (2012) · Machine Learning · doi:10.1007/s10994-012-5323-6 · Cited by 26
Self-citationCondition Number Analysis of Kernel-based Density Ratio EstimationPreprint
Kanamori, T., Suzuki, T., & Sugiyama, M. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0912.2800 · Cited by 22
Self-citation
Cited by
Selective review of offline change point detection methods
Truong, C., Oudre, L., & Vayatis, N. (2020) · Signal Processing · doi:10.1016/j.sigpro.2019.107299 · Cited by 1,338
A Survey of Deep Learning-Based Object Detection
Jiao, L., Zhang, F., Liu, F., Yang, S., Li, L., Feng, Z., & Qu, R. (2019) · IEEE Access · doi:10.1109/access.2019.2939201 · Cited by 1,323
Concrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314
A survey of methods for time series change point detection
Aminikhanghahi, S., & Cook, D. J. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-016-0987-z · Cited by 1,237
Generic and Scalable Framework for Automated Time-series Anomaly Detection
Laptev, N., Amizadeh, S., & Flint, I. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788611 · Cited by 425
Metadata
- Authors
- Liu, S., Yamada, M., Collier, N., & Sugiyama, M.
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 2013-07
- Volume
- 43
- Issue
- 275
- Pages
- 72-83
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W1682770403
- Cited by
- 447
- References
- 51
- FWCI
- 29.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.