The DOI matches its DataCite record; 55 of the 58 references it cites were found in a registry or an index.
Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shift
Open accessAbstract
We might hope that when faced with unexpected inputs, well-designed software systems would fire off warnings. Machine learning (ML) systems, however, which depend strongly on properties of their inputs (e.g. the i.i.d. assumption), tend to fail silently. This paper explores the problem of building ML systems that fail loudly, investigating methods for detecting dataset shift, identifying exemplars that most typify the shift, and quantifying shift malignancy. We focus on several datasets and various perturbations to both covariates and label distributions with varying magnitudes and fractions of data affected. Interestingly, we show that across the dataset shifts that we explore, a two-sample-testing-based approach, using pre-trained classifiers for dimensionality reduction, performs best. Moreover, we demonstrate that domain-discriminating approaches tend to be helpful for characterizing shifts qualitatively and determining if they are harmful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As demonstrated by Rabanser et al. 46 , the p-values are calculated by computing the maximum discrepancy between two distributions and comparing via permutation tests to a null-hypothesis distribution.”
From Empirical data drift detection experiments on real-world medical imaging data (2024) · cites this paper as [46]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“When implementing our experiments, we followed state-of-theart methodologies found in previous work 46 .”
From Empirical data drift detection experiments on real-world medical imaging data (2024) · cites this paper as [46]
The cited source says what the claim attributes to it.
In the citing paper
“Model output-based drift detection is a method to detect drift using only the output of the classifier without any gold labels 46 .”
From Empirical data drift detection experiments on real-world medical imaging data (2024) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Liu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,261
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
Wide & Deep Learning for Recommender Systems
Cheng, H.-T., Koç, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G. S., Chai, W., Ispir, M., et al. (2016) · Workshop on Deep Learning for Recommender Systems (DLRS) · doi:10.1145/2988450.2988454 · Cited by 3,547
Deep Neural Networks for YouTube Recommendations
Covington, P., Adams, J., & Sargin, E. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959190 · Cited by 3,539
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery
Schlegl, T., Seeböck, P., Waldstein, S. M., Schmidt-Erfurth, U., & Langs, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_12 · Cited by 2,627
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Transfer Feature Learning with Joint Distribution Adaptation
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.274 · Cited by 2,071
Support Vector Method for Novelty Detection
Schölkopf, B., Williamson, R. C., Smola, A. J., Shawe-Taylor, J. S., & Platt, J. C. (1999) · Cited by 2,038
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
Hendrycks, D., & Gimpel, K. (2016) · arXiv · doi:10.48550/arxiv.1610.02136 · Cited by 1,968
Deep Neural Networks for Acoustic Modeling in Speech Recognition
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · Cited by 1,839
Lakhani, P., & Sundaram, B. (2017) · Radiology · doi:10.1148/radiol.2017162326 · Cited by 1,775
Improving predictive inference under covariate shift by weighting the log-likelihood function
Shimodaira, H. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00115-4 · Cited by 1,678
Novelty detection: a review—part 1: statistical approaches
Markou, M., & Singh, S. (2003) · Signal Processing · doi:10.1016/j.sigpro.2003.07.018 · Cited by 1,472
Database-friendly random projections: Johnson-Lindenstrauss with binary coins
Achlioptas, D. (2003) · Journal of Computer and System Sciences · doi:10.1016/s0022-0000(03)00025-4 · Cited by 1,374
Adversarial Attacks on Neural Networks for Graph Data
Zügner, D., Akbarnejad, A., & Günnemann, S. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220078 · Cited by 997
Self-citationDeep Anomaly Detection with Outlier Exposure
Hendrycks, D., Mazeika, M., & Dietterich, T. (2018) · arXiv · doi:10.48550/arxiv.1812.04606 · Cited by 932
Direct importance estimation with model selection and its application to covariate shift adaptation
Sugiyama, M., Nakajima, S., Kashima, H., von Bünau, P., & Kawanabe, M. (2008) · Cited by 681
Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution SamplesPreprint
Lee, K., Lee, H., Lee, K., & Shin, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09325 · Cited by 650
Very sparse random projections
Li, P., Hastie, T. J., & Church, K. (2006) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1150402.1150436 · Cited by 632
Truncated product method for combining P ‐values
Zaykin, D. V., Анатольевич, Ж. Л., Westfall, P. H., & Weir, B. S. (2002) · Genetic Epidemiology · doi:10.1002/gepi.0042 · Cited by 508
Covariate Shift by Kernel Mean Matching
Gretton, A., Smola, A. J., Huang, J., Schmittfull, M., Borgwardt, K. M., & Schölkopf, B. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/9780262170055.003.0008 · Cited by 502
Enhancing the reliability of out-of-distribution image detection in neural networks
Liang, S. (2025) · TIB Data Manager · doi:10.57702/uwcm8hhf · Cited by 474
Domain Adaptation under Target and Conditional Shift
Zhang, K., Schölkopf, B., Muandet, K., & Wang, Z. (2013) · Cited by 431
Adjusting the Outputs of a Classifier to New a Priori Probabilities: A Simple Procedure
Saerens, M., Latinne, P., & Decaestecker, C. (2002) · Neural Computation · doi:10.1162/089976602753284446 · Cited by 361 · cited 1×
“Owing to the impossibility of correcting for shift absent assumptions [3], these papers often assume either covariate shift q(x, y) = q(x)p(y|x) [15, 45, 49] or label shift q(x, y) = q(y)p(x|y) [7, 29, 38, 48, 56].”
BackgroundMachine Learning: The High Interest Credit Card of Technical Debt
Sculley, D., Holt, G. D., Golovin, D., Davydov, E. V., Phillips, T., Ebner, D., Chaudhary, V., & Young, M. (2014) · Cited by 218
A systematic comparison of methods for combining p-values from independent tests
Loughin, T. M. (2004) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2003.11.020 · Cited by 217
On causal and anticausal learning
Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., Mooij, J. M., & Schölkopf, B. (2012) · International Conference on Machine Learning · Cited by 214
Time-uniform, nonparametric, nonasymptotic confidence sequences
Howard, S. R., Ramdas, A., McAuliffe, J., & Sekhon, J. (2021) · The Annals of Statistics · doi:10.1214/20-aos1991 · Cited by 190
Impossibility Theorems for Domain Adaptation
Ben-David, S., Lu, T., Luu, T. V., & Pál, D. (2010) · Cited by 189
Autotagging Facebook: Social network context improves photo annotation
Stone, Z., Zickler, T. E., & Darrell, T. J. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4562956 · Cited by 175
When Training and Test Sets are Different: Characterising Learning Transfer
Storkey, A. (2013) · Cited by 137
Ramdas, A., Reddi, S. J., Póczos, B., Singh, A., & Wasserman, L. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9692 · Cited by 116
Uncertainty in the Variational Information BottleneckPreprint
Alemi, A. A., Fischer, I. S., & Dillon, J. V. (2018) · arXiv.org · doi:10.48550/arxiv.1807.00906 · Cited by 113
A Less Biased Evaluation of Out-of-distribution Sample DetectorsPreprint
Shafaei, A., Schmidt, M., & Little, J. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04729 · Cited by 111
On Causal and Anticausal LearningPreprint
Schölkopf, B., Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., & Mooij, J. M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6471 · Cited by 109
Out-of-Distribution Detection using Multiple Semantic Label RepresentationsPreprint
Shalev, G., Adi, Y., & Keshet, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.06664 · Cited by 70
Word sense disambiguation with distribution estimation
Chan, Y. S., & Ng, H. T. (2005) · National University of Singapore · Cited by 63
Classification accuracy as a proxy for two-sample testing
Kim, I., Ramdas, A., Singh, A., & Wasserman, L. (2021) · The Annals of Statistics · doi:10.1214/20-aos1962 · Cited by 55
A review of change point detection methods.Preprint
Truong, C., Oudre, L., & Vayatis, N. (2018) · arXiv (Cornell University) · Cited by 55
Generative Ensembles for Robust Anomaly Detection
Choi, H., & Jang, E. (2018) · Cited by 51
Does Your Model Know the Digit 6 Is Not a Cat? A Less Biased Evaluation of "Outlier" DetectorsPreprint
Shafaei, A., Schmidt, M., & Little, J. J. (2018) · arXiv (Cornell University) · Cited by 33
Combining p-values via averagingPreprint
Vovk, V., & Wang, R. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.4966 · Cited by 22
Uniform, nonparametric, non-asymptotic confidence sequencesPreprint
Howard, S. R., Ramdas, A., McAuliffe, J., & Sekhon, J. S. (2018) · arXiv (Cornell University) · Cited by 14
Research works printed but not linked: 3
- [13][13] Ian Goodfellow, Jonathon Shlens, and Christian Szegedy. Explaining and Harnessing Adversarial Examples. In International Conference on Learning Representations (ICLR) , 2014. -
- [29][29] Zachary C Lipton, Yu-Xiang Wang, and Alex Smola. Detecting and Correcting for Label Shift with Black Box Predictors. In International Conference on Machine Learning (ICML) , 2018. -
- [51][51] Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. Intriguing Properties of Neural Networks. In International Conference on Learning Representations (ICLR) , 2014. -
Cited by
Sorted by citations
Toward Causal Representation Learning
Scholkopf, B., Locatello, F., Bauer, S., Ke, N. R., Kalchbrenner, N., Goyal, A., & Bengio, Y. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3058954 · Cited by 1,170
Algorithmic Fairness: Choices, Assumptions, and Definitions
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042720-125902 · Cited by 687
Machine learning for medical imaging: methodological failures and recommendations for the future
Varoquaux, G. P., & Cheplygina, V. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00592-y · Cited by 815
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
“Data drift monitoring [268] provides important means to maintain the generalization of an AI system under concept change [394] caused by dynamic environment such as market change [289].”
BackgroundEthical Machine Learning in Healthcare
Chen, I. Y., Pierson, E., Rose, S., Joshi, S., Ferryman, K., & Ghassemi, M. (2021) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-092820-114757 · Cited by 645
Metadata
- Authors
- Rabanser, S., Günnemann, S., & Lipton, Z. C.
- Affiliations
- Amazon (United States) (US)
- Technical University of Munich (DE)
- Carnegie Mellon University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 32
- Pages
- 1396-1408
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.11953
- OpenAlex
- W2898158860
- Cited by
- 204
- References
- 58
- Citations by year
- 2026: 4 · 2025: 23 · 2024: 36 · 2023: 44 · 2022: 29 · 2021: 44 · 2020: 22 · 2019: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- distribution shift, shift detection, fault detection, silent failures, covariate shift, label shift, two-sample test, dimensionality reduction, i.i.d. assumption
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
