The DOI matches its Crossref record; 245 of the 252 references it cites were found in a registry or an index.
Machine learning with a reject option: a survey
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In order to assess models' ability to refrain from answering a question when uncertain [14], we also include an additional multiple choice answer for each question:”
From LAB-Bench: Measuring Capabilities of Language Models for Biology Research (2024) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1996) · Cited by 20,179
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,759
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Liu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
Methods of combining multiple classifiers and their applications to handwriting recognition
Xu, L., Krzyżak, A., & Suen, C. Y. (1992) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.155943 · Cited by 2,192
Kowalska, M. K., Woźniak, M., Kijek, M. M., Mitrosz, P., Szakiel, J., & Turek, P. (2022) · Scientific Reports · doi:10.1038/s41598-021-99269-x · Cited by 2,121
Support Vector Method for Novelty Detection
Schölkopf, B., Williamson, R. C., Smola, A. J., Shawe-Taylor, J. S., & Platt, J. C. (1999) · Cited by 2,038
Efficient algorithms for mining outliers from large data sets
Ramaswamy, S., Rastogi, R. R., & Shim, K. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335437 · Cited by 1,908
Pimentel, M. A. F., Clifton, D. A., Clifton, L., & Tarassenko, L. (2014) · Signal Processing · doi:10.1016/j.sigpro.2013.12.026 · Cited by 1,649
Research works printed but not linked: 13
- Alhoniemi, E., Himberg, J., & Vesanto, J. (1999). Probabilistic measures for responses of self-organizing map units. In H. Bothe, E. Oja, E. Massad and C. Haefke, (eds.), Proceedings of the international ICSC congress on computational intelligence methods and applications. ICSC Academic Press, Zurich, Switzerland, (pp. 286–290). ICSC Academic Press.
- Cao, Y., Cai, T., & An, B. (2022). Generalizing consistent multi-class classification with rejection to be compatible with arbitrary losses. (NeurIPS), (pp. 1–14).
- Ferri, C., & Hernández-Orallo, J. (2004). Cautious lassifiers. Proceedings of ROC analysis in artificial intelligence, 1st international workshop (ROCAI-2004), (pp. 27–36).
- Frélicot, C. (1997). Learning rejection thresholds for a class of fuzzy classifiers from possibilistic clustered noisy data. In 7th International fuzzy systems association world congress, IFSA, (vol. 3, pp. 111–116).
- Friedel, C. C., Rückert, U., & Kramer, S. (2006). Cost Curves for Abstaining Classifiers. In ICML 2006 - 3th workshop ROC analysis in ML, Pittsburgh, Pennsylvania.
- Hansen, L. K., Liisberg, C., & Salamon, P. (1997). The error-reject tradeoff. Open Systems & Information Dynamics, 4(2), 159–184. · DOI
- Landgrebe, T. C., Tax, D. M., Paclík, P., Duin, R. P., & Andrew, C. (2004). A combining strategy for ill-defined problems. In Proceedings of the 15th annual symposium of the pattern recognition association of South Africa, (pp. 57–62).
- Lee, J. K., Bu, Y., Rajan, D., Sattigeri, P., Panda, R., Das, S., & Wornell, G. W. (2021). Fair selective classification via sufficiency. In Proceedings of the 38th international conference on machine learning, (vol. 139, pp. 6076–6086).
- Nalisnick, E., Matsukawa, A., Whye, Y., Dilan, T., & Balaji, G. (2019). Hybrid models with deep and invertible features (ICML, 2019).
- Prasad, N. R., Almanza-Garcia, S., & Lu, T. T. (2009). Anomaly detection. Computers, Materials and Continua, 14(1), 1–22.
- Van der Plas, D., Meert, W., Verbraecken, J., & Davis, J. (2021). A reject option for automated sleep stage scoring. In ICML workshop on interpretable machine learning in healthcare, Virtual event.
- Vanschoren, J. (2018). Meta-learning: A survey. pp. 1–29.
- Zhou, L., Martínez-Plumed, F., Hernández-Orallo, J., Ferri, C., & Schellaert, W. (2022). Reject before you run: Small assessors anticipate big language models. In CEUR workshop proceedings, (vol. 3169).
Cited by
Sorted by citations
Items 101–135 of 135
Shahrokhshahi, F., & Mohammadi, F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-32335-4_29
A Framework for Optimizing Human-Machine Interaction in Classification Systems
Murić, G., & Minton, S. (2026) · International Conference on Human-AI Interaction and Experience Design (HAXD) · doi:10.1109/haxd70072.2026.11620907
Zhou, Z., Liu, C., & Wang, X. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1926874
Kexel, C., ALIPEK, S., & Moll, J. (2026) · Remote Sensing · doi:10.3390/rs18152535
Thanh, D. H. (2026) · International Journal of Critical Infrastructure Protection · doi:10.1016/j.ijcip.2026.100876
Rejectors in the Wild: Deployment Barriers for LLM Rejectors
Schönwälder, E., Hartmann, C., & Lehner, W. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817850
Kishore, D., Ranjan, P., Neely, C. J., Cashman, M., Sakkaff, Z., Riehl, W. J., Joachimiak, M. P., Edirisinghe, J. N., Faria, J. P., Weisenhorn, P. B., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.08.06.743333
A two-stage learning architecture for reliable financial time series forecasting
Isufaj, A., Mollá, P., Li, J., Matsuo, Y., & Prendinger, H. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134703
Leakage-aware race-level upset-risk diagnostics for prospective horse-race prediction
Sugiura, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1922250
Towards a Resilience-Oriented Framework for Fault Diagnosis Under Varying Operating Conditions
Baddou, N., Dadda, A., & Rzine, B. (2026) · Sensors · doi:10.3390/s26165239
Fast and Accurate Classification with Parallel IDK Classifier Cascades
Ratul, I. J., & Yang, K. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00197
Dong, S., Li, H., Zhong, C., & Pan, J. (2026) · Remote Sensing · doi:10.3390/rs18162825
iMediFood-Shield: Secure Edge AI for Food and Medication Interaction Screening
Chakravarthula, S. S. H., Siripurapu, I. D., Rachakonda, L., Mohanty, S. P., & Kougianos, E. (2026) · Electronics · doi:10.3390/electronics15173799
Marques, F., Lourenço, A., Silva, P., Mateus, M., Fernandes, D., Ferreira, N., Soares, S. P., Augusto, D., & Teixeira, T. (2026) · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT) · doi:10.1109/dcoss-iot69657.2026.00167
Continuous Trust Scoring for Three-Level Pre-Chain Admission of IoT Sensor Streams
Zhang, Y., Li, C., Qin, M., Wang, L., & Chen, Y. (2026) · Applied Sciences · doi:10.3390/app16189011
Bao, Q., Sun, B., Guo, L., & Ye, J. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-026-03302-2
A Lightweight Spatial-Anchor-Aware Confidence Routing Method for Heterogeneous Scanned Documents
Wang, Z., Yong, Z., Yao, M., & Liu, M. (2026) · International Conference on Intelligent Systems and Robotics (CISR) · doi:10.1109/cisr70722.2026.11680153
LAPF: A Learnability-Aware Predictive Framework for Multi-task E-commerce Behavior Analysis
Gao, Y. (2026) · International Conference on Software Engineering and Computer Applications · doi:10.1145/3829641.3829735
Reject Option for Medical Image Classification Using CNN-Derived Latent-Space Neighbourhood Analysis
Arcangeli, A., Santi, L. A. D., Santarelli, M. F., Celi, S., & Positano, V. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02318-y
Liu, N., Zhang, X., Wu, Y., Fu, W., Wang, J., Pan, Y., Fan, Z., Wang, S., Tang, Q., & Yin, H. (2026) · Ecosystem Services · doi:10.1016/j.ecoser.2026.101916
Zhang, Y., Li, L., Liu, Y., Gao, J., & Shi, X. (2026) · IEEE Access · doi:10.1109/access.2026.3736805
Topcu, D., Bayraktar, N., & Devrim, E. (2026) · Clinica chimica acta; international journal of clinical chemistry · doi:10.1016/j.cca.2026.121355
When Should Recommender Systems Not Act?
Neidhardt, J., Kolb, T. E., Wagne, A., Fonseca, G. R., & Baeza-Yates, R. A. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3841277
Podemos confiar na predição de spalling do concreto sob incêndio por aprendizado de máquina?
do Amaral, M. M., & Real, M. D. V. (2026) · Ambiente Construído · doi:10.1590/s1678-86212026000101027
Ueda, P. S. M., Rívolli, A., Soares, C., & Lorena, A. C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39882-6_26
Kabir-Chisty, M. (2026) · Research Square · doi:10.21203/rs.3.rs-11227072/v1
Sultankulov, B., Nurtas, M., Chepashev, D., & Zhilkibayeva, E. (2026) · IEEE Access · doi:10.1109/access.2026.3741661
Constrained Automated Requirements Formalization for Rigorous Analysis with Alloy
Koscinski, V., & Mirakhorli, M. T. (2026) · doi:10.1145/3843777.3844526
Shah, S. T. A., Santos, J. P. O., Fernandes, J. M., Pereira, A. B., & Constantinescu, G. (2026) · Sensors · doi:10.3390/s26196334
Younis, U., Nazira, M. S., Iqbal, M. J., Saleem, Y., Ashfaq, R., & Ahmad, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7601308
Gorodnichev, M. G., & Moseva, M. S. (2026) · Applied Sciences · doi:10.3390/app162010231
Estimating the accuracy of selective classifiers without labels using Venn-Abers predictors
García‐Galindo, A., López-De-Castro, M., Armañanzas, R., & Löfström, T. (2026) · Patterns · doi:10.1016/j.patter.2026.101694
Zhang, J., Lai, H., He, R., Chen, J., & Su, C. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-6843-6_31
Barna, C., Petcuţ, F.-M., & Petcut-Lasc, A.-A. (2026) · Applied Sciences · doi:10.3390/app162110568
Selective Prediction Under Distribution Shift: The Failure of Threshold TransferPreprint
Ahmad, S. (2026) · Research Square · doi:10.21203/rs.3.rs-11212470/v1
Metadata
- Authors
- Hendrickx, K., Perini, L., Van der Plas, D., Meert, W., & Davis, J.
- Affiliations
- Siemens (Belgium) (BE)
- KU Leuven (BE)
- Corresponding author
- Hendrickx, Kilian
- Venue
- Machine Learning
- Published
- 2024-03-29
- Volume
- 113
- Issue
- 5
- Pages
- 3073-3110
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W3183516990
- Cited by
- 134
- References
- 252
- Citations by year
- 2026: 59 · 2025: 31 · 2024: 23
- FWCI
- 16.68
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Machine Learning (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- arXiv (Cornell University) (cc-by)
- Funders
- agentschap innoveren en ondernemen (HBC.2017.0226, HBC.2019.2615)
- onderzoeksraad, ku leuven (C14/17/070)
- vlaamse overheid (Onderzoeksprogramma Artificiële Intelligentie (AI) Vlaanderen)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- abstention, decision support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
