A Probabilistic Theory of Pattern Recognition

An introduction to probability theory and its applications

(1958) · Journal of the Franklin Institute · doi:10.1016/0016-0032(58)90688-4 · Cited by 29,621

Probability theory

Loève, M. (1963) · Andalas University Repository (Andalas University) · Cited by 5,938

Probability: Theory and Examples.

Prewitt, K., & Durrett, R. T. (1992) · Journal of the American Statistical Association · doi:10.2307/2290301 · Cited by 3,238

Probability and Random Processes

Grimmett, G., & Stirzaker, D. (2004) · Elsevier eBooks · doi:10.1016/b978-0-12-172651-5.x5000-3 · Cited by 2,607

Probability Theory: Independence, Interchangeability, Martingales

Lund, R., Chow, Y. S., & Teicher, H. (1998) · Journal of the American Statistical Association · doi:10.2307/2670078 · Cited by 1,095

Real Analysis and Probability.

Ross, K. A., & ASH, R. B. (1975) · American Mathematical Monthly · doi:10.2307/2319153 · Cited by 727

Determination of the optimal number of features for quadratic discriminant analysis via the normal approximation to the discriminant distribution

Hua, J., Xiong, Z., & Dougherty, E. R. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2004.08.007 · Cited by 25

An autonomous robot that eats information via interaction with humans and environments

Fujita, M., Hasegawa, R., Takagi, C. G. T., Yokono, J., & Shimomura, H. (2002) · IEEE RO-MAN · doi:10.1109/roman.2001.981934 · Cited by 25

Combined compression and classification with learning vector quantization

Baras, J. S., & Dey, S. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.782112 · Cited by 25

Weighting prototypes - a new editing approach

Paredes, R., & Vidal, E. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2000.906011 · Cited by 25

Statistical theory for image classification using deep convolutional neural network with cross-entropy loss under the hierarchical max-pooling model

Köhler, M., & Langer, S. (2024) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2024.106188 · Cited by 48

Classification of Alzheimer's disease and mild cognitive impairment by pattern recognition of EEG power and coherence

Akrofi, K., Pal, R., Baker, M. C., Nutter, B. S., & Schiffer, R. W. (2010) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2010.5495193 · Cited by 24

Cross-validation under separate sampling: strong bias and how to correct it

Braga-Neto, U., Zollanvari, A., & Dougherty, E. R. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu527 · Cited by 22

Analysis of convolutional neural network image classifiers in a hierarchical max-pooling model with additional local pooling

Walter, B. (2022) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2022.11.001 · Cited by 26

The Cross Validation Problem

Langford, J. C. (2005) · Lecture notes in computer science · doi:10.1007/11503415_47 · Cited by 24

Benchmarking local classification methods

Bischl, B., Schiffner, J., & Weihs, C. (2013) · Computational Statistics · doi:10.1007/s00180-013-0420-y · Cited by 24

Denoising deterministic time series

Lalley, S. P., & Nobel, A. B. (2006) · Dynamics of Partial Differential Equations · doi:10.4310/dpde.2006.v3.n4.a1 · Cited by 24

A statistical view of clustering performance through the theory of U -processes

Clémençon, S. (2013) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2013.10.001 · Cited by 29

Multivariate analyses applied to fetal, neonatal and pediatric MRI of neurodevelopmental disorders

Levman, J. E. D., & Takahashi, E. (2015) · NeuroImage Clinical · doi:10.1016/j.nicl.2015.09.017 · Cited by 25

On the Relationship Between Binary Classification, Bipartite Ranking, and Binary Class Probability Estimation

Narasimhan, H., & Agarwal, S. (2013) · neural information processing systems · Cited by 26

Adaptive Density Level Set Clustering

Steinwart, I. (2011) · Conference on Learning Theory · Cited by 24

Upper bounds for error rates of linear combinations of classifiers

Murua, A. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000235 · Cited by 24

Generative models for similarity-based classification

Cazzanti, L., Gupta, M. R., & Koppal, A. J. (2008) · Pattern Recognition · doi:10.1016/j.patcog.2008.01.005 · Cited by 24

Alarm reduction and correlation in defence of IP networks

Chyssler, T., Nadjm‐Tehrani, S., Burschka, S., & Burbeck, K. R. (2005) · IEEE International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE) · doi:10.1109/enabl.2004.7 · Cited by 24

Rademacher Chaos Complexities for Learning the Kernel Problem

Ying, Y., & Campbell, C. (2010) · Neural Computation · doi:10.1162/neco_a_00028 · Cited by 24

Nonproduct Data-Dependent Partitions for Mutual Information Estimation: Strong Consistency and Applications

Silva, J. F., & Narayanan, S. S. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2046077 · Cited by 24

Identification of Squamous Intraepithelial Lesions: Fluorescence of Cervical Tissue During Colposcopy

Burke, L., Modell, M. D., Niloff, J. M., Kobelin, M., Abu‐Jawdeh, G. M., & Zelenchuk, A. R. (1999) · Journal of Lower Genital Tract Disease · doi:10.1046/j.1526-0976.1999.08109.x · Cited by 24

A semiparametric density estimation approach to pattern classification

Hoti, F. J., & Holmström, L. (2003) · Pattern Recognition · doi:10.1016/j.patcog.2003.08.004 · Cited by 24

Trading Variance Reduction with Unbiasedness: The Regularized Subspace Information Criterion for Robust Model Selection in Kernel Regression

Sugiyama, M., Kawanabe, M., & Müller, K. (2004) · Neural Computation · doi:10.1162/089976604773135113 · Cited by 24

Thresholding method for dimensionality reduction in recognition systems

Schmid, N. A., & O’Sullivan, J. A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.959269 · Cited by 24

Statistical Learning: Stability is Sufficient for Generalization and Necessary and Sufficient for Consistency of Empirical Risk Minimization

Mukherjee, S., Niyogi, P., Poggio, T., & Rifkin, R. M. (2004) · doi:10.21236/ada459857 · Cited by 24

Learning From Heterogeneous Data Based on Social Interactions Over Graphs

Bordignon, V., Vlaski, S., Matta, V., & Sayed, A. H. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3232368 · Cited by 23

Tackling the problem of noisy IoT sensor data in smart agriculture: Regression noise filters for enhanced evapotranspiration prediction

Martín, J. J. A., Sáez, J. A., & Corchado, E. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121608 · Cited by 23

Foundational Principles for Large-Scale Inference: Illustrations Through Correlation Mining

Hero, A. O., & Rajaratnam, B. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494178 · Cited by 23

Submodular Functions: Learnability, Structure, and Optimization

Balcan, M.-F., & Harvey, N. J. A. (2018) · SIAM Journal on Computing · doi:10.1137/120888909 · Cited by 25

A comparison of global and semi-local approximation in T-stage stochastic optimization

Cervellera, C., & Macciò, D. (2010) · European Journal of Operational Research · doi:10.1016/j.ejor.2010.08.002 · Cited by 23

Near-Optimal Sample Compression for Nearest Neighbors

Gottlieb, L.-A. J., Kontorovich, A., & Nisnevitch, P. (2018) · IEEE Transactions on Information Theory · doi:10.1109/tit.2018.2822267 · Cited by 24

On Stochastic Optimization and Statistical Learning in Reproducing Kernel Hilbert Spaces by Support Vector Machines (SVM)

Norkin, V. I., & Keyzer, M. A. (2009) · Informatica · doi:10.15388/informatica.2009.250 · Cited by 23

Vector Field Learning via Spectral Filtering

Baldassarre, L., Rosasco, L., Barla, A., & Verri, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15880-3_10 · Cited by 23

On divergences of finite measures and their applicability in statistics and information theory

Stummer, W., & Vajda, I. (2009) · Statistics · doi:10.1080/02331880902986919 · Cited by 23

PAC-bayesian analysis of distribution dependent priors: Tighter risk bounds and stability analysis

Oneto, L., Anguita, D., & Ridella, S. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.06.019 · Cited by 23

Statistical analysis of k-nearest neighbor collaborative recommendation

Gérard Biau, A., Benoît Cadre, B., & Laurent Rouvière, C. (2010) · HAL · Cited by 23

Quantification of the Impact of Feature Selection on the Variance of Cross-Validation Error Estimation

Xiao, Y., Jianping Hua, A., & Dougherty, E. R. (2007) · EURASIP Journal on Bioinformatics and Systems Biology · doi:10.1155/2007/16354 · Cited by 23

Automated Diagnosis of Mammogram Images of Breast Cancer Using Discrete Wavelet Transform and Spherical Wavelet Transform Features: A Comparative Study

Ganesan, K., Acharya, U. R., Chua, C. K., Min, L. C., & Abraham, T. K. (2013) · Technology in Cancer Research & Treatment · doi:10.7785/tcrtexpress.2013.600262 · Cited by 23

Nonparametric Regression Estimation by Normalized Radial Basis Function Networks

Krzyżak, A., & Schäfer, D. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.842632 · Cited by 23

Region segmentation using information divergence measures

Hibbard, L. S. (2004) · Medical Image Analysis · doi:10.1016/j.media.2004.06.003 · Cited by 23

Confidence Intervals for the True Classification Error Conditioned on the Estimated Error

Xu, Q., Jianping Hua, A., Braga-Neto, U., Xiong, Z., Suh, E. B., & Dougherty, E. R. (2006) · Technology in Cancer Research & Treatment · doi:10.1177/153303460600500605 · Cited by 23

On the V γ Dimension for Regression in Reproducing Kernel Hilbert Spaces

Evgeniou, T., & Pontil, M. (1999) · Lecture notes in computer science · doi:10.1007/3-540-46769-6_9 · Cited by 23

Geometric Parameters in Learning Theory

Mendelson, S. (2004) · Lecture notes in mathematics · doi:10.1007/978-3-540-44489-3_17 · Cited by 23

Suboptimality of Penalized Empirical Risk Minimization in Classification

Lecué, G. (2007) · Springer eBooks · doi:10.1007/978-3-540-72927-3_12 · Cited by 21

Universal Denoising for the Finite-Input General-Output Channel

Dembo, A., & Weissman, T. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.844104 · Cited by 23

Minimax nonparametric classification. II. Model selection for adaptation

Yang, Y. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.796369 · Cited by 23

Feedforward Neural Nets

Fine, T. L. (1999) · Wiley eBooks · doi:10.1002/047134608x.w5106 · Cited by 26

Using visualization, variable selection and feature extraction to learn from industrial data

Laine, S. (2003) · Aaltodoc (Aalto University) · Cited by 23

TREE-STRUCTURED REGRESSION AND THE DIFFERENTIATION OF INTEGRALS 1Preprint

Olshen, R. A. (2012) · Cited by 23

Fast Semantic-Aware Motion State Detection for Visual SLAM in Dynamic Environment

Singh, G., Wu, M.-Q., Đỗ, M. V., & Lam, S.-K. (2022) · IEEE transactions on intelligent transportation systems (Print) · doi:10.1109/tits.2022.3213694 · Cited by 21

Bayes classification of imprecise information of interval type

Kulczycki, P., & Kowalski, P. A. (2011) · Control and Cybernetics · Cited by 22

A Risk Minimization Principle for a Class of Parzen Estimators

Kristiaan Pelckmans, A., Suykens, J. A. K., & Moor, B. D. (2007) · Cited by 22

CONVERGENCE OF A LEAST‐SQUARES MONTE CARLO ALGORITHM FOR AMERICAN OPTION PRICING WITH DEPENDENT SAMPLE DATA

Zanger, D. Z. (2016) · Mathematical Finance · doi:10.1111/mafi.12125 · Cited by 22

Smart Fire Detection System with Early Notifications Using Machine Learning

Mahmud, M. S., Islam, M. S., & Rahman, M. A. (2017) · International Journal of Computational Intelligence and Applications · doi:10.1142/s1469026817500092 · Cited by 22

Supervised Classification: Quite a Brief Overview

Loog, M. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-811788-0.00005-6 · Cited by 28

A decision-theoretic approach to the evaluation of machine learning algorithms in computational drug discovery

Watson, O. P., Cortés‐Ciriano, I., Taylor, A. R., & Watson, J. A. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz293 · Cited by 25

Condensed Nearest Neighbor Data Domain Description

Angiulli, F. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1086 · Cited by 22

Maximum-Likelihood Estimation of the Discrete Coefficient of Determination in Stochastic Boolean Systems

Chen, T., & Braga-Neto, U. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2264054 · Cited by 22

Convergence of a Least‐Squares Monte Carlo Algorithm for Bounded Approximating Sets

Zanger, D. Z. (2009) · Applied Mathematical Finance · doi:10.1080/13504860802516881 · Cited by 22

On the Almost Sure Rate of Convergence of Linear Stochastic Approximation Algorithms

Tadić, V. B. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2003.821971 · Cited by 22

On-Line Regression Competitive with Reproducing Kernel Hilbert Spaces

Vovk, V. (2006) · Lecture notes in computer science · doi:10.1007/11750321_43 · Cited by 22

Universal Consistency of Local Polynomial Kernel Regression Estimates

Köhler, M. (2002) · Annals of the Institute of Statistical Mathematics · doi:10.1023/a:1022427805425 · Cited by 22

Classification-Driven Pathological Neuroimage Retrieval Using Statistical Asymmetry Measures

Liu, Y.-X., Dellaert, F., Rothfus, W., Moore, A., Schneider, J., & Kanade, T. (2001) · International Conference on Medical Image Computing and Computer-Assisted Intervention · doi:10.1007/3-540-45468-3_79 · Cited by 30

2D-3D Migration of Large Chemical Inventories with Conformational Multiplication. Application of the Genetic Algorithm

Mekenyan, O. G., Pavlov, T. S., Grancharov, V., Todorov, M., Schmieder, P. K., & Veith, G. D. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci0498463 · Cited by 22

Dyadic Classification Trees via Structural Risk Minimization

Scott, C. D., & Nowak, R. M. (2002) · Cited by 22

Computer-aided morphological analysis of Holter ECG recordings based on support vector learning system

Jankowski, S., Oręziak, A., Skorupski, A., Kowalski, H. A., Szymanski, Z., & Piątkowska-Janko, E. (2003) · Computers in cardiology · doi:10.1109/cic.2003.1291226 · Cited by 22

Multidimensional Indexing Structures for Content‐Based Retrieval

Castelli, V. (2001) · doi:10.1002/0471224634.ch14 · Cited by 22

On generalized entropies, Bayesian decisions and statistical diversity

Vajda, I., & Zvárová, J. (2007) · Czech digital mathematics library · Cited by 22

CONSTRUCTION AND EVALUATION OF CLASSIFIERS FOR FORENSIC DOCUMENT ANALYSIS1Preprint

Saunders, C. P., Davis, L. J., Lamas, A. C., Miller, J. J., & Gantz, D. T. (2016) · Cited by 22

Over-parametrized deep neural networks minimizing the empirical risk do not generalize well

Köhler, M., & Krzyżak, A. (2021) · Bernoulli · doi:10.3150/21-bej1323 · Cited by 32

Performance of empirical risk minimization in linear aggregation

Lecué, G., & Mendelson, S. (2016) · Bernoulli · doi:10.3150/15-bej701 · Cited by 21

Sets of approximating functions with finite Vapnik–Chervonenkis dimension for nearest-neighbors algorithms

Klęsk, P., & Korzeń, M. (2011) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.07.012 · Cited by 21

Wavelet based shock wave and muzzle blast classification for different supersonic projectiles

Libal, U., & Spyra, K. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.02.037 · Cited by 21

Optimal Feature Selection in High-Dimensional Discriminant Analysis

Kolar, M., & Liu, H. (2015) · IEEE Transactions on Information Theory · doi:10.1109/tit.2014.2381241 · Cited by 21

Bayesian hypothesis testing for pattern discrimination in brain decoding

Olivetti, E., Veeramachaneni, S., & Nowakowska, E. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.04.025 · Cited by 21

Online Learning with Samples Drawn from Non-identical Distributions

Hu, T., & Zhou, D. (2009) · Cited by 21

Exact representation of the second-order moments for resubstitution and leave-one-out error estimation for linear discriminant analysis in the univariate heteroskedastic Gaussian model

Zollanvari, A., Braga-Neto, U., & Dougherty, E. R. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.08.006 · Cited by 21

The Value of Labeled and Unlabeled Examples when the Model is Imperfect

Sinha, K. P., & Belkin, M. (2007) · Cited by 21

Concentration Bounds for Unigrams Language Model

Drukh, E., & Mansour, Y. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-27819-1_12 · Cited by 21

Analysis of Classification-based Policy Iteration Algorithms

Lazaric, A., Ghavamzadeh, M., & Munos, R. (2016) · LillOA (Université de Lille (University Of Lille)) · Cited by 21

Best subset binary prediction

Chen, L., & Lee, S. (2018) · Journal of Econometrics · doi:10.1016/j.jeconom.2018.05.001 · Cited by 21

Grammatical evolution decision trees for detecting gene-gene interactions

Motsinger‐Reif, A. A., Deodhar, S., Winham, S. J., & Hardison, N. E. (2010) · BioData Mining · doi:10.1186/1756-0381-3-8 · Cited by 21

Bandit-Based Estimation of Distribution Algorithms for Noisy Optimization: Rigorous Runtime Analysis

Rolet, P., & Teytaud, O. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13800-3_8 · Cited by 21

Normalization Benefits Microarray-Based Classification

Jianping Hua, A., Balagurunathan, Y., Chen, Y., Lowey, J., Bittner, M. L., Xiong, Z., Suh, E. B., & Dougherty, E. R. (2006) · EURASIP Journal on Bioinformatics and Systems Biology · doi:10.1155/bsb/2006/43056 · Cited by 21

Bounding the generalization error of convex combinations of classifiers: balancing the dimensionality and the margins

Koltchinskii, V. I., Panchenko, D., & Lozano, F. (2003) · The Annals of Applied Probability · doi:10.1214/aoap/1042765667 · Cited by 21

Consistency of support vector machines for forecasting the evolution of an unknown ergodic dynamical system from observations with unknown noise

Steinwart, I., & Anghel, M. (2009) · The Annals of Statistics · doi:10.1214/07-aos562 · Cited by 24

Bounds on the Generalization Performance of Kernel Machine Ensembles

Evgeniou, T., Perez-Breva, L., Pontil, M., & Poggio, T. (2000) · Cited by 21

A new family of proximity graphs: Class cover catch digraphs

DeVinney, J. G., & Priebe, C. E. (2006) · Discrete Applied Mathematics · doi:10.1016/j.dam.2006.04.004 · Cited by 21

Probabilistic Models for Bacterial Taxonomy

Gyllenberg, M., & Koski, T. (2001) · International Statistical Review · doi:10.1111/j.1751-5823.2001.tb00458.x · Cited by 20

Fast Rates for Regularized Least-Squares Algorithm

Caponnetto, A., & Vito, E. D. (2005) · doi:10.21236/ada454989 · Cited by 21

Pattern Recognition for Conditionally Independent DataPreprint

Ryabko, D. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0507040 · Cited by 21

Minimizers of the Empirical Risk and Risk MonotonicityPreprint

Loog, M., Viering, T. J., & Mey, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05476 · Cited by 20

Tree-structured regression and the differentiation of integrals

Olshen, R. A. (2007) · The Annals of Statistics · doi:10.1214/009053606000001000 · Cited by 20

Pattern recognition via projection-based NN rules

Fraiman, R., Justel, A., & Svarc, M. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2009.12.009 · Cited by 20

Automated Synthesis of Safe Autonomous Vehicle Control Under Perception Uncertainty

Jha, S., & Raman, V. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-40648-0_10 · Cited by 20

Measuring the expressivity of graph kernels through Statistical Learning Theory

Oneto, L., Navarin, N., Donini, M., Sperduti, A., Aiolli, F., & Anguita, D. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.088 · Cited by 20

Registration of 2D x-ray images to 3D MRI by generating pseudo-CT data

van der Bom, M. J., Pluim, J. P. W., Gounis, M. J., van de Kraats, E. B., Sprinkhuizen, S. M., Timmer, J., Homan, R., & Bartels, L. W. (2011) · Physics in Medicine and Biology · doi:10.1088/0031-9155/56/4/010 · Cited by 21

Quantum computing and supervised machine learning

Oneto, L., Ridella, S., & Anguita, D. (2017) · Quantum Inspired Computational Intelligence · doi:10.1016/b978-0-12-804409-4.00002-4 · Cited by 11

A statistical theory of optimal decision-making in sports betting

Dmochowski, J. P. (2023) · PLOS ONE · doi:10.1371/journal.pone.0287601 · Cited by 5

Untitled work

(2015) · Cited by 2,857

Learning Pattern ClassificationA Survey

(2009) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9780470544907.ch7 · Cited by 2

Automatic pattern recognition: a study of the probability of error

Devroye, L. (1988) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.3915 · Cited by 140

Non-parametric distance-based classification techniques and their applications

Pla, F., Radeva, P. I., & Vitria, J. M. (2008) · Pattern Analysis and Applications · doi:10.1007/s10044-008-0132-z

Statistical learning theory: a tutorial

Kulkarni, S. R., & Harman, G. H. (2011) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.179 · Cited by 51

Nonparametric pattern recognition

Kasdan, H. L. (1971) · Cited by 2