Twenty Years of Mixture of Experts
The DOI matches its Crossref record; 141 of the 141 references it cites were found in a registry or an index.
Abstract
In this paper, we provide a comprehensive survey of the mixture of experts (ME). We discuss the fundamental models for regression and classification and also their training with the expectation-maximization algorithm. We follow the discussion with improvements to the ME model and focus particularly on the mixtures of Gaussian process experts. We provide a review of the literature for other training methods, such as the alternative localized ME training, and cover the variational learning of ME in detail. In addition, we describe the model selection literature which encompasses finding the optimum number of experts, as well as the depth of the tree. We present the advances in ME in the classification area and present some issues concerning the classification model. We list the statistical properties of ME, discuss how the model has been modified over the years, compare ME to some popular algorithms, and list several applications. We conclude our survey with future directions and provide a list of publicly available datasets and a list of publicly available software that implement ME. Finally, we provide examples for regression and classification. We believe that the study described in this paper will provide quick access to the relevant literature for researchers and practitioners who would like to improve or use ME, and that it will stimulate further studies in ME.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These two models on Edge TPU also consume higher power (5W) than Inception V3 and ResNet50 (4.6W).”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [206]
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Pattern Recognition with Fuzzy Objective Function Algorithms
Bezdek, J. C. (1981) · doi:10.1007/978-1-4757-0450-1 · Cited by 9,881
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
(2006) · Springer eBooks · Cited by 8,123
Multivariate Adaptive Regression Splines
Friedman, J. H. (1991) · The Annals of Statistics · doi:10.1214/aos/1176347963 · Cited by 8,000
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Top 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667
Monte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
Information Theory, Inference, and Learning Algorithms
(2004) · Kybernetes · doi:10.1108/03684920410534506 · Cited by 4,937
The Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,846
Control Methods Used in a Study of the Vowels
Peterson, G. E., & Barney, H. L. (1952) · The Journal of the Acoustical Society of America · doi:10.1121/1.1906875 · Cited by 2,837 · cited 1×
“3) Vowel formant frequency database by Peterson and Barney [130], available at: http://www.cs.cmu.edu/afs/cs/ project/ai-repository/ai/areas/speech/database/pb/0.html.”
BackgroundHierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,673
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (1999) · Springer Texts in Statistics · doi:10.1007/978-1-4757-3071-5 · Cited by 2,278
Advances in Neural Information Processing Systems 5
Zemel, R. S., Williams, C. K. I., & Mozer, M. C. (1993) · Cited by 1,896
mixtools: An R Package for Analyzing Finite Mixture Models
Benaglia, T., Chauveau, D., Hunter, D. R., & Young, D. (2009) · Journal of Statistical Software · doi:10.18637/jss.v032.i06 · Cited by 1,271
Factorial Hidden Markov Models
Ghahramani, Z., & Jordan, M. I. (1997) · Machine Learning · doi:10.1023/a:1007425814087 · Cited by 1,157
Some aspects of the spline smoothing approach to non-parametric regression curve fitting
Silverman, B. W. (1985) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1985.tb01327.x · Cited by 1,117
Boosting Algorithms as Gradient Descent
Mason, L., Baxter, J., Bartlett, P. L., & Frean, M. R. (1999) · Cited by 767
(2001) · Probabilistic Risk Analysis · doi:10.1017/cbo9780511813597.005 · Cited by 714
Principles of Risk Minimization for Learning Theory
Vapnik, V. N. (1991) · neural information processing systems · Cited by 692
Machine Learning for Sequential Data: A Review
Dietterich, T. G. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-70659-3_2 · Cited by 666
A patient-adaptable ECG beat classifier using a mixture of experts approach
Hu, Y. H., Palreddy, S., & Tompkins, W. J. (1997) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.623058 · Cited by 614
Support vector machines experts for time series forecasting
Cao, L. (2003) · Neurocomputing · doi:10.1016/s0925-2312(02)00577-5 · Cited by 424
Infinite Mixtures of Gaussian Process Experts
Rasmussen, C. E., & Ghahramani, Z. (2001) · Cited by 377
Convergence results for the EM approach to mixtures of experts architectures
Jordan, M. I., & Xu, L. (1995) · Neural Networks · doi:10.1016/0893-6080(95)00014-3 · Cited by 305
Input-output HMMs for sequence processing
Bengio, Y., & Frasconi, P. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536317 · Cited by 300
NONLINEAR GATED EXPERTS FOR TIME SERIES: DISCOVERING REGIMES AND AVOIDING OVERFITTING
WEIGEND, A. S., MANGEAS, M., & SRIVASTAVA, A. N. (1995) · International Journal of Neural Systems · doi:10.1142/s0129065795000251 · Cited by 253
Mixture of experts for classification of gender, ethnic origin, and pose of human faces
Gutta, S., Huang, J. R. J., Jonathon, P., & Wechsler, H. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.857774 · Cited by 226
An Alternative Model for Mixtures of Experts
Xu, L., Jordan, M. I., & Hinton, G. E. (1994) · Cited by 215
Mixtures of Gaussian Processes
Volker Tresp, C. (2000) · Cited by 206
Computational learning theory: an introduction
Anthony, M., & Biggs, N. (1992) · Cambridge University Press eBooks · Cited by 202
Bayesian Methods for Mixtures of Experts
Waterhouse, S. R., Mackay, D., & Robinson, A. J. (1995) · Cited by 178
Geweke, J., & Keane, M. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.05.022 · Cited by 177
Hierarchical mixtures of experts and the EM algorithm
Jordan, M. I., & Jacobs, R. A. (2005) · Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan) · doi:10.1109/ijcnn.1993.716791 · Cited by 159
Peng, F., Jacobs, R. A., & Tanner, M. A. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476965 · Cited by 155
Bayesian model search for mixture models based on optimizing variational bounds
Ueda, N., & Ghahramani, Z. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00040-0 · Cited by 151
Hierarchies of adaptive experts
Jordan, M. I., & Jacobs, R. A. (1991) · neural information processing systems · Cited by 150
Clements, M. P., & Smith, J. P. (2000) · Journal of Forecasting · doi:10.1002/1099-131x(200007)19:4<375::aid-for779>3.0.co;2-u · Cited by 147
Jiang, W., & Tanner, M. A. (1999) · The Annals of Statistics · doi:10.1214/aos/1018031265 · Cited by 141
Bayesian Hierarchical Mixtures of ExpertsPreprint
Bishop, C., & Svensen, M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.2447 · Cited by 139
Predicting the exchange traded fund DIA with a combination of genetic algorithms and neural networks
Massimiliano Versace, A., Bhatt, R., Hinds, O., & Shiffer, M. (2004) · Expert Systems with Applications · doi:10.1016/j.eswa.2004.05.018 · Cited by 139
Improved learning algorithms for mixture of experts in multiclass classification
Chen, K., Xu, L., & Chi, H. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00043-x · Cited by 131
A mixture of experts model for rank data with applications in election studies
Gormley, I. C., & Murphy, T. B. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas178 · Cited by 130
On a logistic mixture autoregressive model
Wong, C. S. (2001) · Biometrika · doi:10.1093/biomet/88.3.833 · Cited by 128
Classification of seismic signals by integrating ensembles of neural networks
Shimshoni, Y., & Intrator, N. (1998) · IEEE Transactions on Signal Processing · doi:10.1109/78.668782 · Cited by 120
An Alternative Infinite Mixture Of Gaussian Process Experts
Meeds, E., & Osindero, S. (2005) · Cited by 110
Hierarchical Gaussian process mixtures for regression
Shi, J. Q., Murray‐Smith, R., & Titterington, D. M. (2005) · Statistics and Computing · doi:10.1007/s11222-005-4787-7 · Cited by 109
Boosted Mixture of Experts: An Ensemble Learning Scheme
Avnimelech, R., & Intrator, N. (1999) · Neural Computation · doi:10.1162/089976699300016737 · Cited by 103
On the identifiability of mixtures-of-experts
Jiang, W., & Tanner, M. A. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00066-0 · Cited by 100
Recognizing Handwritten Digits Using Mixtures of Linear Models
Hinton, G. E., Revow, M. D., & Dayan, P. (1994) · Cited by 97
Evaluation of Adaptive Mixtures of Competing Experts
Nowlan, S. J., & Hinton, G. E. (1990) · neural information processing systems · Cited by 94
A mixture of experts model for rank data with applications in election studies
Gormley, I. C., & Murphy, T. B. (2015) · Arrow@dit (Dublin Institute of Technology) · Cited by 92
Jordan, M. I., Ghahramani, Z., & Saul, L. K. (1996) · Cambridge University Engineering Department Publications Database · Cited by 89
Variational Mixture of Gaussian Process Experts
Yuan, C., & Neubauer, C. (2008) · Cited by 84
Classification using hierarchical mixtures of experts
Waterhouse, S. R., & Robinson, A. J. (2002) · Machine learning for signal processing ... · doi:10.1109/nnsp.1994.366050 · Cited by 84
Fast algorithms for large scale conditional 3D prediction
Bo, L., Sminchisescu, C., Kanaujia, A., & Metaxas, D. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587578 · Cited by 84
Bias/Variance Analyses of Mixtures-of-Experts Architectures
Jacobs, R. A. (1997) · Neural Computation · doi:10.1162/neco.1997.9.2.369 · Cited by 82
A mixture of feature experts approach for protein-protein interaction prediction
Qi, Y., Klein‐Seetharaman, J., & Bar‐Joseph, Z. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-s10-s6 · Cited by 79
A mixture-of-experts framework for adaptive Kalman filtering
Chaer, W. S., Bishop, R. H., & Ghosh, J. (1997) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/3477.584952 · Cited by 75
BM³E : Discriminative Density Propagation for Visual Tracking
Sminchisescu, C., Kanaujia, A., & Metaxas, D. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1111 · Cited by 73
Lima, C. A. M., Coelho, A. L. V., & Zuben, F. J. V. (2007) · Information Sciences · doi:10.1016/j.ins.2007.01.009 · Cited by 66
Mixtures of Controllers for Jump Linear and Non-Linear Plants
Cacciatore, T. W., & Nowlan, S. J. (1993) · Cited by 62
Ng, S., & McLachlan, G. J. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.826217 · Cited by 61
A mixture of experts latent position cluster model for social network data
Gormley, I. C., & Murphy, T. B. (2010) · Statistical Methodology · doi:10.1016/j.stamet.2010.01.002 · Cited by 59
Mixtures-of-Experts of Autoregressive Time Series: Asymptotic Normality and Model Specification
de Carvalho, A. X. Y., & Tanner, M. A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.839356 · Cited by 56
On the Approximation Rate of Hierarchical Mixtures-of-Experts for Generalized Linear Models
Jiang, W., & Tanner, M. A. (1999) · Neural Computation · doi:10.1162/089976699300016403 · Cited by 52
A Bayesian Approach to Model Selection in Hierarchical Mixtures-of-Experts Architectures
Jacobs, R. A., Peng, F., & Tanner, M. A. (1997) · Neural Networks · doi:10.1016/s0893-6080(96)00050-0 · Cited by 51
Bayesian regression and classification using mixtures of Gaussian processes
Shi, J., Murray‐Smith, R., & Titterington, D. M. (2003) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.744 · Cited by 48
Input partitioning to mixture of experts
Tang, B., Heywood, M. I., & Shepherd, M. A. (2003) · doi:10.1109/ijcnn.2002.1005474 · Cited by 46
Mixture of Experts Classification Using a Hierarchical Mixture Model
Titsias, M. K., & Likas, A. C. (2002) · Neural Computation · doi:10.1162/089976602320264060 · Cited by 43
Error bounds for functional approximation and estimation using mixtures of experts
Zeevi, A. J., Meir, R., & Maiorov, V. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.669150 · Cited by 41
Integrative mixture of experts to combine clinical factors and gene markers
Cao, K. L., Meugnier, E., & McLachlan, G. J. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq107 · Cited by 41
Extension of mixture-of-experts networks for binary classification of hierarchical data
Ng, S., & McLachlan, G. J. (2007) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2007.06.001 · Cited by 40
Novel Self-Organizing Takagi Sugeno Kang Fuzzy Neural Networks Based on ART-like Clustering
Wang, D., Quek, C. H., & Ng, G. S. (2004) · Neural Processing Letters · doi:10.1023/b:nepl.0000039425.58002.36 · Cited by 38
Hidden Markov models with states depending on observations
Li, Y. (2004) · Pattern Recognition Letters · doi:10.1016/j.patrec.2004.09.050 · Cited by 36
View-independent face recognition with Mixture of Experts
Ebrahimpour, R., Kabir, E., Esteky, H., & Yousefi, M. R. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.08.021 · Cited by 33
Ensemble Methods for Phoneme Classification
Waterhouse, S. R., & Cook, G. (1996) · Cited by 32
Xing, H.-J., & Hu, B.-G. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.02.010 · Cited by 30
Yüksel, S. E., Ramachandran, G., Gader, P., Wilson, J. N., Heo, G., & Ho, K. C. (2008) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2008.4778956 · Cited by 30
Self-citationOn the asymptotic normality of hierarchical mixtures-of-experts for generalized linear models
Jiang, W., & Tanner, M. A. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.841177 · Cited by 30
An Efficient EM Approach to Parameter Learning of the Mixture of Gaussian Processes
Yang, Y. T., & Ma, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21090-7_20 · Cited by 29
A modified HME architecture for text-dependent speaker identification
Chen, K., Xie, D., & Chi, H. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536325 · Cited by 29
Learning Appearance Based Models: Mixtures of Second Moment Experts
Bregler, C., & Malik, J. (1996) · Cited by 29
Learning Fine Motion by Markov Mixtures of Experts
Meilă, M., & Jordan, M. I. (1995) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 28
Hierarchical Mixture of Classification Experts Uncovers Interactions between Brain Regions
Yao, B., Walther, D. B., Beck, D. M., & Fei-Fei, L. (2009) · neural information processing systems · Cited by 28
Context-dependent hybrid HME/HMM speech recognition using polyphone clustering decision trees
Fritsch, J., Finke, M., & Waibel, A. H. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1997.598867 · Cited by 28
Adaptively growing hierarchical mixtures of experts
Fritsch, J., Finke, M., & Waibel, A. (1996) · doi:10.5445/ir/186097 · Cited by 26
Time Series Prediction using Mixtures of Experts
Zeevi, A. J., Meir, R., & Adler, R. J. (1996) · neural information processing systems · Cited by 22
Recognition of Persian handwritten digits using Characterization Loci and Mixture of Experts
Ebrahimpour (2009) · International Journal of Digital Content Technology and its Applications · doi:10.4156/jdcta.vol3.issue3.5 · Cited by 21
On Consistency of Bayesian Inference with Mixtures of Logistic Regression
Ge, Y., & Jiang, W. (2005) · Neural Computation · doi:10.1162/089976606774841594 · Cited by 20
Deformable model fitting with a mixture of local experts
Saragih, J., Lucey, S., & Cohn, J. F. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459461 · Cited by 20
Lu, Z. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.12.002 · Cited by 18
Advances in using hierarchical mixture of experts for signal classification
Ramamurti, V., & Ghosh, J. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1996.550800 · Cited by 18
A bayesian hierarchical mixture of experts approach to estimate speech quality
Mossavat, S. I., Amft, O., de Vries, B., Petkov, P. N., & Kleijn, W. B. (2010) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2010.5516203 · Cited by 18
Hierarchical mixture of experts and Max-Min propagation neural networks
Estévez, P. A., & Nakano, R. (2002) · doi:10.1109/icnn.1995.488257 · Cited by 17
Mixture of Experts Modelling with Social Science Applications
Gormley, I. C., & Murphy, T. B. (2011) · Wiley series in probability and statistics · doi:10.1002/9781119995678.ch5 · Cited by 16
A Mixture of Experts Network Structure for EEG Signals Classification
Güler, İ., Übeylı, E. D., & Güler, N. F. (2005) · doi:10.1109/iembs.2005.1617029 · Cited by 15
Financial Time Series Prediction Using Mixture of Experts
Yümlü, M. S., Gürgen, F. S., & Okay, N. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39737-3_69 · Cited by 15
The EM Algorithm, Variational Approximations and Expectation Propagation for Mixtures
Titterington, D. M. (2011) · Wiley series in probability and statistics · doi:10.1002/9781119995678.ch1 · Cited by 15
A mixture-of-experts framework for text classification
Estabrooks, A., & Japkowicz, N. (2001) · doi:10.3115/1117822.1117828 · Cited by 14
Time-line hidden Markov experts for time series prediction
Wang, X., Whigham, P. A., Deng, J. D., & Purvis, M. (2003) · International Conference on Neural Networks and Signal Processing · doi:10.1109/icnnsp.2003.1279393 · Cited by 14
Learning in neural networks and stochastic approximation methods with averaging
Shcherbakov, P., Tikhonov, S. N., Mason, J. D., & Warwick, K. (1994) · Cited by 13
A Single Loop EM Algorithm for the Mixture of Experts Architecture
Yang, Y. T., & Ma, J. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01510-6_109 · Cited by 12
Hierarchical mixtures of experts methodology applied to continuous speech recognition
Zhao, Y., Schwartz, R. M., Sroka, J. J., & Makhoul, J. (2002) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1995.479726 · Cited by 12
Optimal model inference for Bayesian mixture of experts
Ueda, N., & Ghahramani, Z. (2002) · IEEE Workshop on Neural Networks for Signal Processing (NNSP) · doi:10.1109/nnsp.2000.889405 · Cited by 12
Pruning and growing hierachical mixtures of experts
Waterhouse, S. R. (1995) · doi:10.1049/cp:19950579 · Cited by 12
Image transport regression using mixture of experts and discrete Markov Random Fields
Michel, F., & Nikos Paragios, A. (2010) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2010.5490217 · Cited by 12
A constructive learning algorithm for an HME
Saito, K., & Nakano, R. (2002) · doi:10.1109/icnn.1996.549080 · Cited by 10
Hidden Markov mixtures of experts for prediction of non-stationary dynamics
Liehr, S., Pawelzik, K. R., Kohlmorgen, J., Lemm, S., & Müller, K. R. (2003) · doi:10.1109/nnsp.1999.788138 · Cited by 10
Learning Ambiguities Using Bayesian Mixture of Experts
Kanaujia, A., & Metaxas, D. (2006) · Proceedings - International Conference on Tools with Artificial Intelligence, TAI · doi:10.1109/ictai.2006.73 · Cited by 9
Mixture of Experts for Stellar Data Classification
Jiang, Y., & Guo, P. (2005) · Lecture notes in computer science · doi:10.1007/11427445_50 · Cited by 8
Hybrid genetic training of gated mixtures of experts for nonlinear time series forecasting
Coelho, A. L. V., Lima, C. A. M., & Zuben, F. J. V. (2004) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2003.1245713 · Cited by 8
Variational Mixture of Experts for Classification with Applications to Landmine Detection
Yüksel, S. E., & Gader, P. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.730 · Cited by 8
Self-citationThe VC Dimension for Mixtures of Binary Classifiers
Jiang, W. (2000) · Neural Computation · doi:10.1162/089976600300015367 · Cited by 8
A Mixture of Recurrent Neural Networks for Speaker Normalisation
Trentin, E., & Giuliani, D. (2001) · Neural Computing and Applications · doi:10.1007/s005210170004 · Cited by 7
Trentin, E., & Cattoni, R. (1999) · Connection Science · doi:10.1080/095400999116241 · Cited by 7
Asymptotic Convergence Properties of the EM Algorithm for Mixture of Experts
Yang, Y. T., & Ma, J. (2011) · Neural Computation · doi:10.1162/neco_a_00154 · Cited by 7
Hierarchical mixtures of experts methodology applied to continuous speech recognition
Zhao, Y., Schwartz, R. M., Sroka, J. J., & Makhoul, J. I. (2002) · IEEE Workshop on Neural Networks for Signal Processing (NNSP) · doi:10.1109/nnsp.1995.514900 · Cited by 7
Customized ECG beat classifier using mixture of experts
Hu, Y. H., Palreddy, S., & Tompkins, W. J. (2002) · IEEE Workshop on Neural Networks for Signal Processing (NNSP) · doi:10.1109/nnsp.1995.514920 · Cited by 7
Harb, H., Chen, L., & Auloge, J. Y. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2004.1394479 · Cited by 6
Speaker identification based on the time-delay hierarchical mixture of experts
Chen, K., Xie, D., & Chi, H. (2002) · doi:10.1109/icnn.1995.488992 · Cited by 6
Fritsch, J., & Finke, M. (1997) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1997-521 · Cited by 4
A note on mixtures of experts for multiclass responses
Ge, Y., & Jiang, W. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143886 · Cited by 3
Combine multiple time-delay HMEs for speaker identification
Chen, K., Xie, D., & Chi, H. (2002) · doi:10.1109/icnn.1996.549211 · Cited by 3
View-Independent Face Recognition with Biological Features Based on Mixture of Experts
Hajiany, A., Makhsoos, N. T., & Ebrahimpour, R. (2009) · International Conference on Intelligent Systems Design and Applications (ISDA) · doi:10.1109/isda.2009.57 · Cited by 3
3D object recognition with a specialized mixtures of experts architecture
Walter, P., Elsen, I., Müller, H. J., & Kraiss, K. (2003) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1999.836243 · Cited by 2
Research works printed but not linked: 12
- Sminchisescu, 2004, Learning to reconstruct 3D human motion from Bayesian mixture of experts, a probabilistic discriminative approach
- 10.2307/2984875 · doi:10.2307/2984875
- Kim, Boosting and random forest for visual recognition
- 10.2307/2984875 · doi:10.2307/2984875
- Hinton, 2007, Introduction to Machine Learning, Decision Trees and Mixtures of Experts
- Waterhouse, 1997, Classification and regression using mixtures of experts
- 10.21236/ada307097 · DOI · Paper page
- 10.1214/aos/1176347968 · doi:10.1214/aos/1176347968
- Tuerk, 2001, The state based mixture of experts HMM with applications to the recognition of spontaneous speech
- Cheung, 1995, Application of mixture of experts model to financial time series forecasting, 1
- Evers, 2007, HME: Methods for Fitting Hierarchical Mixtures of Experts R Package Version 0.1–0
- 2012, The R Project for Statistical Computing
Cited by
When Gaussian Process Meets Big Data: A Review of Scalable GPs
Liu, H., Ong, Y.-S., Shen, X., & Cai, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2957109 · Cited by 878
Multi-level Factorisation Net for Person Re-identification
Chang, X., Hospedales, T. M., & Xiang, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00225 · Cited by 550
De Caigny, A., Coussement, K., & De Bock, K. W. (2018) · European Journal of Operational Research · doi:10.1016/j.ejor.2018.02.009 · Cited by 524
Dynamic classifier selection: Recent advances and perspectives
Cruz, R. M. O., Sabourin, R., & Cavalcanti, G. D. C. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.09.010 · Cited by 440
Generalizing DTW to the multi-dimensional case requires an adaptive approach
Shokoohi-Yekta, M., Hu, B., Jin, H., Wang, J., & Keogh, E. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-016-0455-0 · Cited by 320
Metadata
- Authors
- Yuksel, S. E., Wilson, J. N., & Gader, P. D.
- Affiliations
- University of Florida (US)
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2012-08
- Volume
- 23
- Issue
- 8
- Pages
- 1177-1193
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2068238590
- Cited by
- 606
- References
- 141
- Citations by year
- 2026: 62 · 2025: 90 · 2024: 51 · 2023: 56 · 2022: 53 · 2021: 65 · 2020: 36 · 2019: 62 · 2018: 38 · 2017: 23 · 2016: 25 · 2015: 16 · 2014: 12 · 2013: 10 · 2012: 6
- FWCI
- 13.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Methods and Mixture Models
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- mixture of experts, regression analysis, classification, expectation-maximization training, variational learning, model selection, tree depth, statistical properties
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.