Towards deeper understanding: Deep convex networks for semantic utterance classification
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Following the recent advances in deep learning techniques, in this paper, we present the application of special type of deep architecture - deep convex networks (DCNs) - for semantic utterance classification (SUC). DCNs are shown to have several advantages over deep belief networks (DBNs) including classification accuracy and training scalability. However, adoption of DCNs for SUC comes with non-trivial issues. Specifically, SUC has an extremely sparse input feature space encompassing a very large number of lexical and semantic features. This is about a few thousand times larger than the feature space for acoustic modeling, yet with a much smaller number of training samples. Experimental results we obtained on a domain classification task for spoken language understanding demonstrate the effectiveness of DCNs. The DCN-based method produces higher SUC accuracy than the Boosting-based discriminative classifier with word trigrams.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning a better representation of speech soundwaves using restricted boltzmann machines
Jaitly, N., & Hinton, G. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947700 · Cited by 231 · cited 1×
“Following the introduction of this RBM learning and layer-by-layer construction of deep architectures, DBNs have been successfully used for numerous tasks in speech and language processing, including acoustic modeling [8, 9, 10] and intent determination [6].”
Method
Research works printed but not linked: 22
- deng, 0, Binary coding of speech spectrograms using a deep auto-encoder, Proc Interspeech September 2010
- 10.1109/ICASSP.2011.5947637 · DOI
- 10.1006/jcss.1997.1504 · DOI · Paper page
- 10.1109/ICASSP.2011.5947631 · DOI
- 10.1109/ASRU.2003.1318506 · doi:10.1109/asru.2003.1318506
- 10.1162/153244303322533223 · DOI · Paper page
- yang, 0, A comparative study on feature selection in text categorization, Proceedings of ICML 1997
- 10.1016/S0167-6393(97)00040-X · DOI · Paper page
- chu-carroll, 1999, Vector-based natural language call routing, Computational Linguistics, 25, 361
- deng, 0, Deep convex nets: A scalable architecture for speech pattern classification, Proceedings of Interspeech 2011 Florence Italy
- 10.1109/ICASSP.2012.6288333 · DOI · Paper page
- 10.1109/MSP.2011.941852 · doi:10.1109/msp.2011.941852
- 10.1023/A:1007649029923 · DOI · Paper page
- mohamed, 0, Investigation of full-sequence training of deep belief networks for speech recognition, Proc Interspeech September 2010
- 10.1109/MSP.2005.1511822 · DOI
- tur, 2011, Intent Determination and Spoken Utterance Classification Chpater 3 in Book Spoken Language Understanding
- 10.1162/neco.2006.18.7.1527 · DOI · Paper page
- 10.1109/ICASSP.2011.5947649 · DOI · Paper page
- 10.1109/TASL.2008.2001106 · doi:10.1109/tasl.2008.2001106
- 10.1109/ICASSP.2003.1198860 · DOI · Paper page
- yu, 0, Roles of pre-training and fine-tuning in context-dependent dbn-hmms for real-world speech recognition, Proc NIPS 2010 Workshop Deep Learn Unsupervised Feature Learn
- dahl, 0, Context-dependent pretrained dnns for large vocabulary speech recognition, IEEE Trans Audio Speech and Lang Proc Jan 2012
Cited by
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Self-citationEnsemble deep learning: A review
Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105151 · Cited by 2,143
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009
Self-citationDeep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
Self-citationRecent advances in deep learning for speech research at Microsoft
Deng, L., Li, J., Huang, J.-T., Yao, K., Yu, D., Seide, F., Seltzer, M., Zweig, G., He, X., Williams, J., et al. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639345 · Cited by 801
“We have also explored the use of various versions of deep learning models for this task, with highly promising results reported in [15][50].”
MethodSelf-citation
Metadata
- Authors
- Tur, G., Deng, L., Hakkani-Tur, D., & He, X.
- Venue
- 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2012-03
- Pages
- 5045-5048
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2106347453
- Cited by
- 122
- References
- 1
- FWCI
- 8.86
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Towards deeper understanding: Deep convex networks for semantic utterance classification. https://app.cochat.ai/papers/10.1109/icassp.2012.6289054
- The paper
- Tur, G., Deng, L., Hakkani-Tur, D., & He, X. (2012). Towards deeper understanding: Deep convex networks for semantic utterance classification. 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp.2012.6289054
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.