The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Unsupervised word sense disambiguation rivaling supervised methods
Open accessAbstract
This paper presents an unsupervised learning algorithm for sense disambiguation that, when trained on unannotated English text, rivals the performance of supervised techniques that require time-consuming hand annotations. The algorithm is based on two powerful constraints---that words tend to have one sense per discourse and one sense per collocation---exploited in an iterative bootstrapping procedure. Tested accuracy exceeds 96%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Maximum Likelihood from Incomplete Data via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1976) · Cited by 4,517
Introduction to WordNet: An On-line Lexical Database*
Miller, G. A., Beckwith, R., Fellbaum, C., Gross, D., & Miller, K. J. (1990) · International Journal of Lexicography · doi:10.1093/ijl/3.4.235 · Cited by 4,197
Lesk, M. (1986) · Proceedings of the 5th annual international conference on Systems documentation - SIGDOC '86 · doi:10.1145/318723.318728 · Cited by 1,770
Baum, L. E. (1972) · Medical Entomology and Zoology · Cited by 1,405
Inference and disputed authorship : The Federalist
Mosteller, F. C., & Wallace, D. L. (1964) · Medical Entomology and Zoology · Cited by 904
Rivest, R. L. (1987) · Machine Learning · doi:10.1007/bf00058680 · Cited by 886
Word-sense disambiguation using statistical models of Roget's categories trained on large corpora
Yarowsky, D. (1992) · Proceedings of the 14th conference on Computational linguistics - · doi:10.3115/992133.992140 · Cited by 663
Self-citationA method for disambiguating word senses in a large corpus
Gale, W. A., Church, K., & Yarowsky, D. (1992) · Computers and the Humanities · doi:10.1007/bf00136984 · Cited by 532
Self-citationYarowsky, D. (1993) · Proceedings of the workshop on Human Language Technology - HLT '93 · doi:10.3115/1075671.1075731 · Cited by 376
Self-citation
Cited by
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
A survey on semi-supervised learning
van Engelen, J. E., & Hoos, H. H. (2020) · Machine Learning · doi:10.1007/s10994-019-05855-6 · Cited by 2,666
Self-Training With Noisy Student Improves ImageNet Classification
Xie, Q., Luong, M.-T., Hovy, E., & Le, Q. V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01070 · Cited by 2,393
Toward an architecture for never-ending language learning
Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., & Mitchell, T. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7519 · Cited by 2,000
Word sense disambiguation: A survey
Navigli, R. (2009) · ACM Computing Surveys · doi:10.1145/1459352.1459355 · Cited by 1,819
Introduction to Semi-Supervised Learning
Zhu, X., & Goldberg, A. B. (2009) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01548-9 · Cited by 1,766
LexRank: Graph-based Lexical Centrality as Salience in Text Summarization
Erkan, G., & Radev, D. R. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1523 · Cited by 1,700
AutoML: A survey of the state-of-the-art
He, X., Zhao, K., & Chu, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,691
Unsupervised Domain Adaptation for Semantic Segmentation via Class-Balanced Self-training
Zou, Y., Yu, Z., Vijaya Kumar, B. V. K., & Wang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_18 · Cited by 1,464
“Another important strategy for unsupervised domain adaptation is based on self-training [4,47], which has many applications in vision and natural language processing [22, 25, 40, 47].”
BackgroundTemporal Ensembling for Semi-Supervised Learning
Laine, S., & Aila, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02242 · Cited by 1,395
A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data
Ando, R. K., & Zhang, T. (2005) · doi:10.5555/1046920.1194905 · Cited by 1,311
Statistical machine translation
(2010) · Choice Reviews Online · doi:10.5860/choice.47-6293 · Cited by 1,309
Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference
Schick, T., & Schütze, H. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.20 · Cited by 1,305
Automating the Construction of Internet Portals with Machine Learning
McCallum, A. K., Nigam, K., Rennie, J., & Seymore, K. (2000) · Information Retrieval · doi:10.1023/a:1009953814988 · Cited by 1,280
Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping
Smith, A. E., & Humphreys, M. S. (2006) · Behavior Research Methods · doi:10.3758/bf03192778 · Cited by 1,205
Tri-training: exploiting unlabeled data using three classifiers
Zhou, Z.-H., & Li, M. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.186 · Cited by 1,171
Toolformer: Language Models Can Teach Themselves to Use Tools
Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Zettlemoyer, L., Cancedda, N., & Scialom, T. (2023) · arXiv · doi:10.48550/arxiv.2302.04761 · Cited by 1,150
Snowball: extracting relations from large plain-text collections
Agichtein, E., & Gravano, L. (2000) · Proceedings of the fifth ACM conference on Digital libraries · doi:10.1145/336597.336644 · Cited by 1,147
Abusive Language Detection in Online User Content
Nobata, C., Tetreault, J., Thomas, A., Mehdad, Y., & Chang, Y. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883062 · Cited by 1,122
Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery
Yang, X., Wang, Y., Byrne, R., Schneider, G., & Yang, S. (2019) · Chemical Reviews · doi:10.1021/acs.chemrev.8b00728 · Cited by 1,022
Analyzing the effectiveness and applicability of co-training
Nigam, K., & Ghani, R. (2000) · Proceedings of the ninth international conference on Information and knowledge management · doi:10.1145/354756.354805 · Cited by 1,005
A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective
Roh, Y., Heo, G., & Whang, S. E. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2946162 · Cited by 968
The hierarchical hidden Markov model: Analysis and applications
Fine, S., Singer, Y., & Tishby, N. (1998) · Machine Learning · doi:10.1023/a:1007469218079 · Cited by 906
Event Extraction via Dynamic Multi-Pooling Convolutional Neural Networks
Chen, Y., Xu, L., Liu, K., Zeng, D., & Zhao, J. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1017 · Cited by 906
Confidence Regularized Self-Training
Zou, Y., Yu, Z., Liu, X., Kumar, B. V. K. V., & Wang, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00608 · Cited by 811
Review of Image Classification Algorithms Based on Convolutional Neural Networks
Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., & Miao, Y. (2021) · Remote Sensing · doi:10.3390/rs13224712 · Cited by 789
A syntax-based statistical translation model
Yamada, K., & Knight, K. (2001) · Proceedings of the 39th Annual Meeting on Association for Computational Linguistics - ACL '01 · doi:10.3115/1073012.1073079 · Cited by 728
Bickel, S., & Scheffer, T. (2005) · Fourth IEEE International Conference on Data Mining (ICDM'04) · doi:10.1109/icdm.2004.10095 · Cited by 710
Meta-Learning for Semi-Supervised Few-Shot Classification
Ren, M., Triantafillou, E., Ravi, S., Snell, J., Swersky, K., Tenenbaum, J. B., Larochelle, H., & Zemel, R. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00676 · Cited by 694
Scaling to very very large corpora for natural language disambiguation
Banko, M., & Brill, E. (2001) · Proceedings of the 39th Annual Meeting on Association for Computational Linguistics - ACL '01 · doi:10.3115/1073012.1073017 · Cited by 675
Training Deep Neural Networks on Noisy Labels with Bootstrapping
Reed, S., Lee, H., Anguelov, D., Szegedy, C., Erhan, D., & Rabinovich, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6596 · Cited by 667
Deriving concept hierarchies from text
Sanderson, M., & Croft, B. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312679 · Cited by 612
Settles, B. (2012) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.2200/s00429ed1v01y201207aim018 · Cited by 605
Data collection and quality challenges in deep learning: a data-centric AI perspective
Whang, S. E., Roh, Y., Song, H., & Lee, J.-G. (2023) · The VLDB Journal · doi:10.1007/s00778-022-00775-9 · Cited by 573
Self-labeled techniques for semi-supervised learning: taxonomy, software and empirical study
Triguero, I., García, S., & Herrera, F. (2015) · Knowledge and Information Systems · doi:10.1007/s10115-013-0706-y · Cited by 573
Fuzziness based semi-supervised learning approach for intrusion detection system
Ashfaq, R. A. R., Wang, X.-Z., Huang, J. Z., Abbas, H., & He, Y.-L. (2017) · Information Sciences · doi:10.1016/j.ins.2016.04.019 · Cited by 552
Resnik, P., & Smith, N. A. (2003) · Computational Linguistics · doi:10.1162/089120103322711578 · Cited by 522
Bootstrapping Entity Alignment with Knowledge Graph Embedding
Sun, Z., Hu, W., Zhang, Q., & Qu, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/611 · Cited by 521
StressSense: detecting stress in unconstrained acoustic environments using smartphones
Lu, H., Frauendorfer, D., Rabbi, M., Mast, M. S., Chittaranjan, G. T., Campbell, A. T., Gatica-Perez, D., & Choudhury, T. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370270 · Cited by 511
Pham, H., Dai, Z., Xie, Q., & Le, Q. V. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01139 · Cited by 509
Extracting paraphrases from a parallel corpus
Barzilay, R., & McKeown, K. R. (2001) · Proceedings of the 39th Annual Meeting on Association for Computational Linguistics - ACL '01 · doi:10.3115/1073012.1073020 · Cited by 470
Machine Learning Paradigms for Speech Recognition: An Overview
Deng, L., & Li, X. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2013.2244083 · Cited by 456
Using corpus statistics and WordNet relations for sense identification
Leacock, C., Miller, G. A., & Chodorow, M. S. (1998) · doi:10.5555/972719.972726 · Cited by 439
Data Distillation: Towards Omni-Supervised Learning
Radosavovic, I., Dollar, P., Girshick, R., Gkioxari, G., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00433 · Cited by 421
Semi-supervised learning by disagreement
Zhou, Z.-H., & Li, M. (2010) · Knowledge and Information Systems · doi:10.1007/s10115-009-0209-z · Cited by 410
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., Shpanskaya, K., et al. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301590 · Cited by 392
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., Shpanskaya, K., et al. (2019) · arXiv · doi:10.48550/arxiv.1901.07031 · Cited by 392
“Our work follows the approach of (Yarowsky 1995), who train a classifier on labeled examples and then predict on unlabeled examples labeling them when the prediction is above a certain threshold, and repeating until convergence.”
MethodRethinking Pre-training and Self-training
Zoph, B., Ghiasi, G., Lin, T.-Y., Cui, Y., Liu, H., Cubuk, E. D., & Le, Q. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06882 · Cited by 369
Semi-Supervised Sequence Modeling with Cross-View Training
Clark, K., Luong, M.-T., Manning, C. D., & Le, Q. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1217 · Cited by 366
MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection
Feng, J.-C., Hong, F.-T., & Zheng, W.-S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01379 · Cited by 355
Word sense disambiguation and information retrieval
Sanderson, M. (1994) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.5555/188490.188548 · Cited by 340
Multiscale Categorical Object Recognition Using Contour Fragments
Shotton, J., Blake, A., & Cipolla, R. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70772 · Cited by 332
Learning query intent from regularized click graphs
Li, X., Wang, Y.-Y., & Acero, A. (2008) · Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1390334.1390393 · Cited by 332
Overview of BioCreative II gene normalization
Morgan, A. A., Lu, Z., Wang, X., Cohen, A. M., Fluck, J., Ruch, P., Divoli, A., Fundel, K., Leaman, R., Hakenberg, J., et al. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s3 · Cited by 327
Lexical association measures and collocation extraction
Pecina, P. (2010) · Language Resources and Evaluation · doi:10.1007/s10579-009-9101-4 · Cited by 316
Contrastive estimation: training log-linear models on unlabeled data
Smith, N. A., & Eisner, J. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219884 · Cited by 305
Systematic reviews in sentiment analysis: a tertiary study
Ligthart, A., Catal, C., & Tekinerdogan, B. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09973-3 · Cited by 303
CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learning
Wei, C., Sohn, K., Mellina, C., Yuille, A., & Yang, F. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01071 · Cited by 298
WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognition
Zhu, Z., Huang, G., Deng, J., Ye, Y., Huang, J., Chen, X., Zhu, J., Yang, T., Lu, J., Du, D., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01035 · Cited by 290
Multi-representation adaptation network for cross-domain image classification
Zhu, Y., Zhuang, F., Wang, J., Chen, J., Shi, Z., Wu, W., & He, Q. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.07.010 · Cited by 286
Chung, Y.-A., Zhang, Y., Han, W., Chiu, C.-C., Qin, J., Pang, R., & Wu, Y. (2021) · 2021 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru51503.2021.9688253 · Cited by 293
PAC Generalization Bounds for Co-training
Dasgupta, S., Littman, M. L., & McAllester, D. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0053 · Cited by 275
Semi-supervised self-training for decision tree classifiers
Tanha, J., van Someren, M., & Afsarmanesh, H. (2017) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-015-0328-7 · Cited by 266
Co-Training and Expansion: Towards Bridging Theory and Practice
Balcan, M.-F., Blum, A. L., & Yang, K. (2018) · doi:10.1184/r1/6604544 · Cited by 252
MultiMAE: Multi-modal Multi-task Masked Autoencoders
Bachmann, R., Mizrahi, D., Atanov, A., & Zamir, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19836-6_20 · Cited by 268
Linear Algebraic Structure of Word Senses, with Applications to Polysemy
Arora, S., Li, Y., Liang, Y., Ma, T., & Risteski, A. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00034 · Cited by 186
“Automatic learning of word senses (Word Sense Induction) usually is done via variants of the exemplar approach of Yarowsky (1995) (see also (Schutze, 1998; Reisinger and Mooney, 2010; Di Marco and Navigli, 2013)), which identifies multiple word senses by clustering neighboring words.”
MethodInfluentialNaive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation
Chen, L.-C., Lopes, R. G., Cheng, B., Collins, M. D., Cubuk, E. D., Zoph, B., Adam, H., & Shlens, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_40 · Cited by 165
Zhang, Y., Park, D. S., Han, W., Qin, J., Gulati, A., Shor, J., Jansen, A., Xu, Y., Huang, Y., Wang, S., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3182537 · Cited by 161
A Cluster-then-label Semi-supervised Learning Approach for Pathology Image Classification
Peikari, M., Salama, S., Nofech-Mozes, S., & Martel, A. L. (2018) · Scientific Reports · doi:10.1038/s41598-018-24876-0 · Cited by 161
“The most basic and easiest SSL method to apply is self-training 7–10 , which involves repeatedly training and retraining a statistical model.”
MethodSelfHAR: Improving Human Activity Recognition through Self-training with Unlabeled Data
Tang, C. I., Perez-Pozuelo, I., Spathis, D., Brage, S., Wareham, N., & Mascolo, C. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448112 · Cited by 140
Denoising Pretraining for Semantic Segmentation
Brempong, E. A., Kornblith, S., Chen, T., Parmar, N., Minderer, M., & Norouzi, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00462 · Cited by 120
Multi-Task Self-Training for Learning General Representations
Ghiasi, G., Zoph, B., Cubuk, E. D., Le, Q. V., & Lin, T.-Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00873 · Cited by 84
Zhu, Z., Li, J., Zhao, Q., & Akhtar, F. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120709 · Cited by 24
Convolutional neural networks for multi-topic dialog state tracking,
Shi, H., Ushio, T., Endo, M., Yamagami, K., & Horii, N. (2017) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-10-2585-3_37 · Cited by 24
“To address this problem, we apply self-training semi-supervised learning process to make use of the huge amount of unlabeled data available on the internet [12].”
Method
Metadata
- Authors
- Yarowsky, D.
- Venue
- Proceedings of the 33rd annual meeting on Association for Computational Linguistics -
- Published
- 1995
- Pages
- 189-196
- OpenAlex
- W2101210369
- Cited by
- 2,385
- References
- 18
- FWCI
- 25.24
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.