The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Measurement of Text Similarity: A Survey
Open accessAbstract
Text similarity measurement is the basis of natural language processing tasks, which play an important role in information retrieval, automatic question answering, machine translation, dialogue systems, and document matching. This paper systematically combs the research status of similarity measurement, analyzes the advantages and disadvantages of current methods, develops a more comprehensive classification description system of text similarity measurement algorithms, and summarizes the future development direction. With the aim of providing reference for related research and application, the text similarity measurement method is described by two aspects: text distance and text representation. The text distance can be divided into length distance, distribution distance, and semantic distance; text representation is divided into string-based, corpus-based, single-semantic text, multi-semantic text, and graph-structure-based representation. Finally, the development of text similarity is also summarized in the discussion section.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 14,807
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
(2013) · Cited by 5,726
Distributed Representations of Sentences and Documents
Le, Q. V., & Mikolov, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.4053 · Cited by 4,934
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 1×
“…comparatively similar degree of word bag vector, LSA (latent semantic analysis) [37,38] maps the text from sparse high-dimensional vocabulary space to low-dimensional latent semantic space by singular value decomposition, so as to calculate the similarity in the potential semantic space [39,40].”
BackgroundTHE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE. 1
Jaccard, P. (1912) · New Phytologist · doi:10.1111/j.1469-8137.1912.tb05611.x · Cited by 4,561
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. (2020) · UTS ePRESS (University of Technology Sydney) · Cited by 3,174
Long short-term memory recurrent neural network architectures for large scale acoustic modeling
Sak, H., Senior, A., & Beaufays, F. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-80 · Cited by 2,973
De Maesschalck, R., Jouan-Rimbaud, D., & Massart, D. L. (2000) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(99)00047-7 · Cited by 2,325
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
Serban, I., Sordoni, A., Bengio, Y., Courville, A., & Pineau, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9883 · Cited by 1,615
A technique for computer detection and correction of spelling errors
Damerau, F. J. (1964) · Communications of the ACM · doi:10.1145/363958.363994 · Cited by 1,575
Some Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval
Robertson, S. E., & Walker, S. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_24 · Cited by 1,477
Convolutional Neural Network Architectures for Matching Natural Language Sentences
Hu, B., Lu, Z., Li, H., & Chen, Q. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03244 · Cited by 1,098
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Deza, M. M., & Deza, E. (2014) · Springer eBooks · doi:10.1007/978-3-662-44342-2 · Cited by 1,041
A review: Knowledge reasoning over knowledge graph
Chen, X., Jia, S., & Xiang, Y. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112948 · Cited by 1,035 · cited 1×
“Knowledge-graph representation learning is used to project the entities and relationships in the knowledge graph into a continuous low-dimensional vector space through machine learning technology, while maintaining the basic structure and properties of the original knowledge graph [54].”
Baselines and Bigrams: Simple, Good Sentiment and Topic Classification
Wang, S. I., & Manning, C. D. (2012) · Cited by 1,006
Deza, E., & Deza, M. M. (2009) · Springer eBooks · doi:10.1007/978-3-642-00234-2 · Cited by 950
Sak, H., Senior, A., & Beaufays, F. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.1128 · Cited by 838
A Survey of Text Similarity Approaches
H.Gomaa, W., & A. Fahmy, A. (2013) · International Journal of Computer Applications · doi:10.5120/11638-7118 · Cited by 823
A web-based kernel function for measuring the similarity of short text snippets
Sahami, M., & Heilman, T. D. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135834 · Cited by 735
Hamming Distance Metric Learning
Norouzi, M., Fleet, D. J., & Salakhutdinov, R. (2012) · neural information processing systems · Cited by 701
A fast algorithm for computing longest common subsequences
Hunt, J. W., & Szymanski, T. G. (1977) · Communications of the ACM · doi:10.1145/359581.359603 · Cited by 691
Learning Deep Transformer Models for Machine Translation
Wang, Q., Li, B., Xiao, T., Zhu, J., Li, C., Wong, D. F., & Chao, L. S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1176 · Cited by 673
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Shen, Y., He, X., Gao, J., Deng, L., & Mesnil, G. (2014) · Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management · doi:10.1145/2661829.2661935 · Cited by 661
word2vec Parameter Learning Explained
Rong, X. (2014) · arXiv · doi:10.48550/arxiv.1411.2738 · Cited by 626
Text Matching as Image Recognition
Pang, L., Lan, Y., Guo, J., Xu, J., Wan, S., & Cheng, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10341 · Cited by 526
Calculation of the Wasserstein Distance Between Probability Distributions on the Line
Vallender, S. S. (1974) · Theory of Probability & Its Applications · doi:10.1137/1118101 · Cited by 483
Question Answering over Freebase with Multi-Column Convolutional Neural Networks
Dong, L., Wei, F., Zhou, M., & Xu, K. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1026 · Cited by 445
A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representations
Wan, S., Lan, Y., Guo, J., Xu, J., Pang, L., & Cheng, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10342 · Cited by 322
Li, H., & Xu, J. (2014) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000035 · Cited by 235
Computing Semantic Similarity of Concepts in Knowledge Graphs
Zhu, G., & Iglesias, C. A. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2610428 · Cited by 232
A framework for understanding Latent Semantic Indexing (LSI) performance
Kontostathis, A., & Pottenger, W. M. (2006) · Information Processing & Management · doi:10.1016/j.ipm.2004.11.007 · Cited by 193
From GAN to WGANPreprint
Weng, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.08994 · Cited by 170
Liu, Z., Xiong, C., Sun, M., & Liu, Z. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1223 · Cited by 148
Word Mover’s Embedding: From Word2Vec to Document Embedding
Wu, L., Yen, I. E.-H., Xu, K., Xu, F., Balakrishnan, A., Chen, P., Ravikumar, P., & Witbrock, M. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1482 · Cited by 125
Supervised word mover's distance
Huang, G. M., Quo, C., Kusner, M. J., Sun, Y., Weinberger, K. Q., & Sha, F. (2016) · PolyPublie (École Polytechnique de Montréal) · doi:10.5555/3157382.3157641 · Cited by 123
Li, H., & Xu, J. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988058 · Cited by 117
DLS$@$CU: Sentence Similarity from Word Alignment and Semantic Vector Composition
Sultan, M. A., Bethard, S. J., & Sumner, T. (2015) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s15-2027 · Cited by 115
Earth Mover Distance over High-Dimensional Spaces
Andoni, A., Indyk, P., & Krauthgamer, R. (2007) · Cited by 78
Learning Distributed Representations for Multilingual Text Sequences
Pham, H., Luong, T., & Manning, C. D. (2015) · doi:10.3115/v1/w15-1512 · Cited by 60
A family of statistical symmetric divergences based on Jensen's inequalityPreprint
Nielsen, F. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1009.4004 · Cited by 59
CNM: An Interpretable Complex-valued Network for Matching
Li, Q., Wang, B., & Melucci, M. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1420 · Cited by 59
Word Mover's Embedding: From Word2Vec to Document EmbeddingPreprint
Wu, L., Yen, I. E.-H., Xu, K., Xu, F., Balakrishnan, A., Chen, P., Ravikumar, P., & Witbrock, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01713 · Cited by 42
A User-Centered Concept Mining System for Query and Document Understanding at Tencent
Liu, B., Guo, W., Niu, D., Wang, C., Xu, S., Lin, J., Lai, K., & Xu, Y. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330727 · Cited by 38
Jiang, N., & de Marneffe, M.-C. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1412 · Cited by 16
Cited by
A Comparative Analysis of Collaborative Filtering Similarity Measurements for Recommendation Systems
Kumar, P., Gupta, M. K., Rao, C. R. S., Bhavsingh, M., & Srilakshmi, M. (2023) · International Journal on Recent and Innovation Trends in Computing and Communication · doi:10.17762/ijritcc.v11i3s.6180 · Cited by 12
Metadata
- Authors
- Wang, J., & Dong, Y.
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2020-08-31
- Volume
- 11
- Issue
- 9
- Pages
- 421
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W3081886688
- Cited by
- 266
- References
- 57
- FWCI
- 10.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.