Open-world Machine Learning: Applications, Challenges, and Opportunities
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Traditional machine learning, mainly supervised learning, follows the assumptions of closed-world learning, i.e., for each testing class, a training class is available. However, such machine learning models fail to identify the classes, which were not available during training time. These classes can be referred to as unseen classes. Open-world Machine Learning (OWML) is a novel technique, which deals with unseen classes. Although OWML is around for a few years and many significant research works have been carried out in this domain, there is no comprehensive survey of the characteristics, applications, and impact of OWML on the major research areas. In this article, we aimed to capture the different dimensions of OWML with respect to other traditional machine learning models. We have thoroughly analyzed the existing literature and provided a novel taxonomy of OWML considering its two major application domains: Computer Vision and Natural Language Processing. We listed the available software packages and open datasets in OWML for future researchers. Finally, the article concludes with a set of research gaps, open challenges, and future directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 4×
“edu/data/amazon WordNet [90] https://wordnet.”
BackgroundResultInfluentialExplaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 2×
“It uses a BiLSTM network with a margin loss to extract the feature of unknown intents.”
MethodBeyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916 · cited 1×
“The evaluation done on 15-Scenes [67], Auslan [56], Caltech-256 [42], ALOI [38] and Ukbench [98] datasets.”
Method
Research works printed but not linked: 119
- A. S. Albahri, A. A. Zaidan, O. S. Albahri, B. B. Zaidan, A. H. Alamoodi, Ali H. Shareef, Jwan K. Alwan, Rula A. Hamid, M. T. Aljbory, Ali Najm Jasim, et al. 2021. Development of IoT-based mhealth framework for various cases of heart disease patients. Health Technol. 11, 5 (2021), 1013–1033. · DOI
- Osamah Shihab Albahri, A. A. Zaidan, B. B. Zaidan, Ahmed Shihab Albahri, Ali H. Mohsin, K. I. Mohammed, and M. A. Alsalem. 2022. New mHealth hospital selection framework supporting decentralised telemedicine architecture for outpatient cardiovascular disease-based integrated techniques: Haversine-GPS and AHP-VIKOR. J. Amb. Intell. Human. Comput. 13, 1 (2022), 219–239. · DOI
- Ethem Alpaydin. 2020. Introduction to Machine Learning. MIT Press.
- 10.1109/TFUZZ.2008.925904 · DOI · Paper page
- 10.1007/978-3-540-76298-0_52 · DOI · Paper page
- Abhijit Bendale and Terrance Boult. 2015. Towards open world recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1893–1902.
- 10.1109/CVPR.2016.173 · DOI · Paper page
- Christopher M. Bishop and M. Nasrabadi Nasser. 2006. Pattern recognition and machine learning. Vol. 4 no. 4.
- Paul Bodesheim, Alexander Freytag, Erik Rodner, and Joachim Denzler. 2015. Local novelty detection in multi-class recognition problems. In Proceedings of the IEEE Winter Conference on Applications of Computer Vision. IEEE, 813–820.
- Antoine Bordes, Nicolas Usunier, Alberto Garcia-Durán, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Proceedings of the 26th International Conference on Neural Information Processing Systems. 2787–2795.
- 10.1007/s10994-013-5335-x · DOI · Paper page
- 10.1613/JAIR.1.12228 · DOI · Paper page
- 10.1145/1961189.1961199 · DOI · Paper page
- Zhiyuan Chen and Bing Liu. 2014. Mining topics in documents: Standing on the shoulders of big data. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1116–1125. · DOI · Paper page
- Gouenou Coatrieux, Laurent Lecornu, Bülent Sankur, and Ch Roux. 2006. A review of image watermarking applications in healthcare. In Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology Society. 4691–4694.
- Gregory Cohen, Saeed Afshar, Jonathan Tapson, and Andre Van Schaik. 2017. EMNIST: Extending MNIST to handwritten letters. In Proceedings of the International Joint Conference on Neural Networks (IJCNN’17). IEEE, 2921–2926.
- Alice Coucke, Alaa Saade, Adrien Ball, Théodore Bluche, Alexandre Caulier, David Leroy, Clément Doumouro, Thibault Gisselbrecht, Francesco Caltagirone, Thibaut Lavril, et al. 2018. Snips voice platform: An embedded spoken language understanding system for private-by-design voice interfaces. arXiv:1805.10190. Retrieved from https://arxiv.org/abs/1805.10190. · arXiv
- Laurens De Haan, Ana Ferreira, and Ana Ferreira. 2006. Extreme Value Theory: An Introduction, Vol. 21. Springer. · DOI · Paper page
- Rocco De Rosa, Thomas Mensink, and Barbara Caputo. 2016. Online open world recognition. arXiv:1604.02275. Retrieved from https://arxiv.org/abs/1604.02275. · arXiv
- 10.1007/s10489-015-0661-2 · DOI · Paper page
- Tri Doan and Jugal Kalita. 2017. Overcoming the challenge for text classification in the open world. In Proceedings of the IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC). 1–7.
- Geli Fei and Bing Liu. 2016. Breaking the closed world assumption in text classification. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 506–514.
- 10.1023/A:1022606404104 · doi:10.1023/a:1022606404104 · Paper page
- Yang Gao, Yi-Fan Li, Bo Dong, Yu Lin, and Latifur Khan. 2019. SIM: Open-world multi-task stream classifier with integral similarity metrics. In Proceedings of the IEEE International Conference on Big Data (Big Data’19). IEEE, 751–760.
- Chuanxing Geng, Sheng-jun Huang, and Songcan Chen. 2020. Recent advances in open set recognition: A survey. IEEE Trans. Pattern Anal. Machine Intell. 43, 10 (2020), 3614–3631.
- 10.1023/B:VISI.0000042993.50813.60 · DOI · Paper page
- 10.5555/3086952 · doi:10.5555/3086952
- 10.1145/3357384.3357981 · DOI
- Sonal Gupta, Rushin Shah, Mrinal Mohit, Anuj Kumar, and Mike Lewis. 2018. Semantic parsing for task oriented dialog using hierarchical representations. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2787–2792.
- Mehadi Hassen and Philip K. Chan. 2020. Learning a neural-network-based representation for open set recognition. In Proceedings of the SIAM International Conference on Data Mining. SIAM, 154–162.
- Jiangpeng He, Runyu Mao, Zeman Shao, and Fengqing Zhu. 2020. Incremental learning in online scenario. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 13926–13935.
- 10.1145/2872427.2883037 · DOI · Paper page
- Qianjiang Hu, Xiao Wang, Wei Hu, and Guo-Jun Qi. 2021. Adco: Adversarial contrast for efficient learning of unsupervised representations from self-trained negative adversaries. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1074–1083.
- Andrei De Souza Inácio, Matheus Gutoski, André Eugênio Lazzaretti, and Heitor Silvério Lopes. 2021. OSVidCap: A framework for the simultaneous recognition and description of concurrent actions in videos in an open-set scenario. IEEE Access 9 (2021), 137029–137041.
- 10.1109/91.413232 · doi:10.1109/91.413232
- Lalit P. Jain, Walter J. Scheirer, and Terrance E. Boult. 2014. Multi-class open set recognition using probability of inclusion. In Proceedings of the 13th European Conference on Computer Vision. 393–409.
- A. Jeya Christy and K. Dhanalakshmi. 2021. Content-based image recognition and tagging by deep learning methods. Wireless Pers. Commun. (2021), 1–26.
- 10.1145/2736277.2741669 · DOI · Paper page
- 10.1007/s10994-016-5610-8 · DOI · Paper page
- Dan Jurafsky. 1997. Switchboard SWBD-DAMSL Shallow-discourse-function Annotation Coders Manual. Institute of Cognitive Science Technical Report.
- James M. Keller, Michael R. Gray, and James A. Givens. 1985. A fuzzy k-nearest neighbor algorithm. IEEE Trans. Syst. Man Cybernet.4 (1985), 580–585. · DOI · Paper page
- Zubair Ahmed Khan and Asma Rizvi. 2021. AI based facial recognition technology and criminal justice: Issues and challenges. Turk. J. Comput. Math. Educ. 12, 14 (2021), 3384–3392.
- Shu Kong and Deva Ramanan. 2021. Opengan: Open-set recognition via open data generation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 813–822.
- Sotiris B. Kotsiantis, I. Zaharakis, P. Pintelas, et al. 2007. Supervised machine learning: A review of classification techniques. Emerg. Artif. Intell. Appl. Comput. Eng. 160, 1 (2007), 3–24.
- Alex Krizhevsky Geoffrey Hinton et al. 2009. Learning multiple layers of features from tiny images. Master’s thesis. Department of Computer Science University of Toronto.
- Ludmila Kuncheva. 2000. Fuzzy Classifier Design. Vol. 49. Springer Science & Business Media. · DOI
- Ken Lang. 1995. Newsweeder: Learning to filter netnews. In Machine Learning Proceedings, LakeTahoe, CA, 331–339.
- 10.1109/TPAMI.2005.92 · DOI · Paper page
- 10.1109/TCSVT.2019.2898940 · DOI · Paper page
- Ting-En Lin and Hua Xu. 2019. Deep unknown intent detection with margin loss. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 5491–5496.
- 10.1016/j.knosys.2019.104979 · DOI
- Fan Liu and Yong Deng. 2020. Determine the number of unknown targets in open world based on elbow method. IEEE Trans. Fuzzy Syst. 29, 5 (2020), 986–995.
- 10.1145/3544013 · doi:10.1145/3544013
- Abbas Saliimi Lokman and Mohamed Ariff Ameedeen. 2018. Modern chatbot systems: A technical review. In Proceedings of the Future Technologies Conference. 1012–1023.
- Vincent Lonij, Ambrish Rawat, and Maria-Irina Nicolae. 2017. Open-world visual recognition using knowledge graphs. arXiv:1708.08310. Retrieved from https://arxiv.org/abs/1708.08310. · arXiv
- 10.1016/j.ins.2022.03.014 · DOI
- 10.1016/j.asoc.2015.06.038 · DOI
- Sahisnu Mazumder, Nianzu Ma, and Bing Liu. 2018. Towards a continuous knowledge learning engine for chatbots. arXiv:1802.06024. Retrieved from https://arxiv.org/abs/1802.06024. · arXiv
- 10.1145/2766462.2767755 · DOI · Paper page
- 10.1109/TPAMI.2013.83 · DOI · Paper page
- Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv:1301.3781. Retrieved from https://arxiv.org/abs/1301.3781. · arXiv
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111–3119.
- 10.1109/WACV48630.2021.00361 · DOI
- Philip Moore and Hai Van Pham. 2015. On context and the open world assumption. In Proceedings of the IEEE 29th International Conference on Advanced Information Networking and Applications Workshops. 387–392.
- 10.1109/TKDE.2017.2691702 · DOI
- Susan M. Mudambi and David Schuff. 2010. Research note: What makes a helpful online review? A study of customer reviews on Amazon. com. MIS Quart. (2010), 185–200. · DOI · Paper page
- Kevin P. Murphy. 2012. Machine Learning: A Probabilistic Perspective. MIT Press.
- 10.5555/550675 · doi:10.5555/550675
- David Nister and Henrik Stewenius. 2006. Scalable recognition with a vocabulary tree. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), Vol. 2. 2161–2168.
- Manuel Olave, Vladislav Rajkovic, and Marko Bohanec. 1989. An application for admission in public school systems. Expert Syst. Publ. Admin. 1 (1989), 145–160.
- Poojan Oza and Vishal M. Patel. 2019. C2ae: Class conditioned auto-encoder for open-set recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2307–2316.
- Poojan Oza and Vishal M. Patel. 2019. Deep cnn-based multi-task learning for open-set recognition. arXiv:1903.03161. Retrieved from https://arxiv.org/abs/1903.03161. · arXiv
- Jitendra Parmar, Sanskar Soni, and Satyendra Singh Chouhan. 2020. OWI: Open-world intent identification framework for dialog based system. In Proceedings of the International Conference on Big Data Analytics. 329–343. · DOI
- 10.3115/v1/D14-1162 · DOI · Paper page
- John Platt et al. 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Advances in Large Margin Classifiers, Vol. 10. MIT Press, 61–74.
- Sridhama Prakhya, Vinodini Venkataram, and Jugal Kalita. 2017. Open set text classification using convolutional neural networks. In Proceedings of the International Conference on Natural Language Processing.
- Hemant Purohit, Carlos Castillo, Fernando Diaz, Amit Sheth, and Patrick Meier. 2014. Emergency-relief coordination on social media: Automatically matching resource requests and offers. First Monday (2014).
- David Ratcliffe and Kerry Taylor. 2014. Closed-world concept induction for learning in OWL knowledge bases. In Proceedings of the International Conference on Knowledge Engineering and Knowledge Management. Springer, 429–440. · doi:10.1007/978-3-319-13704-9_33
- Muhammad Imran Razzak, Saeeda Naz, and Ahmad Zaib. 2018. Deep learning for medical image processing: Overview, challenges and the future. Classif. BioApps (2018), 323–350. · DOI · Paper page
- Mengye Ren, Eleni Triantafillou, Sachin Ravi, Jake Snell, Kevin Swersky, Joshua B. Tenenbaum, Hugo Larochelle, and Richard S. Zemel. 2018. Meta-learning for semi-supervised few-shot classification. In Proceedings of the International Conference on Learning Representations.
- Jason Rennie and Ken Lang. 2008. The 20 Newsgroups Data Set. Retrieved from http://qwone.com/jason/20Newsgroups.
- 10.5555/1005332.1005336 · doi:10.5555/1005332.1005336
- 10.1016/S0020-0255(02)00369-9 · doi:10.1016/s0020-0255(02)00369-9
- 10.1007/s11263-015-0816-y · DOI · Paper page
- 10.1145/3446374 · DOI · Paper page
- 10.1109/TPAMI.2011.54 · DOI · Paper page
- 10.1145/3338501.3357372 · DOI · Paper page
- Haseeb Shah, Johannes Villmow, Adrian Ulges, Ulrich Schwanecke, and Faisal Shafait. 2019. An open-world extension to knowledge graph completion models. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 3044–3051.
- Baoxu Shi and Tim Weninger. 2018. Open-world knowledge graph completion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.
- 10.1177/002383099804100410 · DOI · Paper page
- Lei Shu, Hu Xu, and Bing Liu. 2017. DOC: Deep open classification of text documents. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2911–2916.
- Lei Shu, Hu Xu, and Bing Liu. 2018. Unseen class discovery in open-world classification. arXiv:1801.05609. Retrieved from https://arxiv.org/abs/1801.05609. · arXiv
- Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556. Retrieved from https://arxiv.org/abs/1409.1556. · arXiv
- Liwei Song, Vikash Sehwag, Arjun Nitin Bhagoji, and Prateek Mittal. 2020. A critical evaluation of open-world machine learning. arXiv:2007.04391. Retrieved from https://arxiv.org/abs/2007.04391. · arXiv
- Wallace Stevens. 2021. Efficient uncertainty estimation for open-set object detection. In Epistemic Uncertainty Estimation for Object Detection in Open-Set Conditions, 91.
- 10.1162/089120100561737 · DOI · Paper page
- Martin Thoma. 2017. The hasyv2 dataset. arXiv:1701.08380. Retrieved from https://arxiv.org/abs/1701.08380. · arXiv
- 10.1109/SLT.2010.5700816 · DOI
- Nikhita Vedula, Rahul Gupta, Aman Alok, and Mukund Sridhar. 2020. Automatic discovery of novel intents & domains from text utterances. arXiv:2006.01208. Retrieved from https://arxiv.org/abs/2006.01208. · arXiv
- Nikhita Vedula, Nedim Lipka, Pranav Maneriker, and Srinivasan Parthasarathy. 2019. Towards open intent discovery for conversational text. arXiv:1904.08524. Retrieved from https://arxiv.org/abs/1904.08524. · arXiv
- Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Daan Wierstra, et al. 2016. Matching networks for one shot learning. In Advances in Neural Information Processing Systems, Vol. 29. 3630–3638.
- Alex Hai Wang. 2010. Detecting spam bots in online social networking sites: A machine learning approach. In Proceedings of the IFIP Annual Conference on Data and Applications Security and Privacy. 335–342.
- Yuhan Wang, Weidong Xiao, Zhen Tan, and Xiang Zhao. 2021. Caps-OWKG: A capsule network model for open-world knowledge graph. Int. J. Mach. Learn. Cybernet. 12, 6 (2021), 1627–1637. · DOI
- 10.1109/ACCESS.2022.3155451 · DOI
- John Willes, James Harrison, Ali Harakeh, Chelsea Finn, Marco Pavone, and Steven Waslander. 2021. Bayesian embeddings for few-shot open world recognition. arXiv:2107.13682. Retrieved from https://arxiv.org/abs/2107.13682. · arXiv
- 10.1109/TPAMI.2008.79 · DOI · Paper page
- Qitian Wu, Hengrui Zhang, Xiaofeng Gao, Junchi Yan, and Hongyuan Zha. 2021. Towards open-world recommendation: An inductive model-based collaborative filtering approach. In Proceedings of the International Conference on Machine Learning. 11329–11339.
- Zhi-Fan Wu Tong Wei Jianwen Jiang Chaojie Mao Mingqian Tang and Yu-Feng Li. 2021. NGC: A unified framework for learning with open-world noisy data. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 62–71.
- 10.1145/3308558.3313644 · DOI · Paper page
- 10.5555/2464909 · doi:10.5555/2464909
- J. Yang and Joseph. Coughlin. 2014. In-vehicle technology for self-driving cars: Advantages and challenges for aging drivers. Int. J. Automot. Technol. 15, 2 (2014), 333–340. · DOI
- Mang Ye, Jianbing Shen, Gaojie Lin, Tao Xiang, Ling Shao, and Steven C. H. Hoi. 2021. Deep learning for person re-identification: A survey and outlook. IEEE Trans. Pattern Anal. Mach. Intell. (2021).
- Ryota Yoshihashi, Wen Shao, Rei Kawakami, Shaodi You, Makoto Iida, and Takeshi Naemura. 2019. Classification-reconstruction learning for open-set recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 4016–4025.
- Kun Yue, Jiahui Wang, Xinbai Li, and Kuang Hu. 2020. Representation-based completion of knowledge graph with open-world data. In Proceedings of the 5th International Conference on Computer and Communication Systems (ICCCS’20). 1–8.
- He Zhang and Vishal M. Patel. 2016. Sparse representation-based open set recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39, 8 (2016), 1690–1696. · DOI · Paper page
- Tianchen Zhang, Zhongqin Bi, Meijing Shan, and Yongbin Li. 2022. IFGAN: Information fusion generative adversarial network for knowledge base completion. Expert Syst. (2022), e12984. · DOI
- 10.1007/s10115-015-0897-5 · DOI
- Zhun Zhong, Linchao Zhu, Zhiming Luo, Shaozi Li, Yi Yang, and Nicu Sebe. 2021. OpenMix: Reviving known knowledge for discovering novel visual categories in an open world. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR’21). 9457–9465.
- 10.1109/SP.2012.16 · DOI · Paper page
Cited by
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884
Díaz-Rodríguez, N., Del Ser, J., Coeckelbergh, M., López de Prado, M., Herrera-Viedma, E., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101896 · Cited by 800
Triguero, I., Molina, D., Poyatos, J., Del Ser, J., & Herrera, F. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102135 · Cited by 90
Metadata
- Authors
- Parmar, J., Chouhan, S., Raychoudhury, V., & Rathore, S.
- Venue
- ACM Computing Surveys
- Published
- 2023-02-02
- Volume
- 55
- Issue
- 10
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3164246203
- Cited by
- 154
- References
- 37
- FWCI
- 9.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.