A Survey of Deep Active Learning
Open accessAbstract
Active learning (AL) attempts to maximize a model’s performance gain while annotating the fewest samples possible. Deep learning (DL) is greedy for data and requires a large amount of data supply to optimize a massive number of parameters if the model is to learn how to extract high-quality features. In recent years, due to the rapid development of internet technology, we have entered an era of information abundance characterized by massive amounts of available data. As a result, DL has attracted significant attention from researchers and has been rapidly developed. Compared with DL, however, researchers have a relatively low interest in AL. This is mainly because before the rise of DL, traditional machine learning requires relatively few labeled samples, meaning that early AL is rarely according the value it deserves. Although DL has made breakthroughs in various fields, most of this success is due to a large number of publicly available annotated datasets. However, the acquisition of a large number of high-quality annotated datasets consumes a lot of manpower, making it unfeasible in fields that require high levels of expertise (such as speech recognition, information extraction, medical images, etc.). Therefore, AL is gradually coming to receive the attention it is due. It is therefore natural to investigate whether AL can be used to reduce the cost of sample annotation while retaining the powerful learning capabilities of DL. As a result of such investigations, deep active learning (DeepAL) has emerged. Although research on this topic is quite abundant, there has not yet been a comprehensive survey of DeepAL-related works; accordingly, this article aims to fill this gap. We provide a formal classification method for the existing work, along with a comprehensive and systematic overview. In addition, we also analyze and summarize the development of DeepAL from an application perspective. Finally, we discuss the confusion and problems associated with DeepAL and provide some possible development directions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Active learning techniques focus on acquiring a large and diverse set of examples while reducing the time needed by researchers or professionals to screen data.
“A valid way to overcome these challenges lies in the application of ALtechniques [5-8], which focuses on the acquisition of a large and diverse set of examples, while reducing the time needed by researchers/professionals to screen the data.”
From Ten Years of Active Learning Techniques and Object Detection: A Systematic Review (2023) · cites this paper as [8]
Previous reviews are more oriented to other AI areas such as natural language processing, speech processing, and computer vision, without going deeper into OD, showing only a few related papers.
“Furthermore, previous reviews [8,10-13] are more oriented to other AI areas such as natural language processing, speech processing, and computer vision, but without going deeper into OD, showing only a few related papers.”
From Ten Years of Active Learning Techniques and Object Detection: A Systematic Review (2023) · cites this paper as [8]
Five recent active learning reviews were identified in the preliminary search.
“Five recent AL reviews [8,10-13] were identified in that process”
From Ten Years of Active Learning Techniques and Object Detection: A Systematic Review (2023) · cites this paper as [8]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Lecture Notes in Computer Science 1205
(1999) · Industrial Robot the international journal of robotics research and application · doi:10.1108/ir.1999.04926fae.001 · Cited by 39,228 · see citing works
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · see citing works
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · see citing works
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892 · see citing works
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · see citing works
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472 · see citing works
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · see citing works
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · see citing works
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1993.341010 · Cited by 14,474 · see citing works
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891 · see citing works
Adomavičius, G., & Tuzhilin, A. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.99 · Cited by 10,347 · see citing works
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691 · see citing works
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107 · see citing works
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487 · see citing works
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515 · see citing works
Pedestrian Detection: An Evaluation of the State of the Art
Dollár, P., Wojek, C., Schiele, B., & Perona, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.155 · Cited by 3,412 · see citing works
Andrzejak, R. G., Lehnertz, K., Mormann, F., Rieke, C., David, P., & Elger, C. E. (2001) · Physical Review E · doi:10.1103/physreve.64.061907 · Cited by 3,032 · see citing works
An algorithm for quadratic programming
Frank, M., & Wolfe, P. (1956) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800030109 · Cited by 3,030 · see citing works
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 1× · see citing works
“[95] OPPORTUNITY [95], WISDM [122], SenseBox [219], Skoda Daphnet [15],CASAS [40] Smart home”
BackgroundArmato, S. G., McLennan, G., Bidaut, L., McNitt‐Gray, M. F., Meyer, C. R., Reeves, A. P., Zhao, B., Aberle, D. R., Henschke, C. I., Hoffman, E. A., et al. (2011) · Medical Physics · doi:10.1118/1.3528204 · Cited by 2,887 · see citing works
Proceedings of the 23rd international conference on Machine learning
Cohen, W. W., & Moore, A. (2006) · Cited by 2,647 · see citing works
Comprehensive database for facial expression analysis
Takeo Kanade, A., Cohn, J. F., & Tian, Y. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840611 · Cited by 2,612 · see citing works
Seung, H., Opper, M., & Sompolinsky, H. (1992) · Annual Conference Computational Learning Theory · doi:10.1145/130385.130417 · Cited by 2,193 · see citing works
Proceedings of The 32nd International Conference on Machine Learning
Germain, M., Gregor, K., Murray, I., & Larochelle, H. (2015) · Cited by 2,020 · see citing works
Angluin, D. (1988) · Machine Learning · doi:10.1023/a:1022821128753 · Cited by 1,918 · see citing works
A Dataset for Breast Cancer Histopathological Image Classification
Spanhol, F. A., Oliveira, L. S., Petitjean, C., & Heutte, L. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2496264 · Cited by 1,885 · see citing works
Proceedings for the 5th International Conference on Learning Representations
Srivastava, A., & Sutton, C. A. (2017) · Cited by 1,829 · see citing works
"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection
Wang, W. Y. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-2067 · Cited by 1,822 · see citing works
Bag of Tricks for Image Classification with Convolutional Neural Networks
He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., & Li, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00065 · Cited by 1,680 · see citing works
Proceedings of the British Machine Vision Conference 2014
(2014) · doi:10.5244/c.28 · Cited by 1,360 · see citing works
wav2vec: Unsupervised Pre-Training for Speech Recognition
Schneider, S., Baevski, A., Collobert, R., & Auli, M. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-1873 · Cited by 1,290 · see citing works
Serial Order: A Parallel Distributed Processing Approach
Jordan, M. I. (1997) · Advances in psychology · doi:10.1016/s0166-4115(97)80111-2 · Cited by 1,251 · see citing works
Speech Recognition Using Deep Neural Networks: A Systematic Review
Nassif, A. B., Shahin, I. M. A., Attili, I. B., Azzeh, M., & Shaalan, K. F. (2019) · IEEE Access · doi:10.1109/access.2019.2896880 · Cited by 1,159 · see citing works
On Learning, Representing, and Generalizing a Task in a Humanoid Robot
Calinon, S., Guenter, F., & Billard, A. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2006.886952 · Cited by 1,090 · see citing works
CityPersons: A Diverse Dataset for Pedestrian Detection
Zhang, S., Benenson, R., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.474 · Cited by 1,061 · see citing works
MARS: A Video Benchmark for Large-Scale Person Re-Identification
Zheng, L., Bie, Z., Sun, Y., Wang, J., Su, C., Wang, S., & Tian, Q. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46466-4_52 · Cited by 1,010 · see citing works
Person Re-identification by Descriptive and Discriminative Classification
Hirzer, M., Beleznai, C., Roth, P. M., & Bischof, H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21227-7_9 · Cited by 997 · see citing works
NCBI Disease Corpus: A Resource for Disease Name Recognition and Concept Normalization
Dogan, R., Leaman, R., & Lu, Z.-Y. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.12.006 · Cited by 994 · see citing works
Less is more: Sampling chemical space with active learning
Smith, J. S., Nebgen, B., Lubbers, N., Isayev, O., & Roitberg, A. E. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5023802 · Cited by 811 · see citing works
A Comprehensive Survey of Neural Architecture Search
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Chen, X., & Wang, X. Y. (2021) · ACM Computing Surveys · doi:10.1145/3447582 · Cited by 808 · see citing works
Self-citationKendall, A., Badrinarayanan, V., & Cipolla, R. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.57 · Cited by 784 · see citing works
Proceedings 2001 IEEE International Conference on Data Mining
(2001) · Proceedings · doi:10.1109/icdm.2001.989492 · Cited by 776 · see citing works
Proceedings of the 28th International Conference on Neural Information Processing Systems
Cortes, C., Lee, D., Sugiyama, M., & Garnett, R. (2015) · Cited by 747 · see citing works
Learning Loss for Active Learning
Yoo, D., & Kweon, I. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00018 · Cited by 740 · see citing works
A tutorial survey of architectures, algorithms, and applications for deep learning
Deng, L. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2013.9 · Cited by 737 · see citing works
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714 · see citing works
Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom
Bachlin, M., Plotnik, M., Roggen, D., Maidan, I., Hausdorff, J. M., Giladi, N., & Troster, G. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036165 · Cited by 693 · cited 1× · see citing works
“[95] OPPORTUNITY [95], WISDM [122], SenseBox [219], Skoda Daphnet [15],CASAS [40] Smart home”
BackgroundCost-Effective Active Learning for Deep Image Classification
Wang, K., Zhang, D., Li, Y., Zhang, R., & Lin, L. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2589879 · Cited by 669 · see citing works
Deep learning approach for active classification of electrocardiogram signals
Rahhal, M. M. A., Bazi, Y., Alhichri, H. S., Alajlan, N., Melgani, F., & Yager, R. R. (2016) · Information Sciences · doi:10.1016/j.ins.2016.01.082 · Cited by 626 · see citing works
Fundus Image Classification Using VGG-19 Architecture with PCA and SVD
Mateen, M., Wen, J., Nasrullah, N., Sun, S., & Huang, Z. (2018) · Symmetry · doi:10.3390/sym11010001 · Cited by 614 · see citing works
A survey on active learning and human-in-the-loop deep learning for medical image analysis
Budd, S., Robinson, E. C., & Kainz, B. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102062 · Cited by 606 · see citing works
Multi-class active learning for image classification
Joshi, A. J., Porikli, F., & Papanikolopoulos, N. P. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206627 · Cited by 588 · see citing works
Variational Adversarial Active Learning
Sinha, S., Ebrahimi, S., & Darrell, T. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00607 · Cited by 585 · see citing works
Deep Learning for Entity Matching
Mudgal, S., Li, H., Rekatsinas, T., Doan, A., Park, Y., Krishnan, G., Deep, R., Arcaute, E., & Raghavendra, V. (2018) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3183713.3196926 · Cited by 563 · see citing works
Nam, J. G., Park, S., Hwang, E. J., Lee, J. H., Jin, K.-N., Lim, K. Y., Vu, T. H., Sohn, J. H., Hwang, S., Goo, J. M., et al. (2019) · Radiology · doi:10.1148/radiol.2018180237 · Cited by 539 · see citing works
Swanson, A., Kosmala, M., Lintott, C., Simpson, R., Smith, A., & Packer, C. (2015) · Scientific Data · doi:10.1038/sdata.2015.26 · Cited by 510 · see citing works
Leveraging uncertainty information from deep neural networks for disease detection
Leibig, C., Allken, V., Ayhan, M. S., Berens, P., & Wahl, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-17876-z · Cited by 510 · see citing works
Bayesian Active Learning for Classification and Preference Learning
Houlsby, N., Huszár, F., Ghahramani, Z., & Lengyel, M. (2011) · arXiv · doi:10.48550/arxiv.1112.5745 · Cited by 507 · cited 9× · see citing works
“For its part, BatchBALD [84] opts to expand BALD [67] to the batch query context; this approach no longer calculates the mutual information between a single sample and model parameters, but rather recalculates the mutual information between the batch samples and the model parameters to jointly score the batch of sampl…”
BackgroundMethodInfluentialProceedings of the 27th International Conference on Neural Information Processing Systems
Zoubin Ghahramani, A., Welling, M., Cortes, C., Lawrence, N. D., & Weinberger, K. Q. (2014) · Cited by 481 · see citing works
Assessing the Quality of Activities in a Smart Environment
Schmitter‐Edgecombe, M., & Cook, D. J. (2009) · Methods of Information in Medicine · doi:10.3414/me0592 · Cited by 405 · see citing works
Massively Multilingual Neural Machine Translation
Aharoni, R., Johnson, M., & Firat, O. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1388 · Cited by 402 · see citing works
Exploit the Unknown Gradually: One-Shot Video-Based Person Re-identification by Stepwise Learning
Wu, Y., Lin, Y., Dong, X., Yan, Y., Ouyang, W., & Yang, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00543 · Cited by 401 · see citing works
Deep Active Learning for Named Entity Recognition
Shen, Y., Yun, H., Lipton, Z. C., Kronrod, Y., & Anandkumar, A. (2017) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w17-2630 · Cited by 389 · see citing works
Baeza-Yates, R., Brazil, S. T. 2. A. I. S. O. I. R. 2. 2. S., Association for Computing Machinery-Digital Library, ACM Special Interest Group on Information Retrieval, & SIGs, A. (2005) · doi:10.1145/1076034 · Cited by 361 · see citing works
Rumor Detection over Varying Time Windows
Kwon, S., Cha, M., & Jung, K. (2017) · PLOS ONE · doi:10.1371/journal.pone.0168344 · Cited by 352 · see citing works
Capsule Networks for Hyperspectral Image Classification
Paoletti, M. E., Haut, J. M., Fernández-Beltrán, R., Plaza, J., Plaza, A., Li, J., & Pla, F. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2871782 · Cited by 348 · see citing works
Lotfian, R., & Busso, C. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2736999 · Cited by 330 · see citing works
A new active labeling method for deep learning
Wang, D., & Shang, Y. (2014) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889457 · Cited by 329 · see citing works
Competence-based Curriculum Learning for Neural Machine Translation
Platanios, E. A., Stretcu, O., Neubig, G., Póczos, B., & Mitchell, T. M. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1119 · Cited by 316 · see citing works
Active Deep Learning for Classification of Hyperspectral Images
Liu, P., Zhang, H., & Eom, K. B. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2598859 · Cited by 290 · see citing works
Hekmatfar, M., Seifi, M. S., Farahani, R. Z., & Hekmatfar, M. (2009) · Contributions to management science · doi:10.1007/978-3-7908-2151-2 · Cited by 266 · see citing works
Algorithms for optimal scheduling and management of hidden Markov model sensors
Krishnamurthy, V. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2002.1003062 · Cited by 262 · see citing works
Learning how to Active Learn: A Deep Reinforcement Learning Approach
Fang, M., Li, Y., & Cohn, T. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1063 · Cited by 262 · see citing works
Dasgupta, S. (2010) · Theoretical Computer Science · doi:10.1016/j.tcs.2010.12.054 · Cited by 254 · see citing works
Multimodal emotion recognition using deep learning architectures
Ranganathan, H., Chakraborty, S., & Panchanathan, S. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477679 · Cited by 249 · see citing works
Proceedings of the 20th International Conference on Neural Information Processing Systems
Platt, J. C., Koller, D., Singer, Y., & Roweis, S. T. (2007) · Cited by 240 · see citing works
SmartFall: A Smartwatch-Based Fall Detection System Using Deep Learning
Mauldin, T. R., Canby, M. E., Metsis, V., Ngu, A., & Rivera, C. (2018) · Italian National Conference on Sensors · doi:10.3390/s18103363 · Cited by 236 · see citing works
Automated categorization in the international patent classification
Fall, C. J., Törcsvári, A., Benzineb, K., & Karetka, G. (2003) · ACM SIGIR Forum · doi:10.1145/945546.945547 · Cited by 232 · see citing works
Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Joshi, A. K., Huang, C., & Jurafsky, D. (2010) · Cited by 212 · see citing works
A patent search and classification system
Larkey, L. S. (1999) · doi:10.1145/313238.313304 · Cited by 203 · see citing works
Active learning: theory and applications
Koller, D., & Tong, S. (2001) · Cited by 182 · see citing works
Balcan, M.-F., Beygelzimer, A., & Langford, J. C. (2008) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2008.07.003 · Cited by 174 · see citing works
Deng, C. D., Xue, Y., Liu, X., Li, C., & Tao, D. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2868851 · Cited by 168 · see citing works
Deep Learning for Imbalanced Multimedia Data Classification
Yan, Y., Chen, M., Shyu, M., & Chen, S. (2015) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2015.126 · Cited by 160 · see citing works
Active learning for large multi-class problems
Jain, P., & Kapoor, A. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206651 · Cited by 157 · see citing works
Active Learning for Deep Detection Neural Networks
Aghdam, H. H., Gonzalez-Garcia, A., Lopez, A., & Weijer, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00377 · Cited by 148 · cited 3× · see citing works
“tion so as to obtain high-quality query samples. Fig.3 presents a comparison between traditional AL, RAL and DRAL pipelines. On the other hand, Active-iNAS [50] notices that most previous DAL methods [3, 5, 89] assume that a suitable DL model has been designed for the current task, meaning that their primary focus is…”
BackgroundMethodInfluentialKellenberger, B., Marcos, D., Lobry, S., & Tuia, D. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2927393 · Cited by 143 · see citing works
Low-resource Deep Entity Resolution with Transfer and Active Learning
Kasai, J., Qian, K., Gurajada, S., Li, Y., & Popa, L. C. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1586 · Cited by 143 · see citing works
Multilingual Neural Machine Translation with Language Clustering
Tan, X., Chen, J.-L., He, D., Xia, Y., Qin, T., & Liu, T.-Y. (2019) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d19-1089 · Cited by 138 · see citing works
Wang, J., Li, G., Yu, J. X., & Feng, J. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/2021017.2021020 · Cited by 122 · see citing works
Deep Reinforcement Active Learning for Human-in-the-Loop Person Re-Identification
Liu, Z., Wang, J., Gong, S., Tao, D., & Lu, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00622 · Cited by 115 · see citing works
A large-scale quantitative analysis of latent factors and sentiment in online doctor reviews
Wallace, B., Paul, M. J., Sarkar, U., Trikalinos, T. A., & Dredze, M. H. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-002711 · Cited by 113 · see citing works
Biometric Person Recognition: Face, Speech and Fusion
Sanderson, C. (2008) · Griffith Research Online · Cited by 100 · see citing works
Garla, V. N., Taylor, C., & Brandt, C. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.06.014 · Cited by 99 · see citing works
Hierarchical Losses and New Resources for Fine-grained Entity Typing and Linking
Murty, S., Verga, P. W., Vilnis, L., Radovanovic, I., & McCallum, A. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1010 · Cited by 91 · see citing works
Active learning based news veracity detection with feature weighting and deep-shallow fusion
Bhattacharjee, S. D., Talukder, A., & Balantrapu, B. V. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8257971 · Cited by 87 · see citing works
Deep Active Learning for Efficient Training of a LiDAR 3D Object Detector
Feng, D., Wei, X., Rosenbaum, L., Maki, A., & Dietmayer, K. (2019) · 2019 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2019.8814236 · Cited by 85 · see citing works
Folmsbee, J., Liu, X., Brandwein‐Weber, M., & Doyle, S. T. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363686 · Cited by 80 · see citing works
Deep active learning for image classification
Ranganathan, H., Venkateswara, H., Chakraborty, S., & Panchanathan, S. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8297020 · Cited by 77 · see citing works
Mind reading machines: automated inference of cognitive mental states from video
el Kaliouby, R., & Robinson, P. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1398380 · Cited by 70 · see citing works
Automated Scalable Bayesian Inference via Hilbert CoresetsPreprint
Campbell, T., & Broderick, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.05053 · Cited by 69 · see citing works
MedAL: Accurate and Robust Deep Active Learning for Medical Image Analysis
Smailagic, A., Costa, P., Noh, H. Y., Walawalkar, D., Khandelwal, K., Galdrán, A., Mirshekari, M., Fagert, J., Xu, S., Zhang, P., et al. (2018) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2018.00078 · Cited by 68 · see citing works
Leveraging Crowdsourcing Data for Deep Active Learning An Application
Yang, J., Drake, T., Damianou, A., & Maarek, Y. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186033 · Cited by 66 · see citing works
Active-Learning-Incorporated Deep Transfer Learning for Hyperspectral Image Classification
Lin, J., Zhao, L., Li, S., Ward, R. K., & Wang, Z. J. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2874225 · Cited by 65 · see citing works
Classification of ECG beats using deep belief network and active learning
Sayantan, G., Kien, P. T., & Kadambari, K. V. (2018) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-018-1815-2 · Cited by 62 · see citing works
Lee, B., & Paeng, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_93 · Cited by 58 · see citing works
Deep Active Learning for Surface Defect Detection
Lv, X., Duan, F., Jiang, J.-J., Fu, X., & Gan, L. (2020) · Sensors · doi:10.3390/s20061650 · Cited by 58 · see citing works
Cost-Sensitive Deep Active Learning for Epileptic Seizure Detection
Chen, X., Ji, J., Ji, T., & Li, P. (2018) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3233547.3233566 · Cited by 56 · see citing works
Self-citationDeep Active Learning for Biased Datasets via Fisher Kernel Self-Supervision
Gudovskiy, D., Hodgkinson, A., Yamaguchi, T., & Tsukizawa, S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00906 · Cited by 55 · see citing works
ActiveLink: Deep Active Learning for Link Prediction in Knowledge Graphs
Ostapuk, N., Yang, J., & Cudré-Mauroux, P. (2019) · The Web Conference · doi:10.1145/3308558.3313620 · Cited by 54 · see citing works
Rethinking deep active learning: Using unlabeled data at model training
Siméoni, O., Budnik, M., Avrithis, Y., & Gravier, G. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412716 · Cited by 51 · see citing works
Deep Active Learning for Dialogue Generation
Asghar, N., Poupart, P., Jiang, X., & Li, H. (2017) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s17-1008 · Cited by 49 · see citing works
Hanbay, K. (2018) · IET Signal Processing · doi:10.1049/iet-spr.2018.5103 · Cited by 46 · see citing works
Bloodgood, M., & Vijay‐Shanker, K. (2009) · doi:10.3115/1596374.1596384 · Cited by 45 · see citing works
Huang, Y., Liu, Z., Jiang, M., Yu, X., & Ding, X.-H. (2020) · IEEE transactions on intelligent transportation systems (Print) · doi:10.1109/tits.2018.2888698 · Cited by 42 · see citing works
O‐MedAL: Online active deep learning for medical image analysis
Smailagic, A., Costa, P., Gaudio, A., Khandelwal, K., Mirshekari, M., Fagert, J., Walawalkar, D., Xu, S., Galdrán, A., Zhang, P., et al. (2020) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1353 · Cited by 39 · see citing works
Deep Active Learning with Adaptive Acquisition
Haußmann, M., Hamprecht, F. A., & Kandemir, M. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/343 · Cited by 38 · see citing works
Multiclass Deep Active Learning for Detecting Red Blood Cell Subtypes in Brightfield Microscopy
Sadafi, A., Koehler, N., Makhro, A., Bogdanova, A. Y., Navab, N., Marr, C., & Peng, T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32239-7_76 · Cited by 38 · see citing works
He, T., Jin, X., Ding, G., Yi, L., & Yan, C. C. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00236 · Cited by 35 · see citing works
Active Deep Learning for Activity Recognition with Context Aware Annotator Selection
Hossain, H. M. S., & Roy, N. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330688 · Cited by 34 · see citing works
Deep Active Learning for Anchor User Prediction
Cheng, A., Zhou, C., Yang, H., Wu, J., Li, L., Tan, J., & Guo, L. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/298 · Cited by 33 · see citing works
Wang, Z., Du, B., Zhang, L., & Zhang, L. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.11.062 · Cited by 30 · see citing works
Wang, W., Feng, R., Chen, J., Lu, Y., Chen, T., Yu, H., Chen, D. Z., & Wu, J. (2019) · IEEE Access · doi:10.1109/access.2019.2939850 · Cited by 28 · see citing works
Du, B., Qi, Q., Zheng, H., Huang, Y., & Ding, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01421-6_11 · Cited by 28 · see citing works
Efficient Imbalanced Multimedia Concept Retrieval by Deep Learning on Spark Clusters
Yan, Y., Chen, M., Sadiq, S. B., & Shyu, M. (2017) · International Journal of Multimedia Data Engineering and Management · doi:10.4018/ijmdem.2017010101 · Cited by 26 · see citing works
Takahashi, K., Ogata, T., Nakanishi, J., Cheng, G., & Sugano, S. (2017) · Advanced Robotics · doi:10.1080/01691864.2017.1383939 · Cited by 25 · see citing works
Multi-class batch-mode active learning for image classification
Joshi, A. J., Porikli, F., & Papanikolopoulos, N. P. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509293 · Cited by 23 · see citing works
Deep Bayesian Active Semi-Supervised Learning
Rottmann, M., Kahl, K., & Gottschalk, H. (2018) · IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2018.00031 · Cited by 22 · see citing works
Shardlow, M., Ju, M., Li, M., O’Reilly, C., Iavarone, E., McNaught, J., & Ananiadou, S. (2018) · Neuroinformatics · doi:10.1007/s12021-018-9404-y · Cited by 21 · see citing works
Active Learning for Neural Machine Translation
Zhang, P., Xu, X., & Xiong, D. (2018) · International Conference on Asian Language Processing · doi:10.1109/ialp.2018.8629116 · Cited by 19 · see citing works
Chang, H.-S., Vembu, S., Mohan, S., Uppaal, R., & McCallum, A. (2020) · Machine Learning · doi:10.1007/s10994-020-05897-1 · Cited by 19 · see citing works
Maldonado, R., & Harabagiu, S. M. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103265 · Cited by 17 · see citing works
Deeply Supervised Active Learning for Finger Bones Segmentation
Zhao, Z., Yang, X., Veeravalli, B., & Zeng, Z. (2020) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc44109.2020.9176662 · Cited by 16 · see citing works
Building an Active Palmprint Recognition System
Du, X., Zhong, D., & Shao, H. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803135 · Cited by 15 · see citing works
Kwolek, B., Koziarski, M., Bukała, A., Antosz, Z., Olborski, B., Wąsowicz, P., Swadźba, J., & Cyganek, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30493-5_31 · Cited by 14 · see citing works
Identifying infrastructure damage during earthquake using deep active learning
Priya, S., Singh, S., Dandapat, S. K., Ghosh, K., & Chandra, J. (2019) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/3341161.3342955 · Cited by 14 · see citing works
Competence-based Curriculum Learning for Neural Machine TranslationPreprint
Platanios, E. A., Stretcu, O., Neubig, G., Póczos, B., & Mitchell, T. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.09848 · Cited by 14 · see citing works
SenseBox: A low-cost smart home system
Taylor, J., Hossain, H. M. S., Alam, M. A. U., Khan, M. A. A. H., Roy, N., Galik, E. M., & Gangopadhyay, A. (2017) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2017.7917522 · Cited by 13 · see citing works
Xia, X., Protopapas, P., & Doshi‐Velez, F. (2016) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611974348.54 · Cited by 11 · see citing works
Deep Active Learning for Autonomous Navigation
Hussein, A. M., Gaber, M. M., & Elyan, E. (2016) · Communications in computer and information science · doi:10.1007/978-3-319-44188-7_1 · Cited by 11 · see citing works
Batch Mode Active Learning for Semantic Segmentation Based on Multi-Clue Sample Selection
Tan, Y., Liu, Y., Hu, Q., & Du, Z. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357968 · Cited by 9 · see citing works
CellECT: cell evolution capturing tool
Delibaltov, D. L., Gaur, U., Kim, J. S., Kourakis, M. J., Newman-Smith, E. D., Smith, W. C., Belteton, S. A., Szymanski, D. B., & Manjunath, B. S. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-0927-7 · Cited by 8 · see citing works
Deep Active Learning Through Cognitive Information Parcels
Zhao, W., Kong, Y., Ding, Z., & Fu, Y. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123337 · Cited by 5 · see citing works
A Linear Program Formulation for the Segmentation of Ciona Membrane Volumes
Delibaltov, D. L., Ghosh, P., Rodoplu, V., Veeman, M. T., Smith, W. C., & Manjunath, B. S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40811-3_56 · Cited by 4 · see citing works
Proceedings of the 6th international conference on Advances in Intelligent Data Analysis
Famili, A. F., Kok, J. N., Peña, J. M., Siebes, A. P. J. M., & Feelders, A. (2005) · Cited by 4 · see citing works
Face Recognition via Heuristic Deep Active Learning
Li, Y., Wang, K., Nie, L., & Wang, Q. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-69923-3_11 · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 152 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons
Psaros, A. F., Meng, X., Zou, Z., Guo, L., & Karniadakis, G. E. (2023) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111902 · Cited by 464 · see citing works
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436 · see citing works
“Active learning [421] can deal with the unlabeled data problem up to a certain extent.”
BackgroundData-centric Artificial Intelligence: A Survey
Zha, D., Bhat, Z. P., Lai, K.-H., Yang, F., Jiang, Z., Zhong, S., & Hu, X. (2025) · ACM Computing Surveys · doi:10.1145/3711118 · Cited by 508 · see citing works
A Comprehensive Survey of Scene Graphs: Generation and Application
Chang, X., Ren, P., Xu, P., Li, Z., Chen, X., & Hauptmann, A. G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3137605 · Cited by 349 · see citing works
Self-citationDeep Learning Approaches for Data Augmentation in Medical Imaging: A Review
Kebaili, A., Lapuyade‐Lahorgue, J., & Ruan, S. (2023) · Journal of Imaging · doi:10.3390/jimaging9040081 · Cited by 308 · see citing works
Yao, S., Guan, R., Huang, X., Li, Z., Sha, X., Yue, Y., Lim, E. G., Seo, H., Man, K. L., Zhu, X., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3307157 · Cited by 287 · see citing works
Self-citationData‐Driven Design for Metamaterials and Multiscale Systems: A Review
Lee, D., Chen, W., Wang, L., Chen, W., & Chen, W. (2023) · Advanced Materials · doi:10.1002/adma.202305254 · Cited by 246 · see citing works
Muhammad, K., Hussain, T., Ullah, H., Ser, J. D., Rezaei, M., Kumar, N., Hijji, M., Bellavista, P., & de Albuquerque, V. H. C. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3207665 · Cited by 221 · see citing works
Gupta, B. B., Gaurav, A., Panigrahi, P. K., & Arya, V. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2022.122152 · Cited by 202 · see citing works
Self-citationTen deep learning techniques to address small data problems with remote sensing
Safonova, A. N., Ghazaryan, G., Stiller, S., Main-Knorn, M., Nendel, C., & Ryo, M. (2023) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2023.103569 · Cited by 202 · see citing works
Sarker, I. H., Janicke, H., Mohsin, A., Gill, A. Q., & Maglaras, L. A. (2024) · ICT Express · doi:10.1016/j.icte.2024.05.007 · Cited by 227 · see citing works
Desarrollo de estados de la cuestión robustos: Revisiones Sistemáticas de Literatura
García‐Peñalvo, F. J. (2022) · Education in the Knowledge Society (EKS) · doi:10.14201/eks.28600 · Cited by 258 · see citing works
A Survey on Active Deep Learning: From Model Driven to Data Driven
Liu, P., Wang, L., Ranjan, R. K., He, G., & Zhao, L. (2022) · ACM Computing Surveys · doi:10.1145/3510414 · Cited by 199 · see citing works
A survey on deep learning for cybersecurity: Progress, challenges, and opportunities
Macas, M., Wu, C., & Fuertes, W. (2022) · Computer Networks · doi:10.1016/j.comnet.2022.109032 · Cited by 192 · see citing works
A Survey on Active Learning: State-of-the-Art, Practical Challenges and Research Directions
Tharwat, A., & Schenck, W. (2023) · Mathematics · doi:10.3390/math11040820 · Cited by 182 · see citing works
Applications, Challenges, and Future Directions of Human-in-the-Loop Learning
Kumar, S., Datta, S., Singh, V., Datta, D., Singh, S. K., & Sharma, R. (2024) · IEEE Access · doi:10.1109/access.2024.3401547 · Cited by 194 · see citing works
Bayoudh, K. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102217 · Cited by 173 · see citing works
Review of Lightweight Deep Convolutional Neural Networks
Chen, F., Li, S., Han, J., Ren, F., & Yang, Z. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-10032-z · Cited by 172 · see citing works
Pyun, K. R., Kwon, K., Yoo, M. J., Kim, K. K., Gong, D., Yeo, W., Han, S., & Ko, S. H. (2023) · National Science Review · doi:10.1093/nsr/nwad298 · Cited by 159 · see citing works
Active Learning for Deep Visual Tracking
Yuan, D., Chang, X.-J., Liu, Q., Yang, Y., Wang, D., Shu, M.-L., He, Z.-Y., & Shi, G.-M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3266837 · Cited by 159 · see citing works
Self-citationA Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic
Cunha, B., Droz, C., Zine, A., Foulard, S., & Ichchou, M. (2022) · Mechanical systems and signal processing · doi:10.1016/j.ymssp.2023.110535 · Cited by 164 · see citing works
Auxiliary signal-guided knowledge encoder-decoder for medical report generation
Li, M., Liu, R., Wang, F., Chang, X., & Liang, X. (2022) · World Wide Web · doi:10.1007/s11280-022-01013-6 · Cited by 149 · see citing works
Self-citationMacas, M., Wu, C., & Fuertes, W. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122223 · Cited by 160 · see citing works
Zhang, S., Makoś, M. Z., Jadrich, R. B., Kraka, E., Barros, K. M., Nebgen, B. T., Tretiak, S., Isayev, O., Lubbers, N., Messerly, R. A., et al. (2024) · Nature Chemistry · doi:10.1038/s41557-023-01427-3 · Cited by 140 · see citing works
A Survey on Deep Active Learning: Recent Advances and New Frontiers
Li, D., Wang, Z. R., Chen, Y., Jiang, R., Ding, W., & Okumura, M. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3396463 · Cited by 145 · see citing works
A comprehensive survey on deep active learning in medical image analysis
Wang, H., Jin, Q., Li, S., Liu, S., Wang, M., & Song, Z. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103201 · Cited by 139 · see citing works
Level-5 Autonomous Driving—Are We There Yet? A Review of Research Literature
Khan, M. A., Sayed, H. E., Malik, S., Zia, T., Khan, J., Alkaabi, N., & Ignatious, H. A. (2022) · ACM Computing Surveys · doi:10.1145/3485767 · Cited by 130 · see citing works
Data-centric AI: Perspectives and Challenges
Zha, D., Bhat, Z. P., Lai, K.-H., Yang, F., & Hu, X. (2023) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611977653.ch106 · Cited by 127 · see citing works
Patel, R. A., & Webb, M. A. (2023) · ACS Applied Bio Materials · doi:10.1021/acsabm.2c00962 · Cited by 113 · see citing works
Active learning for data streams: a survey
Cacciarelli, D., & Külahçı, M. (2023) · Machine Learning · doi:10.1007/s10994-023-06454-2 · Cited by 117 · see citing works
Efficient Methods for Natural Language Processing: A Survey
Treviso, M., Lee, J.-U., Ji, T., van Aken, B., Cao, Q., Ciosici, M. R., Hassid, M., Heafield, K., Hooker, S., Raffel, C., et al. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00577 · Cited by 124 · see citing works
Alert Fatigue in Security Operations Centres: Research Challenges and Opportunities
Tariq, S., Baruwal Chhetri, M., Nepal, S., & Paris, C. (2025) · ACM Computing Surveys · doi:10.1145/3723158 · Cited by 101 · see citing works
Rakholia, R., Suárez‐Cetrulo, A. L., Singh, M., & Carbajo, R. S. (2024) · IEEE Access · doi:10.1109/access.2024.3458830 · Cited by 103 · see citing works
Almaatouq, A., Griffiths, T. L., Suchow, J. W., Whiting, M. E., Evans, J., & Watts, D. J. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002874 · Cited by 126 · see citing works
Edge Intelligence: A Review of Deep Neural Network Inference in Resource-Limited Environments
Ngo, D., Park, H.-C., & Kang, B. (2025) · Electronics · doi:10.3390/electronics14122495 · Cited by 108 · see citing works
Meta-Based Self-Training and Re-Weighting for Aspect-Based Sentiment Analysis
He, K., Mao, R., Gong, T., Li, C., & Cambria, E. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3202831 · Cited by 91 · see citing works
Hu, B., Gaurav, A., Choi, C., & Almomani, A. (2022) · International Journal on Semantic Web and Information Systems · doi:10.4018/ijswis.302895 · Cited by 86 · see citing works
CoNeRF: Controllable Neural Radiance Fields
Kania, K., Yi, K. M., Kowalski, M., Trzciniski, T., & Tagliasacchi, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01807 · Cited by 81 · see citing works
Data-Centric Green Artificial Intelligence: A Survey
Salehi, S., & Schmeink, A. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3315272 · Cited by 80 · see citing works
UD_BBC: Named entity recognition in social network combined BERT-BiLSTM-CRF with active learning
Li, W., Du, Y., Li, X., Chen, X., Xie, C., Li, H., & Li, X. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105460 · Cited by 77 · see citing works
Self-citationLabel-efficient learning in agriculture: A comprehensive review
Li, J., Chen, D., Qi, X., Li, Z., Huang, Y., Morris, D., & Tan, X. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108412 · Cited by 77 · see citing works
Self-citationActive Learning for Network Traffic Classification: A Technical Study
Shahraki, A., Abbasi, M., Taherkordi, A., & Jurcut, A. D. (2021) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2021.3119062 · Cited by 79 · see citing works
Discovering and forecasting extreme events via active learning in neural operators
Pickering, E. M., Guth, S., Karniadakis, G. E., & Sapsis, T. P. (2022) · Nature Computational Science · doi:10.1038/s43588-022-00376-0 · Cited by 77 · see citing works
Learning quadrotor dynamics for precise, safe, and agile flight control
Saviolo, A., & Loianno, G. (2023) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2023.03.009 · Cited by 76 · see citing works
A Survey of Active Learning for Natural Language Processing
Zhang, Z., Strubell, E., & Hovy, E. H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.414 · Cited by 85 · see citing works
Xin, R., Liu, H., Chen, P., & Zhao, Z. (2023) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-022-00383-6 · Cited by 73 · see citing works
Fan, C., Wu, Q., Zhao, Y., & Mo, L. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.122356 · Cited by 68 · see citing works
An active learning framework for the low-frequency Non-Intrusive Load Monitoring problem
Sobot, T., Stanković, V., & Stanković, L. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121078 · Cited by 67 · see citing works
Training data influence analysis and estimation: a survey
Hammoudeh, Z., & Lowd, D. (2024) · Machine Learning · doi:10.1007/s10994-023-06495-7 · Cited by 80 · see citing works
A review of deep learning methods for digitisation of complex documents and engineering diagrams
Jamieson, L., Moreno‐García, C. F., & Elyan, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10779-2 · Cited by 66 · see citing works
The sense of agency in human–AI interactions
Legaspi, R., Xu, W., Konishi, T., Wada, S., Kobayashi, N., Naruse, Y., & Ishikawa, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111298 · Cited by 64 · see citing works
Machine learning and Bayesian inference in nuclear fusion research: an overview
Pavone, A., Merlo, A., Kwak, S., & Svensson, J. (2023) · Plasma Physics and Controlled Fusion · doi:10.1088/1361-6587/acc60f · Cited by 63 · see citing works
Machine learning for CO 2 capture and conversion: A review
Jerng, S. E., Park, Y. J., & Li, J. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100361 · Cited by 64 · see citing works
A machine learning-based approach to predict the fatigue life of three-dimensional cracked specimens
Zhang, J., Zhu, J., Guo, W., & Guo, W. (2022) · International Journal of Fatigue · doi:10.1016/j.ijfatigue.2022.106808 · Cited by 61 · see citing works
Deep active learning for object detection
Li, Y., Fan, B., Zhang, W., Ding, W., & Yin, J. (2021) · Information Sciences · doi:10.1016/j.ins.2021.08.019 · Cited by 60 · see citing works
LLMaAA: Making Large Language Models as Active Annotators
Zhang, R., Li, Y., Ma, Y., Zhou, M. Q., & Zou, L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.872 · Cited by 80 · see citing works
Uncertainty quantification: Can we trust artificial intelligence in drug discovery?
Yu, J., Wang, D., & Zheng, M. (2022) · iScience · doi:10.1016/j.isci.2022.104814 · Cited by 59 · see citing works
Chen, Z., Wu, M., Chan, A., Li, X., & Ong, Y.-S. (2023) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2023.3245733 · Cited by 73 · see citing works
Cohn, C., Hutchins, N. M., Le, T., & Biswas, G. (2024) · AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i21.30364 · Cited by 93 · see citing works
Singh, G., Moncrieff, G. R., Venter, Z. S., Cawse-Nicholson, K. A., Slingsby, J. A., & Robinson, T. B. (2024) · Scientific Reports · doi:10.1038/s41598-024-65954-w · Cited by 58 · see citing works
Influence Selection for Active Learning
Liu, Z., Ding, H., Zhong, H., Li, W., Dai, J., & He, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00914 · Cited by 57 · see citing works
A Survey on Machine Learning Techniques for Source Code AnalysisPreprint
Sharma, T., Kechagia, M., Georgiou, S., Tiwari, R. K., Vats, I., Moazen, H., & Sarro, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09610 · Cited by 56 · see citing works
Shi, Z., Yao, W., Tang, Y., Ai, X., Wen, J., & Cheng, S. (2022) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2022.3220955 · Cited by 55 · see citing works
Active learning for medical image segmentation with stochastic batches
Gaillochet, M., Desrosiers, C., & Lombaert, H. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102958 · Cited by 57 · see citing works
Xu, M., Kim, H., Yang, J., Fuentes, A., Meng, Y., Yoon, S., Kim, T.-H., & Park, D. S. (2023) · Frontiers in Plant Science · doi:10.3389/fpls.2023.1225409 · Cited by 55 · see citing works
Almaatouq, A., Griffiths, T. L., Suchow, J. W., Whiting, M. E., Evans, J. A., & Watts, D. J. (2022) · doi:10.31234/osf.io/anjkm · Cited by 57 · see citing works
Deep Discrete Cross-Modal Hashing with Multiple Supervision
Yu, E., Ma, J., Sun, J., Chang, X., Zhang, H., & Hauptmann, A. G. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.11.035 · Cited by 54 · see citing works
Self-citationJin, Q., Yuan, M., Qiao, Q., & Song, Z. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108278 · Cited by 53 · see citing works
Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Control
Saviolo, A., Frey, J., Rathod, A., Diehl, M., & Loianno, G. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3339543 · Cited by 56 · see citing works
Active Clustering Ensemble With Self-Paced Learning
Zhou, P., Sun, B., Liu, X., Du, L., & Li, X. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3252586 · Cited by 52 · see citing works
NeU-NBV: Next Best View Planning Using Uncertainty Estimation in Image-Based Neural Rendering
Jin, L., Chen, X., Rückin, J., & Popović, M. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342226 · Cited by 52 · see citing works
Self-citationMolina, M. J., O'Brien, T. A., Anderson, G. J., Ashfaq, M., Bennett, K. E., Collins, W. D., Dagon, K., Restrepo, J. M., & Ullrich, P. A. (2023) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-22-0086.1 · Cited by 57 · see citing works
Wang, J., Zheng, N., Wan, H., Yao, Q., Jia, S., Zhang, X., Fu, S., Ruan, J., He, G., Chen, X., et al. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00085-2 · Cited by 51 · see citing works
Self-citationBoosting Cyber-Threat Intelligence via Collaborative Intrusion Detection
Guarascio, M., Cassavia, N., Pisani, F. S., & Manco, G. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.04.028 · Cited by 50 · see citing works
Adaptive deep density approximation for Fokker-Planck equations
Tang, K., Wan, X., & Liao, Q. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111080 · Cited by 48 · see citing works
Jiang, J., Lu, W., Chen, J., Lin, Q., Zhao, P., Kang, Y., Zhang, H., Xiong, Y., Gao, F., Xu, Z., et al. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3417054 · Cited by 56 · see citing works
Deep Active Learning for Computer Vision Tasks: Methodologies, Applications, and Challenges
Wu, M., Li, C., & Yao, Z. (2022) · Applied Sciences · doi:10.3390/app12168103 · Cited by 51 · see citing works
Deep active learning models for imbalanced image classification
Jin, Q., Yuan, M., Wang, H., Wang, M., & Song, Z. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109817 · Cited by 47 · see citing works
Wang, P., Yao, W., & Shao, J. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.09.002 · Cited by 47 · see citing works
Lai, Z., Wang, C., Oliveira, L. C., Dugger, B. N., Cheung, S.-C. S., & Chuah, C. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00072 · Cited by 46 · see citing works
All you need are a few pixels: semantic segmentation with PixelPick
Shin, G., Xie, W., & Albanie, S. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00194 · Cited by 46 · see citing works
From Data and Model Levels: Improve the Performance of Few-Shot Malware Classification
Chai, Y., Qiu, J., Yin, L., Zhang, L., Gupta, B. B., & Tian, Z. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3200866 · Cited by 46 · see citing works
Self-citationIndustrial Foundation Models (IFMs) for intelligent manufacturing: A systematic review
Zhao, S., Liu, S., Jiang, Y., Zhao, B. M., Lv, Y., Zhang, J., Wang, L., & Zhong, R. Y. (2025) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2025.06.011 · Cited by 46 · see citing works
Smart Flood Detection with AI and Blockchain Integration in Saudi Arabia Using Drones
Alsumayt, A., El-Haggar, N., Amouri, L., Alfawaer, Z. M., & Aljameel, S. S. (2023) · Sensors · doi:10.3390/s23115148 · Cited by 44 · see citing works
A survey on machine learning techniques applied to source code
Sharma, T., Kechagia, M., Georgiou, S., Tiwari, R., Vats, I., Moazen, H., & Sarro, F. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111934 · Cited by 130 · see citing works
Venugopalan, M., & Gupta, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118228 · Cited by 42 · see citing works
A Disjoint Samples-Based 3D-CNN With Active Transfer Learning for Hyperspectral Image Classification
Ahmad, M. I., Ghous, U., Hong, D., Khan, A., Yao, J. T., Wang, S., & Chanussot, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3209182 · Cited by 42 · see citing works
Calisto, F. M., Abrantes, J., Santiago, C., Nunes, N., & Nascimento, J. C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103444 · Cited by 40 · see citing works
Bai, S., Yu, D., Han, C., Yang, M., Gupta, B. B., Arya, V., Panigrahi, P. K., Tang, R., He, H., & Zhao, J. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123395 · Cited by 46 · see citing works
Self-citationLi, X., Li, L., Li, M., Yan, P., Feng, T., Luo, H., Zhao, Y. L., & Shen, Y. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103819 · Cited by 41 · see citing works
Human-in-the-loop reinforcement learning in continuous-action space
Luo, B., Wu, Z., Zhou, F., & Wang, B.-C. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3289315 · Cited by 41 · see citing works
Xiao, J., Li, H., Wu, M., Jin, H., Deen, M. J., & Cao, J. (2022) · ACM Computing Surveys · doi:10.1145/3530682 · Cited by 40 · see citing works
Self-Supervised Learning for data scarcity in a fatigue damage prognostic problem
Akrim, A., Gogu, C., Vingerhoeds, R. A., & Salaün, M. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105837 · Cited by 40 · see citing works
Machine Learning Strategies for Reaction Development: Toward the Low-Data Limit
Shim, E., Tewari, A., Cernak, T., & Zimmerman, P. M. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c00577 · Cited by 42 · see citing works
When Model Meets New Normals: Test-Time Adaptation for Unsupervised Time-Series Anomaly Detection
Kim, D., Park, S., & Choo, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29210 · Cited by 40 · see citing works
Robot learning in the era of foundation models: a survey
Xiao, X., Liu, J., Wang, Z., Zhou, Y., Qi, Y., Jiang, S., He, B., & Cheng, Q. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129963 · Cited by 47 · see citing works
FisherRF: Active View Selection and Mapping with Radiance Fields Using Fisher Information
Jiang, W., Lei, B., & Daniilidis, K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72624-8_24 · Cited by 39 · see citing works
Efficient Dark Web traffic classification using a hybrid CNN-LSTM model
Mandela, N., Sonia, Mistry, N. R., & Nagpal, A. (2025) · International Journal of Information Technology · doi:10.1007/s41870-025-02427-x · Cited by 39 · see citing works
Jackett, C., Althaus, F., Maguire, K., Farazi, M. R., Scoulding, B., Untiedt, C., Ryan, T. E., Shanks, P., Brodie, P., & Williams, A. (2023) · Journal of Applied Ecology · doi:10.1111/1365-2664.14408 · Cited by 38 · see citing works
Supervised contrastive learning for wafer map pattern classification
Bae, Y., & Kang, S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107154 · Cited by 37 · see citing works
- Authors
- Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Gupta, B. B., Chen, X., & Wang, X.
- Affiliations
- Northwest University (CN)
- RMIT University (AU)
- Carnegie Mellon University (US)
- Qilu University of Technology (CN)
- National Institute of Technology Kurukshetra (IN)
- ORCID
- Venue
- ACM Computing Surveys
- Published
- 2021-10-08
- Volume
- 54
- Issue
- 9
- Pages
- 1-40
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3205626500
- Cited by
- 1,169
- References
- 152
- Citations by year
- 2026: 143 · 2025: 256 · 2024: 297 · 2023: 302 · 2022: 125 · 2021: 43 · 2020: 3
- FWCI
- 68.03
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- RMIT Research Repository (RMIT University Library) (submittedVersion)
- Figshare (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- NSFC (61972315 and 62072372)
- Shaanxi Science and Technology Innovation Team Support (2018TD-026)
- Australian Research Council Discovery Early Career Researcher Award (DE190100626)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- deep active learning, active learning (machine learning), deep learning, annotation cost reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review