The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Interpretable machine learning
Open accessAbstract
Machine learning (ML, a type of artificial intelligence) is increasingly being used to support decision making in a variety of applications including recruitment and clinical diagnoses. While ML has many advantages, there are concerns that in some cases it may not be possible to explain completely how its outputs have been produced. This POSTnote gives an overview of ML and its role in decision-making. It examines the challenges of understanding how a complex ML system has reached its output, and some of the technical approaches to making ML easier to interpret. It also gives a brief overview of some of the proposed tools for making ML systems more accountable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Anchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162
Povyakalo, A. A., Alberdi, E., Strigini, L., & Ayton, P. (2013) · Medical Decision Making · doi:10.1177/0272989x12465490 · Cited by 79
Cited by
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Explainable AI (XAI): Core Ideas, Techniques, and Solutions
Dwivedi, R., Dave, D., Naik, H., Singhal, S., Omer, R., Patel, P., Qian, B., Wen, Z., Shah, T., Morgan, G., et al. (2023) · ACM Computing Surveys · doi:10.1145/3561048 · Cited by 1,386
Machine Learning: New Ideas and Tools in Environmental Science and Engineering
Zhong, S., Zhang, K., Bagheri, M., Burken, J. G., Gu, A., Li, B., Ma, X., Marrone, B. L., Ren, Z. J., Schrier, J., et al. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.1c01339 · Cited by 945
Machine Learning Testing: Survey, Landscapes and Horizons
Zhang, J. M., Harman, M., Ma, L., & Liu, Y. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2962027 · Cited by 897
Machine learning for digital soil mapping: Applications, challenges and suggested solutions
Wadoux, A. M. J.-C., Minasny, B., & McBratney, A. B. (2020) · Earth-Science Reviews · doi:10.1016/j.earscirev.2020.103359 · Cited by 731
Industrial Artificial Intelligence in Industry 4.0 - Systematic Review, Challenges and Outlook
Peres, R. S., Jia, X., Lee, J., Sun, K., Colombo, A. W., & Barata, J. (2020) · IEEE Access · doi:10.1109/access.2020.3042874 · Cited by 693
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
Razavi, S., Jakeman, A., Saltelli, A., Prieur, C., Iooss, B., Borgonovo, E., Plischke, E., Lo Piano, S., Iwanaga, T., Becker, W., et al. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104954 · Cited by 628
Nauta, M., Trienes, J., Pathak, S., Nguyen, E., Peters, M., Schmitt, Y., Schlötterer, J., van Keulen, M., & Seifert, C. (2023) · ACM Computing Surveys · doi:10.1145/3583558 · Cited by 590
Machine learning and deep learning—A review for ecologists
Pichler, M., & Hartig, F. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14061 · Cited by 454
Explainable Deep Learning: A Field Guide for the Uninitiated
Ras, G., Xie, N., Van Gerven, M., & Doran, D. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13200 · Cited by 446
Interpretable and Explainable Machine Learning for Materials Science and Chemistry
Oviedo, F., Ferres, J. L., Buonassisi, T., & Butler, K. T. (2022) · Accounts of Materials Research · doi:10.1021/accountsmr.1c00244 · Cited by 435
Interpretable machine learning for building energy management: A state-of-the-art review
Chen, Z., Xiao, F., Guo, F., & Yan, J. (2023) · Advances in Applied Energy · doi:10.1016/j.adapen.2023.100123 · Cited by 343
Bottom-up Coarse-Graining: Principles and Perspectives
Jin, J., Pak, A. J., Durumeric, A. E. P., Loose, T. D., & Voth, G. A. (2022) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.2c00643 · Cited by 305
Deep learning for insider threat detection: Review, challenges and opportunities
Yuan, S., & Wu, X. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102221 · Cited by 271
Interpretable and explainable AI (XAI) model for spatial drought prediction
Dikshit, A., & Pradhan, B. (2021) · Science of The Total Environment · doi:10.1016/j.scitotenv.2021.149797 · Cited by 272
Moustafa, N., Koroniotis, N., Keshk, M., Zomaya, A. Y., & Tari, Z. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3280465 · Cited by 266
Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations
Rong, Y., Leemann, T., Nguyen, T.-T., Fiedler, L., Qian, P., Unhelkar, V., Seidel, T., Kasneci, G., & Kasneci, E. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3331846 · Cited by 278
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261
Trustworthy ai: A computational perspective
Liu, H., Wang, Y., Fan, W., Liu, X., Li, Y., Jain, S., Liu, Y., Jain, A., & Tang, J. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3546872 · Cited by 261
Model-Guided Deep Hyperspectral Image Super-Resolution
Dong, W., Zhou, C., Wu, F., Wu, J., Shi, G., & Li, X. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3078058 · Cited by 254
Explaining the black-box model: A survey of local interpretation methods for deep neural networks
Liang, Y., Li, S., Yan, C., Li, M., & Jiang, C. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.08.011 · Cited by 253
Interpretable dropout prediction: towards XAI-based personalized intervention
Nagy, M., & Molontay, R. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00331-8 · Cited by 179
Bai, Q., Liu, S., Tian, Y., Xu, T., Banegas‐Luna, A. J., Pérez‐Sánchez, H., Huang, J., Liu, H., & Yao, X. (2022) · WIREs Computational Molecular Science · doi:10.1002/wcms.1581 · Cited by 156
Barr Kumarakulasinghe, N., Blomberg, T., Liu, J., Saraiva Leao, A., & Papapetrou, P. (2020) · 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS) · doi:10.1109/cbms49503.2020.00009 · Cited by 133
Measuring Association Between Labels and Free-Text Rationales
Wiegreffe, S., Marasović, A., & Smith, N. A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.804 · Cited by 119
Mertes, S., Huber, T., Weitz, K., Heimerl, A., & André, E. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.825565 · Cited by 119
Emerging approaches applied to maritime transport research: past and future
Yan, R., Wang, S., Zhen, L., & Laporte, G. (2021) · Communications in Transportation Research · doi:10.1016/j.commtr.2021.100011 · Cited by 111
Luz, C. F., Vollmer, M., Decruyenaere, J., Nijsten, M. W., Glasner, C., & Sinha, B. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.02.003 · Cited by 106
A Robust Interpretable Deep Learning Classifier for Heart Anomaly Detection Without Segmentation
Dissanayake, T., Fernando, T., Denman, S., Sridharan, S., Ghaemmaghami, H., & Fookes, C. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3027910 · Cited by 105
Survey on Explainable AI: Techniques, challenges and open issues
Abusitta, A., Li, M. Q., & Fung, B. C. M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124710 · Cited by 98
Pereira, F. D., Fonseca, S. C., Oliveira, E. H. T., Cristea, A. I., Bellhauser, H., Rodrigues, L., Oliveira, D. B. F., Isotani, S., & Carvalho, L. S. G. (2021) · IEEE Access · doi:10.1109/access.2021.3105956 · Cited by 63
Deep learning-based algorithms for long-term prediction of chlorophyll-a in catchment streams
Abbas, A., Park, M., Baek, S.-S., & Cho, K. H. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130240 · Cited by 63
Liao, Q. V., Zhang, Y., Luss, R., Doshi-Velez, F., & Dhurandhar, A. (2022) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v10i1.21995 · Cited by 69
Establishing and evaluating trustworthy AI: overview and research challenges
Kowald, D., Scher, S., Pammer-Schindler, V., Müllner, P., Waxnegger, K., Demelius, L., Fessl, A., Toller, M., Mendoza Estrada, I. G., Šimić, I., et al. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1467222 · Cited by 59
Artificial agents’ explainability to support trust: considerations on timing and context
Papagni, G., de Pagter, J., Zafari, S., Filzmoser, M., & Koeszegi, S. T. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01462-7 · Cited by 52
Sheik, A. G., Kumar, A., Patnaik, R., Kumari, S., & Bux, F. (2024) · Critical Reviews in Environmental Science and Technology · doi:10.1080/10643389.2023.2252313 · Cited by 47
Considerations for a more ethical approach to data in AI: On data representation and infrastructure
Baird, A., & Schuller, B. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.00025 · Cited by 46
Sheik, A. G., Kumar, A., Ansari, F. A., Raj, V., Peleato, N. M., Patan, A. K., Kumari, S., & Bux, F. (2024) · Algal Research · doi:10.1016/j.algal.2024.103779 · Cited by 37
Beyond model interpretability: socio-structural explanations in machine learning
Smart, A., & Kasirzadeh, A. (2025) · AI & SOCIETY · doi:10.1007/s00146-024-02056-1 · Cited by 25
MIMIC-IF: Interpretability and Fairness Evaluation of Deep Learning Models on MIMIC-IV Dataset
Meng, C., Trinh, L., Xu, N., & Liu, Y. (2021) · doi:10.21203/rs.3.rs-402058/v1 · Cited by 21
Interpretable AI/ML for High-stakes Tasks with Human-in-the-loop: Critical Review and Future Trends
Kovalerchuk, B. (2024) · doi:10.21203/rs.3.rs-3989807/v1 · Cited by 9
Directions of Technical Innovation for Regulatable AI Systems
Shen, X., Brown, H., Tao, J., Strobel, M., Tong, Y., Narayan, A., Soh, H., & Doshi-Velez, F. (2024) · Communications of the ACM · doi:10.1145/3653670 · Cited by 3
Informing EEG-Based Error Decoding With Explainable AI
Jeremy Chan, H. T., Wimmer, M., Šimić, I., Müller-Putz, G. R., & Veas, E. (2025) · 2025 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc58881.2025.11343575
Metadata
- Authors
- Parliamentary Office of Science and Technology, & Christie, L.
- Published
- 2020-10-06
- OpenAlex
- W4402843978
- Cited by
- 952
- References
- 2
- Type
- report
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.