Measuring and Improving Consistency in Pretrained Language Models

Elazar, Yanai, Kassner, Nora, Ravfogel, Shauli, Ravichander, Abhilasha, Hovy, Eduard, Schütze, Hinrich, Goldberg, Yoav·2021·Transactions of the Association for Computational Linguistics
DOI 10.1162/tacl_a_00410

Cited by (234)

Items 201–234 of 234

  1. A2R: A hybridactivation-attention framework for enhancing large language model reliability
    Xuran Li, Jingyi Wang, Xiaohan Yuan, Wenhai Wang · 2025 · Expert Systems with Applications
  2. On Automating Configuration Dependency Validation via Retrieval-Augmented Generation
    Sebastian Simon, Alina Mailach, Johannes Dorn, Norbert Siegmund · 2025 · IEEE/ACM International Conference on Automated Software Engineering (ASE)
  3. Analyzing how pre-trained language models capture factual knowledge using attribution methods
    Shaobo Li, Chengjie Sun, Bingquan Liu, Xiaoguang Li, Lifeng Shang, Zhenhua Dong, Zhenzhou Ji, Xin Jiang, Qun Liu · 2026 · Knowledge-Based Systems
  4. A text consistency evaluation method combining unified modeling and mixture-of-expert networks
    Lina Zhang, Wanying Xiong, Runtao Yang, Ming Li · 2026 · Expert Systems with Applications
  5. LLMs vs. humans in sarcasm detection on german soccer tweets: The impact of domain knowledge and voting type
    Vadim Rodt, Frank Domahs · 2026 · Yearbook of the German Cognitive Linguistics Association
  6. Representational and Behavioral Stability of Truth in Large Language Models
    Samantha Dies, Courtney Maynard, Germans Savcisens, Tina Eliassi‐Rad · 2026 · SSRN Electronic Journal
  7. Triple-constrained and assumption-based zero-shot logical reasoning in reading comprehension
    Xin Wu, Yuqi Bu, Yi Cai, Tao Wang · 2026 · Knowledge-Based Systems
  8. Large Language Model Evaluation
    優介 坂井 · 2024 · Institutional Repositories DataBase (IRDB)
  9. Towards efficient, general and robust entity disambiguation systems
    Lihu Chen · 2023 · theses.fr (ABES)
  10. Machine Learning Approaches for Sub-surface Geological Heterogeneous Sources
    Molood Arman · 2023 · theses.fr (ABES)
  11. Entropy and Attention Dynamics in Small Language Models: A Trace-Level Structural Analysis on the TruthfulQA Benchmark
    Adeyemi Adeseye, Aisvarya Adeseye, Hannu Tenhunen, Jouni Isoaho · 2026 · Lecture notes in networks and systems
  12. Employing Transformers and Humans for Textual-Claim Verification
    Mohammed Saeed · 2022 · theses.fr (ABES)
  13. Optimizing the Signal-to-Noise Ratio of Contextual Information for Improved Attributed Text Generation
    Zhaoye Li, Xueqiong Li, Yunxin Mao, Ligong Cao, Wanrong Huang, Jing Ren, Wenjing Yang · 2026 · IEEE International Conference on Acoustics Speech and Signal Processing
  14. FIBER: A Multilingual Evaluation Resource for Factual Inference Bias
    Evren Ayberk Munis, Deniz Yılmaz, Arianna Muti, Çağrı Toraman · 2026 · Language Resources and Evaluation Conference (LREC)
  15. GHOST: Getting to the Bottom of Hallucinations with A Multi-round Consistency Benchmark
    Vibashan VS, Nadine Chang, Jenny Schmalfuß, Vishal M. Patel, Zhiding Yu, José Manuel Álvarez · 2026 · IEEE Winter Conference on Applications of Computer Vision
  16. Enhance ecological validity of scenario-based experiments on human–AI collaboration: evidence from an interactive LLM-based research tool
    Grzegorz Leszczyński, Piotr Gaczek, Amira Mouakher · 2026 · Journal of Research in Interactive Marketing
  17. Activation Trained Layer Based Controls Continual Knowledge Editing Approach
    Yilin Huang, Yimin Wen, Junying Zeng, Xudong Jia, Tao Chen · 2026 · Machine Learning
  18. Identifying the Achilles’ Heel: An Iterative Method for Uncovering Factual Errors in Large Language Models
    Wenxuan Wang, Yuk-Kit Chan, Zixuan Ling, Juluan Shi, Youliang Yuan, Jen-tse Huang, Yifei Zhang, Wenxiang Jiao, Zhaopeng Tu, Michael Rung-Tsong Lyu · 2026 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  19. Rewriting History: A Recipe for Interventional Analyses to Study Data Effects on Model Behavior
    Rahul Nadkarni, Yanai Elazar, Hila Gonen, Noah A. Smith · 2026 · Transactions of the Association for Computational Linguistics
  20. Trust the Eye or the Crowd? Unveiling Conformity in Multimodal Large Language Models
    Haoran Luo, Yuhan Niu, Hengxian Liu, Yuanfei Sun, Zhihao Yang, Tong Chen, Dexin Liu, Yiyi Miao, 周景师, Haiyang Zhang et al. · 2026 · International Conference on Computer Supported Cooperative Work in Design (CSCWD)
  21. KGtelescope: Knowledge Graph Guided Model Routing for Factual Question Answering
    Blerina Spahiu, Marco Maccarini, Anisa Rula, Matteo Palmonari · 2026 · SSRN Electronic Journal
  22. LLMSafeGuard: A Training-Free Framework for Safeguarding LLM Decoding via Context-Wise Similarity Validation
    Ximing Dong, Shaowei Wang, Dayi Lin, Ahmed E. Hassan · 2026 · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE)
  23. A Protocol for Rater-Invariant Measures from Language Models, with an Application to AI Exposure
    benjamin verschuere, Angus Cameron · 2026 · SSRN Electronic Journal
  24. Tracing Stereotypes in Pre-trained Transformers: From Biased Neurons to Fairer Models
    Gianmario Voria, Moses Openja, Foutse Khomh, Gemma Catolino, Fabio Palomba · 2026 · International Conference on Mining Software Repositories (MSR)
  25. Applying Specialized AI Agents for Plug and Abandonment Operation Analysis and Regulatory Compliance: A Fundamental Shift Towards Automating Workflows and Augmenting Engineer's Capabilities
    Vlad Karen Payrazyan, Oxana Gubaidullina, Rustam Galliamov, Andrey Egorov, Christopher Wilson · 2026 · SPE/IADC Asia Pacific Drilling Technology Conference and Exhibition (APDT)
  26. Large Language Models and Their Impact on English Teaching Practices
    Dedakhanov Abdumalik Mutalliyevich · 2023 · International Journal of English and Education
  27. From EventStorming Artifacts to User Stories: A Semi-Automated Requirements Extraction Approach
    Mantas Jurgelaitis, Ramanauskas, Antanas,, Gvidas Ambrozaitis, Guoda Stulpinaite · 2026 · IEEE Access
  28. Are Large Language Models Consistent Reasoners?
    Valentina Dragos, Erik Blasch, Anne-Laure Jousselme, J. P. de Villiers, Paulo Cesar G Costa, Kathryn B. Laskey · 2026 · IEEE National Aerospace and Electronics Conference (NAECON)
  29. Are LLMs Syllogistic Reasoners? A Mechanistic Interpretation Perspective via Activation Patching
    Zhidian Huang, Jinxin Liu, Zijun Yao, Weichuan Liu, Xiaoyin Che, Lei Hou, Juanzi Li · 2026 · Lecture notes in computer science
  30. Characterizing Why Inference-Time Interventions Fail to Mitigate Sycophancy in LLMs
    Gireesh Sundaram, Balaji Venktesh V, K. B. Sundharakumar · 2026 · International Conference on Emerging Technologies in Computing and Communication (ETCC)
  31. Stochasticity-Induced Unreliability in LLM-Based Hiring Systems
    Animesh Giri, Keerthana Bhat, Nehal G, Manodnya K H · 2026 · IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT)
  32. Multilingual Trajectory Integrity in Legal Reasoning Across Nine Large Language Models: Justificatory Decoupling and Self-Audit Drift
    Evans F. Tovar O. · 2026 · Research Square
  33. The impact of AI hallucination on the chatbot service quality in e-commerce: the moderating role of human agent based service recovery
    Xi Chen, Jiarui Liu, QinXian Chen, Lin Li · 2026 · Frontiers in Psychology
  34. Multilingual Energy-Performance Evaluation of Large Language Models
    I. de Zarzà, Mauro Liz, J. de Curtò, Jordi Cabot, Carlos T. Calafate · 2026 · Procedia Computer Science