The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
FinBERT: A Large Language Model for Extracting Information from Financial Text*
Open accessAbstract
We develop FinBERT, a state‐of‐the‐art large language model that adapts to the finance domain. We show that FinBERT incorporates finance knowledge and can better summarize contextual information in financial texts. Using a sample of researcher‐labeled sentences from analyst reports, we document that FinBERT substantially outperforms the Loughran and McDonald dictionary and other machine learning algorithms, including naïve Bayes, support vector machine, random forest, convolutional neural network, and long short‐term memory, in sentiment classification. Our results show that FinBERT excels in identifying the positive or negative sentiment of sentences that other algorithms mislabel as neutral, likely because it uses contextual information in financial text. We find that FinBERT's advantage over other algorithms, and Google's original bidirectional encoder representations from transformers model, is especially salient when the training sample size is small and in texts containing financial words not frequently used in general texts. FinBERT also outperforms other models in identifying discussions related to environment, social, and governance issues. Last, we show that other approaches underestimate the textual informativeness of earnings conference calls by at least 18% compared to FinBERT. Our results have implications for academic researchers, investment professionals, and financial market regulators.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
(2014) · Cited by 33,419
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks
LOUGHRAN, T., & MCDONALD, B. (2011) · The Journal of Finance · doi:10.1111/j.1540-6261.2010.01625.x · Cited by 6,015
Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
Vuong, Q. H. (1989) · Econometrica · doi:10.2307/1912557 · Cited by 5,929
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684
Annual report readability, current earnings, and earnings persistence
Li, F. (2008) · Journal of Accounting and Economics · doi:10.1016/j.jacceco.2008.02.003 · Cited by 2,838
Textual Analysis in Accounting and Finance: A Survey
LOUGHRAN, T., & MCDONALD, B. (2016) · Journal of Accounting Research · doi:10.1111/1475-679x.12123 · Cited by 2,261
Text-Based Network Industries and Endogenous Product Differentiation
Hoberg, G., & Phillips, G. (2016) · Journal of Political Economy · doi:10.1086/688176 · Cited by 2,095
Can we open the black box of AI?
Castelvecchi, D. (2016) · Nature · doi:10.1038/538020a · Cited by 1,773
Alsentzer, E., Murphy, J., Boag, W., Weng, W.-H., Jindi, D., Naumann, T., & McDermott, M. (2019) · Proceedings of the 2nd Clinical Natural Language Processing Workshop · doi:10.18653/v1/w19-1909 · Cited by 1,736
Kernel methods in machine learning
Hofmann, T., Schölkopf, B., & Smola, A. J. (2008) · The Annals of Statistics · doi:10.1214/009053607000000677 · Cited by 1,651
Schwartz, R., Dodge, J., Smith, N. A., & Etzioni, O. (2020) · Communications of the ACM · doi:10.1145/3381831 · Cited by 1,647
A primer in BERTology: What we know about how BERT works
Rogers, A., Kovaleva, O., & Rumshisky, A. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00349 · Cited by 1,552
Measuring Readability in Financial Disclosures
LOUGHRAN, T., & MCDONALD, B. (2014) · The Journal of Finance · doi:10.1111/jofi.12162 · Cited by 1,446
What Does BERT Look at? An Analysis of BERT’s Attention
Clark, K., Khandelwal, U., Levy, O., & Manning, C. D. (2019) · Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w19-4828 · Cited by 1,373
LI, F. (2010) · Journal of Accounting Research · doi:10.1111/j.1475-679x.2010.00382.x · Cited by 1,360
BERT Rediscovers the Classical NLP Pipeline
Tenney, I., Das, D., & Pavlick, E. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1452 · Cited by 1,307
Gentzkow, M., Kelly, B., & Taddy, M. (2019) · Journal of Economic Literature · doi:10.1257/jel.20181020 · Cited by 1,236
Topic modeling: beyond bag-of-words
Wallach, H. M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143967 · Cited by 1,058
LEGAL-BERT: The Muppets straight out of Law School
Chalkidis, I., Fergadiotis, M., Malakasiotis, P., Aletras, N., & Androutsopoulos, I. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.261 · Cited by 994
News implied volatility and disaster concerns
Manela, A., & Moreira, A. (2017) · Journal of Financial Economics · doi:10.1016/j.jfineco.2016.01.032 · Cited by 721
An introduction to Deep Learning in Natural Language Processing: Models, techniques, and tools
Lauriola, I., Lavelli, A., & Aiolli, F. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.05.103 · Cited by 691
Large‐Sample Evidence on Firms’ Year‐over‐Year MD&A Modifications
BROWN, S. V., & TUCKER, J. W. (2011) · Journal of Accounting Research · doi:10.1111/j.1475-679x.2010.00396.x · Cited by 671
Earnings conference calls and stock returns: The incremental informativeness of textual tone
Price, S. M., Doran, J. S., Peterson, D. R., & Bliss, B. A. (2012) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2011.10.013 · Cited by 666
Textual Analysis of Corporate Disclosures: A Survey of the LiteraturePreprint
Li, F. (2011) · SSRN Electronic Journal · Cited by 640
A plain English measure of financial reporting readability
Bonsall, S. B., Leone, A. J., Miller, B. P., & Rennekamp, K. (2017) · Journal of Accounting and Economics · doi:10.1016/j.jacceco.2017.03.002 · Cited by 624
The effect of manager-specific optimism on the tone of earnings conference calls
Davis, A. K., Ge, W., Matsumoto, D., & Zhang, J. L. (2015) · Review of Accounting Studies · doi:10.1007/s11142-014-9309-4 · Cited by 592
Analyst Information Discovery and Interpretation Roles: A Topic Modeling Approach
Huang, A. H., Lehavy, R., Zang, A. Y., & Zheng, R. (2018) · Management Science · doi:10.1287/mnsc.2017.2751 · Cited by 585
Self-citationGood debt or bad debt: Detecting semantic orientations in economic texts
Malo, P., Sinha, A., Korhonen, P., Wallenius, J., & Takala, P. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23062 · Cited by 513
Evidence on the Information Content of Text in Analyst Reports
Huang, A. H., Zang, A. Y., & Zheng, R. (2014) · The Accounting Review · doi:10.2308/accr-50833 · Cited by 499
Self-citationTextual analysis and international financial reporting: Large sample evidence
Lang, M., & Stice-Lawrence, L. (2015) · Journal of Accounting and Economics · doi:10.1016/j.jacceco.2015.09.002 · Cited by 460
A Measure of Competition Based on 10‐K Filings
LI, F., LUNDHOLM, R., & MINNIS, M. (2013) · Journal of Accounting Research · doi:10.1111/j.1475-679x.2012.00472.x · Cited by 405
Assessing BERT's Syntactic Abilities
Goldberg, Y. (2019) · arXiv · doi:10.48550/arxiv.1901.05287 · Cited by 385
Henry, E., & Leone, A. J. (2016) · The Accounting Review · doi:10.2308/accr-51161 · Cited by 381
On the Robustness of Interpretability Methods
Alvarez-Melis, D., & Jaakkola, T. S. (2018) · arXiv · doi:10.48550/arxiv.1806.08049 · Cited by 310
Brown, S. V., (Shaolee) Tian, X., & Wu Tucker, J. (2018) · Contemporary Accounting Research · doi:10.1111/1911-3846.12414 · Cited by 290
Restoring the Tower of Babel: How Foreign Firms Communicate with U.S. Investors
Lundholm, R. J., Rogo, R., & Zhang, J. L. (2014) · The Accounting Review · doi:10.2308/accr-50725 · Cited by 244
Accounting Variables, Deception, and a Bag of Words: Assessing the Tools of Fraud Detection
Purda, L., & Skillicorn, D. (2015) · Contemporary Accounting Research · doi:10.1111/1911-3846.12089 · Cited by 242
Textual Analysis in Accounting: What's Next?*
Bochkay, K., Brown, S. V., Leone, A. J., & Tucker, J. W. (2023) · Contemporary Accounting Research · doi:10.1111/1911-3846.12825 · Cited by 242
Are Financial Constraints Priced? Evidence from Textual Analysis
Buehlmaier, M. M. M., & Whited, T. M. (2018) · The Review of Financial Studies · doi:10.1093/rfs/hhy007 · Cited by 214
Blau, B. M., DeLisle, J. R., & Price, S. M. (2015) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2015.02.003 · Cited by 187
Hyperbole or Reality? Investor Response to Extreme Language in Earnings Conference Calls
Bochkay, K., Hales, J., & Chava, S. (2016) · The Accounting Review · doi:10.2308/accr-52507 · Cited by 183
Sinha, K., Jia, R., Hupkes, D., Pineau, J., Williams, A., & Kiela, D. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.230 · Cited by 181
Does concrete language in disclosures increase willingness to invest?
Elliott, W. B., Rennekamp, K. M., & White, B. J. (2015) · Review of Accounting Studies · doi:10.1007/s11142-014-9315-6 · Cited by 170
Disclosure Sentiment: Machine Learning vs. Dictionary Methods
Frankel, R., Jennings, J., & Lee, J. (2022) · Management Science · doi:10.1287/mnsc.2021.4156 · Cited by 170
Headline Salience, Managerial Opportunism, and Over- and Underreactions to Earnings
Huang, X., Nekrasov, A., & Teoh, S. H. (2018) · The Accounting Review · doi:10.2308/accr-52010 · Cited by 166
Sinha, K., Parthasarathi, P., Pineau, J., & Williams, A. (2021) · doi:10.18653/v1/2021.acl-long.569 · Cited by 139
Measuring credit risk using qualitative disclosure
Donovan, J., Jennings, J. N., Koharki, K., & Lee, J. A. (2021) · Review of Accounting Studies · doi:10.1007/s11142-020-09575-4 · Cited by 130
Using unstructured and qualitative disclosures to explain accruals
Frankel, R. M., Jennings, J. N., & Lee, J. A. (2016) · Journal of Accounting and Economics · doi:10.1016/j.jacceco.2016.07.003 · Cited by 103
Is Positive Sentiment in Corporate Annual Reports Informative? Evidence from Deep Learning
Azimi, M., & Agrawal, A. (2021) · The Review of Asset Pricing Studies · doi:10.1093/rapstu/raab005 · Cited by 71
Siano, F., & Wysocki, P. D. (2021) · Accounting Horizons · doi:10.2308/horizons-19-161 · Cited by 62
Nayak, A., Timmapathini, H., Ponnalagu, K., & Venkoparao, V. G. (2020) · Workshop on Insights from Negative Results in NLP (Insights) · doi:10.18653/v1/2020.insights-1.1 · Cited by 55
The unintended benefit of the risk factor mandate of 2005
Huang, A., Shen, J., & Zang, A. Y. (2021) · Review of Accounting Studies · doi:10.1007/s11142-021-09590-z · Cited by 39
Self-citationThe Random House guide to good writing
Ivers, M. (2002) · Medical Entomology and Zoology · Cited by 11
Cited by
Fosso Wamba, S., Guthrie, C., Queiroz, M. M., & Minner, S. (2024) · International Journal of Production Research · doi:10.1080/00207543.2023.2294116 · Cited by 289
How to talk when a machine is listening: Corporate disclosure in the age of AI
Cao, S., Jiang, W., Yang, B., & Zhang, A. L. (2023) · The Review of Financial Studies · doi:10.1093/rfs/hhad021 · Cited by 222
Sentiment trading with large language models
Kirtac, K., & Germano, G. (2024) · Finance Research Letters · doi:10.1016/j.frl.2024.105227 · Cited by 115
“By enabling the use of LLMs, a wealth of knowledge becomes accessible for financial research (Huang et al., 2023).”
Neural Retrievers are Biased Towards LLM-Generated Content
Dai, S., Zhou, Y., Pang, L., Liu, W., Hu, X., Liu, Y., Zhang, X., Wang, G., & Xu, J. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671882 · Cited by 35
Human + AI in accounting: Early evidence from the field
Choi, J. H., & Xie, C. L. (2026) · Journal of Accounting Research · doi:10.1111/1475-679x.70052 · Cited by 30
Metadata
- Authors
- Huang, A. H., Wang, H., & Yang, Y.
- Venue
- Contemporary Accounting Research
- Publisher
- Wiley
- Published
- 2023-01-06
- Volume
- 40
- Issue
- 2
- Pages
- 806-841
- ISSN
- 0823-9150 (ISSN-L)
- 1911-3846
- OpenAlex
- W4298110867
- Cited by
- 778
- References
- 70
- FWCI
- 39.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.