The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
Text Algorithms in Economics
Open accessAbstract
This article provides an overview of the methods used for algorithmic text analysis in economics, with a focus on three key contributions. First, we introduce methods for representing documents as high-dimensional count vectors over vocabulary terms, for representing words as vectors, and for representing word sequences as embedding vectors. Second, we define four core empirical tasks that encompass most text-as-data research in economics and enumerate the various approaches that have been taken so far to accomplish these tasks. Finally, we flag limitations in the current literature, with a focus on the challenge of validating algorithmic output.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Coase, R. H. (1960) · The Journal of Law and Economics · doi:10.1086/466560 · Cited by 18,255
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Indexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Measuring Economic Policy Uncertainty*
Baker, S. R., Bloom, N., & Davis, S. J. (2016) · The Quarterly Journal of Economics · doi:10.1093/qje/qjw024 · Cited by 12,458
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Research works printed but not linked: 47
- 2020, Flexible work arrangements in low wage jobs: evidence from job vacancy data
- 2021, Race-related research in economics and other social sciences
- 2023, Natural language processing for monetary economics: a benchmark
- 2009, Mostly Harmless Econometrics: An Empiricist's Companion
- 2016, A simple but tough-to-beat baseline for sentence embeddings
- 2020a, Ideas have consequences: the impact of law and economics on American justice
- 2020b, Gender attitudes in the judiciary: evidence from U.S. circuit courts
- 2021, Visual stereotypes in news media
- 2020c, Unsupervised extraction of workplace rights and duties from collective bargaining agreements
- 2020d, More laws, more growth? Evidence from US states
- 2015, Neural machine translation by jointly learning to align and translate
- 2022, Work2vec: using language models to understand wage premia
- 2020, How big is the media multiplier? Evidence from dyadic news data
- 2022, The education-innovation gap
- 2003, Latent dirichlet allocation, J. Mach. Learn. Res., 3, 993
- 2021, The diffusion of disruptive technologies
- 2006, The information content of FOMC minutes
- 2021, Business news and business cycles
- 2023a, Measuring the temporal dimension of text: an application to policymaker speeches. CEPR Discuss. Pap. 17931
- 2023b, The Central Bank crystal ball: temporal information in monetary policy communication
- 2021, Policymakers' uncertainty
- 2020, Firm-level risk exposures and stock returns in the wake of COVID-19
- 2021, The impact of online competition on local newspapers: evidence from the introduction of Craigslist
- 2018, How polarized are citizens? Measuring ideology from the ground-up
- 1963, A Monetary History of the United States: 1867–1960
- 2017, Neural Network Methods for Natural Language Processing
- 2022, Text as Data: A New Framework for Machine Learning and the Social Sciences
- 2023, Remote work across jobs, companies, and space
- 2021, The demand for executive skills
- 2009, The Elements of Statistical Learning
- 2022, Does finance benefit society? A language embedding approach
- 2020, Unpublished manuscript
- 2021, Robust machine learning algorithms for text analysis
- 2019, Predicting returns with text data
- 2019, Technology, vintage-specific human capital, and labor displacement: evidence from linking patents with occupations
- 2014, Dependency-based word embeddings, 2, 302
- 2008, Introduction to Information Retrieval
- 2020, Who watches the watchmen? Local news and police behavior in the United States
- 2007, Supervised topic models, Adv. Neural Inf. Process. Syst., 20
- 2021, Human-in-the-Loop Machine Learning: Active Learning and Annotation for Human-Centered AI
- 2001, On discriminative versus generative classifiers: a comparison of logistic regression and naive Bayes, 841
- 2018, Improving language understanding by generative pre-training
- 2021, Worldwide global datasphere and global storagesphere structured and unstructured data forecast, 2021–2025
- 2022, Undergraduate gender diversity and direction of scientific research
- 2017, Attention is all you need, 6000
- 2009, Rethinking LDA: why priors matter, Adv. Neural Inf. Process. Syst., 22
- 2020, Media slant is contagious
Cited by
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
The Crowdless Future? Generative AI and Creative Problem-Solving
Boussioux, L., Lane, J. N., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2024) · Organization Science · doi:10.1287/orsc.2023.18430 · Cited by 329
Remote Work Across Jobs, Companies and Space
Hansen, S. E., Lambert, P. J., Bloom, N., Davis, S. J., Muvdi, Y., Sadun, R., & Taska, B. (2023) · Federal Reserve Bank of Dallas, Working Papers · doi:10.24149/wp2629 · Cited by 155
Self-citationMeasuring What is Top of MindPreprint
Haaland, I., Roth, C., Stantcheva, S., & Wohlfart, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4827419 · Cited by 82
The Crowdless Future? Generative AI and Creative Problem Solving
Boussioux, L., N. Lane, J., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2023) · doi:10.2139/ssrn.4533642 · Cited by 343
Metadata
- Authors
- Ash, E., & Hansen, S.
- Affiliations
- ETH Zurich (CH)
- Centre for Economic Policy Research (GB)
- Corresponding author
- Hansen, Stephen
- Venue
- Annual Review of Economics
- Publisher
- Annual Reviews
- Published
- 2023-09-13
- Volume
- 15
- Issue
- 1
- Pages
- 659-688
- ISSN
- 1941-1383 (ISSN-L)
- 1941-1391
- OpenAlex
- W4383198328
- Cited by
- 197
- References
- 84
- Citations by year
- 2026: 46 · 2025: 78 · 2024: 48 · 2023: 18
- FWCI
- 10.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Annual Review of Economics (publishedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion, cc-by)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
- ETH Zürich Research Collection
- Funders
- University College London
- H2020 European Research Council (864863)
- Topics
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- text-as-data, document representation, word embeddings
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Text Algorithms in Economics. https://app.cochat.ai/papers/10.1146/annurev-economics-082222-074352
- The paper
- Ash, E., & Hansen, S. (2023). Text Algorithms in Economics. Annual Review of Economics. https://doi.org/10.1146/annurev-economics-082222-074352
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.