Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.

Text Algorithms in Economics

Open access
Ash, Elliott, Hansen, Stephen · 2023 · Annual Review of Economics

Abstract

This article provides an overview of the methods used for algorithmic text analysis in economics, with a focus on three key contributions. First, we introduce methods for representing documents as high-dimensional count vectors over vocabulary terms, for representing words as vectors, and for representing word sequences as embedding vectors. Second, we define four core empirical tasks that encompass most text-as-data research in economics and enumerate the various approaches that have been taken so far to accomplish these tasks. Finally, we flag limitations in the current literature, with a focus on the challenge of validating algorithmic output.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1146/annurev-economics-082222-074352

Cites

89 of 89 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 84 references

Research works printed but not linked: 47

  1. 2020, Flexible work arrangements in low wage jobs: evidence from job vacancy data
  2. 2021, Race-related research in economics and other social sciences
  3. 2023, Natural language processing for monetary economics: a benchmark
  4. 2009, Mostly Harmless Econometrics: An Empiricist's Companion
  5. 2016, A simple but tough-to-beat baseline for sentence embeddings
  6. 2020a, Ideas have consequences: the impact of law and economics on American justice
  7. 2020b, Gender attitudes in the judiciary: evidence from U.S. circuit courts
  8. 2021, Visual stereotypes in news media
  9. 2020c, Unsupervised extraction of workplace rights and duties from collective bargaining agreements
  10. 2020d, More laws, more growth? Evidence from US states
  11. 2015, Neural machine translation by jointly learning to align and translate
  12. 2022, Work2vec: using language models to understand wage premia
  13. 2020, How big is the media multiplier? Evidence from dyadic news data
  14. 2022, The education-innovation gap
  15. 2003, Latent dirichlet allocation, J. Mach. Learn. Res., 3, 993
  16. 2021, The diffusion of disruptive technologies
  17. 2006, The information content of FOMC minutes
  18. 2021, Business news and business cycles
  19. 2023a, Measuring the temporal dimension of text: an application to policymaker speeches. CEPR Discuss. Pap. 17931
  20. 2023b, The Central Bank crystal ball: temporal information in monetary policy communication
  21. 2021, Policymakers' uncertainty
  22. 2020, Firm-level risk exposures and stock returns in the wake of COVID-19
  23. 2021, The impact of online competition on local newspapers: evidence from the introduction of Craigslist
  24. 2018, How polarized are citizens? Measuring ideology from the ground-up
  25. 1963, A Monetary History of the United States: 1867–1960
  26. 2017, Neural Network Methods for Natural Language Processing
  27. 2022, Text as Data: A New Framework for Machine Learning and the Social Sciences
  28. 2023, Remote work across jobs, companies, and space
  29. 2021, The demand for executive skills
  30. 2009, The Elements of Statistical Learning
  31. 2022, Does finance benefit society? A language embedding approach
  32. 2020, Unpublished manuscript
  33. 2021, Robust machine learning algorithms for text analysis
  34. 2019, Predicting returns with text data
  35. 2019, Technology, vintage-specific human capital, and labor displacement: evidence from linking patents with occupations
  36. 2014, Dependency-based word embeddings, 2, 302
  37. 2008, Introduction to Information Retrieval
  38. 2020, Who watches the watchmen? Local news and police behavior in the United States
  39. 2007, Supervised topic models, Adv. Neural Inf. Process. Syst., 20
  40. 2021, Human-in-the-Loop Machine Learning: Active Learning and Annotation for Human-Centered AI
  41. 2001, On discriminative versus generative classifiers: a comparison of logistic regression and naive Bayes, 841
  42. 2018, Improving language understanding by generative pre-training
  43. 2021, Worldwide global datasphere and global storagesphere structured and unstructured data forecast, 2021–2025
  44. 2022, Undergraduate gender diversity and direction of scientific research
  45. 2017, Attention is all you need, 6000
  46. 2009, Rethinking LDA: why priors matter, Adv. Neural Inf. Process. Syst., 22
  47. 2020, Media slant is contagious

Cited by

See all 198

Metadata

Authors
Ash, E., & Hansen, S.
Affiliations
  • ETH Zurich (CH)
  • Centre for Economic Policy Research (GB)
Corresponding author
Hansen, Stephen
Venue
Annual Review of Economics
Published
2023-09-13
Volume
15
Issue
1
Pages
659-688
ISSN
  • 1941-1383 (ISSN-L)
  • 1941-1391
OpenAlex
W4383198328
Cited by
197
References
84
Citations by year
2026: 46 · 2025: 78 · 2024: 48 · 2023: 18
FWCI
10.23
Type
journal article
Language
en
Open access
Locations
  • Annual Review of Economics (publishedVersion, cc-by)
  • UCL Discovery (University College London) (submittedVersion, cc-by)
  • Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
  • ETH Zürich Research Collection
Funders
  • University College London
  • H2020 European Research Council (864863)
Topics
  • Social Sciences › General Social Sciences › Computational and Text Analysis Methods
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
Keywords
text-as-data, document representation, word embeddings

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Text Algorithms in Economics. https://app.cochat.ai/papers/10.1146/annurev-economics-082222-074352
The paper
Ash, E., & Hansen, S. (2023). Text Algorithms in Economics. Annual Review of Economics. https://doi.org/10.1146/annurev-economics-082222-074352

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.