The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Text as Data
Abstract
An ever-increasing share of human interaction, communication, and culture is recorded as digital text. We provide an introduction to the use of text as an input to economic research. We discuss the features that make text different from other forms of data, offer a practical overview of relevant statistical methods, and survey a variety of applications. (JEL C38, C55, L82, Z13)
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Inference of Population Structure Using Multilocus Genotype Data
Pritchard, J. K., Stephens, M., & Donnelly, P. (2000) · Genetics · doi:10.1093/genetics/155.2.945 · Cited by 33,908
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Measuring Economic Policy Uncertainty*
Baker, S. R., Bloom, N., & Davis, S. J. (2016) · The Quarterly Journal of Economics · doi:10.1093/qje/qjw024 · Cited by 12,458
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096 · cited 1×
“The Porter stemmer (Porter 1980) is a standard stemming tool for English language text.”
MethodThe adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
Friedman, J. H. (2002) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00065-2 · Cited by 7,067
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Journal of The American Statistical Association
Fienberg, S. E. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,125
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks
LOUGHRAN, T., & MCDONALD, B. (2011) · The Journal of Finance · doi:10.1111/j.1540-6261.2010.01625.x · Cited by 6,015
Blei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Enhancing Sparsity by Reweighted ℓ 1 Minimization
Candès, E. J., Wakin, M. B., & Boyd, S. P. (2008) · Journal of Fourier Analysis and Applications · doi:10.1007/s00041-008-9045-x · Cited by 4,863
Giving content to investor sentiment: The role of media in the stock market
TETLOCK, P. C. (2007) · The Journal of Finance · doi:10.1111/j.1540-6261.2007.01232.x · Cited by 4,827
Detecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · cited 1×
“See Evans and Aceves (2016) and Grimmer and Stewart (2013) for related surveys focused on text analysis in sociology and political science, respectively.”
BackgroundSparse Principal Component Analysis
Zou, H., Hastie, T., & Tibshirani, R. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x113430 · Cited by 3,152
Forecasting Using Principal Components From a Large Number of Predictors
Stock, J. H., & Watson, M. W. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618960 · Cited by 2,985
Double/debiased machine learning for treatment and structural parameters
Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., & Robins, J. (2018) · The Econometrics Journal · doi:10.1111/ectj.12097 · Cited by 2,946
Park, T., & Casella, G. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000337 · Cited by 2,934
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917
Variable Selection via Gibbs Sampling
George, E. I., & McCulloch, R. E. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476353 · Cited by 2,828 · cited 1×
“For those looking to do a full Bayesian analysis for high-dimensional (e.g., text) regression, an especially appealing model is the spike-and-slab introduced in George and McCulloch (1993).”
Macroeconomic Forecasting Using Diffusion Indexes
Stock, J. H., & Watson, M. W. (2002) · Journal of Business & Economic Statistics · doi:10.1198/073500102317351921 · Cited by 2,547
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523 · cited 1×
“Lazer et al. (2014), for example, show that the accuracy of the Google Flu Trends model—which has not been recalibrated or updated based on more recent data—has deteriorated dramatically, and that in recent years it is outperformed by simple extrapolation from prior CDC estimates.”
MethodSimultaneous analysis of Lasso and Dantzig selector
Bickel, P. J., Ritov, Y., & Tsybakov, A. B. (2009) · The Annals of Statistics · doi:10.1214/08-aos620 · Cited by 2,396
Is All That Talk Just Noise? The Information Content of Internet Stock Message Boards
Antweiler, W., & Frank, M. Z. (2004) · The Journal of Finance · doi:10.1111/j.1540-6261.2004.00662.x · Cited by 2,373
Angrist, J. D., & Krueger, A. B. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.69 · Cited by 2,355
Predicting the Present with Google Trends
CHOI, H., & VARIAN, H. (2012) · Economic Record · doi:10.1111/j.1475-4932.2012.00809.x · Cited by 2,354
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Proceedings of the 19th International Conference on Artificial Intelligence and Statistics 2016
Murray, I., & Graham, M. M. (2016) · Cited by 2,115
Text-Based Network Industries and Endogenous Product Differentiation
Hoberg, G., & Phillips, G. (2016) · Journal of Political Economy · doi:10.1086/688176 · Cited by 2,095
Recursive partitioning for heterogeneous causal effects
Athey, S., & Imbens, G. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510489113 · Cited by 1,586
What Drives Media Slant? Evidence From U.S. Daily Newspapers
(2010) · Econometrica · doi:10.3982/ecta7195 · Cited by 1,483
Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web
Das, S. R., & Chen, M. Y. (2007) · Management Science · doi:10.1287/mnsc.1070.0704 · Cited by 1,396
The horseshoe estimator for sparse signals
Carvalho, C. M., Polson, N. G., & Scott, J. G. (2010) · Biometrika · doi:10.1093/biomet/asq017 · Cited by 1,381
LI, F. (2010) · Journal of Accounting Research · doi:10.1111/j.1475-679x.2010.00382.x · Cited by 1,360
Asymptotics for lasso-type estimators
Fu, W., & Knight, K. (2000) · The Annals of Statistics · doi:10.1214/aos/1015957397 · Cited by 1,276
A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
Kass, R. E., & Wasserman, L. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476592 · Cited by 1,253
A Primer on Neural Network Models for Natural Language Processing
Goldberg, Y. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4992 · Cited by 1,201
Wainwright, M. J. (2009) · IEEE Transactions on Information Theory · doi:10.1109/tit.2009.2016018 · Cited by 1,198
The Causal Impact of Media in Financial Markets
ENGELBERG, J. E., & PARSONS, C. A. (2011) · The Journal of Finance · doi:10.1111/j.1540-6261.2010.01626.x · Cited by 1,121
Groseclose, T., & Milyo, J. (2005) · The Quarterly Journal of Economics · doi:10.1162/003355305775097542 · Cited by 991
A correlated topic model of Science
Blei, D. M., & Lafferty, J. D. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas114 · Cited by 953
On the “degrees of freedom” of the lasso
Zou, H., Hastie, T., & Tibshirani, R. (2007) · The Annals of Statistics · doi:10.1214/009053607000000127 · Cited by 947
Can Stock Market Forecasters Forecast?
Cowles, A. (1933) · Econometrica · doi:10.2307/1907042 · Cited by 726
News implied volatility and disaster concerns
Manela, A., & Moreira, A. (2017) · Journal of Financial Economics · doi:10.1016/j.jfineco.2016.01.032 · Cited by 721
Forecasting economic time series using targeted predictors
Bai, J., & Ng, S. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.08.010 · Cited by 704
How to analyze political attention with minimal assumptions and costs
Quinn, K. M., Monroe, B. L., Colaresi, M., Crespin, M. H., & Radev, D. R. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2009.00427.x · Cited by 671
Transparency and Deliberation Within the FOMC: A Computational Linguistics Approach*
Hansen, S., McMahon, M., & Prat, A. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx045 · Cited by 631
Market expectations in the cross-section of present values
KELLY, B., & PRUITT, S. (2013) · The Journal of Finance · doi:10.1111/jofi.12060 · Cited by 584
Self-citationGrimmer, J. (2010) · Political Analysis · doi:10.1093/pan/mpp034 · Cited by 550
Word power: A new approach for content analysis
Jegadeesh, N., & Wu, D. (2013) · Journal of Financial Economics · doi:10.1016/j.jfineco.2013.08.018 · Cited by 539
The Estimation of Prediction Error: Covariance Penalties and Cross-Validation
Efron, B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000692 · Cited by 467
Hans, C. (2009) · Biometrika · doi:10.1093/biomet/asp047 · Cited by 463
Denny, M. J., & Spirling, A. (2018) · Political Analysis · doi:10.1017/pan.2017.44 · Cited by 463
The cost of racial animus on a black candidate: Evidence using Google search data
Stephens-Davidowitz, S. (2014) · Journal of Public Economics · doi:10.1016/j.jpubeco.2014.04.010 · Cited by 443
The three-pass regression filter: A new approach to forecasting using many predictors
Kelly, B., & Pruitt, S. (2015) · Journal of Econometrics · doi:10.1016/j.jeconom.2015.02.011 · Cited by 415
Self-citationPredicting the present with Bayesian structural time series
Scott, S. L., & Varian, H. R. (2014) · International Journal of Mathematical Modelling and Numerical Optimisation · doi:10.1504/ijmmno.2014.059942 · Cited by 393
Machine Translation: Mining Text for Social Theory
Evans, J. A., & Aceves, P. (2016) · Annual Review of Sociology · doi:10.1146/annurev-soc-081715-074206 · Cited by 333
Strong oracle optimality of folded concave penalized estimation
Fan, J., Xue, L., & Zou, H. (2014) · The Annals of Statistics · doi:10.1214/13-aos1198 · Cited by 313
Fisher Lecture: Dimension Reduction in Regression
Cook, R. D. (2007) · Statistical Science · doi:10.1214/088342306000000682 · Cited by 283
Multinomial Inverse Regression for Text Analysis
Taddy, M. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.734168 · Cited by 240
Self-citationAre Financial Constraints Priced? Evidence from Textual Analysis
Buehlmaier, M. M. M., & Whited, T. M. (2018) · The Review of Financial Studies · doi:10.1093/rfs/hhy007 · Cited by 214
On the computational complexity of high-dimensional Bayesian variable selection
Yang, Y., Wainwright, M. J., & Jordan, M. I. (2016) · The Annals of Statistics · doi:10.1214/15-aos1417 · Cited by 186
Improving and Evaluating Topic Models and Other Models of Text
Airoldi, E. M., & Bischof, J. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1051182 · Cited by 182
Retrospectives: Who Invented Instrumental Variable Regression?
Stock, J. H., & Trebbi, F. (2003) · Journal of Economic Perspectives · doi:10.1257/089533003769204416 · Cited by 171
Central Bank Communication on Financial Stability
Born, B., Ehrmann, M., & Fratzscher, M. (2014) · The Economic Journal · doi:10.1111/ecoj.12039 · Cited by 171
Data augmentation for support vector machines
Polson, N. G., & Scott, S. L. (2011) · Bayesian Analysis · doi:10.1214/11-ba601 · Cited by 169
Bayesian inference and the parametric bootstrap
Efron, B. (2012) · The Annals of Applied Statistics · doi:10.1214/12-aoas571 · Cited by 126
A Nonparametric Bayesian Analysis of Heterogenous Treatment Effects in Digital Experimentation
Taddy, M. A., Gardner, M., Chen, L., & Draper, D. (2016) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2016.1172013 · Cited by 120
Self-citationPROXYING FOR UNOBSERVABLE VARIABLES WITH INTERNET DOCUMENT-FREQUENCY
Sáiz, A., & Simonsohn, U. (2013) · Journal of the European Economic Association · doi:10.1111/j.1542-4774.2012.01110.x · Cited by 80
Distributed Multinomial Regression
Taddy, M. A. (2016) · Cited by 71
Self-citationDistributed multinomial regression
Taddy, M. (2015) · The Annals of Applied Statistics · doi:10.1214/15-aoas831 · Cited by 62
Self-citationFlynn, C. J., Hurvich, C. M., & Simonoff, J. S. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.801775 · Cited by 58
The role of media in the credit crunch: The case of the banking sector
Wisniewski, T. P., & Lambe, B. J. (2011) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.10.012 · Cited by 57
Reconceptualizing the classification of PNAS articles
Airoldi, E. M., Erosheva, E. A., Fienberg, S. E., Joutard, C. J., Love, T., & Shringarpure, S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1013452107 · Cited by 32
Authorship attribution: the case of Oliver Goldsmith
Mannion, D., & Dixon, P. A. (1997) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.1111/1467-9884.00055 · Cited by 23
Cited by
Caldara, D., & Iacoviello, M. (2022) · American Economic Review · doi:10.1257/aer.20191823 · Cited by 3,707
Angrist, J. D., & Krueger, A. B. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.69 · Cited by 2,355
Firm‐Level Climate Change Exposure
SAUTNER, Z., VAN LENT, L., VILKOV, G., & ZHANG, R. (2023) · The Journal of Finance · doi:10.1111/jofi.13219 · Cited by 1,328
Measuring Corporate Culture Using Machine Learning
Li, K., Mai, F., Shen, R., & Yan, X. (2021) · The Review of Financial Studies · doi:10.1093/rfs/hhaa079 · Cited by 999
How Valuable Is FinTech Innovation?
Chen, M. A., Wu, Q., & Yang, B. (2019) · The Review of Financial Studies · doi:10.1093/rfs/hhy130 · Cited by 808
Metadata
- Authors
- Gentzkow, M., Kelly, B., & Taddy, M.
- Venue
- Journal of Economic Literature
- Publisher
- American Economic Association
- Published
- 2019-09-01
- Volume
- 57
- Issue
- 3
- Pages
- 535-574
- ISSN
- 0022-0515 (ISSN-L)
- OpenAlex
- W2601780063
- Cited by
- 1,236
- References
- 86
- FWCI
- 293.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.