Why the 1936 Literary Digest Poll Failed
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
The Literary Digest poll of 1936 holds an infamous place in the history of survey research. Despite its importance, no empirical research has been conducted to determine why the poll failed. Using data from a 1937 Gallup survey which asked about participation in the Literary Digest poll I conclude that the magazine's sample and the response were both biased and jointly produced the wildly incorrect estimate of the vote. But, if all of those who were polled had responded, the magazine would have, at least, correctly predicted Roosevelt the winner. The current relevance of these findings is discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
An Introduction to Survey Research and Data Analysis
Harris, L., Weisberg, H. F., & Bowen, B. D. (1977) · Journal of Marketing Research · doi:10.2307/3151216 · Cited by 243
The Hidden 25 Percent: An Analysis of Nonresponse on the 1980 General Social Survey
Smith, T. W. (1983) · Public Opinion Quarterly · doi:10.1086/268797 · Cited by 140
The 1928–1936 Partisan Realignment: The Case for the Conversion Hypothesis
Erikson, R. S., & Tedin, K. L. (1981) · American Political Science Review · doi:10.2307/1962295 · Cited by 94
Likert, R. (1948) · Scientific American · doi:10.1038/scientificamerican1248-7 · Cited by 71
Testing for the Potential for Nonresponse Bias in Sample Surveys
Pearl, D. K., & Fairley, D. (1985) · Public Opinion Quarterly · doi:10.1086/268950 · Cited by 63
Bean, L. H. (2012) · Cited by 54
The Literary Digest Poll: Making of a Statistical Myth
Bryson, M. C. (1976) · The American Statistician · doi:10.1080/00031305.1976.10479173 · Cited by 48
A Guide to Public Opinion Polls
Hartmann, G. W., & Gallup, G. (1945) · The American Journal of Psychology · doi:10.2307/1417842 · Cited by 40
Crossley, A. M. (1937) · Public Opinion Quarterly · doi:10.1086/265035 · Cited by 37
American Institute of Public Opinion-Surveys, 1935-38
Gallup, G., & Robinson, C. E. (1938) · Public Opinion Quarterly · doi:10.1086/265204 · Cited by 16
Cited by
Items 101–159 of 159
Analyzing Support for U.S. Presidential Candidates in Twitter Polls
Scarano, S., Vasudevan, V., Samory, M., Yang, J., & Grabowicz, P. A. (2024) · Journal of Quantitative Description Digital Media · doi:10.51685/jqd.2024.icwsm.4 · Cited by 2
“The failure was mainly due to a low response rate and a bias in the demographic of re-Scarano spondents who returned their ballots (Squire, 1988).”
BackgroundComparación metodológica de encuestas vía telefonía fija y celular en Costa Rica
Alfaro‐Córdoba, M., Galera, M. P. V., & Cerdas, G. N. (2010) · Revista de Ciencias Económicas · doi:10.15517/rce.v28i1.7064 · Cited by 1
Anstead, N., & O’Loughlin, B. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137276773_11 · Cited by 1
Statistical Analysis of Geoscience Data
Ma, Y. Z. (2019) · Springer eBooks · doi:10.1007/978-3-030-17860-4_3 · Cited by 1
Die Nutzung von Webdaten in den Sozialwissenschaften
Munzert, S., & Nyhuis, D. (2020) · Springer eBooks · doi:10.1007/978-3-658-16936-7_22 · Cited by 2
Townsley, M. (2013) · Springer eBooks · doi:10.1007/978-1-4614-5690-2_318 · Cited by 1
Baker, R., Strategies, M., Blumberg, S. J., Brick, J. M., Couper, M. P., Courtright, M., Dennis, J., Dillman, D. A., Frankel, M. R., & Groves, R. M. (2010) · Cited by 1
Survey Methods, Traditional, Public Opinion Polling
Elmelund‐Præstekær, C., Hopmann, D. N., & Pedersen, R. T. (2017) · The International Encyclopedia of Communication Research Methods · doi:10.1002/9781118901731.iecrm0245 · Cited by 1
Election Forecasting: Scientific Approaches
Lewis‐Beck, M. S., & Stegmaier, M. (2018) · Springer eBooks · doi:10.1007/978-1-4939-7131-2_63 · Cited by 1
Penn, E. M., Alvarez, R. M., & Deverell, W. F. (2008)
Gray, P. S., Williamson, J. B., Karp, D. A., et al. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511819391.007
Cuxart, A., & Riba, C. (2007) · SSRN Electronic Journal · doi:10.2139/ssrn.1002843
POLS 503: Political Science Research Methods
Ridout, T. N. (2010)
Diffuse electrical injury: Questioning the scientific basis
McGowan, J. C., Shkolnikov, Y. P., Sala, J. B., et al. (2008) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece.2008.4564890
“Indeed, problems associated with non-probability-based sampling and nonresponse have historically led to invalid results, as was the case in the failure of the 1936 Literary Digest poll, which predicted a landslide victory for presidential candidate Alf Landon over Franklin Roosevelt [ 14 ].”
ResultTOPIC 1 The production of knowledge in social science and the Scientific Method
Johnson, J. B., Joslyn, R. A., Reynolds, H., King, G., & Keohane, R. O. (2006)
Shapiro, R. Y. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.93101-5 · Cited by 1
Krosnick, J. A., Marquette, J. F., & Curtin, M. F. (2016)
“As Maine Goes, So Goes Vermont”: 1933–1939
Mason, R. L. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511843907.003
The New Technologies: How the Parties Have Adapted
Eldersveld, S. J., & Walton, H. (2000) · Palgrave Macmillan US eBooks · doi:10.1007/978-1-137-11290-3_14
Accurate But Not Reproducible? The Possible Worlds of Public Opinion Research
Keller, F. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118865064.ch20
On Model-Selection and Applications of Multilevel Models in Survey and Causal Inference
Wang, W. (2016) · doi:10.7916/d8571c4q
“As pollsters and academics have since pointed out, the magazine’s pool of respondents was highly biased: it consisted mostly of auto and telephone owners as well as the magazine’s own subscribers, which underrepresented Roosevelt’s core constituencies [63].”
BackgroundRodgers on calls for observable verbs
Mackenzie, J. (2017) · Educational Philosophy and Theory · doi:10.1080/00131857.2017.1314211
“…published with opinion polls in the media are usually calculated just from the relation of sample size to population size, and therefore may greatly underestimate error where the sample was not truly random, usually because of convenience sampling and volunteer effects (see also Squire, 1988).”
BackgroundStreiner, D. L., Norman, G. R., & Cairney, J. (2014) · Oxford University Press eBooks · doi:10.1093/med/9780199685219.003.0013
Polls, Prediction Markets, and Financial Variables
Santillán‐Salgado, R. J., Lastra, M. G. U., & Escobar-Saldívar, L. J. (2018) · Revista Mexicana de Economía y Finanzas · doi:10.21919/remef.v13i3.325
“There might have been a sample and a response bias, since the polled groups were mainly Digest’s readers, automobile owners, and telephone users (Squire, 1988).”
BackgroundLessig, L. (2018) · The Good Society · doi:10.5325/goodsociety.27.1-2.0171
Amostragem estratificada e distribuição multinomial na pesquisa de opinião
Georges, M. R. R. (2020) · Revista de Empreendedorismo Negócios e Inovação · doi:10.36942/reni.v4i1.183
Philippou, A. N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.14166 · Cited by 1
Motulsky, H. (2019) · De Boeck Supérieur eBooks · doi:10.3917/dbu.motul.2019.01.0533
Hahn, G. J., & Doganaksoy, N. (2011) · doi:10.1002/9781118490143.refs
(2013) · Wiley eBooks · doi:10.1002/9781118447895.ref
Die Nutzung von Webdaten in den Sozialwissenschaften
Munzert, S., & Nyhuis, D. (2019) · Springer Reference Sozialwissenschaften · doi:10.1007/978-3-658-16937-4_22-1 · Cited by 1
Traugott, M. W. (2013) · The International Encyclopedia of Communication · doi:10.1002/9781405186407.wbiecp071.pub2
SocioestadísticaPreprint
Monfort, J. G. (2020) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/5uxm2
Tudor, J. (2020) · SSRN Electronic Journal · doi:10.31235/osf.io/h58pz · Cited by 3
(2009) · Handbook of statistics · doi:10.1016/s0169-7161(09)70031-8
Traugott, M. (2013) · doi:10.1093/obo/9780199756841-0140
(2017) · Advances in logistics, operations, and management science book series · doi:10.4018/978-1-5225-2277-5.ch003
Perrin, A. J. (2011) · Oxford University Press eBooks · doi:10.1093/obo/9780199756384-0042 · Cited by 1
Exploratory diary study of survey request frequency among research professionalsPreprint
Wallen, K., Hammell, A. E., & Dentzman, K. E. (2021) · doi:10.31235/osf.io/mrebz
Traugott, M. W. (2008) · The International Encyclopedia of Communication · doi:10.1002/9781405186407.wbiecp071
Moghadam, A. K., & Bastanfard, A. (2022) · International Conference on Web Research (ICWR) · doi:10.1109/icwr54782.2022.9786241
Election Forecasting, Scientific Approaches
Lewis‐Beck, M. S., & Stegmaier, M. (2016) · Springer eBooks · doi:10.1007/978-1-4614-7163-9_63-1
Pesquisas eleitorais no Brasil: tendências e desempenho
Meireles, F., & Russo, G. (2022) · Estudos Avançados · doi:10.1590/s0103-4014.2022.36106.007
Social surveys during the COVID-19 pandemic
Connelly, R., & Gayle, V. (2020) · Policy Press eBooks · doi:10.51952/9781447360391.ch006
Wissenskrisen - Krisenwissen: Zum Umgang mit Krisenzuständen in und durch Wissenschaft und Technik
Online, I.-N. ". K. Z. U. M. K. I. U. D. W. U. T. 2., Engelschalt, J., Lemberg, J., Maibaum, A., Rothenhäusler, A., & Wiegand, M. (2023) · transcript Verlag eBooks · doi:10.14361/9783839461600 · Cited by 1
Zwischen Konsens und Kontroverse
Griessl, L. (2023) · transcript Verlag eBooks · doi:10.1515/9783839461600-004
Social surveys during the COVID-19 pandemic
Connelly, R., & Gayle, V. (2020) · Policy Press eBooks · doi:10.56687/9781447360391-009
Stockemer, D., & Bordeleau, J. (2023) · Springer texts in political science and international relations · doi:10.1007/978-3-031-34583-8_5
Rejoinder: Building a Paradigm That Allows for the Possibility of Non-Ignorable Nonresponse
Bailey, M. A. (2023) · Harvard Data Science Review · doi:10.1162/99608f92.4187b1b4
Samples in Psychological Research – Conclusions and Recommendations from the Literature Review
Świderska, J., Puchalska, M., Grzegorczyk, M., Szałek, Z., Nadolna, N., Andryszkiewicz, M., Jastrzębska, M., Szablowski, P., & Śmigrodzka, M. (2023) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9831 · Cited by 4
Survey research in perinatal medicine
Conroy, S., & Gallagher, P. G. (2024) · Journal of Perinatology · doi:10.1038/s41372-024-01940-4
“Subsequent explanations for this error included sampling bias as well as a non-response bias [2].”
Taking the Next Step in Exploring the Literary Digest 1936 Poll
Chance, B., Kerr, A., & Palmer, J. (2024) · Journal of Statistics and Data Science Education · doi:10.1080/26939169.2024.2395505
“Our focus is not on exploring causes for the bad prediction (e.g., see Lusinchi 2012; Squire 1988), debating how to best evaluate the accuracy of straw polls (e.g., Robinson 1932), or analyzing the effectiveness of different adjustment methods (e.g., Lohr and Brick 2017), though we do present some…”
Collaborative Robot Education Through Train-The-Trainer Workshops: Analysis and Assessment
Musa, Y., Tantawi, O., Tantawi, K. H., et al. (2024) · IEEE International Conference on Engineering Education (ICEED) · doi:10.1109/iceed62316.2024.10923810
“…of bias that may cause inaccuracy in results [3], an example of which is the famous blunder of the Literary Digest survey of 10 million Americans which was carried out in 1936 and concluded that Roosevelt would lose the 1936 U.S. presidential elections decisively, but the opposite was true [3] [4].”
«Опрос, который изменил опросы»
Кудрявцева, Н. Ф. (2009) · CyberLeninK (CyberLeninka)
Koch, T., Seeger, C., & Müller, P. (2025) · Studienbücher zur Kommunikations- und Medienwissenschaft · doi:10.1007/978-3-658-49131-4_7
The Hidden Game: How Corporate Social Media Shapes Product Marketing
Qiu, L. (2026) · New perspectives in organizational communication · doi:10.1007/978-3-032-14713-4_4
Metadata
- Authors
- Squire, P.
- Affiliations
- University of Iowa (US)
- Corresponding author
- Squire, Peverill
- ORCID
- Squire, Peverill
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 1988
- Volume
- 52
- Issue
- 1
- Pages
- 125
- ISSN
- 0033-362X (ISSN-L)
- OpenAlex
- W2169025594
- Cited by
- 164
- References
- 15
- Citations by year
- 2026: 5 · 2025: 3 · 2024: 5 · 2023: 10 · 2022: 8 · 2021: 7 · 2020: 10 · 2019: 8 · 2018: 12 · 2017: 11 · 2016: 10 · 2015: 7 · 2014: 9 · 2013: 12 · 2012: 4
- FWCI
- 1.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Public Opinion Quarterly (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Keywords
- 1936 presidential election, sampling bias, response bias, Franklin D. Roosevelt, magazine readership, history of survey research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.