Bayesian Multilevel Estimation with Poststratification: State-Level Estimates from National Polls
The DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index.
Abstract
We fit a multilevel logistic regression model for the mean of a binary response variable conditional on poststratification cells. This approach combines the modeling approach often used in small-area estimation with the population information used in poststratification (see Gelman and Little 1997, Survey Methodology 23:127–135). To validate the method, we apply it to U.S. preelection polls for 1988 and 1992, poststratified by state, region, and the usual demographic variables. We evaluate the model by comparing it to state-level election outcomes. The multilevel model outperforms more commonly used models in political science. We envision the most important usage of this method to be not forecasting elections but estimating public opinion on a variety of issues at the state level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“small-area methods that borrow information across subgroups 48 can perform better with higher-quality-albeit few-data”
From Unrepresentative big surveys significantly overestimated US vaccine uptake (2021) · cites this paper as [48]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The multilevel model allows more accurate inferences-the usual partial pooling or Bayesian rationale [see Park, Gelman and Bafumi (2004)]”
From Analysis of variance—why it is more important than ever (2005) · cites this paper as Park, Gelman and Bafumi (2004)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Self-citationHierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 2×
“See Kreft and de Leeuw (1998), Snijders and Bosker (1999), Bryk and Raudenbush (2001), and Gelman et al. (2003) for introductions to multilevel models from classical and Bayesian perspectives.”
BackgroundMethodMultilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,786
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
Introducing Multilevel Modeling
Kreft, I., & de Leeuw, J. (1998) · doi:10.4135/9781849209366 · Cited by 2,997
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 1,767
Prior distributions for variance parameters in hierarchical modelsPreprint
Gelman, A. (2004) · RePEc: Research Papers in Economics · Cited by 1,632
Self-citationMeasuring Citizen and Government Ideology in the American States, 1960-93
Berry, W. D., Ringquist, E. J., Fording, R. C., & Hanson, R. L. (1998) · American Journal of Political Science · doi:10.2307/2991759 · Cited by 1,592 · cited 2×
“In the early 1970s, Weber et al. (1972–1973) expanded the number of voter types from 480 to 960 categories and were able to estimate state-level opinions on a variety of issues (for recent research on state-level estimates, see Erikson et al. 1993, Berry et al. 1998, and Brace et al. 2002).”
BackgroundInfluentialStatehouse democracy: public opinion and policy in the American states
(1995) · Choice Reviews Online · doi:10.5860/choice.32-3008 · Cited by 1,216
Why Are American Presidential Election Campaign Polls So Variable When Votes Are So Predictable?
Gelman, A., & King, G. (1993) · British Journal of Political Science · doi:10.1017/s0007123400006682 · Cited by 846
Self-citation
Research works printed but not linked: 5
- Burdick, 1964, The 480
- Spiegelhalter, 1999, WinBugs Version 1.4
- Park D. 2004. “Multilevel Models of Representation in the U.S. States.” Ph.D. dissertation. Department of Political Science, Columbia University.
- Gelman, 1997, Postratification into Many Categories Using Hierarchical Logistic Regression, Survey Methodology, 23, 127
- 2003, R: A Language and Environment for Statistical Computing
Cited by
Items 401–500 of 560
Reaching into the Grassroots: A Comparative Study of Local Public Opinions in Taiwan
Yu, C.-H., Tsai, C., & Hsu, Y.-M. (2006)
Bayesian modeling and computation with latent variables
Simpson, M. (2015) · Iowa State University Digital Repository (Iowa State University) · doi:10.31274/etd-180810-4281
Geographic Variation in Disaster Preparedness Across U.S. States and Metropolitan AreasPreprint
Howe, P. D. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2830690
Caughey, D., Dunham, J., & Warshaw, C. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2853674
Toward a Good Life in Later Life: Perspectives, Problems, and Responses
Klein, R. R. (2013) · OhioLink ETD Center (Ohio Library and Information Network)
Underestimation of Inequality in JapanPreprint
Yanai, Y. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2938840
Beating Plowshares into Swords: The Impact of the Metropolitan-Military Complex
Chowdhury, R. (2017) · eScholarship (California Digital Library)
Confusion or Competence?: Ballot Initiative Politics and Voting Behavior in the American States
Skovron, C. (2011) · The Knowledge Bank (The Ohio State University)
Perceptions of Public Opinion and Representation in American Politics
Skovron, C. (2017) · Deep Blue (University of Michigan)
Bayesian Modeling for Mental Health Surveys
Williams, S. Z. (2018) · doi:10.7916/d8np3mvm
“A number of prediction models are suggested in the literature for aggregate auxiliary data [7, 15, 30, 31].”
BackgroundUnobserved Heterogeneity in Observational Studies of Political Behavior
Núñez, L. (2018) · CaltechTHESIS (California Institute of Technology) · doi:10.7907/xkqp-8429
Rights by Fortune or Fight? Reexamining the Addition of Sex to Title VII of the Civil Rights Act
Krimmel, K. (2018) · Legislative Studies Quarterly · doi:10.1111/lsq.12225
Estimation of Underrepresented Strata in Preelection Polls: A Comparative Study
Figueiredo, J., & Campos, P. (2012) · Springer eBooks · doi:10.1007/978-3-642-32419-2_6
Green, N., Sherrard-Smith, E., Tanton, C., Sonnenberg, P., Mercer, C. H., & White, P. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-43521-y
Measuring public opinion using Big Data : applications in computational social sciences
Temporão, M. (2019) · Corpus Université Laval (Université Laval)
Bayesian Trivariate Analysis of an Opinion Poll: With Application to the Kenyan Pollss
Kiingati, J., Mwalili, S. M., & Waititu, A. (2020) · International Journal of Data Science and Analysis · doi:10.11648/j.ijdsa.20200601.17
Introductory Topics for Everyone
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.002
Bauz-Olvera, S. A. (2019) · Gredos (University of Salamanca) · doi:10.14201/gredos.143554
Sample bias related to household role
Hitczenko, M. (2021) · doi:10.29338/wp2021-09
Surrogate Champions for the Poor
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.006
Congressional Inaction for the Poor
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.003
Ethics in Controlled Experiments
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.012
The Measurement of Latina/o Racism-Ethnicism
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.005
Attitudes about Punishment and Policing
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.007
The Electoral Implications of Latina/o Racism-Ethnicism
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.009
Parker, P. A., & Holan, S. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07934
“An exceedingly common solution is that of regression and poststratification, whereby the population is segmented via a set of categorical covariates, and units that are associated with identical covariates are assumed to be independent and identically distributed (Park et al., 2004).”
BackgroundMethodInfluentialWhy Whites Favor Restrictive Voting Laws
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.008
Crise politique en Biélorussie suite aux élections présidentielles
Stepanov, A. (2020) · Civitas Europa · doi:10.3917/civit.045.0431
Downes, M. (2020) · Minerva Access (University of Melbourne)
Lewis, D. C., & Jacobsmeier, M. L. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2141565
Risk of Workforce Exit due to Disability: State Differences in 2003–2016
Ben‐Shalom, Y., Martínez, I. A., & Finucane, M. M. (2021) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smab005
The Political Visibility of the Poor
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.002
Distant Neighbours: Social Distance, Mobility Prospects, and Government Redistribution
Borwein, S. (2020) · TSpace (University of Toronto)
The Statistics behind Online Controlled Experiments
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.023
Legislators’ Unresponsiveness to the Poor
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.005
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.015
Twyman’s Law and Experimentation Trustworthiness
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.005
Advanced Topics for Analyzing Experiments
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.022
Why White America Opposes Immigration
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.006
Sample Ratio Mismatch and Other Trust-Related Guardrail Metrics
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.027
Complementary and Alternative Techniques to Controlled Experiments
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.013
Achieving Better Representation
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.008
Experimentation Platform and Culture
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.006
Positioned for Legislative Success
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.007
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.025
Institutional Memory and Meta-Analysis
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.011
Measuring Long-Term Treatment Effects
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.029
Running and Analyzing Experiments: An End-to-End Example
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.004
Congressional Unresponsiveness to the Poor
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.004
Variance Estimation and Improved Sensitivity: Pitfalls and Solutions
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.024
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.019
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.017
Efficient low-rank estimation from sparse social science data
Zhang, C. (2020) · eScholarship (California Digital Library)
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.007
Advanced Topics for Building an Experimentation Platform
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.016
Triggering for Improved Sensitivity
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.026
Choosing the Future: Digital Human Capital and Inclusive Innovation
Mossberger, K., Tolbert, C. J., & LaCombe, S. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.003.0006
Breen, C. F., Mahmud, A. S., & Feehan, D. M. (2021) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/87e32
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.009
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.012
Leakage and Interference between Variants
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.028
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.010
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.013
Ramping Experiment Exposure: Trading Off Speed, Quality, and Risk
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.020
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.030
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.001
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.018
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.011
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.003
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.021
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.009
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.001
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.002
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.014
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.003
LoPilato, A. C., & Wang, M. (2016) · Oxford University Press eBooks · doi:10.1093/obo/9780199846740-0102
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915.014
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386.010
Kohavi, R., Tang, D., & XU, Y. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108653985.031
(2021) · PeerJ · doi:10.7287/peerj.11863v0.2/reviews/3
“…of small and sparse group data Manuscript to be reviewed (in the present study, the longitudinal observations) and consequently predicts a target population (in the present study, the cross-sectional observations) (Gelman & Little, 1997; Park, Gelman, & Bafumi, 2004; Kennedy & Gelman, 2020).”
Visualising Multilevel Regression and Poststratification: Alternatives to the Current PracticePreprint
Amaliah, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.12478
“…(Gelman (2014); Ghitza and Gelman (2013); Kiewiet de Jonge, Langer, and Sinozich (2018); Lauderdale et al. (2020); Lei, Gelman, and Ghitza (2017); Park, Gelman, and Bafumi (2004); Wang et al. (2015)) included in the systematic literature review in Chapter 2 that also applied MRP to presidential…”
BackgroundParker, P. A. (2021) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/91014
States: The Innovation Environment
Mossberger, K., Tolbert, C. J., & LaCombe, S. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.003.0005
Innovation and Inequality: Two Narratives of Place
Mossberger, K., Tolbert, C. J., & LaCombe, S. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.003.0001
Smart Cities and Neighborhoods: With Bomi Lee
Mossberger, K., Tolbert, C. J., LaCombe, S., & Lee, B. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.003.0004
Counties: Broadband Use and Prosperity across Diverse Contexts
Mossberger, K., Tolbert, C. J., & LaCombe, S. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.003.0002
Metros: Does Broadband Promote Growing and Prosperous Regions?With Kellen Gracey
Mossberger, K., Tolbert, C. J., LaCombe, S., & Gracey, K. J. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.003.0003
Comment on Hodgkins et al. (2018)Preprint
Teickner, H., & Knorr, K. (2023) · EarthArXiv (California Digital Library) · doi:10.31223/x5xh5v
Hanretty, C., Bale, T., Poletti, M., & Webb, P. (2024) · The British Journal of Politics and International Relations · doi:10.1177/13691481231221482
“The constituency opinion data were generated using MRP (Hanretty et al., 2018; Park et al., 2004) based on individual-level data from wave 5 of the British Election Study.”
Bayesian Spatial Methods and Public Opinion of Geographical Areas
Bao, L., Carson, J. L., & Gill, J. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780192868282.013.34
An Approximation of Joint Distributions of Weighting Variables Using a Pseudo Population ApproachPreprint
Bruch, C., & Felderer, B. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/pg2wt
Mossberger, K., Tolbert, C. J., & LaCombe, S. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.002.0005
Mossberger, K., Tolbert, C. J., & LaCombe, S. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.002.0007
Mossberger, K., Tolbert, C. J., & LaCombe, S. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.002.0006
Mossberger, K., Tolbert, C. J., & LaCombe, S. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197585757.002.0003
Metadata
- Authors
- Park, D. K., Gelman, A., & Bafumi, J.
- Affiliations
- Washington University in St. Louis (US)
- Columbia University (US)
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2004
- Volume
- 12
- Issue
- 4
- Pages
- 375-385
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2105602542
- Cited by
- 480
- References
- 15
- Citations by year
- 2026: 19 · 2025: 20 · 2024: 26 · 2023: 19 · 2022: 28 · 2021: 48 · 2020: 85 · 2019: 45 · 2018: 48 · 2017: 16 · 2016: 20 · 2015: 21 · 2014: 20 · 2013: 12 · 2012: 10
- FWCI
- 5.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Political Analysis (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- Bayesian hierarchical model, post-stratification, small area estimation, state-level estimates, national polls, election forecasting, multilevel logistic regression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.