Bayesian Multilevel Estimation with Poststratification: State-Level Estimates from National Polls
The DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index.
Abstract
We fit a multilevel logistic regression model for the mean of a binary response variable conditional on poststratification cells. This approach combines the modeling approach often used in small-area estimation with the population information used in poststratification (see Gelman and Little 1997, Survey Methodology 23:127–135). To validate the method, we apply it to U.S. preelection polls for 1988 and 1992, poststratified by state, region, and the usual demographic variables. We evaluate the model by comparing it to state-level election outcomes. The multilevel model outperforms more commonly used models in political science. We envision the most important usage of this method to be not forecasting elections but estimating public opinion on a variety of issues at the state level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“small-area methods that borrow information across subgroups 48 can perform better with higher-quality-albeit few-data”
From Unrepresentative big surveys significantly overestimated US vaccine uptake (2021) · cites this paper as [48]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The multilevel model allows more accurate inferences-the usual partial pooling or Bayesian rationale [see Park, Gelman and Bafumi (2004)]”
From Analysis of variance—why it is more important than ever (2005) · cites this paper as Park, Gelman and Bafumi (2004)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Self-citationHierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 2×
“See Kreft and de Leeuw (1998), Snijders and Bosker (1999), Bryk and Raudenbush (2001), and Gelman et al. (2003) for introductions to multilevel models from classical and Bayesian perspectives.”
BackgroundMethodMultilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,786
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
Introducing Multilevel Modeling
Kreft, I., & de Leeuw, J. (1998) · doi:10.4135/9781849209366 · Cited by 2,997
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 1,767
Prior distributions for variance parameters in hierarchical modelsPreprint
Gelman, A. (2004) · RePEc: Research Papers in Economics · Cited by 1,632
Self-citationMeasuring Citizen and Government Ideology in the American States, 1960-93
Berry, W. D., Ringquist, E. J., Fording, R. C., & Hanson, R. L. (1998) · American Journal of Political Science · doi:10.2307/2991759 · Cited by 1,592 · cited 2×
“In the early 1970s, Weber et al. (1972–1973) expanded the number of voter types from 480 to 960 categories and were able to estimate state-level opinions on a variety of issues (for recent research on state-level estimates, see Erikson et al. 1993, Berry et al. 1998, and Brace et al. 2002).”
BackgroundInfluentialStatehouse democracy: public opinion and policy in the American states
(1995) · Choice Reviews Online · doi:10.5860/choice.32-3008 · Cited by 1,216
Why Are American Presidential Election Campaign Polls So Variable When Votes Are So Predictable?
Gelman, A., & King, G. (1993) · British Journal of Political Science · doi:10.1017/s0007123400006682 · Cited by 846
Self-citation
Research works printed but not linked: 5
- Burdick, 1964, The 480
- Spiegelhalter, 1999, WinBugs Version 1.4
- Park D. 2004. “Multilevel Models of Representation in the U.S. States.” Ph.D. dissertation. Department of Political Science, Columbia University.
- Gelman, 1997, Postratification into Many Categories Using Hierarchical Logistic Regression, Survey Methodology, 23, 127
- 2003, R: A Language and Environment for Statistical Computing
Cited by
Coppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
“And while it is commonplace in the popular media to conduct opinion polls using convenience samples of viewers or listeners (Kent et al., 2006), most descriptive work in political science uses explicit random sampling or reweighting techniques to target population quantities (Park et al., 2004).”
BackgroundAnalysis of variance—why it is more important than ever
Gelman, A. (2005) · The Annals of Statistics · doi:10.1214/009053604000001048 · Cited by 861
Self-citationGeographic variation in opinions on climate change at state and local scales in the USA
Howe, P. D., Mildenberger, M., Marlon, J. R., & Leiserowitz, A. (2015) · Nature Climate Change · doi:10.1038/nclimate2583 · Cited by 724
Struggles with Survey Weighting and Regression Modeling
Gelman, A. (2007) · Statistical Science · doi:10.1214/088342306000000691 · Cited by 604
Self-citationCrowdsourcing Consumer Research
Goodman, J. K., & Paolacci, G. (2017) · Journal of Consumer Research · doi:10.1093/jcr/ucx047 · Cited by 588
“…model-based poststratification can be used to statistically adjust the estimates obtained from nonrepresentative samples (Battaglia, Hoaglin, and Frankel 2013; Park, Gelman, and Bafumi 2004), and may be applied to MTurk samples (Goel, Obeng, and Rothschild 2015; Levay, Freese, and Druckman 2016).”
BackgroundBias in Perceptions of Public Opinion among Political Elites
BROOCKMAN, D. E., & SKOVRON, C. (2018) · American Political Science Review · doi:10.1017/s0003055418000011 · Cited by 503
“…support for each issue in all of the nation’s state legislative districts using multilevel regression and poststratification (MRP) (Eggers and Lauderdale 2016; Hanretty, Lauderdale, and Vivyan 2016; Lax and Phillips 2009a, 2009b, 2012; Park, Gelman, and Bafumi 2004; Warshaw and Rodden 2012).”
MethodCerdá, M., Wall, M., Keyes, K. M., Galea, S., & Hasin, D. (2012) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2011.06.011 · Cited by 490
“…data to address associations at the tate-level can be accomplished through multilevel regression (Gelman, 2007; Lax nd Phillips, 2009; Park et al., 2004) where potential lack of representativeness of amples within states is accounted for by controlling for individual-level covarites…”
BackgroundRepresentation in Municipal Government
TAUSANOVITCH, C., & WARSHAW, C. (2014) · American Political Science Review · doi:10.1017/s0003055414000318 · Cited by 431
Cornesse, C., Blom, A. G., Dutwin, D., Krosnick, J. A., De Leeuw, E. D., Legleye, S., Pasek, J., Pennay, D., Phillips, B., Sakshaug, J. W., et al. (2020) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz041 · Cited by 418
Measuring Constituent Policy Preferences in Congress, State Legislatures, and Cities
Tausanovitch, C., & Warshaw, C. (2013) · The Journal of Politics · doi:10.1017/s0022381613000042 · Cited by 413
“…generated using the 2006 CCES, with a sample of approximately 36,000 Americans; d Disaggregated estimates of citizens’ policy preferences generated using our large sample of the policy preferences of 275,000 Americans; and d MRP estimates of citizens’ policy preferences generated using our sample…”
MethodMeasuring Citizen and Government Ideology in the U.S. States: A Re-appraisal
Berry, W. D., Fording, R. C., Ringquist, E. J., Hanson, R. L., & Klarner, C. E. (2010) · State Politics & Policy Quarterly · doi:10.1177/153244001001000201 · Cited by 412
Forecasting elections with non-representative polls
Wang, W., Rothschild, D., Goel, S., & Gelman, A. (2015) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2014.06.001 · Cited by 371
“…strategy, known as multilevel regression and poststratification (MRP), has been used to obtain accurate small-area subgroup estimates, such as for public opinion and voter turnout in individual states and demographic subgroups (Park et al., 2004; Lax and Phillips, 2009; Ghitza and Gelman, 2013).”
MethodSelf-citationTrustworthy Online Controlled Experiments: A Practical Guide to A/B Testing
Kohavi, R., Tang, D., & Xu, Y. (2020) · doi:10.1017/9781108653985 · Cited by 297
A Review of Generalizability and Transportability
Degtiar, I., & Rose, S. (2023) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042522-103837 · Cited by 295
Riddle, T., & Sinclair, S. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1808307116 · Cited by 269
“Before conducting the main analysis, we used multilevel regression with poststratification to make the estimated level of bias for each county more representative of the population (27).”
MethodPublic Opinion and Criminal Justice Policy: Theory and Research
Pickett, J. T. (2019) · Annual Review of Criminology · doi:10.1146/annurev-criminol-011518-024826 · Cited by 263
Unrepresentative big surveys significantly overestimated US vaccine uptake
Bradley, V. C., Kuriwaki, S., Isakov, M., Sejdinovic, D., Meng, X.-L., & Flaxman, S. (2021) · Nature · doi:10.1038/s41586-021-04198-4 · Cited by 248
The Geographic Distribution of Political Preferences
Rodden, J. (2010) · Annual Review of Political Science · doi:10.1146/annurev.polisci.12.031607.092945 · Cited by 243
Rich State, Poor State, Red State, Blue State: What’s the Matter with Connecticut?
Gelman, A., Shor, B., Bafumi, J., & Park, D. (2008) · Quarterly Journal of Political Science · doi:10.1561/100.00006026 · Cited by 237
Self-citationPacheco, J. (2012) · The Journal of Politics · doi:10.1017/s0022381611001241 · Cited by 229
Zhang, X., Holt, J. B., Lu, H., Wheaton, A. G., Ford, E. S., Greenlund, K. J., & Croft, J. B. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu018 · Cited by 223
“MRP ignores the individual survey weights in the model estimation and assumes that later poststratification using small-area populations could overcome the bias from ignoring survey weights (18, 19, 21).”
BackgroundHow Should We Measure District-Level Public Opinion on Individual Issues?
Warshaw, C., & Rodden, J. (2012) · The Journal of Politics · doi:10.1017/s0022381611001204 · Cited by 219
Zheng, T., Salganik, M. J., & Gelman, A. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001168 · Cited by 216
“Controlling for individual characteristics also allows poststratified estimates of population quantities (see, e.g., Lohr 1999; Park, Gelman, and Bafumi 2004).”
BackgroundSelf-citationAttention Felons: Evaluating Project Safe Neighborhoods in Chicago
Papachristos, A. V., Meares, T. L., & Fagan, J. (2007) · Journal of Empirical Legal Studies · doi:10.1111/j.1740-1461.2007.00096.x · Cited by 214
Policy Ideology in European Mass Publics, 1981–2016
CAUGHEY, D., O’GRADY, T., & WARSHAW, C. (2019) · American Political Science Review · doi:10.1017/s0003055419000157 · Cited by 213
Public perceptions of the health risks of extreme heat across US states, counties, and neighborhoods
Howe, P. D., Marlon, J. R., Wang, X., & Leiserowitz, A. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1813145116 · Cited by 194
Does inequality erode social trust? Results from multilevel models of US states and counties
Fairbrother, M., & Martin, I. W. (2012) · Social Science Research · doi:10.1016/j.ssresearch.2012.09.008 · Cited by 194
Understanding and Reducing Biases in Elite Beliefs About the Electorate
Pereira, M. M. (2021) · American Political Science Review · doi:10.1017/s000305542100037x · Cited by 181
Deep Interactions with MRP: Election Turnout and Voting Patterns Among Small Electoral Subgroups
Ghitza, Y., & Gelman, A. (2013) · American Journal of Political Science · doi:10.1111/ajps.12004 · Cited by 177
Self-citationTheory and Practice in Nonprobability Surveys
Mercer, A. W., Kreuter, F., Keeter, S., & Stuart, E. A. (2017) · Public Opinion Quarterly · doi:10.1093/poq/nfw060 · Cited by 176
Demographic Inference and Representative Population Estimates from Multilingual Social Media Data
Wang, Z., Hale, S. A., Adelani, D. I., Grabowicz, P. A., Hartman, T., Flöck, F., & Jurgens, D. (2019) · Publications of the UdS (Saarland University) · doi:10.22028/d291-29212 · Cited by 173
Judicial Selection and Death Penalty Decisions
Canes‐Wrone, B., Clark, T. S., & KELLY, J. P. (2014) · American Political Science Review · doi:10.1017/s0003055413000622 · Cited by 172
“Fortunately, multilevel regression with poststratification (Park, Gelman, and Bafumi 2004) can yield reliable estimates of state-level opinion.”
Incremental Democracy: The Policy Effects of Partisan Control of State Government
Caughey, D., Warshaw, C., & Xu, Y. (2017) · The Journal of Politics · doi:10.1086/692669 · Cited by 171
Pushing the City Limits: Policy Responsiveness in Municipal Government
Einstein, K. L., & Kogan, V. (2016) · Urban Affairs Review · doi:10.1177/1078087414568027 · Cited by 168
Ormond, G., Nieuwenhuijsen, M. J., Nelson, P., Toledano, M. B., Iszatt, N., Geneletti, S., & Elliott, P. (2009) · Environmental Health Perspectives · doi:10.1289/ehp.11933 · Cited by 165
Does Global Warming Increase Public Concern about Climate Change?
Bergquist, P., & Warshaw, C. (2019) · The Journal of Politics · doi:10.1086/701766 · Cited by 161
Demographic Inference and Representative Population Estimates from Multilingual Social Media Data
Wang, Z., Hale, S., Adelani, D. I., Grabowicz, P., Hartman, T., Flöck, F., & Jurgens, D. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313684 · Cited by 160
“Regarding age, annotators were given seven categories to choose from: <= 18, (18, 30), [30, 40), [40, 50), [50, 60), [60, 70), >= 69.”
A Bayesian Multilevel Modeling Approach to Time-Series Cross-Sectional Data
Shor, B., Bafumi, J., Keele, L. J., & Park, D. S. (2007) · Political Analysis · doi:10.1093/pan/mpm006 · Cited by 159
“…and King 1993; Western 1998; Park 2001; Steenbergen and Jones 2002; Gelman et al. 2003; Shor et al. 2003; Shor 2004, 2006; Bafumi 2004a, 2004b; Park, Gelman, and Bafumi 2004; Bafumi et al. 2005; Gelman and Hill 2006; Gelman et al. forthcoming).4 For example, states and years can be modeled…”
BackgroundInfluentialSelf-citationStatistical Analysis of Endorsement Experiments: Measuring Support for Militant Groups in Pakistan
Bullock, W., Imai, K., & Shapiro, J. N. (2011) · Political Analysis · doi:10.1093/pan/mpr031 · Cited by 158
“Poststratification at the analysis stage provides another way of estimating levels of support in the population (Park, Gelman, and Bafumi 2004; Lax and Phillips 2009).”
BackgroundComparing Alternatives for Estimation from Nonprobability Samples
Valliant, R. L. (2019) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz003 · Cited by 157
Public Opinion in the U.S. States: 1956 to 2010
Enns, P. K., & Koch, J. (2013) · State Politics & Policy Quarterly · doi:10.1177/1532440013496439 · Cited by 154
“Park, Gelman, and Bafumi (2004) and Lax and Phillips (2009b) have shown that national surveys can produce valid and reliable estimates of state opinion with a two-step process called multilevel regression and poststratification (MRP).1 In the first step, a multilevel regression model is fit to…”
BackgroundMethodInfluentialPredicting and Interpolating State‐Level Polls Using Twitter Textual Data
Beauchamp, N. (2016) · American Journal of Political Science · doi:10.1111/ajps.12274 · Cited by 153
The Democratic Effect of Direct Democracy
Leemann, L., & Wasserfallen, F. (2016) · American Political Science Review · doi:10.1017/s0003055416000307 · Cited by 137
“…which provides good estimates, even when the samples for individual subnational units are small (Gelman and Little 1997; Kastellec, Lax, and Phillips 2010; Lax and Phillips 2009a; 2009b; 2012; Pacheco 2012; Park, Gelman, and Bafumi 2004; Tausanovitch and Warshaw 2013; Warshaw and Rodden 2012).”
BackgroundMethodHow Does Multilevel Regression and Poststratification Perform with Conventional National Surveys?
Buttice, M. K., & Highton, B. (2013) · Political Analysis · doi:10.1093/pan/mpt017 · Cited by 134
“Multilevel regression and poststratification (MRP) is based on Gelman and Little (1997) and extended in Park, Gelman, and Bafumi (2004, 2006).”
BackgroundMethodInfluentialJohnson, M., Brace, P. R., & Arceneaux, K. (2005) · Social Science Quarterly · doi:10.1111/j.0038-4941.2005.00292.x · Cited by 132
Dynamic Estimation of Latent Opinion Using a Hierarchical Group-Level IRT Model
Caughey, D., & Warshaw, C. (2015) · Political Analysis · doi:10.1093/pan/mpu021 · Cited by 127
Fitting Multilevel Models When Predictors and Group Effects CorrelatePreprint
Bafumi, J., & Gelman, A. (2007) · SSRN Electronic Journal · doi:10.7916/d87p953x · Cited by 126
Self-citationPacheco, J. (2011) · State Politics & Policy Quarterly · doi:10.1177/1532440011419287 · Cited by 125
Large-Scale Replication Projects in Contemporary Psychological Research
McShane, B. B., Tackett, J. L., Böckenholt, U., & Gelman, A. (2019) · The American Statistician · doi:10.1080/00031305.2018.1505655 · Cited by 122
“To place I2 in context, Pigott (2012) defines low, medium, and high heterogeneity in psychological research as I2 of 25%, 50%, and 75% respectively (see also Higgins and Thompson 2002).”
BackgroundSelf-citationThe Primacy of Race in the Geography of Income‐Based Voting: New Evidence from Public Voting Records
Hersh, E. D., & Nall, C. (2015) · American Journal of Political Science · doi:10.1111/ajps.12179 · Cited by 121
From Mass Preferences to Policy
Canes‐Wrone, B. (2015) · Annual Review of Political Science · doi:10.1146/annurev-polisci-050311-165552 · Cited by 119
Public Opinion and Senate Confirmation of Supreme Court Nominees
Kastellec, J., Lax, J. R., & Phillips, J. H. (2010) · The Journal of Politics · doi:10.1017/s0022381610000150 · Cited by 118
The Measurement and Stability of State Citizen Ideology
Berry, W. D., Ringquist, E. J., Fording, R. C., & Hanson, R. L. (2007) · State Politics & Policy Quarterly · doi:10.1177/153244000700700201 · Cited by 105
Why Local Party Leaders Don't Support Nominating Centrists
Broockman, D., Carnes, N., Crowder‐Meyer, M., & Skovron, C. (2019) · British Journal of Political Science · doi:10.1017/s0007123419000309 · Cited by 98
Crime, compulsory schooling laws and education
Bell, B. D., Costa, R. P., & Machin, S. J. (2015) · Economics of Education Review · doi:10.1016/j.econedurev.2015.09.007 · Cited by 95
Downes, M., Gurrin, L. C., English, D. R., Pirkis, J., Currier, D., Spittal, M. J., & Carlin, J. B. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwy070 · Cited by 91
Extending the Use and Prediction Precision of Subnational Public Opinion Estimation
Leemann, L., & Wasserfallen, F. (2017) · American Journal of Political Science · doi:10.1111/ajps.12319 · Cited by 88
The Twilight of the Polls? A Review of Trends in Polling Accuracy and the Causes of Polling Misses
Prosser, C., & Mellon, J. (2018) · Government and Opposition · doi:10.1017/gov.2018.7 · Cited by 87
“One particularly promising area of research is Multilevel Regression with Poststratification (MrP) methods (Lax and Phillips 2009; Park et al. 2004).”
MethodThe Thermostatic Model of Responsiveness in the American States
Pacheco, J. (2013) · State Politics & Policy Quarterly · doi:10.1177/1532440013487388 · Cited by 86
Moral values predict county-level COVID-19 vaccination rates in the United States.
Reimer, N. K., Atari, M., Karimi-Malekabadi, F., Trager, J. P., Kennedy, B., Graham, J., & Dehghani, M. (2022) · American Psychologist · doi:10.1037/amp0001020 · Cited by 85
Voters Get What They Want (When They Pay Attention): Human Rights, Policy Benefits, and Foreign Aid
Heinrich, T., Kobayashi, Y., & Long, L. (2018) · International Studies Quarterly · doi:10.1093/isq/sqx081 · Cited by 85
Why People Vote: Estimating the Social Returns to Voting
Gerber, A. S., Huber, G. A., Doherty, D., & Dowling, C. M. (2014) · British Journal of Political Science · doi:10.1017/s0007123414000271 · Cited by 83
Government's Unequal Attentiveness to Citizens' Political Priorities
Flavin, P., & Franko, W. W. (2016) · Policy Studies Journal · doi:10.1111/psj.12184 · Cited by 82
“MRP provides accurate estimates of state opinion even when using a single national survey (Lax and Phillips 2009a; 2009b; 2012; Park et al. 2004, 2006).”
MethodWho Controls Criminal Law? Racial Threat and the Adoption of State Sentencing Law, 1975 to 2012
Duxbury, S. (2020) · American Sociological Review · doi:10.1177/0003122420967647 · Cited by 78
“ficient for obtaining accurate MRP estimates (Lax and Phillips 2009b; Park et al. 2004).”
BackgroundMethodInfluentialReform and Representation: A New Method Applied to Recent Electoral Changes
Kousser, T. B., Phillips, J. H., & Shor, B. (2016) · Political Science Research and Methods · doi:10.1017/psrm.2016.43 · Cited by 77
Public Support for Development Aid during the COVID-19 Pandemic
Kobayashi, Y., Heinrich, T., & Bryant, K. A. (2020) · World Development · doi:10.1016/j.worlddev.2020.105248 · Cited by 76
“The data we use for post-stratification come from the Cooperative Congressional Election Study (CCES) 2018 (Park et al., 2004; Vavreck & Rivers, 2008).”
Understanding, Choosing, and Unifying Multilevel and Fixed Effect Approaches
Hazlett, C. J., & Wainstein, L. (2020) · Political Analysis · doi:10.1017/pan.2020.41 · Cited by 75
“Although our advice regarding CRSEs is less common, our debiasing recommendations echo Raudenbush (2009), Bell and Jones (2015), andBell, Fairbrother, and Jones (2019).”
BackgroundMethodMeasuring Public Opinion with Social Media Data
Klašnja, M., Barberá, P., Beauchamp, N., Nagler, J., & Tucker, J. A. (2017) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190213299.013.3 · Cited by 74
Geography, Uncertainty, and Polarization
McCarty, N. M., Rodden, J., Shor, B., Tausanovitch, C., & Warshaw, C. (2015) · Political Science Research and Methods · doi:10.1017/psrm.2018.12 · Cited by 74
Does Immigration Undermine Public Support for Integration in the E uropean U nion?
Toshkov, D., & Kortenska, E. (2015) · JCMS Journal of Common Market Studies · doi:10.1111/jcms.12230 · Cited by 73
“…local and regional level data on social attitudes (towards immigration and the EU) one could turn to the recently-popularized technique for estimating local level averages from national data (which is readily available) with the help of multilevel modeling and poststratification (Park et al. 2004).”
MethodImproving Multilevel Regression and Poststratification with Structured Priors
Gao, Y., Kennedy, L., Simpson, D., & Gelman, A. (2020) · Bayesian Analysis · doi:10.1214/20-ba1223 · Cited by 71
“MRP’s beginnings saw applications in political science (Gelman and Little, 1997; Park et al., 2004) for the estimation of state-level opinions from national polls.”
BackgroundSelf-citationInstitution of Nomination and the Policy Ideology of Primary Electorates
Hill, S. J. (2015) · Quarterly Journal of Political Science · doi:10.1561/100.00015023 · Cited by 69
Investigating the role of group-based morality in extreme behavioral expressions of prejudice
Hoover, J., Atari, M., Davani, A. M., Kennedy, B., Portillo-Wightman, G., Yeh, L., & Dehghani, M. (2021) · Nature Communications · doi:10.1038/s41467-021-24786-2 · Cited by 69
Estimating Smooth Country–Year Panels of Public Opinion
Claassen, C. (2018) · Political Analysis · doi:10.1017/pan.2018.32 · Cited by 69
“To do so, they combine a binomial IRT model, the method of multilevel regression and poststratification (MRP; Park, Gelman, and Bafumi (2004)), and a dynamic linear model of the latent opinion.”
MethodKalla, J., & Porter, E. V. (2020) · British Journal of Political Science · doi:10.1017/s0007123419000711 · Cited by 68
“First, using data from the 2016 CCES and multi-level regression and post-stratification (Gelman and Little 1997; Lax and Phillips 2009; Park et al. 2004; Warshaw and Rodden 2012), we estimated district-level public opinion in 2,346 state House and Senate districts on eight issues.”
MethodThe Symbolic and Substantive Representation of LGB Americans in the US House
Hansen, E. R., & Treul, S. A. (2015) · The Journal of Politics · doi:10.1086/682699 · Cited by 67
“…scholars have developed multilevel regression and poststratification (MRP) as a strategy to estimate public opinion in states, congressional districts, and smaller subnational political units (Gelman and Little 1997; Lax and Phillips 2009a; Park, Gelman, and Bafumi 2004; Warshaw and Rodden 2012).”
BackgroundDyadic Representation in a Westminster System
Hanretty, C., Lauderdale, B. E., & Vivyan, N. (2016) · Legislative Studies Quarterly · doi:10.1111/lsq.12148 · Cited by 67
“…and post-stratification’ (MRP), a technique for estimating opinion within small areas using large national survey samples in conjunction with auxiliary information about the small area characteristics (Park et al., 2004; Lax and Phillips, 2009; Warshaw and Rodden, 2012; Selb and Munzert, 2011).”
Kennedy, L., & Gelman, A. (2021) · Psychological Methods · doi:10.1037/met0000362 · Cited by 66
“For a more thorough description of Bayesian workflow in psychological examples, refer to Schad, Betancourt, and Vasishth (2019).”
MethodSelf-citationAttention Felons: Evaluating Project Safe Neighborhoods in ChicagoPreprint
Papachristos, A. V., Meares, T. L., & Fagan, J. A. (2007) · SSRN Electronic Journal · doi:10.2139/ssrn.860685 · Cited by 66
An Introduction to Multilevel Regression and Post-Stratification for Estimating Constituency Opinion
Hanretty, C. (2019) · Political Studies Review · doi:10.1177/1478929919864773 · Cited by 64
“‘Small areas’ are usually anything smaller than nations, and past work using MRP has produced estimates for areas as large as US states (average population: 6.5 million) to areas as small as Westminster constituencies (average population: 100,000) (Hanretty et al., 2018; Park et al., 2004).”
BackgroundMethodInfluentialComparing Strategies for Estimating Constituency Opinion from National Survey Samples
Hanretty, C., Lauderdale, B. E., & Vivyan, N. (2016) · Political Science Research and Methods · doi:10.1017/psrm.2015.79 · Cited by 60
New Measures of Partisanship, Ideology, and Policy Mood in the American States
Carsey, T. M., & Harden, J. J. (2010) · State Politics & Policy Quarterly · doi:10.1177/153244001001000202 · Cited by 59
Eagle, A. J., Eagle, D. E., Stobbe, T. E., & van Kooten, G. C. (2014) · American Journal of Agricultural Economics · doi:10.1093/ajae/aau098 · Cited by 58
Poor Representation: Congress and the Politics of Poverty in the United States
Miler, K. C. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108562386 · Cited by 57
Model-based pre-election polling for national and sub-national outcomes in the US and UK
Lauderdale, B. E., Bailey, D., Blumenau, J., & Rivers, D. (2019) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.05.012 · Cited by 56
“In this study, we describe our approach to applying the logic of multilevel regression and post-strati cation (MRP; Gelman and Little, 1997; Park et al., 2004) to pre-election polling.”
InfluentialRepresentation and Local Policy: Relating County-Level Public Opinion to Policy Outputs
Percival, G. L., Johnson, M., & Neiman, M. (2008) · Political Research Quarterly · doi:10.1177/1065912908316341 · Cited by 56
Understanding Noncompetition Agreements: The 2014 Noncompete Survey Project
Prescott, J. J., Bishara, N., & Starr, E. P. (2016) · bepress Legal Repository · Cited by 55
Estimating Constituency Preferences from Sparse Survey Data Using Auxiliary Geographic Information
Selb, P., & Munzert, S. (2011) · Political Analysis · doi:10.1093/pan/mpr034 · Cited by 55
“…estimators of constituency preferences have been demonstrated to outperform previous approaches regarding their accuracy and efficiency (e.g.,Park, Gelman, and Bafumi 2004) but require detailed structural information that will often be missing, for example, if the boundaries of the…”
BackgroundMethodInfluentialTarget Estimation and Adjustment Weighting for Survey Nonresponse and Sampling Bias
Caughey, D., Berinsky, A. J., Chatfield, S., Hartman, E., Schickler, E., & Sekhon, J. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108879217 · Cited by 54
Two-Stage Regression and Multilevel Modeling: A Commentary
Gelman, A. (2005) · Political Analysis · doi:10.1093/pan/mpi032 · Cited by 54
“…when the sample size in each group is less than overwhelming—from our own recent research, these examples include estimating state-level opinions from national polls (Park et al. 2004) and estimating an ideal point model of Supreme Court voting from at most nine votes per case (Bafumi et al. 2005).”
BackgroundSelf-citationIgnored Racism: White Animus Toward Latinos
Ramirez, M. D., & Peterson, D. A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108861915 · Cited by 53
Cross-Survey Analysis to Estimate Low-Incidence Religious Groups
Tighe, E. M., Livert, D. E., Barnett, M. D., & Saxe, L. (2010) · Sociological Methods & Research · doi:10.1177/0049124110366237 · Cited by 52
“Nevertheless, one can adjust for nonrepresentativeness on key demographic variables by combining the modeling approach described by Park et al. (2004) with poststratification methods.”
MethodInfluentialCorrecting Sociodemographic Selection Biases for Population Prediction from Social Media
Giorgi, S., Lynn, V., Gupta, K., Ahmed, F., Matz, S., Ungar, L., & Schwartz, H. A. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19287 · Cited by 51
“Further, although our focus is social media-based community measurements, this formulation could be used for other types of data: estimating consumer metrics per household [17], state polling [18], and, generally, individual-level data from a biased sample of a population.”
BackgroundThe Role of Public Opinion—Does It Influence the Diffusion of ACA Decisions?
Pacheco, J., & Maltby, E. (2016) · Journal of Health Politics Policy and Law · doi:10.1215/03616878-3766737 · Cited by 49
“To estimate state opinion toward the ACA, we will rely on multilevel modeling, imputation, and post-stratification (referred to as MRP) developed by Gelman and Little (1997) and extended by Park et al. (2004; 2006).”
MethodWhen Voters Matter: The Limits of Local Government Responsiveness
Sances, M. (2019) · Urban Affairs Review · doi:10.1177/1078087419878812 · Cited by 49
When Do Legislators Defy Popular Sovereignty? Testing Theories of Minority Representation Using DOMA
Bishin, B. G., & Smith, C. A. (2013) · Political Research Quarterly · doi:10.1177/1065912913475875 · Cited by 47
Large Language Models as Subpopulation Representative Models: A ReviewPreprint
Simmons, G., & Hare, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.17888 · Cited by 46
Measuring the Unmeasurable: Models of Geographical Context
Fotheringham, A. S., & Li, Z. (2023) · Annals of the American Association of Geographers · doi:10.1080/24694452.2023.2227690 · Cited by 43
“…(Duncan, Jones, and Moon 1998; Zahnd and McLafferty 2017; Ma et al. 2018), measuring neighborhood effects of house prices (Orford 2000; Dong et al. 2015), and estimating small area statistics by combining aggregated and survey data (Twigg, Moon, and Jones 2000; Park, Gelman, and Bafumi 2004).”
BackgroundPredicting Presidential and Other Multistage Election Outcomes Using State-Level Pre-Election Polls
Christensen, W. F., & Florence, L. W. (2008) · The American Statistician · doi:10.1198/000313008x267820 · Cited by 43
“Park, Gelman, and Bafumi (2004) employed a multilevel logistic regression model to generate estimates of state-level vote shares.”
Criminal Governance in Latin America: Prevalence and Correlates
Uribe, A., Lessing, B., Schouela, N., & Stecher, E. (2025) · Perspectives on Politics · doi:10.1017/s1537592725101849 · Cited by 42
“Since the LB data is not representative at this level, we use multilevel regression and poststrati-fi cation (MRP) (Lax and Phillips 2009; Park, Gelman, and Bafumi 2004) to produce more representative MR district-level estimates of the proportion of residents living with CG. 20 While these…”
Metadata
- Authors
- Park, D. K., Gelman, A., & Bafumi, J.
- Affiliations
- Washington University in St. Louis (US)
- Columbia University (US)
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2004
- Volume
- 12
- Issue
- 4
- Pages
- 375-385
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2105602542
- Cited by
- 480
- References
- 15
- Citations by year
- 2026: 19 · 2025: 20 · 2024: 26 · 2023: 19 · 2022: 28 · 2021: 48 · 2020: 85 · 2019: 45 · 2018: 48 · 2017: 16 · 2016: 20 · 2015: 21 · 2014: 20 · 2013: 12 · 2012: 10
- FWCI
- 5.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Political Analysis (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Social Sciences › Political Science and International Relations › Electoral Systems and Political Participation
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- Bayesian hierarchical model, post-stratification, small area estimation, state-level estimates, national polls, election forecasting, multilevel logistic regression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.