The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
An Empirical Comparison of Seven Populist Attitudes Scales
Abstract
With the recent upsurge of populism in developed and transition democracies, researchers have started measuring it as an attitude. Several scales have been proposed for this purpose. However, there is little direct comparison between the available alternatives. Scholars who wish to measure populist attitudes have little information available to help select the best scale for their purposes. In this article, we directly compare seven populist attitudes scales from multiple perspectives: conceptual development, questionnaire design, dimensionality, information, cross-national validity, and external validity. We use original survey data collected online from nine countries in Europe and the Americas, with around 250 participants per country, in which all seven batteries of questions were present. Results show that most scales have important methodological and validity limitations in at least one of the dimensions tested, and should not be used for cross-national comparative research. We recommend populist attitudes items that work better at capturing populism, and more generally provide guidelines for researchers who want to compare different scales that supposedly measure the same construct.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Principles and Practice of Structural Equation Modeling
Tabri, N., & Elliott, C. M. (2012) · Canadian Graduate Journal of Sociology and Criminology · doi:10.15353/cgjsc-rcessc.v1i1.25 · Cited by 38,891
The Nature and Origins of Mass Opinion
Zaller, J. R. (1992) · doi:10.1017/cbo9780511818691 · Cited by 7,785
Mudde, C. (2004) · Government and Opposition · doi:10.1111/j.1477-7053.2004.00135.x · Cited by 5,286
Social dominance orientation: A personality variable predicting social and political attitudes.
Pratto, F., Sidanius, J., Stallworth, L. M., & Malle, B. F. (1994) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.67.4.741 · Cited by 4,954
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 1×
“…CrowdFlower6 between December 2016 and March 2017.7 This platform has started to be used for social scientific studies (e.g., Van Prooijen and Krouwel 2017), and tests with behavioral experiments show that results from studies with field and student samples can be replicated (Peer et al. 2017).”
MethodInfluentialESTIMATION OF LATENT ABILITY USING A RESPONSE PATTERN OF GRADED SCORES1
Samejima, F. (1968) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1968.tb00153.x · Cited by 2,587
Trust the People! Populism and the Two Faces of Democracy
Canovan, M. (1999) · Political Studies · doi:10.1111/1467-9248.00184 · Cited by 2,451
Political Trust and Trustworthiness
Levi, M., & Stoker, L. (2000) · Annual Review of Political Science · doi:10.1146/annurev.polisci.3.1.475 · Cited by 2,190 · cited 1×
“Examples include authoritarian attitudes (Altemeyer 1981; Feldman and Stenner 1997; Oesterreich 2005), ideology (e.g., Lo, Proksch, and Gschwend 2014; Wilson and Patterson 1968), or political trust (Feldman 1983; Levi and Stoker 2000; Marien 2011).”
BackgroundSimultaneous Factor Analysis in Several Populations
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291366 · Cited by 2,051 · cited 8×
“The first test is done with confirmatory factor analysis (CFA), where we check whether the items in each scale load onto the dimension(s) they are theorized to.”
MethodInfluentialStatistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
A Generalized Partial Credit Model: Application of an EM Algorithm
Muraki, E. (1992) · Applied Psychological Measurement · doi:10.1177/014662169201600206 · Cited by 1,535
Jagers, J., & Walgrave, S. (2007) · European Journal of Political Research · doi:10.1111/j.1475-6765.2006.00690.x · Cited by 1,487
Eysenck, H. J. (1982) · Personality and Individual Differences · doi:10.1016/0191-8869(82)90067-8 · Cited by 1,467
How Populist Are the People? Measuring Populist Attitudes in Voters
Akkerman, A., Mudde, C., & Zaslove, A. (2014) · Comparative Political Studies · doi:10.1177/0010414013512600 · Cited by 1,148
Conceptualizing and Measuring Democracy: Evaluating Alternative Indices
Munck, G. L., & Verkuilen, J. (2002) · Comparative Political Studies · doi:10.1177/001041400203500101 · Cited by 1,068
Bruder, M., Haffke, P., Neave, N., Nouripanah, N., & Imhoff, R. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00225 · Cited by 1,049 · cited 1×
“Conspiracy mentality is measured with the five-item scale by Bruder et al. (2013), while political trust is measured with a question on how much confidence the respondent has in three institutions: government, parliament, and political parties.”
Perceived Threat and Authoritarianism
Feldman, S., & Stenner, K. (1997) · Political Psychology · doi:10.1111/0162-895x.00077 · Cited by 1,043
Behaviour research and therapy
(1993) · Behaviour Research and Therapy · doi:10.1016/0005-7967(93)90091-8 · Cited by 869
Measurement Equivalence in Cross-National Research
Davidov, E., Meuleman, B., Cieciuch, J., Schmidt, P., & Billiet, J. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043137 · Cited by 766
Development and validation of the Inventory of Depression and Anxiety Symptoms (IDAS).
Watson, D., O'Hara, M. W., Simms, L. J., Kotov, R., Chmielewski, M., McDade-Montez, E. A., Gamez, W., & Stuart, S. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.3.253 · Cited by 740
British Journal of Clinical Psychology
(2010) · British Journal of Clinical Psychology · doi:10.1111/(issn)2044-8260 · Cited by 702
The Oxford Handbook of Political Ideologies
(2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199585977.001.0001 · Cited by 700
Is Chávez Populist?: Measuring Populist Discourse in Comparative Perspective
Hawkins, K. A. (2009) · Comparative Political Studies · doi:10.1177/0010414009331721 · Cited by 662
Rise of the Trumpenvolk: Populism in the 2016 Election
Oliver, J. E., & Rahn, W. M. (2016) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716216662639 · Cited by 566
On Political Methodology: Archival Version
King, G. (1996) · ICPSR Data Holdings · doi:10.3886/icpsr01053 · Cited by 554
What unites the voter bases of populist parties? Comparing the electorates of 15 populist parties
Rooduijn, M. (2018) · European Political Science Review · doi:10.1017/s1755773917000145 · Cited by 513
Van Hauwaert, S. M., & Van Kessel, S. (2018) · European Journal of Political Research · doi:10.1111/1475-6765.12216 · Cited by 513
Who Supports Populism and What Attracts People to It?
Spruyt, B., Keppens, G., & Van Droogenbroeck, F. (2016) · Political Research Quarterly · doi:10.1177/1065912916639138 · Cited by 503
Further Investigating Method Effects Associated With Negatively Worded Items on Self-Report Surveys
DiStefano, C., & Motl, R. W. (2006) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1303_6 · Cited by 467
Hayduk, L. A., & Littvay, L. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-159 · Cited by 437
Self-citationCastanho Silva, B., Vegetti, F., & Littvay, L. (2017) · Swiss Political Science Review · doi:10.1111/spsr.12270 · Cited by 435
Self-citationMeasuring Populist Attitudes on Three Dimensions
Schulz, A., Müller, P., Schemer, C., Wirz, D. S., Wettstein, M., & Wirth, W. (2018) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edw037 · Cited by 389
Throwing out the Bums: Protest Voting and Unorthodox Parties after Communism
Pop-Eleches, G. (2010) · World Politics · doi:10.1017/s0043887110000043 · Cited by 344
Expressing or fuelling discontent? The relationship between populist voting and political discontent
Rooduijn, M., van der Brug, W., & de Lange, S. L. (2016) · Electoral Studies · doi:10.1016/j.electstud.2016.04.006 · Cited by 336
Elchardus, M., & Spruyt, B. (2016) · Government and Opposition · doi:10.1017/gov.2014.27 · Cited by 326
Gradations of Democracy? Empirical Tests of Alternative Conceptualizations
Elkins, Z. (2000) · American Journal of Political Science · doi:10.2307/2669311 · Cited by 324
Political trust : why context matters
Zmerli, S., & Hooghe, M. (2013) · Cited by 290
Flight into Security: A New Approach and Measure of the Authoritarian Personality
Oesterreich, D. (2005) · Political Psychology · doi:10.1111/j.1467-9221.2005.00418.x · Cited by 240
The Appeal of Media Populism: The Media Preferences of Citizens with Populist Attitudes
Hameleers, M., Bos, L., & de Vreese, C. H. (2017) · Mass Communication & Society · doi:10.1080/15205436.2017.1291817 · Cited by 193
Paternalist populism and illiberal elitism in Central Europe
Enyedi, Z. (2016) · Journal of Political Ideologies · doi:10.1080/13569317.2016.1105402 · Cited by 192
Stanley, B. (2011) · Communist and Post-Communist Studies · doi:10.1016/j.postcomstud.2011.10.005 · Cited by 184
Sympathy for the ‘devil’? Voting for populists in the 2006 and 2010 Dutch general elections
Schumacher, G., & Rooduijn, M. (2012) · Electoral Studies · doi:10.1016/j.electstud.2012.11.003 · Cited by 170
Extreme Political Beliefs Predict Dogmatic Intolerance
van Prooijen, J., & Krouwel, A. P. M. (2016) · Social Psychological and Personality Science · doi:10.1177/1948550616671403 · Cited by 165
Samples in applied psychology: Over a decade of research in review.
Shen, W., Kiger, T. B., Davies, S. E., Rasch, R. L., Simon, K. M., & Ones, D. S. (2011) · Journal of Applied Psychology · doi:10.1037/a0023322 · Cited by 160 · cited 1×
“Nevertheless, convenience samples (especially with college students), are common in psychological scale development (Shen et al. 2011), with reason.”
BackgroundAuthoritarianism in Black and White: Testing the Cross-Racial Validity of the Child Rearing Scale
Pérez, E. O., & Hetherington, M. J. (2014) · Political Analysis · doi:10.1093/pan/mpu002 · Cited by 141
Vox populismus: a populist radical right attitude among the public?
Rooduijn, M. (2013) · Nations and Nationalism · doi:10.1111/nana.12054 · Cited by 124
Acquiescence and Recency Response-Order Effects in Interview Surveys
McClendon, M. J. (1991) · Sociological Methods & Research · doi:10.1177/0049124191020001003 · Cited by 122
Rico, G., & Anduiza, E. (2017) · Acta Politica · doi:10.1057/s41269-017-0068-7 · Cited by 122
The Structure of Public Opinion on Policy Issues
Axelrod, R. (1967) · Public Opinion Quarterly · doi:10.1086/267481 · Cited by 83
A Common Left-Right Scale for Voters and Parties in Europe
Lo, J., Proksch, S.-O., & Gschwend, T. (2014) · Political Analysis · doi:10.1093/pan/mpt028 · Cited by 78
On use of Student Samples for Scale Construction
Pernice, R. E., Ommundsen, R., van der Veer, C. G., & Larsen, K. S. (2008) · Psychological Reports · doi:10.2466/pr0.102.2.459-464 · Cited by 39
Questions and Comparisons: Methods of Research in Social Psychology
Ellsworth, P. C., & Gonzalez, R. (2007) · SAGE Publications Ltd eBooks · doi:10.4135/9781848608221.n2 · Cited by 23
Hauwaert, S. M. V., Schimpf, C. H., & Azevedo, F. (2018) · Routledge eBooks · doi:10.4324/9781315196923-7 · Cited by 16
Cited by
The Political Economy of Populism
Guriev, S., & Papaioannou, E. (2022) · Journal of Economic Literature · doi:10.1257/jel.20201595 · Cited by 570
Bonikowski, B., Feinstein, Y., & Bock, S. (2021) · American Journal of Sociology · doi:10.1086/717103 · Cited by 88
Metadata
- Authors
- Castanho Silva, B., Jungkunz, S., Helbling, M., & Littvay, L.
- Venue
- Political Research Quarterly
- Publisher
- SAGE Publications
- Published
- 2019-03-12
- Volume
- 73
- Issue
- 2
- Pages
- 409-424
- ISSN
- 1065-9129 (ISSN-L)
- 1938-274X
- OpenAlex
- W2921238468
- Cited by
- 333
- References
- 55
- FWCI
- 131.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.