The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Evaluating expert judgments
Open accessAbstract
Although expert surveys have gained a prominent place in comparative studies of party positions on issues, their validity has been called into question. In this article, some of the validity concerns are evaluated in the context of the authors' own expert survey on national party positions vis‐à‐vis European integration. One goal of the article is to demonstrate that this expert survey produces valid measures of party positions. An equally important goal, however, is to suggest some methods that can help in assessing the quality of expert survey data. These methods, which are rooted in psychometric theory, are applicable in a variety of contexts and are easily implemented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Courgeau, D., & Goldstein, H. (1997) · Population (French Edition) · doi:10.2307/1534624 · Cited by 2,562
Searle, S. R., Casella, G., & McCulloch, C. E. (1992) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316856 · Cited by 1,926
Mapping Policy Preferences: Estimates for Parties, Electors, and Governments 1945-1998
Budge, I., Klingemann, H., Volkens, A., Bara, J. L., & Tanenbaum, E. (2001) · Medical Entomology and Zoology · Cited by 1,508
Modeling Multilevel Data Structures
Steenbergen, M. R., & Jones, B. S. (2002) · American Journal of Political Science · doi:10.2307/3088424 · Cited by 1,503
Self-citationStatistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
Mapping Policy Preferences: Estimates for Parties, Electors, and Governments 1945—1998
Budge, I., Klingemann, H.-D., Volkens, A., Bara, J., Tanenbaum, E., Fording, R. C., Hearl, D. J., Kim, H. M., Mcdonald, M. D., & Mendes, S. M. (2001) · doi:10.1093/oso/9780199244003.001.0001 · Cited by 1,260
STATISTICAL ANALYSIS OF SETS OF CONGENERIC TESTS*
Jo̎reskog, K. G. (1969) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1969.tb00777.x · Cited by 1,203
Research works printed but not linked: 10
- 10.1111/1475-6765.00506 · doi:10.1111/1475-6765.00506 · Paper page
- Eijk C., 2002, European election studies, 1999: Design, implementation and results
- Laver M., 1999, Party policy and cabinet portfolios in the Netherlands, 1998: Results from an expert survey, Acta Politica, 34, 49
- Mair P., 2001, Estimating the policy positions of political actors
- McDonald M.D., 2001, Estimating the policy positions of political actors
- Rasbash J., 2004, A user's guide to MLwiN, version 2.0
- 10.1111/1475-6765.00471 · doi:10.1111/1475-6765.00471 · Paper page
- 10.1093/oxfordjournals.pan.a029816 · doi:10.1093/oxfordjournals.pan.a029816
- Thomassen J.J.A., 2004, European integration and political conflict
- Wessels B., 1999, Political representation in Europe: European Members of Parliament study
Cited by
Party Policy in Modern Democracies
Benoit, K., & Laver, M. (2006) · doi:10.4324/9780203028179 · Cited by 1,616
Cleavage theory meets Europe’s crises: Lipset, Rokkan, and the transnational cleavage
Hooghe, L., & Marks, G. (2018) · Journal of European Public Policy · doi:10.1080/13501763.2017.1310279 · Cited by 1,438
Self-citationMeasuring party positions in Europe: The Chapel Hill expert survey trend file, 1999–2010
Bakker, R., de Vries, C., Edwards, E., Hooghe, L., Jolly, S., Marks, G., Polk, J., Rovny, J., Steenbergen, M., & Vachudova, M. A. (2015) · Party Politics · doi:10.1177/1354068812462931 · Cited by 862
Self-citationPolk, J., Rovny, J., Bakker, R., Edwards, E., Hooghe, L., Jolly, S., Koedam, J., Kostelka, F., Marks, G., Schumacher, G., et al. (2017) · Research & Politics · doi:10.1177/2053168016686915 · Cited by 741
Self-citationChapel Hill Expert Survey trend file, 1999–2019
Jolly, S., Bakker, R., Hooghe, L., Marks, G., Polk, J., Rovny, J., Steenbergen, M., & Vachudova, M. A. (2022) · Electoral Studies · doi:10.1016/j.electstud.2021.102420 · Cited by 741
Self-citationParty Competition and European Integration in the East and West: Different Structure, Same Causality
Marks, G., Hooghe, L., Nelson, M., & Edwards, E. (2006) · Comparative Political Studies · doi:10.1177/0010414005281932 · Cited by 617
Self-citationImmigration, Europe and the ‘new’ cultural dimension
Van Der Brug, W., & Van Spanje, J. (2009) · European Journal of Political Research · doi:10.1111/j.1475-6765.2009.00841.x · Cited by 553
Why Electoral Integrity Matters
Norris, P. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781107280861 · Cited by 508
Reliability and validity of the 2002 and 2006 Chapel Hill expert surveys on party positioning
Hooghe, L., Bakker, R., Brigevich, A., De Vries, C., Edwards, E., Marks, G., Rovny, J., Steenbergen, M., & Vachudova, M. (2010) · European Journal of Political Research · doi:10.1111/j.1475-6765.2009.01912.x · Cited by 495
Self-citationWhere do radical right parties stand? Position blurring in multidimensional competition
Rovny, J. (2013) · European Political Science Review · doi:10.1017/s1755773911000282 · Cited by 484
When dimensions collide: The electoral success of issue entrepreneurs
De Vries, C. E., & Hobolt, S. B. (2012) · European Union Politics · doi:10.1177/1465116511434788 · Cited by 450
Issue Entrepreneurship and Multiparty Competition
Hobolt, S. B., & de Vries, C. E. (2015) · Comparative Political Studies · doi:10.1177/0010414015575030 · Cited by 393
When Left Is Right: Party Ideology and Policy in Post-Communist Europe
TAVITS, M., & LETKI, N. (2009) · American Political Science Review · doi:10.1017/s0003055409990220 · Cited by 372
Flank attacks: Populism and left-right radicalism in Western Europe
Rooduijn, M., & Akkerman, T. (2017) · Party Politics · doi:10.1177/1354068815596514 · Cited by 371
Throwing out the Bums: Protest Voting and Unorthodox Parties after Communism
Pop-Eleches, G. (2010) · World Politics · doi:10.1017/s0043887110000043 · Cited by 344
Going green: Explaining issue competition on the environment
Spoon, J., Hobolt, S. B., & Vries, C. E. (2014) · European Journal of Political Research · doi:10.1111/1475-6765.12032 · Cited by 334
Measuring Local Autonomy in 39 Countries (1990–2014)
Ladner, A., Keuffer, N., & Baldersheim, H. (2016) · Regional & Federal Studies · doi:10.1080/13597566.2016.1214911 · Cited by 333
Adams, J. (2012) · Annual Review of Political Science · doi:10.1146/annurev-polisci-031710-101450 · Cited by 315
Politics and Social Spending in Latin America
Huber, E., Mustillo, T., & Stephens, J. D. (2008) · The Journal of Politics · doi:10.1017/s0022381608080407 · Cited by 299
Exploiting the Cracks: Wedge Issues in Multiparty Competition
van de Wardt, M., De Vries, C. E., & Hobolt, S. B. (2014) · The Journal of Politics · doi:10.1017/s0022381614000565 · Cited by 281
Candidate Valence and Ideological Positions in U.S. House Elections
Stone, W. J., & Simas, E. N. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2010.00436.x · Cited by 281
Populist Radical Right Parties in the Nordic Region: A New and Distinct Party Family?
Jungar, A., & Jupskås, A. R. (2014) · Scandinavian Political Studies · doi:10.1111/1467-9477.12024 · Cited by 276
Rooduijn, M., Pirro, A. L. P., Halikiopoulou, D., Froio, C., Van Kessel, S., De Lange, S. L., Mudde, C., & Taggart, P. (2024) · British Journal of Political Science · doi:10.1017/s0007123423000431 · Cited by 275
Where to Focus for Successful Adoption of Building Information Modeling within Organization
Won, J., Lee, G., Dossick, C., & Messner, J. (2013) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0000731 · Cited by 267
Why Do Parties Change Position? Party Organization and Environmental Incentives
Schumacher, G., de Vries, C. E., & Vis, B. (2013) · The Journal of Politics · doi:10.1017/s0022381613000145 · Cited by 267
Norris, P. (2020) · Party Politics · doi:10.1177/1354068820927686 · Cited by 258
Position Taking in European Parliament Speeches
Proksch, S.-O., & Slapin, J. B. (2010) · British Journal of Political Science · doi:10.1017/s0007123409990299 · Cited by 254
Crossvalidating data on party positioning on European integration
Marks, G., Hooghe, L., Steenbergen, M. R., & Bakker, R. (2007) · Electoral Studies · doi:10.1016/j.electstud.2006.03.007 · Cited by 254
Self-citationSearching for Bright Lines in the Trump Presidency
Carey, J. M., Helmke, G., Nyhan, B., Sanders, M., & Stokes, S. (2019) · Perspectives on Politics · doi:10.1017/s153759271900001x · Cited by 159
“9 We follow a common practice in gathering expert survey data on qualitative concepts that are otherwise difficult to measure (e.g., Steenbergen and Marks 2007; Hooghe et al. 2010; Maestas, Buttice, and Stone 2014).”
MethodAchieving Methodological Alignment When Combining QCA and Process Tracing in Practice
Beach, D. (2018) · Sociological Methods & Research · doi:10.1177/0049124117701475 · Cited by 90
“…positions are two different expert surveys on the positions of political parties on European integration (less-more dimension [Ray 1999] for the Amsterdam Treaty (AT) negotiations and the 2002 Chapel Hill expert survey for the Constitutional Treaty (CT) negotiations [Steenbergen and Marks 2007]).”
Background
Metadata
- Authors
- Steenbergen, M. R., & Marks, G.
- Venue
- European Journal of Political Research
- Publisher
- Cambridge University Press (CUP)
- Published
- 2007-05
- Volume
- 46
- Issue
- 3
- Pages
- 347-366
- ISSN
- 0304-4130 (ISSN-L)
- 1475-6765
- OpenAlex
- W2128296295
- Cited by
- 369
- References
- 36
- FWCI
- 17.17
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.