The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Evaluating expert judgments
Open accessAbstract
Although expert surveys have gained a prominent place in comparative studies of party positions on issues, their validity has been called into question. In this article, some of the validity concerns are evaluated in the context of the authors' own expert survey on national party positions vis‐à‐vis European integration. One goal of the article is to demonstrate that this expert survey produces valid measures of party positions. An equally important goal, however, is to suggest some methods that can help in assessing the quality of expert survey data. These methods, which are rooted in psychometric theory, are applicable in a variety of contexts and are easily implemented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Courgeau, D., & Goldstein, H. (1997) · Population (French Edition) · doi:10.2307/1534624 · Cited by 2,562
Searle, S. R., Casella, G., & McCulloch, C. E. (1992) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316856 · Cited by 1,926
Mapping Policy Preferences: Estimates for Parties, Electors, and Governments 1945-1998
Budge, I., Klingemann, H., Volkens, A., Bara, J. L., & Tanenbaum, E. (2001) · Medical Entomology and Zoology · Cited by 1,508
Modeling Multilevel Data Structures
Steenbergen, M. R., & Jones, B. S. (2002) · American Journal of Political Science · doi:10.2307/3088424 · Cited by 1,503
Self-citationStatistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
Mapping Policy Preferences: Estimates for Parties, Electors, and Governments 1945—1998
Budge, I., Klingemann, H.-D., Volkens, A., Bara, J., Tanenbaum, E., Fording, R. C., Hearl, D. J., Kim, H. M., Mcdonald, M. D., & Mendes, S. M. (2001) · doi:10.1093/oso/9780199244003.001.0001 · Cited by 1,260
STATISTICAL ANALYSIS OF SETS OF CONGENERIC TESTS*
Jo̎reskog, K. G. (1969) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1969.tb00777.x · Cited by 1,203
Expert Interpretations of Party Space and Party Locations in 42 Societies
Huber, J., & Inglehart, R. (1995) · Party Politics · doi:10.1177/1354068895001001004 · Cited by 1,161
Erikson, R. S., MacKuen, M., & Stimson, J. A. (2001) · Medical Entomology and Zoology · Cited by 1,077
Politics, Parties, and Pressure Groups.
Matthews, D. R., & Key, V. O. (1958) · American Sociological Review · doi:10.2307/2088925 · Cited by 965
Laver, M., & Hunt, W. B. (1992) · Cited by 940
Left–Right Political Scales: Some ‘Expert’ Judgments
Castles, F. G., & Mair, P. (1984) · European Journal of Political Research · doi:10.1111/j.1475-6765.1984.tb00080.x · Cited by 909
Measurement Errors in Surveys.
Vogel, F. A., Biemer, P. P., Groves, R. M., Lyberg, L. E., Mathiowetz, N. A., & Sudman, S. (1992) · Journal of the American Statistical Association · doi:10.2307/2290676 · Cited by 697
Measuring party orientations towards European integration: results from an expert survey
Ray, L. (1999) · European Journal of Political Research · doi:10.1023/a:1007009106184 · Cited by 521
Measurement Errors in Surveys.
Tanur, J. M., Biemer, P. P., Groves, R. M., Lyberg, L. E., Mathiowetz, N. A., & Sudman, S. (1993) · Contemporary Sociology · doi:10.2307/2074470 · Cited by 492
Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach
Andrews, F. M. (1984) · Public Opinion Quarterly · doi:10.1086/268840 · Cited by 415
Alvarez, R. M. (1997) · Choice Reviews Online · doi:10.5860/choice.35-2385 · Cited by 402
Hard Choices, Easy Answers: Values, Information, and American Public Opinion
Alvarez, R. M., & Brehm, J. (2002) · Princeton University Press eBooks · doi:10.1515/9780691220192 · Cited by 389
Alvarez, R. (1997) · University of Michigan Press eBooks · doi:10.3998/mpub.15100 · Cited by 332
Estimating the Policy Position of Political Actors
Laver, M. (2003) · Routledge eBooks · doi:10.4324/9780203451656 · Cited by 313
Hard choices, easy answers: values, information, and American public opinion
(2003) · Choice Reviews Online · doi:10.5860/choice.40-4280 · Cited by 303
Expert judgements of party policy positions: uses and limitations in political research
Budge, I. (2000) · European Journal of Political Research · doi:10.1023/a:1007065520497 · Cited by 302
Issues and Party Support in Multiparty Systems
Macdonald, S. E., Listhaug, O., & Rabinowitz, G. (1991) · American Political Science Review · doi:10.2307/1963938 · Cited by 272
Crossvalidating data on party positioning on European integration
Marks, G., Hooghe, L., Steenbergen, M. R., & Bakker, R. (2007) · Electoral Studies · doi:10.1016/j.electstud.2006.03.007 · Cited by 254
Self-citationPolitics, Parties, and Pressure Groups
Hossom, K., & Key, V. O. (1948) · The Western Political Quarterly · doi:10.2307/442300 · Cited by 247
Eliciting and analyzing expert judgment: A practical guide
Meyer, M., NRC, Lab., N. (. S. L. A. N., & Booker, J. (1990) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/5088782 · Cited by 229
Contesting Europe? The salience of European integration as a party issue
Steenbergen, M. R., & Scott, D. J. (2004) · European Integration and Political Conflict · doi:10.1017/cbo9780511492013.010 · Cited by 207
Self-citationJayasinghe, U. W., Marsh, H. W., & Bond, N. (2003) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/1467-985x.00278 · Cited by 139
Merrill, S., Grofman, B., & Adams, J. (2001) · European Journal of Political Research · doi:10.1111/1475-6765.00594 · Cited by 113
Evaluation of Measurement Instruments Using a Structural Modeling Approach
Saris, W. E., & Andrews, F. M. (2004) · Wiley series in probability and statistics · doi:10.1002/9781118150382.ch28 · Cited by 92
The policy space of party manifestos
McDonald, M. D., & Mendes, S. M. (2001) · Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) · doi:10.4324/9780203451656-16 · Cited by 69
Political competition in the European Parliament: evidence from roll call and survey analyses
Thomassen, J., Noury, A. G., & Voeten, E. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511492013.009 · Cited by 47
Research works printed but not linked: 10
- 10.1111/1475-6765.00506 · doi:10.1111/1475-6765.00506 · Paper page
- Eijk C., 2002, European election studies, 1999: Design, implementation and results
- Laver M., 1999, Party policy and cabinet portfolios in the Netherlands, 1998: Results from an expert survey, Acta Politica, 34, 49
- Mair P., 2001, Estimating the policy positions of political actors
- McDonald M.D., 2001, Estimating the policy positions of political actors
- Rasbash J., 2004, A user's guide to MLwiN, version 2.0
- 10.1111/1475-6765.00471 · doi:10.1111/1475-6765.00471 · Paper page
- 10.1093/oxfordjournals.pan.a029816 · doi:10.1093/oxfordjournals.pan.a029816
- Thomassen J.J.A., 2004, European integration and political conflict
- Wessels B., 1999, Political representation in Europe: European Members of Parliament study
Cited by
Party Policy in Modern Democracies
Benoit, K., & Laver, M. (2006) · doi:10.4324/9780203028179 · Cited by 1,616
Cleavage theory meets Europe’s crises: Lipset, Rokkan, and the transnational cleavage
Hooghe, L., & Marks, G. (2018) · Journal of European Public Policy · doi:10.1080/13501763.2017.1310279 · Cited by 1,438
Self-citationMeasuring party positions in Europe: The Chapel Hill expert survey trend file, 1999–2010
Bakker, R., de Vries, C., Edwards, E., Hooghe, L., Jolly, S., Marks, G., Polk, J., Rovny, J., Steenbergen, M., & Vachudova, M. A. (2015) · Party Politics · doi:10.1177/1354068812462931 · Cited by 862
Self-citationPolk, J., Rovny, J., Bakker, R., Edwards, E., Hooghe, L., Jolly, S., Koedam, J., Kostelka, F., Marks, G., Schumacher, G., et al. (2017) · Research & Politics · doi:10.1177/2053168016686915 · Cited by 741
Self-citationChapel Hill Expert Survey trend file, 1999–2019
Jolly, S., Bakker, R., Hooghe, L., Marks, G., Polk, J., Rovny, J., Steenbergen, M., & Vachudova, M. A. (2022) · Electoral Studies · doi:10.1016/j.electstud.2021.102420 · Cited by 741
Self-citation
Metadata
- Authors
- Steenbergen, M. R., & Marks, G.
- Venue
- European Journal of Political Research
- Publisher
- Cambridge University Press (CUP)
- Published
- 2007-05
- Volume
- 46
- Issue
- 3
- Pages
- 347-366
- ISSN
- 0304-4130 (ISSN-L)
- 1475-6765
- OpenAlex
- W2128296295
- Cited by
- 369
- References
- 36
- FWCI
- 17.17
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.