The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Assessing the Reliability and Validity of Expert Interviews
Open accessAbstract
Testing the reliability of experts should be a key element of expert interviews. Using the Condorcet Jury Theorem, it is shown that expert reliability can provide an indication of the validity of expert-opinion data. The theoretical framework is applied to expert-interview data collected in the Domestic Structures and European Integration (DOSEI) project. Special attention is paid to the role of ‘leading’ experts and salient issues. Evaluating the DOSEI data, the main findings are that (i) with some exceptions, there are acceptable levels of inter-expert agreement, (ii) whether the leading expert is included or not does not make a large difference to expert agreement, and (iii) experts are more in agreement on salient issues.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Designing Social Inquiry: Scientific Inference in Qualitative Research
King, G., Keohane, R. O., & Verba, S. (1994) · Princeton University Press · doi:10.1515/9781400821211 · Cited by 7,225
Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability
Lombard, M., Snyder-Duch, J., & Bracken, C. C. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00826.x · Cited by 3,068
Reliability in content analysis: some common misconceptions and recommendations.
Krippendorff, K. (2004) · Human Communication Research · doi:10.1093/hcr/30.3.411 · Cited by 1,027
Cited by
Reliability and validity of the 2002 and 2006 Chapel Hill expert surveys on party positioning
Hooghe, L., Bakker, R., Brigevich, A., De Vries, C., Edwards, E., Marks, G., Rovny, J., Steenbergen, M., & Vachudova, M. (2010) · European Journal of Political Research · doi:10.1111/j.1475-6765.2009.01912.x · Cited by 495
Measuring Interest Group Influence in the EU: A Note on Methodology
Dür, A. (2008) · European Union Politics · doi:10.1177/1465116508095151 · Cited by 292
Moustakas, E., Lamba, N., Mahmoud, D., & Ranganathan, C. (2020) · 2020 International Conference on Cyber Security and Protection of Digital Services (Cyber Security) · doi:10.1109/cybersecurity49315.2020.9138861 · Cited by 260
Montal, T., & Reich, Z. (2017) · Digital Journalism · doi:10.1080/21670811.2016.1209083 · Cited by 208
Chohan, S. R., Hu, G., Khan, A. U., Pasha, A. T., & Sheikh, M. A. (2021) · Transforming Government: People, Process and Policy · doi:10.1108/tg-05-2020-0079 · Cited by 26
Metadata
- Authors
- Dorussen, H., Lenz, H., & Blavoukos, S.
- Venue
- European Union Politics
- Publisher
- SAGE Publications
- Published
- 2005-09
- Volume
- 6
- Issue
- 3
- Pages
- 315-337
- ISSN
- 1465-1165 (ISSN-L)
- 1741-2757
- OpenAlex
- W2084206507
- Cited by
- 182
- References
- 5
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the Reliability and Validity of Expert Interviews. https://app.cochat.ai/papers/10.1177/1465116505054835
- The paper
- Dorussen, H., Lenz, H., & Blavoukos, S. (2005). Assessing the Reliability and Validity of Expert Interviews. European Union Politics. https://doi.org/10.1177/1465116505054835
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.