An examination of the factorial and convergent validity of four measures of conspiracist ideation, with recommendations for researchers
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
A number scales have been developed to measure conspiracist ideation, but little attention has been paid to the factorial validity of these scales. We reassessed the psychometric properties of four widely-used scales, namely the Belief in Conspiracy Theories Inventory (BCTI), the Conspiracy Mentality Questionnaire (CMQ), the Generic Conspiracist Beliefs Scale (GCBS), and the One-Item Conspiracy Measure (OICM). Eight-hundred-and-three U.S. adults completed all measures, along with measures of endorsement of 9/11 and anti-vaccination conspiracy theories. Through both exploratory and confirmatory factor analysis, we found that only the BCTI had acceptable factorial validity. We failed to confirm the factor structures of the CMQ and the GBCS, suggesting these measures had poor factorial validity. Indices of convergent validity were acceptable for the BCTI, but weaker for the other measures. Based on these findings, we provide suggestions for the future refinement in the measurement of conspiracist ideation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587
Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006) · The Journal of Educational Research · doi:10.3200/joer.99.6.323-338 · Cited by 6,937 · cited 1×
“However, any modification to the existing model should make theoretical sense, rather than simply from analytical addition or subtraction of a parameter [43] .”
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
A First Course in Factor Analysis
Comrey, A. L., & Lee, H. B. (2013) · doi:10.4324/9781315827506 · Cited by 4,546
Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis
Hayton, J. C., Allen, D. G., & Scarpello, V. (2004) · Organizational Research Methods · doi:10.1177/1094428104263675 · Cited by 3,104 · cited 2×
“The number of factors to be extracted was determined by factor eigenvalues (λ) above 1.0 (the EGV1 criterion), examination of the scree-plot, and-where more than one factor was identified through rotation-the results of parallel analysis [34] .”
BackgroundMethodInfluentialOn the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
The Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?
Lance, C. E., Butts, M. M., & Michels, L. C. (2006) · Organizational Research Methods · doi:10.1177/1094428105284919 · Cited by 2,053 · cited 1×
“Although Nunnally [9] is widely interpreted as indicating that an internal consistency coefficient of .70 is acceptable, this is in fact a myth [45] .”
BackgroundThe Effects of Anti-Vaccine Conspiracy Theories on Vaccination Intentions
Jolley, D., & Douglas, K. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089177 · Cited by 1,232 · cited 4×
“As a second measure of convergent validity, we included an 8-item measure of belief in anti-vaccination conspiracy theories [13] .”
BackgroundResultInfluential
Cited by
Understanding Conspiracy Theories
Douglas, K. M., Uscinski, J. E., Sutton, R. M., Cichocka, A., Nefes, T., Ang, C. S., & Deravi, F. (2019) · Political Psychology · doi:10.1111/pops.12568 · Cited by 1,511
Vraga, E. K., & Bode, L. (2020) · Political Communication · doi:10.1080/10584609.2020.1716500 · Cited by 479
Goreis, A., & Voracek, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00205 · Cited by 299
Self-citationGeorgiou, N., Delfabbro, P., & Balzan, R. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2020.110201 · Cited by 291
Conspiracy theories and the conspiracy mindset: implications for political ideology
Sutton, R. M., & Douglas, K. M. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.02.015 · Cited by 264
Why conspiracy theories matter: A social psychological analysis
Douglas, K. M., & Sutton, R. M. (2018) · European Review of Social Psychology · doi:10.1080/10463283.2018.1537428 · Cited by 161
“…with conspiracy theories spanning topics as diverse as alien landings, the JFK assassination, the death of Princess Diana and the origin of the AIDs virus are sufficiently correlated for their answers to comprise a highly reliable, unifactorial scale (Douglas & Sutton, 2011; Swami et al., 2017).”
BackgroundHow (Ir)rational is it to believe in contradictory conspiracy theories?
Lukić, P., Žeželj, I., & Stanković, B. (2019) · Europe’s Journal of Psychology · doi:10.5964/ejop.v15i1.1690 · Cited by 59
“Namely, CMs content is generic and independent of cultural or historical content; due to abstractness of its items it can be more acceptable to general public in comparison to specific CTs – some of the CMQ items were even criticized to be factual, instead of conspiratorial (Swami et al., 2017).”
BackgroundThe current and retrospective intentional nature exposure scales: development and factorial validity
Wood, C., Barron, D., & Smyth, N. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16224443 · Cited by 36
Self-citation
Metadata
- Authors
- Swami, V., Barron, D., Weis, L., Voracek, M., Stieger, S., & Furnham, A.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-02-23
- Volume
- 12
- Issue
- 2
- Pages
- e0172617
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2590551053
- Cited by
- 191
- References
- 31
- FWCI
- 32.15
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.