Meta-Heuristics in Short Scale Construction: Ant Colony Optimization and Genetic Algorithm
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
The advent of large-scale assessment, but also the more frequent use of longitudinal and multivariate approaches to measurement in psychological, educational, and sociological research, caused an increased demand for psychometrically sound short scales. Shortening scales economizes on valuable administration time, but might result in inadequate measures because reducing an item set could: a) change the internal structure of the measure, b) result in poorer reliability and measurement precision, c) deliver measures that cannot effectively discriminate between persons on the intended ability spectrum, and d) reduce test-criterion relations. Different approaches to abbreviate measures fare differently with respect to the above-mentioned problems. Therefore, we compare the quality and efficiency of three item selection strategies to derive short scales from an existing long version: a Stepwise COnfirmatory Factor Analytical approach (SCOFA) that maximizes factor loadings and two metaheuristics, specifically an Ant Colony Optimization (ACO) with a tailored user-defined optimization function and a Genetic Algorithm (GA) with an unspecific cost-reduction function. SCOFA compiled short versions were highly reliable, but had poor validity. In contrast, both metaheuristics outperformed SCOFA and produced efficient and psychometrically sound short versions (unidimensional, reliable, sensitive, and valid). We discuss under which circumstances ACO and GA produce equivalent results and provide recommendations for conditions in which it is advisable to use a metaheuristic with an unspecific out-of-the-box optimization function.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 3×
“It is easily demonstrated that high values of internal consistency (i.e., Cronbach’s α ) allow no conclusion about the underlying structure of the measure [19,21].”
BackgroundMethodA very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
Rammstedt, B., & John, O. P. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2006.02.001 · Cited by 4,244
Uses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
Benet-Martínez, V., & John, O. P. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.75.3.729 · Cited by 1,996 · cited 1×
“For example, the full NEO Personality Inventory (NEO PI) consists of 240 items [4], which was reduced to a 60-item version [5], a 44-item version [6] and super-short 10-item measures [7,8].”
MethodZinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005) · Psychometrika · doi:10.1007/s11336-003-0974-7 · Cited by 1,439
Limitations of Coefficient Alpha as an Index of Test Unidimensionality1
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700403 · Cited by 522
Heene, M., Hilbert, S., Draxler, C., Ziegler, M., & Bühner, M. (2011) · Psychological Methods · doi:10.1037/a0024917 · Cited by 406 · cited 1×
“Sufficiently high factor loadings have also been found as a necessary prerequisite for the correct interpretation of cutoff values for model fit [58].”
Background
Cited by
A Review of Key Likert Scale Development Advances: 1995–2019
Jebb, A. T., Ng, V., & Tay, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.637547 · Cited by 770
The Development and Validation of the Short Form of the Foreign Language Enjoyment Scale
BOTES, E., DEWAELE, J., & GREIFF, S. (2021) · The Modern Language Journal · doi:10.1111/modl.12741 · Cited by 286
Body Image–Acceptance and Action Questionnaire–5: An Abbreviation Using Genetic Algorithms
Basarkod, G., Sahdra, B., & Ciarrochi, J. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.09.006 · Cited by 77
“…challenging and time-consuming as it often involves a combination of statistical techniques, subjective judgments, and the consideration of varied psychometric criteria (Marsh, Ellis, Parada, Richards, & Heubeck, 2005; Sahdra, Ciarrochi, Parker, & Scrucca, 2016; Sandy, Gosling, & Koelkebeck, 2014).”
BackgroundSchroeders, U., Kubera, F., & Gnambs, T. (2022) · Assessment · doi:10.1177/10731911211033894 · Cited by 76
“Analyzing the meta-analytic results with modern item selection algorithms such as Ant Colony Optimization (Schroeders et al., 2016) several psychometric criteria could be considered simultaneously.”
MethodSelf-citationDo you mind a closer look? A jingle-jangle fallacy perspective on mindfulness
Altgassen, E., Geiger, M., & Wilhelm, O. (2024) · European Journal of Personality · doi:10.1177/08902070231174575 · Cited by 38
Self-citation
Metadata
- Authors
- Schroeders, U., Wilhelm, O., & Olaru, G.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-11-28
- Volume
- 11
- Issue
- 11
- Pages
- e0167110
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2559701890
- Cited by
- 128
- References
- 14
- FWCI
- 5.11
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Meta-Heuristics in Short Scale Construction: Ant Colony Optimization and Genetic Algorithm. https://app.cochat.ai/papers/10.1371/journal.pone.0167110
- The paper
- Schroeders, U., Wilhelm, O., & Olaru, G. (2016). Meta-Heuristics in Short Scale Construction: Ant Colony Optimization and Genetic Algorithm. PLOS ONE. https://doi.org/10.1371/journal.pone.0167110
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.