Do we measure leadership effectively? Articulating and evaluating scale development psychometrics for best practice
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Abstract Leadership assessment has been a particular point of difficulty for contemporary scholarship, with many practitioners rejecting academically-driven leadership instruments and scales and preferring their own, less rigorous, scales. We believe that current conceptualizations and measurements of leadership are problematic, indicated by contemporary challenges that can be widely understood as failures of leadership (e.g. the Australian Banking Royal Commission and Volkswagen's ‘Dieselgate’). Also, how effective leadership is measured needs to change. This paper presents a systematic review of 17 leadership scales developed in the new millennium. The majority of scales lack some degree of rigor. Our response has been to conduct eighteen critical checks over four stages of scale development: theory generation, item development, content validity, and empirical evaluation. On the premise that understanding past practices, with their limitations, can be used to drive forward a suite of more effective organizational tools, we provide best practice recommendations using contemporary psychometric research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Making sense of cronbach’s alpha.
Tavakol, M., & Dennick, R. (2011) · International Journal of Medical Education · doi:10.5116/ijme.4dfb.8dfd · Cited by 15,126
Costello, A. B., & Osborne, J. (2005) · University of Massachusetts Amherst · doi:10.7275/jyj1-4868 · Cited by 10,297
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810
Structural Equation Modelling: Guidelines for Determining Model Fit
Hooper, D., Coughlan, J., & Mullen, M. R. (2008) · Dublin Institute of Technology · doi:10.21427/d7cf7r · Cited by 8,746
Structural model evaluation and modification: An interval estimation approach
Steiger, J. H. (1990) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2502_4 · Cited by 7,408
A QUANTITATIVE APPROACH TO CONTENT VALIDITY1
LAWSHE, C. H. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01393.x · Cited by 7,313
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
Knowledge management: An organizational capabilities perspective
Gold, A. H., Malhotra, A., & Segars, A. H. (2001) · Journal of Management Information Systems · doi:10.1080/07421222.2001.11045669 · Cited by 6,233
Cited by
Crawford, J., Allen, K.-A., Pani, B., & Cowling, M. (2024) · Studies in Higher Education · doi:10.1080/03075079.2024.2326956 · Cited by 224
“The con fi rmatory fi t index (CFI) and the Tucker-Lewis Index (TLI) were targeted to be below .9 and the Chi-Squared/Degree of Freedom (X 2 / df ) below fi ve as per Crawford and Kelder (2019).”
MethodSelf-citationFrick, N. R. J., Mirbabaie, M., Stieglitz, S., & Salomon, J. (2021) · Journal of Decision Systems · doi:10.1080/12460125.2020.1870065 · Cited by 138
“Likewise, as leadership is known to be perceived subjectively (Crawford & Kelder, 2019), and as environmental events are said to be perceived subjectively, it is necessary to focus on individual differences with regard to the attitude towards a change.”
BackgroundCrawford, J., Cui, Z.-Y. A., & Kewley, D. (2024) · Journal of Small Business Management · doi:10.1080/00472778.2023.2246061 · Cited by 60
Self-citation
Metadata
- Authors
- Crawford, J. A., & Kelder, J.-A.
- Venue
- The Leadership Quarterly
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 30
- Issue
- 1
- Pages
- 133-144
- ISSN
- 1048-9843 (ISSN-L)
- OpenAlex
- W2884744537
- Cited by
- 111
- References
- 44
- FWCI
- 8.39
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Do we measure leadership effectively? Articulating and evaluating scale development psychometrics for best practice. https://app.cochat.ai/papers/10.1016/j.leaqua.2018.07.001
- The paper
- Crawford, J. A., & Kelder, J.-A. (2019). Do we measure leadership effectively? Articulating and evaluating scale development psychometrics for best practice. The Leadership Quarterly. https://doi.org/10.1016/j.leaqua.2018.07.001
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.