The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Cronbach’s alpha is a statistic commonly quoted by authors to demonstrate that tests and scales that have been constructed or adopted for research projects are fit for purpose. Cronbach’s alpha is regularly adopted in studies in science education: it was referred to in 69 different papers published in 4 leading science education journals in a single year (2015)—usually as a measure of reliability. This article explores how this statistic is used in reporting science education research and what it represents. Authors often cite alpha values with little commentary to explain why they feel this statistic is relevant and seldom interpret the result for readers beyond citing an arbitrary threshold for an acceptable value. Those authors who do offer readers qualitative descriptors interpreting alpha values adopt a diverse and seemingly arbitrary terminology. More seriously, illustrative examples from the science education literature demonstrate that alpha may be acceptable even when there are recognised problems with the scales concerned. Alpha is also sometimes inappropriately used to claim an instrument is unidimensional. It is argued that a high value of alpha offers limited evidence of the reliability of a research instrument, and that indeed a very high value may actually be undesirable when developing a test of scientific knowledge or understanding. Guidance is offered to authors reporting, and readers evaluating, studies that present Cronbach’s alpha statistic as evidence of instrument quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Specifically, all studies using the AAQ and one third of studies using the AAQ-II reported internal consistency below recommended cutoffs (i.e., Cronbach’s alpha > .80; Taber, 2018), with alphas as low as .57 and .51 respectively.”
From Psychological flexibility in older adulthood: a scoping review. (2023) · cites this paper as Taber, 2018
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The internal consistency in our data was moderate ( α = 0.59) on the basis of Taber et al.'s (2018) criteria.”
From Enhancing School Students' Self-Regulated Learning through Generative AI Support: A Randomized Controlled Trial (2026) · cites this paper as Taber et al.'s (2018)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The internal consistency in our data was acceptable ( α = 0.70) on the basis of Taber et al.'s (2018) criteria.”
From Enhancing School Students' Self-Regulated Learning through Generative AI Support: A Randomized Controlled Trial (2026) · cites this paper as Taber et al.'s (2018)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“No study reported good internal consistency for the AAQ, as indicated by Cronbach α > .80 (Taber, 2018).”
From Psychological flexibility in older adulthood: a scoping review. (2023) · cites this paper as Taber, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These findings suggest a number of conceptual and statistical issues (see Taber, 2018; Tavakol & Dennick, 2011), including the possibility that the AAQ and AAQ-II do not measure a common factor among older adults or that, given the broad range of alpha scores (i.e., .51-.94), these measures do not perform consistently in older adult samples.”
From Psychological flexibility in older adulthood: a scoping review. (2023) · cites this paper as Taber, 2018
Experimental — accuracy not yet measured
15 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 13×
“Sijtsma (2009) develops an argument explored in Cronbach’s (1951) seminal paper that alpha does not offer an accurate value for reliability as understood by psychometricians (but rather a lower bound, although Cronbach himself had argued in his 1951 paper that alpha was often a suitable proxy) and suggests that intern…”
BackgroundMethodInfluentialWhat is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 5×
“Cronbach ’ s alpha has been described as ‘ one of the most important and pervasive statistics in research involving test construction and use ’ (Cortina, 1993, p. 98) to the extent that its use in research with multiple-item measurements is considered routine (Schmitt, 1996, p. 350).”
BackgroundInfluentialOn the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
Uses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
Global Patterns in Students’ Views of Science and Interest in Science
van Griethuijsen, R. A. L. F., van Eijck, M. W., Haste, H., den Brok, P. J., Skinner, N. C., Mansour, N., Savran Gencer, A., & BouJaoude, S. (2015) · Research in Science Education · doi:10.1007/s11165-014-9438-6 · Cited by 852
The development of a questionnaire to measure students' motivation towards science learning
Tuan *, H., Chin, C., & Shieh, S. (2005) · International Journal of Science Education · doi:10.1080/0950069042000323737 · Cited by 625
Development and Validation of Instruments to Measure Learning of Expert‐Like Thinking
Adams, W. K., & Wieman, C. E. (2011) · International Journal of Science Education · doi:10.1080/09500693.2010.512369 · Cited by 451
Arslan, H. O., Cigdemoglu, C., & Moseley, C. (2012) · International Journal of Science Education · doi:10.1080/09500693.2012.680618 · Cited by 304
Developing attitude to science scales for use with children of ages from five to eleven years
Pell, T., & Jarvis, T. (2001) · International Journal of Science Education · doi:10.1080/09500690010016111 · Cited by 284
Measuring attitudes to science: Unidimensionality and internal consistency revisited
Gardner, P. L. (1995) · Research in Science Education · doi:10.1007/bf02357402 · Cited by 175
Research works printed but not linked: 1
- National Research Council Committee on Scientific Principles for Educational Research. (2002). Scientific Research in Education. Washington DC: National Academies Press.
Cited by
Zhong, B.-L., Luo, W., Li, H.-M., Zhang, Q.-Q., Liu, X.-G., Li, W.-T., & Li, Y. (2020) · International Journal of Biological Sciences · doi:10.7150/ijbs.45221 · Cited by 3,090
Ferdous, M. Z., Islam, M. S., Sikder, M. T., Mosaddek, A. S. M., Zegarra-Valdivia, J. A., & Gozal, D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0239254 · Cited by 590
An effective blended online teaching and learning strategy during the COVID-19 pandemic
Lapitan, L. D., Tiangco, C. E., Sumalinog, D. A. G., Sabarillo, N. S., & Diaz, J. M. (2021) · Education for Chemical Engineers · doi:10.1016/j.ece.2021.01.012 · Cited by 566
Barbayannis, G., Bandari, M., Zheng, X., Baquerizo, H., Pecor, K. W., & Ming, X. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.886344 · Cited by 555
Tang, Y. M., Chen, P. C., Law, K. M. Y., Wu, C. H., Lau, Y.-Y., Guan, J., He, D., & Ho, G. T. S. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104211 · Cited by 538
Metadata
- Authors
- Taber, K. S.
- Affiliations
- University of Cambridge (GB)
- Corresponding author
- Taber, Keith S.
- ORCID
- Taber, Keith S.
- Venue
- Research in Science Education
- Published
- 2017-06-07
- Volume
- 48
- Issue
- 6
- Pages
- 1273-1296
- ISSN
- 0157-244X (ISSN-L)
- 1573-1898
- OpenAlex
- W2623703952
- Cited by
- 10,679
- References
- 37
- Citations by year
- 2026: 1432 · 2025: 1887 · 2024: 1845 · 2023: 1708 · 2022: 1532 · 2021: 1330 · 2020: 682 · 2019: 199 · 2018: 53 · 2017: 6
- FWCI
- 227.70
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- Research in Science Education (publishedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- University of Cambridge
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Science Education and Pedagogy
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- Cronbach's alpha, research instrument development, reliability statistics, scale development, reporting quality, unidimensionality, science education research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. https://app.cochat.ai/papers/10.1007/s11165-016-9602-2
- The paper
- Taber, K. S. (2018). The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Research in Science Education. https://doi.org/10.1007/s11165-016-9602-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
