Cited by 739Reliability and Agreement in MeasurementPsychometric Methodologies and TestingStatistical Methods and Bayesian Inference

The DOI matches its Crossref record.

THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†

Cronbach, Lee J., Rajaratnam, Nageswari, Gleser, Goldine C.·1963·British Journal of Statistical Psychology

DOI 10.1111/j.2044-8317.1963.tb00206.x

Open this paper in CoChat — free account

Abstract

“Reliability theory” is reinterpreted as a theory regarding the adequac with which one can generalize from one observation to a universe of observations. If the observation is randomly sampled from the universe—whether or not the universe consists of equivalent observations—the intraclass correlation provides an approximate lower bound to the expected value of the desired coefficient of generalizability.

Integrity signals

Registry

Crossref · 10.1111/j.2044-8317.1963.tb00206.x

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Sorted by citations

Items 301–400 of 739

Sources of variance in end-of-course student evaluations
Curby, T. W., McKnight, P. E., Alexander, L. A., et al. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1607249 · Cited by 18
Klassische Testtheorie (KTT)
Moosbrugger, H. (2011) · Springer-Lehrbuch · doi:10.1007/978-3-642-20072-4_5 · Cited by 18
THE GENERALIZABILITY OF STUDENT RATINGS OF COURSES: ASKING THE RIGHT QUESTIONS
SMITH, P. L. (1979) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1979.tb00089.x · Cited by 18
Evaluating Fairness of Automated Scoring in Educational Measurement
Johnson, M., & McCaffrey, D. F. (2023) · Routledge eBooks · doi:10.4324/9781003278658-12 · Cited by 18
How to Support Prescriptive Statements by Empirical Research: Some Missing Parts
Wecker, C. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9208-9 · Cited by 17
The validation of a new quality of life questionnaire for patients with congestive heart failure–an extension of the Cardiac Health Profile
Mannheimer, B., Andersson, B., Carlsson, L., & Währborg, P. (2007) · Scandinavian Cardiovascular Journal · doi:10.1080/14017430701422454 · Cited by 17
Generalizability coefficients are reliability coefficients
O’Brien, R. M. (1995) · Quality & Quantity · doi:10.1007/bf01106066 · Cited by 17
Using a linear mixed-effect model framework to estimate multivariate generalizability theory parameters in R
Jiang, Z., Raymond, M. R., Shi, D., et al. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01399-z · Cited by 17
Generalizability and Decision Studies to Inform Observational and Experimental Research in Classroom Settings
Bottema‐Beutel, K., Lloyd, B. P., Carter, E. W., et al. (2014) · American Journal on Intellectual and Developmental Disabilities · doi:10.1352/1944-7558-119.6.589 · Cited by 17
An Exploratory Study of the Generalizability of Selected Marketing Measures
Rentz, J. O. (1988) · Journal of the Academy of Marketing Science · doi:10.1177/009207038801600319 · Cited by 17
Cortical and subcortical mapping of the allostatic-interoceptive system in the human brain using 7 Tesla fMRIPreprint
Zhang, J., Chen, D., Deming, P., Srirangarajan, T., Theriault, J. E., Kragel, P. A., Hartley, L., Lee, K. M., McVeigh, K., Wager, T. D., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.20.548178 · Cited by 17
Test-Retest Reliability and Construct Validity of the Brief Dark Triad Measurements
Dragostinov, Y., & Mõttus, R. (2022) · Journal of Personality Assessment · doi:10.1080/00223891.2022.2052303 · Cited by 15
“However, many authors have highlighted its limitations, including Cronbach himself (Cronbach et al., 1963; Cronbach & Shavelson, 2004; Murphy & Davidshofer, 2001; Sijtsma, 2009), primarily because the assumption that all scale items measure exactly the same trait is untenable.”
Background
Applying Generalizability Theory to Optimize Analysis of Spontaneous Teacher Talk in Elementary Classrooms
Hollo, A., Staubitz, J. L., & Chow, J. C. (2020) · Journal of Speech Language and Hearing Research · doi:10.1044/2020_jslhr-19-00118 · Cited by 16
The influence of experienced severe road traffic accidents on take-over reactions and non-driving-related tasks in an automated driving simulator study
Weigl, K., Schartmüller, C., Wintersberger, P., Steinhauser, M., & Riener, A. (2021) · Accident Analysis & Prevention · doi:10.1016/j.aap.2021.106408 · Cited by 16
Viscosity and social cohesion in temporal lobe epilepsy.
Rao, S. M., Devinsky, O., Grafman, J. H., et al. (1992) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.55.2.149 · Cited by 16
Reliable assessment of operative performance
Bilgiç, E., Watanabe, Y., McKendy, K. M., et al. (2015) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2015.10.008 · Cited by 16
Homogeneity Indices and Test Length
Tyler, T. A., & Fiske, D. W. (1968) · Educational and Psychological Measurement · doi:10.1177/001316446802800306 · Cited by 16
Identifying Writing Strategies Through Text Analysis
van Wijk, C., & Sanders, T. J. M. (1999) · Written Communication · doi:10.1177/0741088399016001003 · Cited by 16
Developing Criterion-Referenced Tests.
Jackson, R. (1970) · Cited by 16
[Executive function in early childhood and Generalizability Theory: Typical babies and preterm babies].
Villaseñor, Á. B., Riba, S. S. I., & Escolano-Pérez, E. (2010) · PubMed · Cited by 16
Ordinal generalizability theory using an underlying latent variable framework
Ark, T. K. (2015) · cIRcle (University of British Columbia) · doi:10.14288/1.0166304 · Cited by 16
Applying Generalizability Theory to Differentiate Between Trait and State in the Interpersonal Mindfulness Scale (IMS)
Chalmers, R. A., Pratscher, S. D., Bettencourt, B. A., & Medvedev, O. N. (2020) · Mindfulness · doi:10.1007/s12671-020-01520-5 · Cited by 16
Extending Applications of Generalizability Theory-Based Bifactor Model Designs
Vispoel, W. P., Lee, H., Chen, T., & Hong, H. (2023) · Psych · doi:10.3390/psych5020036 · Cited by 15
“Applications of GT are based on three primary assumptions: (a) the universe(s) of generalization is/are clearly defined, (b) facet conditions are experimentally independent, and (c) scores are expressed on equal interval metrics [1] (p.”
BackgroundInfluential
Analyzing Multivariate Generalizability Theory Designs within Structural Equation Modeling Frameworks
Vispoel, W. P., Lee, H., & Hong, H. (2023) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2023.2222913 · Cited by 15
“Generalizability theory (GT; Brennan, 2001a; Cronbach et al., 1963; Cronbach et al., 1972; Shavelson & Webb, 1991) provides a powerful framework for understanding how scores from assessment measures are affected by multiple sources of measurement error.”
Background
Data Quality Control of an Observational Tool to Analyze Football Semiotricity
Marqués-Jiménez, D., & Martínez-Santos, R. (2015) · Cuadernos de Psicología del Deporte · doi:10.4321/s1578-84232015000100021 · Cited by 15
Generalisability in unbalanced, uncrossed and fully nested studies
Narayanan, A., Greco, M. J., & Campbell, J. L. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03606.x · Cited by 15
The implications of unconfounding multisource performance ratings.
Jackson, D. J. R., Michaelides, G., Dewberry, C., Schwencke, B., & Toms, S. (2019) · Journal of Applied Psychology · doi:10.1037/apl0000434 · Cited by 16
“The second reliability-related consideration that has yet to be fully investigated in the multisource performance literature concerns intentions to “generalize” across different sources of error (see Cronbach et al., 1963).”
Background
Probabilistic Foundations for Coefficients of Generalizability
Hunter, J. E. (1968) · Psychometrika · doi:10.1007/bf02289672 · Cited by 15
6: Measurement Techniques In Evaluation
Sjogren, D. D. (1970) · Review of Educational Research · doi:10.3102/00346543040002301 · Cited by 16
“Osburn (1968) discussed the generalizability theory of Cronbach et al. (1963) and concluded that for the theory to hold it would be necessary to develop item generating rules.”
Background
The Estimation of Mean Achievement Scores for Schools by the Item-Sampling Technique
Cahen, L. S., Romberg, T. A., & Zwirner, W. W. (1970) · Educational and Psychological Measurement · doi:10.1177/001316447003000104 · Cited by 15
Intraclass Correlation as an Approximation to the Coefficient of Generalizability
Cronbach, L. J., Ikeda, H., & Avner, R. A. (1964) · Psychological Reports · doi:10.2466/pr0.1964.15.3.727 · Cited by 15
Self-citation
Conceptualising and interpreting reliability
Johnson, S., & Johnson, R. (2010) · Digital Education Resource Archive (University College London) · Cited by 15
The affectability of writing assessment scores: a G-theory analysis of rater, task, and scoring method contribution
Khodi, A. (2021) · Language Testing in Asia · doi:10.1186/s40468-021-00134-5 · Cited by 14
“For the first time, G-theory was introduced by Cronbach et al. (1963, b) to the field of education and psychology. Briesch et al. (2014) stated that G-theory estimates the proportion of multiple sources of variances within the framework of ANOVA, and in line with this definition, Bachman (1990) asserted that “It const…”
BackgroundMethodInfluential
A Randomized Controlled Trial for Audiovisual Multisensory Perception in Autistic Youth
Feldman, J. I., Dunham, K., DiCarlo, G. E., Cassidy, M. M., Liu, Y., Suzman, E., Williams, Z. J., Pulliam, G., Kaiser, S., Wallace, M. T., et al. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-022-05709-6 · Cited by 18
The Geometry of Probability, Statistics, and Test Theory
Zimmerman, D. W., & Zumbo, B. D. (2001) · International Journal of Testing · doi:10.1080/15305058.2001.9669476 · Cited by 14
Operationalism and realism in psychometrics
Vessonen, E. (2019) · Philosophy Compass · doi:10.1111/phc3.12624 · Cited by 14
Generalizability Theory: An Analysis of Variance Approach to Measurement Problems in Educational Assessment
Alkharusi, H. (2011) · Journal of Studies in Education · doi:10.5296/jse.v2i1.1227 · Cited by 14
A Family of Measures to Evaluate Scale Reliability in a Longitudinal Setting
Laenen, A., Alonso, A., Molenberghs, G., & Vangeneugden, T. (2008) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2008.00554.x · Cited by 14
“…the most important attempt to extend the concept of reliability to a longitudinal scenario came from generalizability theory (G-theory), which was developed to model explicitly the multiple sources of variation that are present in a measurement system (Cronbach et al., 1963, 1972; Brennan, 2001).”
Background
What measurement is all about
Saint‐Mont, U. (2012) · Theory & Psychology · doi:10.1177/0959354311429997 · Cited by 14
“Yet this attitude has been much criticized, in particular by Duncan (1984), to whom we owe the title of this section (see his chap.”
Background
Open Peer Commentary and Author'S Response
Asendorpf, J. B., Balliet, D. P., Righetti, F., Blackie, L. E. R., Jayawickreme, E., Blum, G. S., Schmitt, M., Donnellan, M. B., Corker, K. S., Dunlop, W. L., et al. (2018) · European Journal of Personality · doi:10.1002/per.2174 · Cited by 15
The association of early blood oxygenation with child development in preterm infants with acute respiratory disorders
Smith, K. E., Keeney, S. E., Zhang, L., Perez-Polo, J. R., & Rassin, D. K. (2007) · International Journal of Developmental Neuroscience · doi:10.1016/j.ijdevneu.2007.09.006 · Cited by 14
TRAIT‐TREATMENT INTERACTIONS AND LEARNING1
Berliner, D. C., & Cahen, L. S. (1972) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1972.tb00448.x · Cited by 14
Measuring the quality of hospital doctors through colleague and patient feedback
Narayanan, A., Greco, M. J., Powell, H., et al. (2011) · Journal of Management & Marketing in Healthcare · doi:10.1179/1753304x11y.0000000006 · Cited by 13
Improving the attention span of elementary school children for physical education through an NAO robotics platform in developed countries
López-Caudana, E. O., Ponce, P., Mazón, N., & Reyes, G. E. B. (2022) · International Journal on Interactive Design and Manufacturing (IJIDeM) · doi:10.1007/s12008-022-00851-y · Cited by 13
“The measure of reliability using Cronbach [40] assumes that the items (measured on a Likert scale) measure the same construct and are highly correlated [41].”
Method
Evaluating validity evidence for 2 instruments developed to assess students' surgical skills in a simulated environment
Farrell, R. M., Gilbert, G. E., Betance, L., Huck, J., Hunt, J., Dundas, J. M., & Pope, E. R. (2022) · Veterinary Surgery · doi:10.1111/vsu.13791 · Cited by 16
Factorial structure of the perception of risk factors for type 2 diabetes scale: exploratory and confirmatory factor analyses
Sousa, V. D., Ryan‐Wenger, N. A., Driessnack, M., & Jaber, A. F. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2009.01276.x · Cited by 13
“This approach is widely accepted when developing and evaluating psychometric properties of new research instruments or scales [37,38].”
BackgroundMethod
Episodic organization in discourse and valid measurement in the sciences*
Oller, J. W., & Chen, L. (2007) · Journal of Quantitative Linguistics · doi:10.1080/09296170701379336 · Cited by 13
“Logically, a general theory of signs thus provides hope for the unified validity sought by Messick (1993, 1998) and alluded to, in principle, by Stevens (1968), also in generalizability theory (Cronbach et al., 1963; Shavelson et al., 1989).”
Background
Fundamentals of Measurement and Assessment in Psychology
Reynolds, C. R. (1998) · Comprehensive Clinical Psychology · doi:10.1016/b0080-4270(73)00002-x · Cited by 13
Correlated Effects in Generalizability Studies
Smith, P. L., & Luecht, R. M. (1992) · Applied Psychological Measurement · doi:10.1177/014662169201600302 · Cited by 12
Integration of Concepts of Reliability and Standard Error of Measurement
Horn, J. L. (1971) · Educational and Psychological Measurement · doi:10.1177/001316447103100104 · Cited by 13
Obtaining Generalizability Coefficients for Clinical Evaluations
Boodoo, G. M., & O’Sullivan, P. (1982) · Evaluation & the Health Professions · doi:10.1177/016327878200500308 · Cited by 13
Congeneric Modeling of Reliability Using Censored Variables
Brown, R. (1989) · Applied Psychological Measurement · doi:10.1177/014662168901300205 · Cited by 12
The Role of Assessment in Clinical Psychology
SECHREST, L. B., Stickle, T. R., & Stewart, M. (1998) · Comprehensive Clinical Psychology · doi:10.1016/b0080-4270(73)00013-4 · Cited by 13
An Analysis of Variance Framework for Matrix Sampling
Sirotnik, K. (1970) · Educational and Psychological Measurement · doi:10.1177/001316447003000410 · Cited by 14
Integrating Bifactor Models into a Generalizability Theory Based Structural Equation Modeling Framework
Vispoel, W. P., Lee, H., Xu, G., & Hong, H. (2022) · The Journal of Experimental Education · doi:10.1080/00220973.2022.2092833 · Cited by 12
“…explicit assumptions of score dimensionality and typically rendering reliability indices reflecting random rather than classical parallelism (see, e.g., Brennan, 2010; Cronbach et al., 1963, 1972; Vispoel, Lee, et al., in press; Vispoel et al., 2018a, 2018b, 2019; Vispoel, Xu, & Schneider, 2021).”
Background
Burnout and quality of life in Portuguese healthcare professionals working in oncology and palliative care—a preliminary study
Gonçalves, F., & Gaudêncio, M. (2023) · BMC Palliative Care · doi:10.1186/s12904-023-01273-7 · Cited by 18
“Before determining Cronbach’s alpha indexes [29], the descriptive statistics of each item observed at each scale were determined, namely the mean and the standard deviation.”
Method
Analyzing and Comparing Univariate, Multivariate, and Bifactor Generalizability Theory Designs for Hierarchically Structured Personality Traits
Vispoel, W. P., Lee, H., Chen, T., & Hong, H. (2023) · Journal of Personality Assessment · doi:10.1080/00223891.2023.2268193 · Cited by 15
“This follows from GT requiring no explicit assumptions about the content of the universe or statistical properties of scores (Cronbach et al., 1963, p. 145).”
BackgroundMethod
Investigating Stable and Dynamic Aspects of the Vietnamese Self-Compassion Scale using Generalisability Theory
Truong, Q. C., Nguyen, T. M., An, N. H., Medvedeva, A., & Medvedev, O. N. (2022) · Mindfulness · doi:10.1007/s12671-022-01950-3 · Cited by 13
“G-Theory is an extension of CTT and can evaluate possible sources of measurement error that may influence the reliability of an instrument (Allen & Yen, 1979; Cronbach et al., 1963).”
BackgroundMethod
Development and validation of a measure of elementary teachers' science content knowledge in two multiyear teacher professional development intervention projects
Maerten‐Rivera, J., Huggins‐Manley, A. C., Adamson, K., Lee, O., & Llosa, L. (2015) · Journal of Research in Science Teaching · doi:10.1002/tea.21198 · Cited by 12
Applying generalizability theory to examine assessments of subjective cognitive complaints: whose reports should we rely on – participant versus informant?
Truong, Q. C., Choo, C. C., Numbers, K. T., Merkin, A., Brodaty, H., Kochan, N. A., Sachdev, P. S., Feigin, V. L., & Medvedev, O. N. (2021) · International Psychogeriatrics · doi:10.1017/s1041610221000363 · Cited by 16
“…measurement consists of true variance and error variance presented as a single factor, G-theory utilizes ANOVA to estimate all possible sources of error variance that may affect the main outcome variable as well as the accuracy of the measurement itself (Allen and Yen, 2001; Cronbach et al., 1963).”
Method
A Monte Carlo Study of Confidence Interval Methods for Generalizability Coefficient
Jiang, Z., Raymond, M. R., DiStefano, C., Shi, D., Liu, R., & Sun, J. (2021) · Educational and Psychological Measurement · doi:10.1177/00131644211033899 · Cited by 12
“Generalizability theory (G-theory) provides a conceptual framework and statistical procedures for evaluating the reliability of behavioral measurements such as test scores, performance evaluations, and survey ratings (Cronbach et al., 1963).”
Background
Using longitudinal data from a clinical trial in depression to assess the reliability of its outcome scales
Laenen, A., Alonso, A., Molenberghs, G., Vangeneugden, T., & Mallinckrodt, C. H. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.09.010 · Cited by 12
“…of the most important attempts to extend reliability theory to more general settings came with the development of Generalizability theory (G-theory; Cronbach et al 1963, 1972), which is based on analysis-of-variance models with random effects, and was developed to model the multiple sources of…”
Open Peer Commentary and Author'S Response
Heimann, A. L., & Ingold, P. V. (2017) · European Journal of Personality · doi:10.1002/per.2119 · Cited by 12
A Note on Design of Test Experiments
Osburn, H. G. (1967) · Educational and Psychological Measurement · doi:10.1177/001316446702700402 · Cited by 12
ITEMS AND PERSONS: FORMAL DUALS AND PSYCHOLOGICAL DIFFERENCES
Fiske, D. W. (1968) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0304_2 · Cited by 12
Estimating the magnitude of anxiety from speech
Gottschalk, L. A., & Frank, E. C. (1967) · Systems Research and Behavioral Science · doi:10.1002/bs.3830120403 · Cited by 12
The Secondary School Administrator and Perceived Teacher Participation in the Decision-Making Process
Ambrosie, F., & Heller, R. W. (1972) · The Journal of Experimental Education · doi:10.1080/00220973.1972.11011344 · Cited by 12
Components of Reliability
LaForge, R. (1965) · Psychometrika · doi:10.1007/bf02289448 · Cited by 12
How to Estimate Intraclass Correlation Coefficients for Interrater Reliability from Planned Incomplete Data
ten Hove, D., Jorgensen, T. D., & van der Ark, L. A. (2025) · Multivariate Behavioral Research · doi:10.1080/00273171.2025.2507745 · Cited by 16
“As mentioned before, ICCs are closely related to generalizability theory (Brennan, 2001; Cronbach et al., 1963) which distinguishes Generalizability studies and Decision studies.”
Influential
Experimentelle Schmerizinduktion im algesimetrischen Humanversuch
Göbel, H., & Westphal, W. (1989) · Der Schmerz · doi:10.1007/bf02527484 · Cited by 11
Measuring teachers’ competence to monitor student interaction in collaborative learning settings
Wiedmann, M., Kaendler, C., Leuders, T., Spada, H., & Rummel, N. (2019) · Unterrichtswissenschaft · doi:10.1007/s42010-019-00047-6 · Cited by 11
Investigating stable and dynamic aspects of student motivation using generalizability theory
Lyndon, M., Medvedev, O. N., Chen, Y., & Henning, M. A. (2019) · Australian Journal of Psychology · doi:10.1111/ajpy.12276 · Cited by 14
Responding to Low Coefficient Alpha: Potential Alternatives to the File Drawer
Chretien, J. L., Nimon, K., Reio, T. G., & Lewis, J. (2020) · Human Resource Development Review · doi:10.1177/1534484320924151 · Cited by 12
“Based on his revelation, Cronbach began to sketch the components of variance approach to reliability from which he and his associates developed the generalizability theory (G theory; Cronbach et al., 1963, 1972).”
Method
Evaluating the validity, reliability and clinical utility of the Music therapy Sensory Instrument for Cognition, Consciousness and Awareness (MuSICCA): protocol of a validation study
Pool, J., Siegert, R. J., Taylor, S. M., Dunford, C., & Magee, W. L. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-039713 · Cited by 11
Analyzing Complete Generalizability Theory Designs Using Structural Equation Models
Vispoel, W. P., Hong, H., Lee, H., et al. (2023) · Applied Measurement in Education · doi:10.1080/08957347.2023.2274573 · Cited by 11
“Generalizability theory (GT; Brennan, 2001; Cronbach, Gleser, Nanda, & Rajaratnam, 1972; Cronbach, Rajaratnam, & Gleser, 1963; Shavelson & Webb, 1991) represents a comprehensive framework for evaluating score consistency for both norm and criterion referencing purposes that allows for estimation of…”
Background
La evaluación de la eficiencia en la intervención familiar: generalizabilidad y optimización del Programa Experiencial para Padres
Blanco-Villaseñor, Á., López, J. R. R., & Vermaes, I. P. R. (2000) · Psicothema · Cited by 11
Models of Inference in Evaluating Brain-Behavior Relationships in Children
Fennell, E. B., & Bauer, R. M. (2008) · Springer eBooks · doi:10.1007/978-0-387-78867-8_10 · Cited by 11
Creating short forms for construct measures: The role of exchangeable forms
Hagtvet, K. A., & Sipos, K. (2017) · Pedagogika · Cited by 11
An exploratory study of the generalizability of selected marketing measures
Rentz, J. O. (1988) · Journal of the Academy of Marketing Science · doi:10.1007/bf02723332 · Cited by 11
Sources of Unreliability in the Diagnosis of Substance Dependence
Feinn, R., Gelernter, J., Cubells, J. F., Farrer, L., & Kranzler, H. R. (2009) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2009.70.475 · Cited by 10
“An advantage of generalizability theory is its ability to estimate both inter-rater and intra-rater reliabilities from the same dataset simultaneously (Cronbach et al., 1963).”
Background
A Generalizability Analysis of the Meaning in Life Questionnaire for Chinese Adolescents
Chen, W., & Gao, R. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.687589 · Cited by 10
Assessing Parent-Adolescent Substance Use Discussions Using the Continuous Assessment of Interpersonal Dynamics
Meisel, S. N., Colder, C. R., & Hopwood, C. J. (2022) · Journal of Personality Assessment · doi:10.1080/00223891.2021.2019051 · Cited by 10
“Generalizability theory is an extension of classical test theory and produces reliability coefficients similar to inter-rater reliability coefficients, such as the intraclass correlation (Cranford et al., 2006; Cronbach et al., 1963).”
Background
The Impact of Business Education on Students’ Moral Competency
Stachowicz-Stanusch, A. (2011) · Vision The Journal of Business Perspective · doi:10.1177/097226291101500207 · Cited by 10
Losing Control of Company Information in the Recruitment Process: The Impact of LinkedIn on Organizational Attraction
Brouer, R. L., Stefanone, M. A., Badawy, R., Egnoto, M. J., & Seitz, S. R. (2015) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2015.226 · Cited by 10
“The robustness of the sample enhances the study’s generalizability to the broader workforce [16] by minimizing the sampling error that might occur from sampling only one organization or group.”
Background
Assessing agreement with repeated measures for random observers
Chen, C., & Barnhart, H. X. (2011) · Statistics in Medicine · doi:10.1002/sim.4353 · Cited by 10
A new tool for assessing short debriefings after immersive simulation: validity of the SHORT scale
Rivière, É., Aubin, E., Tremblay, S.-L., Lortie, G., & Chiniara, G. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1503-4 · Cited by 10
Exploring the Multiverse of Analytical Decisions in Scaling Educational Large-Scale Assessment Data: A Specification Curve Analysis for PISA 2018 Mathematics Data
Robitzsch, A. (2022) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe12070054 · Cited by 10
Perspectives on the Relationship Between Job Performance and Ratings of Job Performance
Murphy, K. R. (2008) · Industrial and Organizational Psychology · doi:10.1111/j.1754-9434.2008.00039.x · Cited by 10
The Calculation of Reliability From a Split-Plot Factorial Design
Brennan, R. L. (1975) · Educational and Psychological Measurement · doi:10.1177/001316447503500404 · Cited by 10
Test-retest reliability of willingness to pay
Shiell, A., & Hawe, P. (2006) · The European Journal of Health Economics · doi:10.1007/s10198-006-0349-y · Cited by 10
“Generalizability theory was devised by Cronbach and colleagues [3] to overcome this shortcoming.”
Background
True Scores, Error, Reliability, and Unit of Analysis in Environment and Behavior Research
Levine, D. W. (1994) · Environment and Behavior · doi:10.1177/001391659402600207 · Cited by 10
Inferential Procedures for Multifaceted Coefficients of Generalizability
Schroeder, M. L., & Hakstian, A. R. (1990) · Psychometrika · doi:10.1007/bf02294759 · Cited by 10
VERBAL MEDIATORS AND CUE DISCRIMINATION IN THE TRANSITION FROM NONCONSERVATION TO CONSERVATION OF NUMBER
Peters, D. L. (1970) · Child Development · doi:10.1111/j.1467-8624.1970.tb01025.x · Cited by 14
Validating performance assessments: Measures that may help to evaluate students’ expertise in ‘doing science’
Hild, P., Gut, C., & Brückmann, M. (2019) · Research in Science & Technological Education · doi:10.1080/02635143.2018.1552851 · Cited by 9
“Different sources of measurement errors (‘facets’) may be investigated within generalisability (G) studies (Brennan 1996; Cronbach, Rajaratnam, and Gleser 1963).”
Background
Implementing Core Entrustable Professional Activities in Undergraduate Medical Education: A Psychometric Study
Violato, C., Englander, R., Dale, E. D., & Gauer, J. L. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005907 · Cited by 10
Measurement and Generalizability
Mayfield, M. R., & Mayfield, J. R. (2017) · Springer eBooks · doi:10.1007/978-3-319-66930-4_9 · Cited by 9
Reliability of the Analytic Rubric and Checklist for the Assessment of Story Writing Skills: G and Decision Study in Generalizability Theory
Uzun, N. B., Alıcı, D., & Aktaş, M. (2018) · European Journal of Educational Research · doi:10.12973/eu-jer.8.1.169 · Cited by 9
Multifactorial assessment of measurement errors affecting intraoral quantitative sensory testing reliability
Moana-Filho, E. J., Alonso, A. A., Kapos, F. P., et al. (2017) · Scandinavian Journal of Pain · doi:10.1016/j.sjpain.2017.03.007 · Cited by 9
Estudos da Consistência Interna e Fatorial Confirmatórioda Escala Toronto de Alexitimia-20 (ETA-20)
Wiethaeuper, D., Balbinotti, M. A. A., Pelisoli, C., & Barbosa, M. L. L. (2005) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 9
Applying Concepts of Generalizability Theory on Data from Experimental Pain Studies to Investigate Reliability
Pryseley, A., Ledent, E. Y., Drewes, A. M., Staahl, C., Olesen, A. E., & Arendt‐Nielsen, L. (2009) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/j.1742-7843.2009.00408.x · Cited by 9

Authors: Cronbach, L. J., Rajaratnam, N., & Gleser, G. C.
Affiliations: University of Illinois Urbana-Champaign (US)
Corresponding author: Rajaratnam, Nageswari
Venue: British Journal of Statistical Psychology
Publisher: Wiley
Published: 1963-11
Volume: 16
Issue: 2
Pages: 137-163
ISSN: 0950-561X (ISSN-L)
DOI: 10.1111/j.2044-8317.1963.tb00206.x
OpenAlex: W2023420063
Cited by: 737
References: 0
Citations by year: 2026: 17 · 2025: 20 · 2024: 28 · 2023: 40 · 2022: 31 · 2021: 29 · 2020: 29 · 2019: 21 · 2018: 31 · 2017: 27 · 2016: 23 · 2015: 24 · 2014: 22 · 2013: 14 · 2012: 21
FWCI: 40.77
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor, 17443 d)
Locations: British Journal of Statistical Psychology (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: generalizability theory, reliability theory, intraclass correlation coefficient, random sampling, lower bounds, measurement reliability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cited by

Related

Metadata

Record

About these checks