THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†

Cronbach, Lee J.; Rajaratnam, Nageswari; Gleser, Goldine C.

doi:10.1111/j.2044-8317.1963.tb00206.x

Cited by 739Reliability and Agreement in MeasurementPsychometric Methodologies and TestingStatistical Methods and Bayesian Inference

THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†

Cronbach, Lee J., Rajaratnam, Nageswari, Gleser, Goldine C.·1963·British Journal of Statistical Psychology

DOI 10.1111/j.2044-8317.1963.tb00206.x

Open this paper in CoChat — free account

Abstract

“Reliability theory” is reinterpreted as a theory regarding the adequac with which one can generalize from one observation to a universe of observations. If the observation is randomly sampled from the universe—whether or not the universe consists of equivalent observations—the intraclass correlation provides an approximate lower bound to the expected value of the desired coefficient of generalizability.

Integrity signals

Registry

Crossref · 10.1111/j.2044-8317.1963.tb00206.x

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

G-theory offers a comprehensive analysis of the reliability and generalizability of assessment scores obtained from psychometric scales and identifies specific error sources potentially influencing measurements.
“G-theory, a robust statistical methodology pioneered by Cronbach etal. (1963, 1972), offers a comprehensive analysis of the reliability and generalizability of assessment scores obtained from psychometric scales. It also identifies specific error sources potentially influencing measurements.”
From Investigating state and trait aspects of resilience using Generalizability theory (2024) · cites this paper as Cronbach et al., 1963

Sorted by citations

Scientific Research in Education
National Research Council (2002) · National Academies Press eBooks · doi:10.17226/10236 · Cited by 1,750 · see citing works
Intraclass Reliability Estimates: Testing Structural Assumptions
Werts, C. E., Linn, R. L., & Jöreskog, K. G. (1974) · Educational and Psychological Measurement · doi:10.1177/001316447403400104 · Cited by 1,657 · see citing works
My Current Thoughts on Coefficient Alpha and Successor Procedures
Cronbach, L. J., & Shavelson, R. J. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404266386 · Cited by 1,641 · see citing works
Self-citation
Reliability: A Review of Psychometric Basics and Recent Marketing Practices
Peter, J. P. (1979) · Journal of Marketing Research · doi:10.2307/3150868 · Cited by 1,577 · see citing works
Common methods bias: does common methods variance really bias results?
Doty, D. H., & Glick, W. H. (1998) · Organizational Research Methods · doi:10.1177/109442819814002 · Cited by 1,380 · see citing works
Conceptualizing and Measuring Organizational and Psychological Climate: Pitfalls in Multilevel Research
Glick, W. H. (1985) · The Academy of Management Review · doi:10.5465/amr.1985.4279045 · Cited by 1,286 · see citing works
Internal consistency, retest reliability, and their implications for personality scale validity
McCrae, R. R., Kurtz, J. E., Yamagata, S., & Terracciano, A. (2011) · Personality and Social Psychology Review · doi:10.1177/1088868310366253 · Cited by 874 · see citing works
Evidence for a large-scale brain system supporting allostasis and interoception in humans
Kleckner, I. R., Zhang, J., Touroutoglou, A., Chanes, L., Xia, C., Simmons, W. K., Quigley, K. S., Dickerson, B. C., & Feldman Barrett, L. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0069 · Cited by 641 · see citing works
“To avoid Type I and Type II errors, which are enhanced with the use of stringent statistical thresholds 196 , we opted to separate signal from random noise using replication, according to the mathematics of classical measurement theory 148 .”
Does early responsive parenting have a special importance for children's development or is consistency across early childhood necessary?
Landry, S. H., Smith, K. E., Swank, P. R., Assel, M. A., & Vellet, S. (2001) · Developmental Psychology · doi:10.1037/0012-1649.37.3.387 · Cited by 640 · see citing works
The generalizability crisis
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701 · see citing works
Using a hierarchy-of-effects approach to gauge the effectiveness of corporate social responsibility to generate goodwill toward the firm: Financial versus nonfinancial impacts
Murray, K. B., & Vogel, C. M. (1997) · Journal of Business Research · doi:10.1016/s0148-2963(96)00061-6 · Cited by 551 · see citing works
The axioms and principal results of classical test theory
Novick, M. R. (1966) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(66)90002-2 · Cited by 511 · see citing works
Reliability from α to ω: A tutorial.
Revelle, W., & Condon, D. M. (2019) · Psychological Assessment · doi:10.1037/pas0000754 · Cited by 514 · see citing works
“An alternative approach makes use of Analysis of Variance procedures to decompose the total test variance into that due to individuals, to items, to time, relevant interactions, and to residual (Cronbach et al., 1963; Gleser et al., 1965; Shavelson, Webb, & Rowley, 1989; Vispoel et al., 2018).”
Method
A Sequential System for Personality Scale Development
Jackson, D. N. (1970) · Current topics in clinical and community psychology · doi:10.1016/b978-0-12-153502-5.50008-4 · Cited by 492 · see citing works
Handbook of multimethod measurement in psychology.
Eid, M., & Diener, E. (2006) · American Psychological Association eBooks · doi:10.1037/11383-000 · Cited by 492 · see citing works
Alpha Factor Analysis
Kaiser, H. F., & Caffrey, J. (1965) · Psychometrika · doi:10.1007/bf02289743 · Cited by 488 · see citing works
Coefficient Alpha and the Reliability of Composite Measurements
Novick, M. R., & Lewis, C. (1967) · Psychometrika · doi:10.1007/bf02289400 · Cited by 468 · see citing works
COEFFICIENT ALPHA AND THE RELIABILITY OF COMPOSITE MEASUREMENTS
Novick, M. R., & Lewis, C. (1966) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1966.tb00356.x · Cited by 445 · see citing works
Qual a fiabilidade do alfa de Cronbach? Questões antigas e soluções modernas?
Marôco, J. P., & Garcia‐Marques, T. (2013) · Laboratório de Psicologia · doi:10.14417/lp.763 · Cited by 439 · see citing works
Does Firm Size Comfound the Relationship Between Corporate Social Performance and Firm Financial Performance?
Orlitzky, M. (2001) · Journal of Business Ethics · doi:10.1023/a:1017516826427 · Cited by 439 · see citing works
Use of Medical Mobile Applications Among Hospital Pharmacists in Malaysia
Ming, L. C., Hameed, M. A., Lee, D. D., Apidi, N. A., Lai, P. S. M., Hadi, M. A., Al‐Worafi, Y. M., & Khan, T. M. (2016) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479015624732 · Cited by 412 · see citing works
Predicting cognitive-language and social growth curves from early maternal behaviors in children at varying degrees of biological risk.
Landry, S. H., Smith, K. E., Miller-Loncar, C. L., & Swank, P. R. (1997) · Developmental Psychology · doi:10.1037/0012-1649.33.6.1040 · Cited by 402 · see citing works
Keep it real: rethinking the primacy of experimental control in cognitive neuroscience
Nastase, S. A., Goldstein, A., & Hasson, U. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117254 · Cited by 349 · see citing works
“…to generalize from a contrived experiment artificially isolating a handful of experimental variables to other contexts with five, ten, or perhaps hundreds of dimensions; however this doesn’t discourage us for interpreting experimental results more generally (Cronbach et al., 1963; Yarkoni, 2019).”
Result
A Meta-Analysis of Infant Habituation and Recognition Memory Performance as Predictors of Later IQ
McCall, R. B., & Carriger, M. S. (1993) · Child Development · doi:10.1111/j.1467-8624.1993.tb02895.x · Cited by 337 · see citing works
Review papers : Design and analysis of reliability studies
Dunn, G. (1992) · Statistical Methods in Medical Research · doi:10.1177/096228029200100202 · Cited by 326 · see citing works
Estimating the reliability of continuous measures with cronbach's alpha or the intraclass correlation coefficient: Toward the integration of two traditions
Bravo, G., & Potvin, L. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90076-l · Cited by 316 · see citing works
Strong claims and weak evidence: Reassessing the predictive validity of the IAT.
Blanton, H., Jaccard, J. J., Klick, J., Mellers, B. A., Mitchell, G., & Tetlock, P. E. (2009) · Journal of Applied Psychology · doi:10.1037/a0014665 · Cited by 295 · see citing works
An Introduction to Network Psychometrics: Relating Ising Network Models to Item Response Theory Models
Marsman, M., Borsboom, D., Kruis, J., Epskamp, S., van Bork, R., Waldorp, L., van der Maas, H. L. J., & Maris, G. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1379379 · Cited by 290 · see citing works
When clinical description becomes statistical prediction.
Westen, D., & Weinberger, J. L. (2004) · American Psychologist · doi:10.1037/0003-066x.59.7.595 · Cited by 292 · see citing works
“As generalizability theory suggests (Cronbach et al., 1964; Strube, 2000), one can maximize reliability and generalizability in multiple ways, ranging from intensive interviewer training to increasing the number of items, raters, or participants whose data are pooled, as long as errors are uncorrelated (or can be cont…”
Background
The Generalizability CrisisPreprint
Yarkoni, T. (2019) · doi:10.31234/osf.io/jqw35 · Cited by 275 · see citing works
The Psychiatric Status Schedule
Spitzer, R. L. (1970) · Archives of General Psychiatry · doi:10.1001/archpsyc.1970.01750010043009 · Cited by 277 · see citing works
4 Reliability Coefficients and Generalizability Theory
Webb, N. M., Shavelson, R. J., & Haertel, E. H. (2006) · Handbook of statistics · doi:10.1016/s0169-7161(06)26004-8 · Cited by 272 · see citing works
Generalizability theory for the perplexed: A practical introduction and guide: AMEE Guide No. 68
Blöch, R., & Norman, G. R. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.703791 · Cited by 248 · see citing works
“And that is what G theory does (Cronbach et al. 1963).”
Background
Observational tools for assessment of procedural skills: a systematic review
Ahmed, K., Mišković, D., Darzi, A. W., Athanasiou, T., & Hanna, G. B. (2011) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2010.10.020 · Cited by 229 · see citing works
Measures of fidelity in motivational enhancement: A systematic review
Madson, M. B., & Campbell, T. C. (2006) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2006.03.010 · Cited by 227 · see citing works
The dependability of alliance assessments: The alliance–outcome correlation is larger than you might think.
Crits-Christoph, P. F., Gibbons, M. B. C., Hamilton, J. L., Ring‐Kurtz, S., & Gallop, R. (2011) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0023668 · Cited by 220 · see citing works
Generalizability Theory and Classical Test Theory
Brennan, R. L. (2010) · Applied Measurement in Education · doi:10.1080/08957347.2011.532417 · Cited by 204 · see citing works
Observer Agreement and Reliabilities of Classroom Observational Measures
Frick, T. W., & Semmel, M. I. (1978) · Review of Educational Research · doi:10.3102/00346543048001157 · Cited by 205 · see citing works
“To avoid such assumptions, intraclass correlation or generalizability coefficients have been proposed as a means of determining reliability (Cronbach et al., 1963; Cronbach, Gleser, Nanda, Rajaratnam, 1972; Gleser, Cronbach, & Rajaratnum, 1965; Haggard, 1958; McGaw et al., 1972; Medley & Mitzel, 1958, 1963).”
Method
Replicating, validating, and reducing the length of the consumer perceived value scale
Walsh, G., Shiu, E., & Hassan, L. M. (2013) · Journal of Business Research · doi:10.1016/j.jbusres.2013.05.012 · Cited by 195 · see citing works
INTERRATER CORRELATIONS DO NOT ESTIMATE THE RELIABILITY OF JOB PERFORMANCE RATINGS
Murphy, K. R., & DeShon, R. P. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb02421.x · Cited by 183 · see citing works
A Procedure for Assessing Intervention Fidelity in Experiments Testing Educational and Behavioral Interventions
Nelson, M. C., Cordray, D. S., Hulleman, C. S., Darrow, C. L., & Sommer, E. C. (2012) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-012-9295-x · Cited by 192 · see citing works
The Use and Misuse of Structural Equation Modeling in Management Research: A Review and Critique
Davcik, N. S. (2010) · Journal of Advances in Management Research · doi:10.1108/jamr-07-2013-0043 · Cited by 202 · see citing works
Generalizability in Factorable Domains: "Domain Validity and Generalizability"1
McDonald, R. P. (1978) · Educational and Psychological Measurement · doi:10.1177/001316447803800111 · Cited by 187 · see citing works
A Meta‐Analysis of Reliability Coefficients in Second Language Research
Plonsky, L., & Derrick, D. J. (2016) · Modern Language Journal · doi:10.1111/modl.12335 · Cited by 187 · see citing works
Reliability, Population Classification and Weighting in Multidimensional Poverty Measurement: A Monte Carlo Study
Nájera, H. (2018) · Social Indicators Research · doi:10.1007/s11205-018-1950-z · Cited by 183 · see citing works
“In the following, the discussion focuses on CTT and IRT, given G-theory is an extension of CTT that focuses on assessing multiple sources of error in measurement and is therefore not central to the interests of this paper (Cronbach et al. 1963).”
Background
Institutional Logics in the Study of Organizations: The Social Construction of the Relationship between Corporate Social and Financial Performance
Orlitzky, M. (2011) · Business Ethics Quarterly · doi:10.5840/beq201121325 · Cited by 176 · see citing works
Applying Generalizability Theory using EduG
Cardinet, J., Johnson, S., & Pini, G. (2011) · Routledge eBooks · doi:10.4324/9780203866948 · Cited by 187 · see citing works
“This intraclass correlation is presented in the Cronbach et al. (1963) paper as Equation (30), and is referred to as the Hoyt formula.”
BackgroundMethodInfluential
Ability factors and environmental influences.
Vernon, P. E. (1965) · American Psychologist · doi:10.1037/h0021472 · Cited by 181 · see citing works
Knowledge and clinical problem‐solving
NORMAN, G. R., TUGWELL, P., FEIGHTNER, J. W., MUZZIN, L. J., & JACOBY, L. L. (1985) · Medical Education · doi:10.1111/j.1365-2923.1985.tb01336.x · Cited by 180 · see citing works
Alpha Coefficients for Stratified-Parallel Tests
Cronbach, L. J., Schönemann, P. H., & McKie, D. (1965) · Educational and Psychological Measurement · doi:10.1177/001316446502500201 · Cited by 177 · see citing works
Self-citation
Handbook of Quantitative Methods for Educational Research
Harlow, L. L., & Duerr, S. R. (2013) · SensePublishers eBooks · doi:10.1007/978-94-6209-404-8 · Cited by 177 · see citing works
Tender points in fibromyalgia
Tunks, E., Crook, J., Norman, G. R., & Kalaher, S. (1988) · Pain · doi:10.1016/0304-3959(88)90176-5 · Cited by 174 · see citing works
The Importance of Parenting During Early Childhood for School-Age Development
Landry, S. H., Smith, K. E. L., & Swank, P. R. (2003) · Developmental Neuropsychology · doi:10.1080/87565641.2003.9651911 · Cited by 173 · see citing works
Generalizability theory: A practical guide to study design, implementation, and interpretation
Briesch, A. M., Swaminathan, H., Welsh, M. E., & Chafouleas, S. M. (2014) · Journal of School Psychology · doi:10.1016/j.jsp.2013.11.008 · Cited by 176 · see citing works
Generalizability theory: 1973–1980
Shavelson, R. J., & Webb, N. M. (1981) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1981.tb00625.x · Cited by 165 · see citing works
Intercoder Reliability Estimation Approaches in Marketing: A Generalizability Theory Framework for Quantitative Data
Hughes, M. A., & Garrett, D. E. (1990) · Journal of Marketing Research · doi:10.1177/002224379002700206 · Cited by 172 · see citing works
Metastudies for robust tests of theory
Baribault, B., Donkin, C., Little, D. R., Trueblood, J., Oravecz, Z., van Ravenzwaaij, D., White, C., Boeck, P. D., & Vandekerckhove, J. (2018) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.1708285114 · Cited by 115 · see citing works
“Borrowing from generalizability theory (13), we call these to-be-randomized IVs facets, and we call a study with many facets a metastudy.”
BackgroundMethodInfluential
Generalizability of Scores Influenced by Multiple Sources of Variance
Gleser, G. C., Cronbach, L. J., & Rajaratnam, N. (1965) · Psychometrika · doi:10.1007/bf02289531 · Cited by 151 · see citing works
Self-citation
Rumination: One Construct, Many Features in Healthy Individuals, Depressed Individuals, and Individuals with Lupus
Siegle, G. J., Moore, P. M., & Thase, M. E. (2004) · Cognitive Therapy and Research · doi:10.1023/b:cotr.0000045570.62733.9f · Cited by 148 · see citing works
“Generalizability theory (G theory; Cronbach et al., 1963, 1972) was used to partition variance into these components.”
Method
The effect of leadership and cultural heterogeneity on group performance: A test of the contingency model
Fiedler, F. E. (1966) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(66)90082-5 · Cited by 149 · see citing works
Explanatory style across the life span: Evidence for stability over 52 years.
Burns, M. O., & Seligman, M. E. P. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.56.3.471 · Cited by 152 · see citing works
Coefficient Alpha as an Estimate of Test Reliability Under Violation of Two Assumptions
Zimmerman, D. W., Zumbo, B. D., & Lalonde, C. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053001003 · Cited by 142 · see citing works
A “UNIVERSE‐DEFINED” SYSTEM OF ARITHMETIC ACHIEVEMENT TESTS1
HivelyII, W., Patterson, H. L., & Page, S. H. (1968) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1968.tb00639.x · Cited by 144 · see citing works
Cross-Cultural Generalization and Universality
van de Vijver, F. J. R., & Poortinga, Y. H. (1982) · Journal of Cross-Cultural Psychology · doi:10.1177/0022002182013004001 · Cited by 143 · see citing works
A Framework for Reporting and Interpreting Internal Consistency Reliability Estimates
Onwuegbuzie, A. J., & Daniel, L. G. (2002) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069052 · Cited by 130 · see citing works
Historical view of the influences of measurement and writing theories on the practice of writing assessment in the United States
Behizadeh, N., & Engelhard, G. (2011) · Assessing Writing · doi:10.1016/j.asw.2011.03.001 · Cited by 135 · see citing works
The working alliance: Where have we been, where are we going?
Doran, J. M. (2014) · Psychotherapy Research · doi:10.1080/10503307.2014.954153 · Cited by 130 · see citing works
Measuring Mindfulness: Applying Generalizability Theory to Distinguish between State and Trait
Medvedev, O. N., Krägeloh, C. U., Narayanan, A., & Siegert, R. J. (2017) · Mindfulness · doi:10.1007/s12671-017-0679-0 · Cited by 127 · see citing works
Mistakes and How to Avoid Mistakes in Using Intercoder Reliability Indices
Feng, G. C. (2014) · Methodology · doi:10.1027/1614-2241/a000086 · Cited by 121 · see citing works
Readers' Expectations for Story Structures
Whaley, J. F. (1981) · Reading Research Quarterly · doi:10.2307/747250 · Cited by 120 · see citing works
The Reliability of Observational Data
Cordes, A. K. (1994) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.3702.264 · Cited by 119 · see citing works
Conjoint Analysis Reliability: Empirical Findings
Reibstein, D. J., Bateson, J., & Boulding, W. (1988) · Marketing Science · doi:10.1287/mksc.7.3.271 · Cited by 117 · see citing works
Construct and consequential validity for learning analytics based on trace data
Winne, P. H. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106457 · Cited by 112 · see citing works
The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT
Cooper, S. R., Gonthier, C., Barch, D. M., & Braver, T. S. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01482 · Cited by 106 · see citing works
Validity and Reliability Analysis of Cooper's 12-Minute Run and the Multistage Shuttle Run in Healthy Adults
Penry, J. T., WILCOX, A. R., & Yun, J. (2010) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0b013e3181cc2423 · Cited by 110 · see citing works
“A statistical tool that can capture and quantify such relationships is Generalizability theory (G-theory) (7).”
Method
Reliability Assessment and Optimization of Marketing Measurement
Finn, A. H. R., & Kayandé, U. (1997) · Journal of Marketing Research · doi:10.1177/002224379703400206 · Cited by 121 · see citing works
Applying Concepts of Generalizability Theory on Clinical Trial Data to Investigate Sources of Variation and Their Impact on Reliability
Vangeneugden, T., Laenen, A., Geys, H., Renard, D., & Molenberghs, G. (2005) · Biometrics · doi:10.1111/j.0006-341x.2005.031040.x · Cited by 104 · see citing works
Examiner alignment and assessment in clinical periodontal research
Hefti, A. F., & Preshaw, P. M. (2012) · Periodontology 2000 · doi:10.1111/j.1600-0757.2011.00436.x · Cited by 101 · see citing works
Moving beyond Alpha: A Primer on Alternative Sources of Single-Administration Reliability Evidence for Quantitative Chemistry Education Research
Komperda, R., Pentecost, T. C., & Barbera, J. (2018) · Journal of Chemical Education · doi:10.1021/acs.jchemed.8b00220 · Cited by 99 · see citing works
Motivating Language Theory
Mayfield, J. R., & Mayfield, M. R. (2017) · Springer eBooks · doi:10.1007/978-3-319-66930-4 · Cited by 114 · see citing works
Generalizability of Stratified-Parallel Tests
Rajaratnam, N., Cronbach, L. J., & Gleser, G. C. (1965) · Psychometrika · doi:10.1007/bf02289746 · Cited by 96 · see citing works
Self-citation
3: Trait-Treatment Interaction and Learning
Berliner, D. C., & Cahen, L. S. (1973) · Review of Research in Education · doi:10.3102/0091732x001001058 · Cited by 98 · see citing works
Generalizability Theory
Marcoulides, G. A. (2000) · Elsevier eBooks · doi:10.1016/b978-012691360-6/50019-7 · Cited by 95 · see citing works
Passing Scores and Test Lengths for Domain-Referenced Measures
Millman, J. (1973) · Review of Educational Research · doi:10.3102/00346543043002205 · Cited by 93 · see citing works
“Cronbach et al. (1963) used the notion of a universe of test items in a theory of reliability.”
Method
PERSONALITY AND THE MEASUREMENT OF INTELLIGENCE
Eysenck, H. J., & White, P. O. (1964) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.1964.tb00624.x · Cited by 91 · see citing works
A FIELD STUDY OF THE EFFECTS OF RATING PURPOSE ON THE QUALITY OF MULTISOURCE RATINGS
Greguras, G. J., Robie, C., Schleicher, D. J., & Goff, M. (2003) · Personnel Psychology · doi:10.1111/j.1744-6570.2003.tb00141.x · Cited by 91 · see citing works
Generalizability Theory: A Comprehensive Method for Assessing and Improving the Dependability of Marketing Measures
Rentz, J. O. (1987) · Journal of Marketing Research · doi:10.1177/002224378702400102 · Cited by 101 · see citing works
Cognitive Styles: Some Conceptual, Methodological, and Applied Issues
Shipman, S. L., & Shipman, V. C. (1985) · Review of Research in Education · doi:10.2307/1167151 · Cited by 90 · see citing works
To invest, or not to invest, in brands? Drivers of brand relevance in B2B markets
Backhaus, K., Steiner, M., & Lügger, K. (2011) · Industrial Marketing Management · doi:10.1016/j.indmarman.2011.09.002 · Cited by 89 · see citing works
Major developments in methods addressing for whom psychotherapy may work and why
Zilcha‐Mano, S. (2018) · Psychotherapy Research · doi:10.1080/10503307.2018.1429691 · Cited by 88 · see citing works
The effects of incomplete information on the formation of attitudes toward behavioral alternatives.
Jaccard, J. J., & Wood, G. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.4.580 · Cited by 89 · see citing works
Assessing the reliability of single-item momentary affective measurements in experience sampling.
Dejonckheere, E., Demeyer, F., Geusens, B., Piot, M., Tuerlinckx, F., Verdonck, S., & Mestdagh, M. (2022) · Psychological Assessment · doi:10.1037/pas0001178 · Cited by 87 · see citing works
Early maternal warm responsiveness as a predictor of child social skills
Steelman, L., Assel, M. A., Swank, P. R., Smith, K. E., & Landry, S. H. (2002) · Journal of Applied Developmental Psychology · doi:10.1016/s0193-3973(02)00101-6 · Cited by 88 · see citing works
Person and population as psychometric concepts.
Loevinger, J. (1965) · Psychological Review · doi:10.1037/h0021704 · Cited by 87 · see citing works
“Neighborhood Matters”: Assessment of Neighborhood Social Processes
Henry, D. B., Gorman‐Smith, D., Schoeny, M. E., et al. (2014) · American Journal of Community Psychology · doi:10.1007/s10464-014-9681-z · Cited by 85 · see citing works
“Because of the stratified sampling of both census tracts and individuals within tracts, we employed a generalizability theory method (G-theory; Cronbach 1963) to identify the proportion of variance attributable to the neighborhoods.”
Method
The Importance of Parenting During Early Childhood for School-Age Development
Landry, S. H., Smith, K., & Swank, P. R. (2003) · Developmental Neuropsychology · doi:10.1207/s15326942dn242&3_04 · Cited by 85 · see citing works
Fundamental topics in the personality disorders: Candidate trait dimensions from lower regions of the hierarchy.
Harkness, A. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.2.251 · Cited by 84 · see citing works
General Education Teachers’ Natural Rates of Praise: A Preliminary Investigation
Floress, M. T., Jenkins, L. N., Reinke, W. M., et al. (2017) · Behavioral Disorders · doi:10.1177/0198742917709472 · Cited by 83 · see citing works
An Overview of Statistics in Education
Sinharay, S. (2010) · Elsevier eBooks · doi:10.1016/b978-0-08-044894-7.01719-x · Cited by 83 · see citing works
Measurement errors in multivariate measurement scales
Tarkkonen, L., & Vehkalahti, K. (2004) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2004.09.007 · Cited by 82 · see citing works
“In generalizability theory[14], which is based on procedures from analysis of variance, number of specific variance components, associated with different features of the measurement process, are included in the model as sources of errors.”
MethodInfluential

Authors: Cronbach, L. J., Rajaratnam, N., & Gleser, G. C.
Affiliations: University of Illinois Urbana-Champaign (US)
Corresponding author: Rajaratnam, Nageswari
Venue: British Journal of Statistical Psychology
Publisher: Wiley
Published: 1963-11
Volume: 16
Issue: 2
Pages: 137-163
ISSN: 0950-561X (ISSN-L)
DOI: 10.1111/j.2044-8317.1963.tb00206.x
OpenAlex: W2023420063
Cited by: 737
References: 0
Citations by year: 2026: 17 · 2025: 20 · 2024: 28 · 2023: 40 · 2022: 31 · 2021: 29 · 2020: 29 · 2019: 21 · 2018: 31 · 2017: 27 · 2016: 23 · 2015: 24 · 2014: 22 · 2013: 14 · 2012: 21
FWCI: 40.77
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor, 17443 d)
Locations: British Journal of Statistical Psychology (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: generalizability theory, reliability theory, intraclass correlation coefficient, random sampling, lower bounds, measurement reliability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cited by

Related

Record

About these checks