Group Comparability: A Multiattribute Utility Measurement Approach to the Use of Random Assignment with Small Numbers of Aggregated Units
Abstract
It is not always possible, especially in large-scale evaluation research, to ensure that random assignment will produce groups that are comparable on any number of potentially important factors. Typically, gaining comparability has been achieved only at the expense of random assignment. A method is presented that allows multivariate comparability while making only minimal restrictions on randomization. The procedure is demonstrated in the context of assigning 63 aggregated units (schools) to 28 experimental and control conditions. Good comparability of groups for all primary main effects and interactions was venfied for 15 individual variables.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Graham et al. (1984) procedure has proven excellent for producing pretest equivalence.
“Performance of the procedure has proven to be excellent for producing pretest equivalence, even at the level of individual school-level variables involved (Graham et al. 1984).”
From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Graham et al. 1984
Cites
The Scree Test For The Number Of Factors
Cattell, R. B. (1966) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0102_10 · Cited by 13,554 · see citing works
Decisions with Multiple Objectives: Preferences and Value Tradeoffs.
Tsoukias, A., Keeney, R. L., & Raiffa, H. (1994) · Journal of the Operational Research Society · doi:10.2307/2584151 · Cited by 8,414 · see citing works
Decisions with Multiple Objectives—Preferences and Value Tradeoffs
Kidd, J. (1977) · Journal of the Operational Research Society · doi:10.1057/jors.1977.126 · Cited by 1,751 · see citing works
How to Use Multiattribute Utility Measurement for Social Decisionmaking
Edwards, W. (1977) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1977.4309720 · Cited by 1,037 · see citing works
Longitudinal Research in the Study of Behavior and Development
Nesselroade, J. R., & Baltes, P. B. (1979) · Medical Entomology and Zoology · Cited by 1,019 · see citing works
Evans, R. I., Rozelle, R. M., Mittelmark, M. B., Hansen, W. B., Bane, A. L., & Havis, J. (1978) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1978.tb00771.x · Cited by 445 · see citing works
Self-citationStanley, J. C. (1965) · The School Review · doi:10.1086/442740 · Cited by 417 · see citing works
Edwards, W., & Newman, J. (1982) · Sage eBooks · doi:10.4135/9781412985123 · Cited by 323 · see citing works
Preventing the onset of cigarette smoking through life skills training
Botvin, G. J., Eng, A., & Williams, C. L. (1980) · Preventive Medicine · doi:10.1016/0091-7435(80)90064-x · Cited by 304 · see citing works
Adolescent Smoking: Onset and Prevention
McAlister, A. L., Perry, C. L., & Maccoby, N. (1979) · PEDIATRICS · doi:10.1542/peds.63.4.650 · Cited by 275 · see citing works
Allocation of Patients to Treatment in Clinical Trials
Pocock, S. (1979) · Biometrics · doi:10.2307/2529944 · Cited by 246 · see citing works
Prevention of cigarette smoking in seventh grade students
Hurd, P. D., Johnson, C. A., Pechacek, T. F., Bast, L. P., Jacobs, D. R., & Luepker, R. V. (1980) · Journal of Behavioral Medicine · doi:10.1007/bf00844911 · Cited by 194 · see citing works
Allocation of patients to treatment groups in a controlled clinical study
White, S. J., & Freedman, L. S. (1978) · British Journal of Cancer · doi:10.1038/bjc.1978.124 · Cited by 192 · see citing works
Restricted Randomization Designs in Clinical Trials
Simon, R. M. (1979) · Biometrics · doi:10.2307/2530354 · Cited by 178 · see citing works
Communication for Health: Unselling Heart Disease
Maccoby, N., & Farquhar, J. W. (1975) · Journal of Communication · doi:10.1111/j.1460-2466.1975.tb00613.x · Cited by 86 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Valente, T. W., Hoffman, B. R., Ritt-Olson, A., Lichtman, K., & Johnson, C. A. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.11.1837 · Cited by 301 · see citing works
Translational research in South Africa: evaluating implementation quality using a factorial design
Caldwell, L. L., Smith, E. A., Collins, L. M., Graham, J. W., Lai, M., Wegner, L., Vergnani, T., Matthews, C., & Jacobs, J. (2012) · Child & Youth Care Forum · doi:10.1007/s10566-011-9164-4 · Cited by 50 · see citing works
Self-citation
- Authors
- Graham, J. W., Flay, B. R., Anderson Johnson, C., Hansen, W. B., & Collins, L. M.
- Affiliations
- Health Behavior Research Institute University of Southern California
- University of Southern California (US)
- Venue
- Evaluation Review
- Publisher
- SAGE Publications
- Published
- 1984-04
- Volume
- 8
- Issue
- 2
- Pages
- 247-260
- ISSN
- 0145-4692 (ISSN-L)
- 0193-841X
- 1552-3926
- OpenAlex
- W2074613824
- Cited by
- 70
- References
- 15
- Citations by year
- 2025: 1 · 2024: 1 · 2022: 2 · 2020: 1 · 2019: 3 · 2017: 3 · 2016: 2 · 2015: 1 · 2014: 4 · 2013: 4 · 2012: 5
- FWCI
- 1.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Evaluation Review (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- random assignment, school assignment, experimental and control groups, main effects and interactions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review