The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Within-subjects designs: To use or not to use?
Abstract
This article considers the several factors pertinent to deciding whether a within- or between-subjects design should be employed for a research application. A general principle favoring within-subjects designs is the statistical efficiency afforded by removing subject variance from error terms used to test treatment effects. Within-subjects designs, however, are often faulted for being subject to context effects of practice, sensitization, and carry-over that may limit interpretation of results. At the same time, between-subjects designs are not devoid of context effects, but rather have #the context that a single treatment affords itself. Since ecological validity of results depends on the correspondence of the research context to the generalization context, within-subjects designs may he preferred when the generalization context includes the equivalent of several concurrent treatments. The discussion focuses additionally on (a) procedures 'to minimize practice, sensitization and carry-over effects in within-subjects designs when they a;e not desired, and (b) means of using these effects to advantage in research. Frequently an investigator faces the choice of whether to examine the effects of two or more experimental treatments by exposing each subject to (a) only a single treatment (between-subjects design) or (b) several or all of the treatments (within-subjects or re-peated-measures design). Grice ( 19.66) has pointed out that the pattern of treatment ef-fects obtained may vary considerably between the two types of designs. However, only rarely does an investigator make a choice of type of design after consideration of the appropri-ateness of each type to the problem being investigated. I attempt to assemble here sev-eral considerations that may often be ap-propriate to the decision between a within-or between-subjects design. Nthough they are mentioned briefly, sta-tistical considerations relating to choice of design are not of primary interest here. These statistical matters are well handled in stan-dard statistical texts, as referenced below. My aim, rather, is to detail the psychological considerations that are critical to the choice
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
(1963) · Medical Entomology and Zoology · Cited by 15,085
The principle of congruity in the prediction of attitude change.
Osgood, C. E., & Tannenbaum, P. H. (1955) · Psychological Review · doi:10.1037/h0048153 · Cited by 1,700 · cited 1×
“Persons familiar with persuasion research will be aware that the between-subjects design is most often chosen for the examination of source credibility effects (but not always -see Osgood & Tannenbaum, 1955).”
BackgroundUnwanted range effects from using within-subject experimental designs.
Poulton, E. C. (1973) · Psychological Bulletin · doi:10.1037/h0034731 · Cited by 195
Dependence of empirical laws upon the source of experimental variation.
Grice, G. R. (1966) · Psychological Bulletin · doi:10.1037/h0023914 · Cited by 73
Analysis of variance for repeated measures designs: Two approaches.
Poor, D. D. S. (1973) · Psychological Bulletin · doi:10.1037/h0034834 · Cited by 63
Poulton, E. C. (1974) · Psychological Bulletin · doi:10.1037/h0035839 · Cited by 15
Cited by
Guidelines for Human Electromyographic Research
Fridlund, A. J., & Cacioppo, J. T. (1986) · Psychophysiology · doi:10.1111/j.1469-8986.1986.tb00676.x · Cited by 1,737
Behavioral Decision Theory: Processes of Judgement and Choice
Einhorn, H. J., & Hogarth, R. M. (1981) · Annual Review of Psychology · doi:10.1146/annurev.ps.32.020181.000413 · Cited by 1,691
Experimental methods: Between-subject and within-subject design
Charness, G., Gneezy, U., & Kuhn, M. A. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.08.009 · Cited by 1,469
Evaluating Recommendation Systems
Shani, G., & Gunawardana, A. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_8 · Cited by 1,325
Barlow, D. H., & Hayes, S. C. (1979) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1979.12-199 · Cited by 652
The ‘ultimate attribution error’? A review of the literature on intergroup causal attribution
Hewstone, M. (1990) · European Journal of Social Psychology · doi:10.1002/ejsp.2420200404 · Cited by 615
Under what conditions does theory obstruct research progress?
Greenwald, A. G., Pratkanis, A. R., Leippe, M. R., & Baumgardner, M. H. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.216 · Cited by 574
Self-citationStrategies for reducing consumers’ risk aversion in Internet shopping
Jiuan Tan, S. (1999) · Journal of Consumer Marketing · doi:10.1108/07363769910260515 · Cited by 528
The ‘Real-World Approach’ and Its Problems: A Critique of the Term Ecological Validity
Holleman, G. A., Hooge, I. T. C., Kemner, C., & Hessels, R. S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00721 · Cited by 345
Ashton, R. H. (1990) · Journal of Accounting Research · doi:10.2307/2491253 · Cited by 342
Incapacitation and just deserts as motives for punishment.
Darley, J. M., Carlsmith, K. M., & Robinson, P. H. (2000) · Law and Human Behavior · doi:10.1023/a:1005552203727 · Cited by 337
Are Women Evaluated More Favorably Than Men?: An Analysis of Attitudes, Beliefs, and Emotions
Eagly, A. H., Mladinic, A., & Otto, S. (1991) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.1991.tb00792.x · Cited by 304
Evaluating Recommender Systems
Gunawardana, A., & Shani, G. (2015) · Recommender Systems Handbook · doi:10.1007/978-1-4899-7637-6_8 · Cited by 283
Limits on perception of cognitive processes: A reply to Nisbett and Wilson.
Smith, E. R., & Miller, F. D. (1978) · Psychological Review · doi:10.1037//0033-295x.85.4.355 · Cited by 278
Statistical Power and Effect Size in Marketing Research
Sawyer, A. G., & Ball, A. D. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800302 · Cited by 269
A Study of Information Search Behavior During the Categorization of New Products
Ozanne, J. L., Brucks, M., & Grewal, D. (1992) · Journal of Consumer Research · doi:10.1086/209273 · Cited by 256
Do applicants fake? An examination of the frequency of applicant faking behavior
Griffith, R. L., Chmielowski, T., & Yoshita, Y. (2007) · Personnel Review · doi:10.1108/00483480710731310 · Cited by 240
E-retailing versus physical retailing
Lee, K. S., & Tan, S. J. (2003) · Journal of Business Research · doi:10.1016/s0148-2963(01)00274-0 · Cited by 232
“I think it, therefore it’s true”: Effects of self-perceived objectivity on hiring discrimination
Uhlmann, E. L., & Cohen, G. L. (2007) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2007.07.001 · Cited by 232
Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006) · Behavior Modification · doi:10.1177/0145445503261167 · Cited by 217
Using Nonnaive Participants Can Reduce Effect Sizes
Chandler, J., Paolacci, G., Peer, E., Mueller, P., & Ratliff, K. A. (2015) · Psychological Science · doi:10.1177/0956797615585115 · Cited by 185
The Two-Period Crossover Design in Medical Research
Woods, J. R., Williams, J. G., & Tavel, M. (1989) · Annals of Internal Medicine · doi:10.7326/0003-4819-110-7-560 · Cited by 139
Situational variables in online versus offline channel choice
Chocarro, R., Cortiñas, M., & Villanueva, M.-L. (2013) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2013.03.004 · Cited by 139
“In this case, any more than 8 choice scenarios per respondent could result in practice, sensitization, and carry-over that may limit interpretation of results (Greenwald 1976).”
BackgroundProbing the effects of individual components in multiple component prevention programs
West, S. G., Aiken, L. S., & Todd, M. (1993) · American Journal of Community Psychology · doi:10.1007/bf00942173 · Cited by 69
There’s Nothing Social about Social Priming: Derailing the “Train Wreck”
Sherman, J. W., & Rivers, A. M. (2021) · Psychological Inquiry · doi:10.1080/1047840x.2021.1889312 · Cited by 62
Effects of predictability of shock timing and intensity on aversive responses
Shankman, S. A., Robison-Andrew, E. J., Nelson, B. D., Altman, S. E., & Campbell, M. L. (2011) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2011.02.008 · Cited by 57
Pellas, N. (2025) · Education Sciences · doi:10.3390/educsci15010102 · Cited by 56
Using authentic 3D product visualisation for an electrical online retailer
Algharabat, R., & Dennis, C. (2010) · Journal of Customer Behaviour · doi:10.1362/147539210x511326 · Cited by 49
“Finally, the design helps reduce costs because we take several observations from the same subject (Greenwald, 1976; Keppel and Wickens, 2004).”
BackgroundRegional diversity in social perceptions of (ing)
Schleef, E., Flynn, N., & Barras, W. (2017) · Language Variation and Change · doi:10.1017/s0954394517000047 · Cited by 14
Metadata
- Authors
- Greenwald, A. G.
- Venue
- Psychological Bulletin
- Published
- 1976-03
- Volume
- 83
- Issue
- 2
- Pages
- 314-320
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2061731700
- Cited by
- 523
- References
- 7
- FWCI
- 14.23
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.