The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Factors relevant to the validity of experiments in social settings.
Abstract
This chapter attempts a specification of the major categories of extraneous variables and employs these categories in evaluating the validity of standard designs for experimentation in the social sciences. The extraneous variables affecting internal validity are introduced in the process of analyzing three pre-experimental designs. In the subsequent evaluation of the applicability of three true experimental designs, factors leading to external invalidity are introduced. In analyzing the extraneous variables which experimental designs for social settings seek to control, seven categories have been distinguished: history, maturation, testing, instrument decay, regression, selection, and mortality. In general, the simple or main effects of these variables jeopardize the internal validity of the experiment and are adequately controlled in standard experimental designs. The interactive effects of these variables and of experimental arrangements affect the external validity of generalizability of experimental results. Standard experimental designs vary in their susceptibility to these interactive effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perception and the Representative Design of Psychological Experiments
Brunswik, E. (1956) · doi:10.1525/9780520350519 · Cited by 2,974
An extension of control group design
Solomon, R. L. (1949) · Psychological Bulletin · doi:10.1037/h0062958 · Cited by 541
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613
“Explanation Generalisability, also called external validity or applicability, is the extent to which the results of a study can be applied to other circumstances [216].”
Toward a definition of mixed methods research
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689806298224 · Cited by 6,464
Achieving integration in mixed methods designs-principles and practices
Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013) · Health Services Research · doi:10.1111/1475-6773.12117 · Cited by 7,219
Ryan, G. W., & Bernard, H. R. (2003) · Field Methods · doi:10.1177/1525822x02239569 · Cited by 5,475
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Vandenbroucke, J. P., Elm, E. V., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010-w1 · Cited by 3,543
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2014) · International Journal of Surgery · doi:10.1016/j.ijsu.2014.07.014 · Cited by 2,969
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181577511 · Cited by 2,779
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Zeng, X., Zhang, Y., Kwong, J. S. W., Zhang, C., Li, S., Sun, F., Niu, Y., & Du, L. (2015) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12141 · Cited by 2,082
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Ma, L.-L., Wang, Y.-Y., Yang, Z.-H., Huang, D., Weng, H., & Zeng, X.-T. (2020) · Military Medical Research · doi:10.1186/s40779-020-00238-8 · Cited by 1,648
Skrivankova, V. W., Richmond, R. C., Woolf, B. A. R., Davies, N. M., Swanson, S. A., VanderWeele, T. J., Timpson, N. J., Higgins, J. P. T., Dimou, N., Langenberg, C., et al. (2021) · BMJ · doi:10.1136/bmj.n2233 · Cited by 1,648
Natural and Quasi-Experiments in Economics
Meyer, B. D. (1995) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1995.10524589 · Cited by 1,100
Qualitative research methods in health technology assessment: a review of the literature.
Murphy, Dingwall, Greatbatch, Parker, & Watson (1998) · Health Technology Assessment · doi:10.3310/hta2160 · Cited by 1,107
Dialectical behavior therapy for borderline personality disorder
Lynch, T. R., Trost, W. T., Salsman, N., & Linehan, M. M. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.2.022305.095229 · Cited by 704
Measuring the impact of positive and negative word of mouth on brand purchase probability
East, R., Hammond, K., & Lomax, W. (2008) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2008.04.001 · Cited by 629
Collins, K. M. T., Onwuegbuzie, A. J., & Jiao, Q. G. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689807299526 · Cited by 552
The Use of Propensity Scores to Assess the Generalizability of Results from Randomized Trials
Stuart, E. A., Cole, S. R., Bradshaw, C. P., & Leaf, P. J. (2011) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00673.x · Cited by 524
Social Attitudes and Other Acquired Behavioral Dispositions.
Campbell, D. T. (1963) · Psychology: A study of a science. Study II. Empirical substructure and relations with other sciences. Volume 6. Investigations of man as socius: Their place in psychology and the social sciences. · doi:10.1037/10590-003 · Cited by 514
Self-citation“Scaling-out” evidence-based interventions to new populations or new health care delivery systems
Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017) · Implementation Science · doi:10.1186/s13012-017-0640-6 · Cited by 399
The ‘Real-World Approach’ and Its Problems: A Critique of the Term Ecological Validity
Holleman, G. A., Hooge, I. T. C., Kemner, C., & Hessels, R. S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00721 · Cited by 345
Long-term effectiveness of inoculation against misinformation: Three longitudinal experiments.
Maertens, R., Roozenbeek, J., Basol, M., & van der Linden, S. (2021) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000315 · Cited by 321
Gielnik, M. M., Frese, M., Kahara-Kawuki, A., Wasswa Katono, I., Kyejjusa, S., Ngoma, M., Munene, J., Namatovu-Dawa, R., Nansubuga, F., Orobia, L., et al. (2015) · Academy of Management Learning & Education · doi:10.5465/amle.2012.0107 · Cited by 305
Happy animals make good science.
Poole, T. (1997) · Laboratory Animals · doi:10.1258/002367797780600198 · Cited by 288
The relevance of systematic reviews to educational policy and practice
Davies, P. (2000) · Oxford Review of Education · doi:10.1080/713688543 · Cited by 286
How human–AI feedback loops alter human perceptual, emotional and social judgements
Glickman, M., & Sharot, T. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02077-2 · Cited by 289
Preventing Bias in Cluster Randomised Trials
Giraudeau, B., & Ravaud, P. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000065 · Cited by 150
McCambridge, J., Kypri, K., & Elbourne, D. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.09.004 · Cited by 138
Random versus nonrandom assignment in controlled experiments: Do you get the same answer?
Shadish, W. R., & Ragsdale, K. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.6.1290 · Cited by 126
Causal discovery and the problem of psychological interventions
Eronen, M. I. (2020) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2020.100785 · Cited by 102
Fok, C. C. T., Henry, D., & Allen, J. (2015) · Prevention Science · doi:10.1007/s11121-015-0569-4 · Cited by 86
When Common Identities Decrease Trust: An Experimental Study of Partisan Women
Klar, S. (2018) · American Journal of Political Science · doi:10.1111/ajps.12366 · Cited by 86
Roozenbeek, J., Maertens, R., McClanahan, W., & van der Linden, S. (2021) · Educational and Psychological Measurement · doi:10.1177/0013164420940378 · Cited by 80
Mensmann, M., & Frese, M. (2019) · Journal of Organizational Behavior · doi:10.1002/job.2333 · Cited by 75
Fiedler, K., McCaughey, L., & Prager, J. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620970602 · Cited by 73
Tang, S. T., Chen, J.-S., Wen, F.-H., Chou, W.-C., Chang, J. W.-C., Hsieh, C.-H., & Chen, C. H. (2019) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2018.7106 · Cited by 58
Wen, F.-H., Chen, J.-S., Chou, W.-C., Chang, W.-C., Hsieh, C.-H., & Tang, S. T. (2019) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2019.04.010 · Cited by 17
Crossing the seven Cs of internal consistency: Assessing the reliability of formative instruments
Gruijters, S. L. K., Fleuren, B. P. I., & Peters, G. J. (2021) · doi:10.31234/osf.io/qar39 · Cited by 17
Copp, D. T. (2017) · Education Policy Analysis Archives · doi:10.14507/epaa.25.3299 · Cited by 8
Dopp, A. R., Perrine, C. M., Iovan, S., & Lantz, P. M. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00940-3 · Cited by 7
Metadata
- Authors
- Campbell, D. T.
- Venue
- Psychological Bulletin
- Published
- 1957
- Volume
- 54
- Issue
- 4
- Pages
- 297-312
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W1982803242
- Cited by
- 1,140
- References
- 2
- FWCI
- 109.62
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
