The DOI matches its Crossref record; 98 of the 100 references it cites were found in a registry or an index.
Behavioral Development and Construct Validity: The Principle of Aggregation
Abstract
Many important variables in behavioral development are presumed to be unrelated because of repeated failures to obtain substantial correlations. In this article, we explore the possibility that such null findings have often been due to failures to aggregate. The principle of aggregation states that the sum of a set of multiple measurements is a more stable and representative estimator than any single measurement. This greater representation occurs because there is inevitably some error associated with measurement. By combining numerous exemplars, such errors of measurement are averaged out, leaving a clearer view of underlying relationships. We illustrate the usefulness of this principle in 12 major areas of developmental research in which the issue of negligible correlations figures prominently: (a) the validity of judges' ratings, (b) the cross-situational consistency of moral character and personality, (c) the longitudinal stability of personality, (d) the coherence of stages of cognitive development, (e) metacognition, (f) the attitude—behavior relationship, (g) the personality—behavior relationship, (h) the role-taking/altruism relationship, (i) the moral-judgment/altruism relationship, (j) the legitimacy of the construct of attachment, (k) the existence of sex differences, and (1) the assessment of emotionality in animals. In a final section, we also discuss the implications of the principle of aggregation for conducting experimental research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“which increases reliability due to the principle of aggregation (see Rushton et al., 1983)”
From A Feasibility and Implementation Integrity Study of the Community Builder (CoBi): An AI-based Collaboration Support System in K-12 Classrooms (2025) · cites this paper as Rushton et al., 1983
Citations
Cites
Kytle, J., & Bandura, A. (1978) · Contemporary Sociology · doi:10.2307/2065952 · Cited by 25,422
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
The psychology of sex differences
Maccoby, E. E. (1975) · Behavior Therapy · doi:10.1016/s0005-7894(75)80031-1 · Cited by 5,714
Principles of behavior modification
Bandura, A. (1969) · Medical Entomology and Zoology · Cited by 4,631
Gray, J. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00013066 · Cited by 4,477
The Moral Judgment Of The Child
Piaget, J. (2013) · Routledge eBooks · doi:10.4324/9781315009681 · Cited by 4,409
Madison, P., & Mischel, W. (1968) · The American Journal of Psychology · doi:10.2307/1421067 · Cited by 4,395
Aggression: A Social Learning Analysis
Bandura, A. (1973) · Stanford Law Review · doi:10.2307/1227918 · Cited by 4,302
Toward a cognitive social learning reconceptualization of personality
Mischel, W. (1973) · Psychological Review · doi:10.1037/h0035002 · Cited by 3,181
Cited by
Sorted by citations
Items 801–900 of 937
af Wåhlberg, A. E. (2018) · Safety · doi:10.3390/safety4040059 · Cited by 4
A brief note on two often ignored principles that tend to attenuate the magnitude of correlations
Barnes, G. E. (1984) · Personality and Individual Differences · doi:10.1016/0191-8869(84)90076-x · Cited by 4
Levels of explanation in sociobiology and psychology: A rejoinder to Archer.
Littlefield, C. H., & Rushton, J. P. (1989) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.56.4.625 · Cited by 4
Self-citationEvolution, altruism and genetic similarity theory
Rushton, J. P. (1987) · Mankind Quarterly · doi:10.46469/mq.1987.27.4.2 · Cited by 4
Self-citationThe role of ports in supply chain disruption management
Loh, H. S. (2015) · doi:10.32657/10356/65266 · Cited by 4
Mood Measurement: Current Status and Future Directions
Watson, D., & Vaidya, J. G. (2012) · Handbook of Psychology, Second Edition · doi:10.1002/9781118133880.hop202013 · Cited by 4
Pulliam, G., Feldman, J. I., Wallace, M. T., Cutting, L. E., & Woynaroski, T. G. (2025) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-025-06960-3 · Cited by 3
Zerrouk, M., Ravigopal, T., & Bell, M. A. (2024) · Infant Behavior and Development · doi:10.1016/j.infbeh.2024.101932 · Cited by 3
Markfeld, J. E., Kiemel, Z., Santapuram, P., Bordman, S. L., Pulliam, G., Clark, S. M., Hampton, L. H., Keçeli-Kaysılı, B., Feldman, J. I., & Woynaroski, T. G. (2024) · Journal of Speech Language and Hearing Research · doi:10.1044/2024_jslhr-23-00794 · Cited by 5
Abu-Gameh, A. A., Koch, J. E. J., Schleifer, D., Baruch, Y., Engel, I., Yaacobi, E., & Ohana, N. (2025) · Cureus · doi:10.7759/cureus.78763 · Cited by 4
Sawaya, S., Jacobs, J., Moulder, R. G., Jr., Chandler, C., Milne, B., Fischaber, T., & D’Mello, S. K. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98459-4_6 · Cited by 3
Assessing the Point at Which Averages Are Stable: A Tutorial in the Context of Impression Formation
Hehman, E., Xie, S. Y., Ofosu, E. K., & Nespoli, G. A. (2025) · Social Cognition · doi:10.1521/soco.2025.43.5.488 · Cited by 3
John Philippe Rushton, 1943–2012
Hur, Y., & Lynn, R. (2012) · Twin Research and Human Genetics · doi:10.1017/thg.2012.138 · Cited by 3
IX. DEVELOPMENTAL TRAJECTORIES OF CHILDREN’S SOMATIC COMPLAINTS AFTER THE BIRTH OF A SIBLING
Beyers-Carlson, E. E. A., Stevenson, M. M., Gonzalez, R., Oh, W., Volling, B. L., & Yu, T. (2017) · Monographs of the Society for Research in Child Development · doi:10.1111/mono.12315 · Cited by 4
Does Symptom Linkage Density Predict Outcomes in Cognitive Therapy for Recurrent Depression?
Vittengl, J. R., Clark, L. A., Thase, M. E., & Jarrett, R. B. (2021) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-021-09914-y · Cited by 3
Costa, F., Júnior, E. P. L., Lemos, A. Q., & Lôbo, R. J. S. (2009) · Revista Gestão Organizacional · doi:10.22277/rgo.v2i2.177 · Cited by 3
The Importance of Cumulative Effects: A Neglected Emphasis of Sherif’s Work
Pettigrew, T. F. (1992) · Springer eBooks · doi:10.1007/978-1-4612-2860-8_4 · Cited by 3
Minor Illnesses, Temperament, and Toddler Social Functioning
Kolak, A. M., Frey, T. J., Brown, C. A., & Vernon‐Feagans, L. (2013) · Early Education and Development · doi:10.1080/10409289.2013.764224 · Cited by 3
Rushton: The great theoretician and his contribution to personality
Templer, D. I. (2012) · Personality and Individual Differences · doi:10.1016/j.paid.2012.04.038 · Cited by 3
Piaget and Kohlberg Lose the Limelight
Pratt, A. B. (1991) · Behavior and Social Issues · doi:10.5210/bsi.v1i1.193 · Cited by 3
The range of seriation training effects in young kindergarten children
Kingma, J. (1986) · Contemporary Educational Psychology · doi:10.1016/0361-476x(86)90023-8 · Cited by 3
Effects of measurement aggregation on predicting externalizing problems from preschool behaviour
Zentner, M. R., Smolkina, M., & Venables, P. H. (2014) · British Journal of Developmental Psychology · doi:10.1111/bjdp.12059 · Cited by 3
Context Specificity in Stability of Hyperactivity–Impulsivity
Kim, J., Deater-Deckard, K. D., Mullineaux, P. Y., & Beekman, C. R. (2010) · European Journal of Personality · doi:10.1002/per.767 · Cited by 3
Self-worth and psychological adjustment of obese children: An analysis through the Draw-A-Person
Scimeca, G., Alborghetti, A., Bruno, A., Troili, G. M., Pandolfo, G., Muscatello, M. R. A., & Zoccali, R. A. (2016) · World Journal of Psychiatry · doi:10.5498/wjp.v6.i3.329 · Cited by 3
Using an Aerial Drone to Examine Lateral Movement in Sweep Rowers
Munn, J. S. (2016) · Scholarship@Western (Western University) · Cited by 3
Scale Development for Enlistment Motivation Measures
Baker, T. A. (1990) · Defense Technical Information Center (DTIC) · Cited by 3
J. P. Rushton's Aggregational Errors in Racial Psychology
Cemovsky, Z. Z. (1993) · Journal of Black Psychology · doi:10.1177/00957984930193004 · Cited by 2
Rushton, J. P. (1984) · Cited by 3
Self-citationPersonality Assessment Paradigms
Parkash, V., & Kumar, U. (2016) · doi:10.1002/9781119173489.ch22 · Cited by 3
Common method variance and other sources of bias in road traffic research
Barraclough, P. (2017) · Queensland University of Technology · doi:10.5204/thesis.eprints.104818 · Cited by 3
Cheat, cheat, repeat: On the consistency of dishonest behavior in structurally comparable situationsPreprint
Thielmann, I., Hilbig, B. E., Schild, C., & Heck, D. W. (2024) · doi:10.31234/osf.io/ntg6c · Cited by 3
An Alternative Paradigm for Studying the Accuracy of Person Perception: Simulated Personalities
Wright, J. C. (1989) · Springer eBooks · doi:10.1007/978-1-4684-0634-4_5 · Cited by 3
Deficits in force production during multifinger tasks demarcate cognitive dysfunction
Carson, R. G., Berdondini, D., Crosbie, M., McConville, C., Forbes, S., Stewart, M., & Chiu, R. (2024) · Aging Clinical and Experimental Research · doi:10.1007/s40520-024-02723-9 · Cited by 2
Can Text Messages Make People Kinder?
Konrath, S. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780190204600.003.0020 · Cited by 2
Kagan, J., Snidman, N. C., Arcus, D. M., & Reznick, J. S. (2018) · Routledge eBooks · doi:10.4324/9780429500282-2 · Cited by 2
Medvedev, O. N., & Krägeloh, C. U. (2025) · Springer eBooks · doi:10.1007/978-3-031-47219-0_4 · Cited by 2
Huynh, T. P., & Miller, J. (2012) · International Journal of Systems and Service-Oriented Engineering · doi:10.4018/jssoe.2012010105 · Cited by 2
II. METHODS AND PROCEDURES FOR THE FAMILY TRANSITIONS STUDY
Oh, W., Volling, B. L., Gonzalez, R., Rosenberg, L., & Song, J. (2017) · Monographs of the Society for Research in Child Development · doi:10.1111/mono.12308 · Cited by 3
Group Differences, Genetic Similarity Theory, and the Importance of Personality Traits
Rushton, J. P. (1984) · Springer eBooks · doi:10.1007/978-1-4757-9191-4_5 · Cited by 2
Self-citationAssessment device of metacognition involved in a working situation
Huet, N. (1999) · International Journal of Industrial Ergonomics · doi:10.1016/s0169-8141(98)00032-8 · Cited by 2
Academic Decision Making and Prospect Theory
Mowrer, R. R., & Davidson, W. B. (2011) · Psychological Reports · doi:10.2466/01.07.20.pr0.109.4.289-300 · Cited by 7
What Do Genes Have to Do with Cognition?
Johnson, W. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139021463.013 · Cited by 2
X. DEVELOPMENTAL TRAJECTORIES OF CHILDREN’S SLEEP PROBLEMS AFTER THE BIRTH OF A SIBLING
Safyer, P., Stevenson, M. M., Gonzalez, R., Volling, B. L., Oh, W., & Yu, T. (2017) · Monographs of the Society for Research in Child Development · doi:10.1111/mono.12316 · Cited by 2
Concurrent and Lagged Effects of Leadership Behavior on Subordinate Stress and Health
Burnfield, J. L. (2005) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 2
‘Did you see that, Mom?’: Social Looking in Three‐Year‐Old Boys
Martin, S. E., Crnic, K. A., & Belsky, J. (2003) · Social Development · doi:10.1111/1467-9507.00243 · Cited by 2
Personality Traits and the Inventories That Measure Them
Ashton, M. C. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-85950-9.00004-2 · Cited by 2
Evaluating the Alberta riparian habitat management program
Bateman, N. G. (2001) · Open ULeth Scholarship (OPUS) (University of Lethbridge) · Cited by 2
Walberg, H. J., & Wynne, E. A. (1993) · Gifted Child Today · doi:10.1177/107621759301600610 · Cited by 2
Achieving reliability in observational research: lessons from a study of newborn temperament.
Breitmayer, B. J. (1991) · PubMed · Cited by 2
Goodin, J. B. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2165574 · Cited by 2
Spann, C. A. (2016) · UTA ResearchCommons (University of Texas Arlington) · Cited by 2
Rushton, J. P. (1990) · Social Science & Medicine · doi:10.1016/0277-9536(90)90026-o · Cited by 2
Self-citationWard, M. J., Vaughn, B. E., & Robb, M. D. (1988) · Child Development · doi:10.1111/j.1467-8624.1988.tb03223.x · Cited by 2
Measuring object recognition ability: Reliability, validity, and the aggregate z-score approach.Preprint
Smithson, C. J. R., Chow, J. K.-J., Chang, T.-Y., & Gauthier, L. (2023) · doi:10.31234/osf.io/bmyan · Cited by 2
Ogbonnaya, C. N. (2013) · UEA Digital Repository (University of East Anglia) · Cited by 2
The effect of multi-tasks mechanism on cooperation in evolutionary game
Fan, J., Du, H., Li, G., & He, X. (2024) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0210787 · Cited by 1
Ramsey, M. C., Bowling, N. A., & Menke, P. (2024) · Applied Psychological Measurement · doi:10.1177/01466216241284293 · Cited by 1
Kim, S., & Kochanska, G. (2025) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.70034 · Cited by 1
Early Parenting Effects on Childhood Delay of Gratification and Adolescent Allostatic Load
Leonard, H., Khurana, A., & Kosty, D. B. (2025) · Children · doi:10.3390/children12091203 · Cited by 1
Schwartz, A., Pulliam, G., Feldman, J. I., Dunham-Carr, K., Clark, S. M., McClurkin, K., Cascio, C. J., Keçeli-Kaysılı, B., & Woynaroski, T. G. (2025) · Hearing Research · doi:10.1016/j.heares.2025.109472 · Cited by 1
Lin, C.-J., Chang, P.-Y., Li, Y.-L., Wu, C., Tu, C., Wu, C.-Y., Chen, S.-Y., & Chiou, H.-Y. (2026) · Environmental Research · doi:10.1016/j.envres.2026.124445 · Cited by 1
Sugimura, N. (2010) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1
Factors, C. (2012) · Dialnet (Universidad de la Rioja) · Cited by 1
Han, J. (2015) · Journal of Digital Convergence · doi:10.14400/jdc.2015.13.7.69 · Cited by 1
Relational aggression: a review and conceptualization
Saket, K. H. (2005) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 1
Brett, J. M., & Drasgow, F. (2002) · Cited by 1
Wood, E. K., Baron, Z., Kruger, R., Halter, C. M., Gabrielle, N., Neville, L., Smith, E., Marett, L., Johnson, M., Rosso, L. A. D., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281935 · Cited by 1
Auswertung und Qualitätsprüfung von Sachverständigengutachten
Kindler, H., & Fegert, J. M. (2023) · Springer eBooks · doi:10.1007/978-3-662-66900-6_40 · Cited by 1
Zhang, Y., Ye, Y., Paquette, L., Wang, Y., & Hu, X. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12951 · Cited by 1
Sihan Wang1, W. L. (2024) · Frontiers in Educational Research · doi:10.25236/fer.2024.070731
Bombel, G. (2009) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 1
Assessing Overall Functioning With Adolescent Inpatients
Haggerty, G., Forlenza, N., Poland, C., Ray, S., Zodan, J., Mehra, A., Goyal, A. K., Baity, M. R., Siefert, C. J., Sobin, S., et al. (2014) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000200 · Cited by 1
Scene Memory in Young Children.
Saarnio, D. A. (1993) · Merrill-palmer Quarterly · Cited by 1
VIII. DEVELOPMENTAL TRAJECTORIES OF CHILDREN’S WITHDRAWAL AFTER THE BIRTH OF A SIBLING
Oh, W., Song, J., Gonzalez, R., Volling, B. L., & Yu, T. (2017) · Monographs of the Society for Research in Child Development · doi:10.1111/mono.12314 · Cited by 2
Taraday, M. (2019) · Studia Psychologica · doi:10.21909/sp.2019.04.783 · Cited by 1
V. DEVELOPMENTAL TRAJECTORIES OF CHILDREN’S ATTENTION PROBLEMS AFTER THE BIRTH OF A SIBLING
Song, J., Oh, W., Gonzalez, R., Volling, B. L., & Yu, T. (2017) · Monographs of the Society for Research in Child Development · doi:10.1111/mono.12311 · Cited by 1
The child's understanding of correspondence relations.
Schonfeld, I. S. (1990) · Developmental Psychology · doi:10.1037//0012-1649.26.1.94 · Cited by 1
Reconsidering core impairments in autism: Diversity in empathy and social behavior
Scheeren, A. M. (2012) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) · Cited by 1
Nordling, J. K. (2014) · doi:10.17077/etd.1le9ct8w · Cited by 2
White collar criminality: a prediction model
Collins, J. M. (1991) · Iowa State University Digital Repository (Iowa State University) · doi:10.31274/rtd-180813-9258 · Cited by 1
Methodological Advances in Composite-based Structural Equation Modeling
Schamberger, T. (2022) · doi:10.3990/1.9789036553759 · Cited by 1
Intervention programs to improve cognitive skills
Gülgöz, S. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511720437.024
Nonindependent mate choice in humans
Vakirtzis, A. (2012) · University of Liverpool · doi:10.17638/00005433
Relation between the Switching Costs and Corporate Image
Kim, Y.-T. (2009) · The Journal of the Korea Contents Association · doi:10.5392/jkca.2009.9.1.293
Looming Maladaptive Style as a Specific Moderator of Risk Factors for Anxiety
Adler, A. (2009) · The Knowledge Bank (The Ohio State University)
Hwan, H.-J. (2011) · The Journal of the Korea Contents Association · doi:10.5392/jkca.2011.11.9.302
Emotion regulation and Borderline Personality features
Porter, C. (2014) · CLOK (University of Central Lancashire)
RESEARCH REPORTS Relationship of Core Self-Evaluations to Goal Setting, Motivation, and Performance
Erez, A., Judge, T. A., & Is, T. A. J. (2014)
Types of Parent Verbal Responsiveness ThatPredictLanguageinYoungChildren
McDuffie, A. S., & Yoder, P. J. (2010)
REPORT A longitudinal behavioral genetic analysis of task persistence
Deater-Deckard, K. D., Petrill, S. A., Thompson, L. A., & DeThorne, L. S. (2006)
L'ensenyament aprenentatge de la cooperació: estudi d'un cas a l'educació primària
Ortíz, D. C. (2008) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Study of the formation of the socio-moral competence of adolescents
Podolskiy, D. A. (2017) · Consulting company Ucom eBooks · doi:10.17117/mon.2017.03.02
Book Review: Handbook of Ethics in Quantitative Methodology
O’Neill, P. (2012) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2012.7.4.87
The Association between Parental Scaffolding and Children's Executive Function
Hui, D. (2017) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3ng4h57x
Sällberg, H. (2010) · LAP LAMBERT Academic Publishing eBooks
The Validity of the Holtzman Inkblot Technique: New Indices
Dawe, J., Hawkins, R. C., Lauriola, M., Leichsenring, F., & Pezzuti, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.621669
(1990) · Monographs of the Society for Research in Child Development · doi:10.1111/j.1540-5834.1990.tb00284.x
Schmidt, L. R. (1988) · Springer eBooks · doi:10.1007/978-1-4613-0893-5_23
Metadata
- Authors
- Rushton, J. P., Brainerd, C. J., & Pressley, M.
- Affiliations
- Western University (CA)
- ORCID
- Brainerd, Charles J.
- Venue
- Psychological Bulletin
- Published
- 1983-07
- Volume
- 94
- Issue
- 1
- Pages
- 18-38
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2152174164
- Cited by
- 940
- References
- 100
- Citations by year
- 2026: 10 · 2025: 17 · 2024: 16 · 2023: 15 · 2022: 22 · 2021: 28 · 2020: 17 · 2019: 23 · 2018: 29 · 2017: 37 · 2016: 26 · 2015: 18 · 2014: 33 · 2013: 20 · 2012: 38
- FWCI
- 32.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Clinical Psychology › Personality Traits and Psychology
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- construct validity, behavioral development, measurement error, personality stability, moral judgment, metacognition, attitude-behavior relationship, altruism, attachment, sex differences, cross-situational consistency, longitudinal stability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review