The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Construct validity of the multidimensional structure of bullying and victimization: An application of exploratory structural equation modeling.
Abstract
Existing research posits multiple dimensions of bullying and victimization but has not identified well-differentiated facets of these constructs that meet standards of good measurement: goodness of fit, measurement invariance, lack of differential item functioning, and well-differentiated factors that are not so highly correlated as to detract from their discriminant validity and substantive usefulness in school settings. Here we demonstrate exploratory structural equation modeling, an integration of confirmatory factor analysis and exploratory factor analysis. On the basis of responses to the 6-factor Adolescent Peer Relations Instrument (verbal, social, physical facets of bullying and victimization), we tested invariance of factor loadings, factor variances–covariances, item uniquenesses, item intercepts (a lack of differential item functioning), and latent means across gender, year in school, and time. Using a combination of relations with student characteristics and a multitrait–multimethod analysis, we showed that the 6 bully/victim factors have discriminant validity over time and in relation to gender, year in school, and relevant psychosocial correlates (e.g., depression, 11 components of academic and nonacademic self-concept, locus of control, attitudes toward bullies and victims). However, bullies and victims are similar in many ways, and longitudinal panel models of the positive correlations between bully and victim factors suggest reciprocal effects such that each is a cause and an effect of the other.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The APRI is a psychometrically validated instrument that can be used to assess involvement in bullying behaviors as bullies and victims among school-aged children”
From The representation of bullying in Italian primary school children: A mixed-method study comparing drawing and interview data and their association with self-report involvement in bullying events (2022) · cites this paper as Marsh et al. 2011
Citations
Cites
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,870
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Self-citationMissing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536
Self-concept: validation of construct interpretations.
Shavelson, R. J., Hubner, J. J., & Stanton, G. C. (1976) · Review of Educational Research · doi:10.3102/00346543046003407 · Cited by 4,164
Relational Aggression, Gender, and Social-Psychological Adjustment
Crick, N. R., & Grotpeter, J. K. (1995) · Child Development · doi:10.1111/j.1467-8624.1995.tb00900.x · Cited by 3,954
Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.391 · Cited by 3,953
Self-citationBullying Behaviors Among US Youth
Nansel, T. R., Overpeck, M. D., Pilla, R. S., Ruan, W. J., Simons‐Morton, B. G., & Scheidt, P. C. (2001) · JAMA · doi:10.1001/jama.285.16.2094 · Cited by 3,805
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
The Development and Treatment of Childhood Aggression
Rubin, K. H., & Pepler, D. J. (2013) · Psychology Press eBooks · doi:10.4324/9780203771693 · Cited by 2,747
Exploratory Structural Equation Modeling
Asparouhov, T., & Muthén, B. (2009) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510903008204 · Cited by 2,701
Hawker, D. S. J., & Boulton, M. J. (2000) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00629 · Cited by 2,694
Card, N. A., Stucky, B. D., Sawalani, G. M., & Little, T. D. (2008) · Child Development · doi:10.1111/j.1467-8624.2008.01184.x · Cited by 1,917 · cited 5×
“…approach, the correlations among the bully factors and among the victim factors were so high as to seriously undermine ability to distinguish among the three subdomains in relation to both bullying and victimization, a result that appears to be the norm in this area of research (Card et al., 2008).”
BackgroundResultInfluentialSex Differences in Aggression in Real-World Settings: A Meta-Analytic Review
Archer, J. (2004) · Review of General Psychology · doi:10.1037/1089-2680.8.4.291 · Cited by 1,916
Marsh, H. W., & Craven, R. G. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00010.x · Cited by 1,368
Self-citationPeer harassment in school: the plight of the vulnerable and victimized
(2002) · Choice Reviews Online · doi:10.5860/choice.39-4110 · Cited by 1,354
(2002) · Choice Reviews Online · doi:10.5860/choice.39-2858 · Cited by 1,304
Olweus, D. (1991) · Medical Entomology and Zoology · Cited by 1,238
(2014) · Routledge eBooks · doi:10.4324/9781315812397 · Cited by 1,106
Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. S., & Trautwein, U. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903008220 · Cited by 1,093
Self-citationMultiple regression as a general data-analytic system.
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026714 · Cited by 1,090
A Primer on Maximum Likelihood Algorithms Available for Use With Missing Data
Enders, C. K. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0801_7 · Cited by 1,027
A factor analytically derived measure of coping: The Coping Strategy Indicator.
Amirkhan, J. H. (1990) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.59.5.1066 · Cited by 1,009
Longitudinal Research in the Study of Behavior and Development
Nesselroade, J. R., & Baltes, P. B. (1979) · MPG.PuRe (Max Planck Society) · Cited by 1,004
School Bullying: Insights and Perspectives
Smith, P. K., & Sharp, S. (1994) · Medical Entomology and Zoology · Cited by 943
A new look at the big five factor structure through exploratory structural equation modeling
Marsh, H. W., Lüdtke, O., Muthén, B., Asparouhov, T., Morin, A. J. S., Trautwein, U., & Nagengast, B. (2010) · Psychological Assessment · doi:10.1037/a0019227 · Cited by 899
Self-citationAdvances in factor analysis and structural equation models
Jöreskog, K. G., Sörbom, D., & Magidson, J. (1979) · Medical Entomology and Zoology · Cited by 826
BULLY/VICTIM PROBLEMS AMONG MIDDLE SCHOOL CHILDREN
Boulton, M. J., & Underwood, K. (1992) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.1992.tb01000.x · Cited by 809
Marsh, H. W., & Hau, K. (1996) · The Journal of Experimental Education · doi:10.1080/00220973.1996.10806604 · Cited by 730
Self-citationBully/victim problems in school: Facts and intervention
Olweus, D. (1997) · European Journal of Psychology of Education · doi:10.1007/bf03172807 · Cited by 724
Due, P., Holstein, B. E., Lynch, J. W., Diderichsen, F., Gabhainn, S. N., Scheidt, P. C., & Currie, C. E. (2005) · European Journal of Public Health · doi:10.1093/eurpub/cki105 · Cited by 706
Polyvictimization and trauma in a national longitudinal cohort
FINKELHOR, D., ORMROD, R. K., & TURNER, H. A. (2007) · Development and Psychopathology · doi:10.1017/s0954579407070083 · Cited by 704
What Can Be Done About School Bullying?: Linking Research to Educational Practice
Swearer, S. M., Espelage, D. L., Vaillancourt, T., & Hymel, S. (2010) · Educational Researcher · doi:10.3102/0013189x09357622 · Cited by 672
New developments in latent variable panel analyses of longitudinal data
Little, T. D., Preacher, K. J., Selig, J. P., & Card, N. A. (2007) · International Journal of Behavioral Development · doi:10.1177/0165025407077757 · Cited by 670
An Essay on Measurement and Factorial Invariance
Meredith, W., & Teresi, J. A. (2006) · Medical Care · doi:10.1097/01.mlr.0000245438.73837.89 · Cited by 664
Bullying in Schools and What to Do About It
Rigby, K. (1996) · Cited by 630
Boulton, M. J., & Smith, P. K. (1994) · British Journal of Developmental Psychology · doi:10.1111/j.2044-835x.1994.tb00637.x · Cited by 622
Measuring self-concept across the life span: Issues and instrumentation.
Byrne, B. M. (1996) · American Psychological Association eBooks · doi:10.1037/10197-000 · Cited by 605
Internalizing disorders in childhood.
Kovacs, M., & Devlin, B. (1998) · Journal of Child Psychology and Psychiatry and Allied Disciplines · doi:10.1111/1469-7610.00303 · Cited by 580
Sutton, J., Smith, P. K., & Swettenham, J. (1999) · Social Development · doi:10.1111/1467-9507.00083 · Cited by 554
Marsh, H. W., & Hocevar, D. (1988) · Journal of Applied Psychology · doi:10.1037/0021-9010.73.1.107 · Cited by 529
Self-citationCrick, N. R., Bigbee, M. A., & Howes, C. (1996) · Child Development · doi:10.1111/j.1467-8624.1996.tb01779.x · Cited by 524
Card, N. A., & Hodges, E. V. E. (2008) · School Psychology Quarterly · doi:10.1037/a0012769 · Cited by 504
Underwood, M. K. (2003) · Cited by 486
Factors Associated with Bullying Behavior in Middle School Students
Bosworth, K., Espelage, D. L., & Simon, T. R. (1999) · The Journal of Early Adolescence · doi:10.1177/0272431699019003003 · Cited by 485
Wolke, D., Woods, S., Bloomfield, L., & Karstadt, L. (2000) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00687 · Cited by 477
Marsh, H. W. (2007) · Wiley eBooks · doi:10.1002/9781118270011.ch35 · Cited by 395
Self-citationA Comparative Investigation of Rotation Criteria Within Exploratory Factor Analysis
Sass, D. A., & Schmitt, T. A. (2010) · Multivariate Behavioral Research · doi:10.1080/00273170903504810 · Cited by 383
Wylie, R. (1989) · Medical Entomology and Zoology · Cited by 382
Orthogonal Rotation to Congruence
Cliff, N. (1966) · Psychometrika · doi:10.1007/bf02289455 · Cited by 382
Multilevel Analysis of Individuals and Cultures
van de Vijver, F. J. R., Hemert, D. A. V., & Poortinga, Y. H. (2015) · Psychology Press eBooks · doi:10.4324/9780203888032 · Cited by 380
Rigby, K., & Slee, P. T. (1999) · Suicide and Life-Threatening Behavior · doi:10.1111/j.1943-278x.1999.tb01050.x · Cited by 373
Latent variable models of multitrait-multimethod data.
Marsh, H. W., & Grayson, D. A. (1995) · Cited by 362
Self-citationCausal ordering of academic self-concept and achievement: Reanalysis of a pioneering study and...
Marsh, H. W., Byrne, B. M., & Yeung, A. S. (1999) · Educational Psychologist · doi:10.1207/s15326985ep3403_2 · Cited by 343
Self-citationMarsh, H. W., Ellis, L. A., Parada, R. H., Richards, G. E., & Heubeck, B. G. (2005) · Psychological Assessment · doi:10.1037/1040-3590.17.1.81 · Cited by 326
Self-citationRoland, E., & Idsøe, T. (2001) · Aggressive Behavior · doi:10.1002/ab.1029 · Cited by 313
Nelson, P. A. (2015) · Sage eBooks · doi:10.4135/9781452206905.n439 · Cited by 294
Group aggression among school children in three schools
LAGERSPETZ, K. M. J., Björkqvist, K., BERTS, M., & KING, E. (1982) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.1982.tb00412.x · Cited by 282
Theoretical perspectives on the structure of self-concept.
Marsh, H. W., & Hattie, J. (1996) · Cited by 281
Self-citationMarsh, H. W., Martin, A. J., & Jackson, S. A. (2010) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.32.4.438 · Cited by 274
Self-citationAggression and Sociometric Status among Peers: Do Gender and Type of Aggression Matter?
Salmivalli, C., Kaukiainen, A., & LAGERSPETZ, K. M. J. (2000) · Scandinavian Journal of Psychology · doi:10.1111/1467-9450.00166 · Cited by 242
Sullivan, K. (2011) · SAGE Publications Ltd eBooks · doi:10.4135/9781446289006 · Cited by 233
Marsh, H. W., & Hau, K. (2006) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2006.10.008 · Cited by 229
Self-citationVaillancourt, T., Brendgen, M. R., Boivin, M., & Tremblay, R. E. (2003) · Child Development · doi:10.1046/j.1467-8624.2003.00628.x · Cited by 172
Relational victimization in childhood and adolescence: I hurt you through the grapevine.
Creek, N. R., Nelson, D. A., Morales, J. R., Cullerton‐Sen, C., Casas, J. F., & Hickman, S. E. (2001) · ScholarsArchive (Brigham Young University) · Cited by 170
Rotation to Achieve Factorial Invariance
Meredith, W. H. (1964) · Psychometrika · doi:10.1007/bf02289700 · Cited by 166
Olweus, D. (1993) · Cited by 166
Toward an integrated gender-linked model of aggression subtypes in early and middle childhood.
Ostrov, J. M., & Godleski, S. A. (2010) · Psychological Review · doi:10.1037/a0018070 · Cited by 159
The Effects of Model Parsimony and Sampling Error on the Fit of Structural Equation Models
Cheung, G. W., & Rensvold, R. B. (2001) · Organizational Research Methods · doi:10.1177/109442810143004 · Cited by 155
Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive?
Campbell, D. T., & O'Connell, E. J. (1967) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0204_1 · Cited by 139
Prospective Associations Between Peer Victimization and Aggression
Ostrov, J. M. (2010) · Child Development · doi:10.1111/j.1467-8624.2010.01501.x · Cited by 133
Bullying: implications for the classroom
(2005) · Choice Reviews Online · doi:10.5860/choice.42-3550 · Cited by 128
Marsh, H. W., Parada, R. H., Yeung, A. S., & Healey, J. B. (2001) · Journal of Educational Psychology · doi:10.1037//0022-0663.93.2.411 · Cited by 117
Self-citationMarsh, H. W. (1993) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1993.tb01072.x · Cited by 105
Self-citationMultitrait-Multimethod Analyses: Inferring Each Trait-Method Combination With Multiple Indicators
Marsh, H. W. (1993) · Applied Measurement in Education · doi:10.1207/s15324818ame0601_4 · Cited by 100
Self-citationMarsh, H. W., Parada, R. H., Craven, R. G., & Finger, L. R. (2004) · Elsevier eBooks · doi:10.1016/b978-012617955-2/50009-6 · Cited by 97
Self-citationSelf-processes, learning, and enabling human potential : dynamic new approaches
Marsh, H. W., Craven, R. G., & McInerney, D. M. (2008) · Cited by 94
Self-citationLongitudinal stability of latent means and individual differences: A unified approach
Marsh, H. W., & Grayson, D. (1994) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705519409539984 · Cited by 94
Self-citationSelig, J. P., Card, N. A., & Little, T. D. (2008) · Cited by 66
Long-Term Total Negative Effects of School-Average Ability on Diverse Educational Outcomes
Marsh, H. W., & O’Mara-Eves, A. (2010) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652.a000004 · Cited by 64
Self-citationTesting Measurement Invariance in the Target Rotated Multigroup Exploratory Factor Model
Dolan, C. V., Oort, F. J., Stoel, R. D., & Wicherts, J. M. (2009) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510902751416 · Cited by 61
Behavioral Disorders in the School
Gumpel, T. P. (2008) · Journal of Emotional and Behavioral Disorders · doi:10.1177/1063426607310846 · Cited by 39
Studies on wild house mice VI: Differential effects of the Y chromosome on intermale aggression
Sluyter, F., van Oortmerssen, G. A., & Koolhaas, J. M. (1994) · Aggressive Behavior · doi:10.1002/1098-2337(1994)20:5 · Cited by 32
Studies on wild house mice iv: On the heredity of testosterone and readiness to attack
van Oortmerssen, G. A., Benus, R. F., & Sluyter, F. (1992) · Aggressive Behavior · doi:10.1002/1098-2337(1992)18:2 · Cited by 27
Hussein, M. H. (2009) · Social Psychology of Education · doi:10.1007/s11218-009-9098-y · Cited by 26
Aggression : biological, developmental, and social perspectives
Feshbach, S., & Zagrodzka, J. (1997) · Plenum Press eBooks · Cited by 25
Evaluations of relational aggression as a function of relationship type and conflict setting
Sumrall, S. G., Ray, G. E., & Tidwell, P. S. (2000) · Aggressive Behavior · doi:10.1002/(sici)1098-2337(2000)26:2 · Cited by 24
School bullying : psychosocial determinants and effective intervention
Parada, R. H. (2006) · Cited by 23
Self-citationMayer, M. J., & Cornell, D. G. (2010) · Educational Researcher · doi:10.3102/0013189x09356778 · Cited by 16
Studying Aggression With Structural Equation Modeling
Card, N. A., & Little, T. D. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816840.038 · Cited by 11
Multitrait–Multimethod Analyses
Pardy, S. A., Fabrigar, L. R., & Visser, P. S. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa427 · Cited by 9
Parada, R. H., Marsh, H. W., & Craven, R. G. (2005) · Cited by 7
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153700 · Cited by 1,988
Self-citationMorin, A. J. S., Arens, A. K., & Marsh, H. W. (2015) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2014.961800 · Cited by 913
Self-citationReeve, J., & Cheon, S. H. (2021) · Educational Psychologist · doi:10.1080/00461520.2020.1862657 · Cited by 766
Understanding the psychology of bullying: Moving toward a social-ecological diathesis–stress model.
Swearer, S. M., & Hymel, S. C. (2015) · American Psychologist · doi:10.1037/a0038929 · Cited by 809
Four decades of research on school bullying: An introduction.
Hymel, S., & Swearer, S. M. (2015) · American Psychologist · doi:10.1037/a0038928 · Cited by 662
Metadata
- Authors
- Marsh, H. W., Nagengast, B., Morin, A. J. S., Parada, R. H., Craven, R. G., & Hamilton, L. R.
- Affiliations
- University of Oxford (GB)
- Université de Sherbrooke (CA)
- Western Sydney University (AU)
- Venue
- Journal of Educational Psychology
- Published
- 2011-08
- Volume
- 103
- Issue
- 3
- Pages
- 701-732
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2004582047
- Cited by
- 232
- References
- 94
- Citations by year
- 2026: 11 · 2025: 19 · 2024: 9 · 2023: 8 · 2022: 15 · 2021: 20 · 2020: 15 · 2019: 22 · 2018: 16 · 2017: 18 · 2016: 19 · 2015: 24 · 2014: 17 · 2013: 9 · 2012: 9
- FWCI
- 15.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Educational Psychology (publishedVersion)
- Research Bank (Australian Catholic University) (submittedVersion)
- ResearchOnline@ND (The University of Notre Dame) (submittedVersion)
- Funders
- Australian Research Council
- Topics
- Social Sciences › Psychology › Social Psychology › Bullying, Victimization, and Aggression
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Workplace Violence and Bullying
- Keywords
- bullying, victimization, construct validity, multidimensional measurement, measurement invariance, differential item functioning, discriminant validity, reciprocal effects, self-concept, locus of control, depression, school students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
