Much ado about nothing: the misestimation and overinterpretation of violent video game effects in eastern and western nations: comment on Anderson et al. (2010)
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
The issue of violent video game influences on youth violence and aggression remains intensely debated in the scholarly literature and among the general public. Several recent meta-analyses, examining outcome measures most closely related to serious aggressive acts, found little evidence for a relationship between violent video games and aggression or violence. In a new meta-analysis, C. A. Anderson et al. (2010) questioned these findings. However, their analysis has several methodological issues that limit the interpretability of their results. In their analysis, C. A. Anderson et al. included many studies that do not relate well to serious aggression, an apparently biased sample of unpublished studies, and a "best practices" analysis that appears unreliable and does not consider the impact of unstandardized aggression measures on the inflation of effect size estimates. They also focused on bivariate correlations rather than better controlled estimates of effects. Despite a number of methodological flaws that all appear likely to inflate effect size estimates, the final estimate of r = .15 is still indicative of only weak effects. Contrasts between the claims of C. A. Anderson et al. (2010) and real-world data on youth violence are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, as of the 1980s, there has been a fierce debate among scholars about the effects of game violence on aggression (e.g.see the dispute in Psychological Bulletin about whether this effect is trivial or meaningful [51,52]).”
From Social media use and its impact on adolescent mental health: An umbrella review of the evidence. (2022) · cites this paper as [52]
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Ioannidis (2005) observed that bias is particularly prevalent in new or “hot” research fields, as that on VVGs certainly is.”
BackgroundThe motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332
Anderson, C. A., Shibuya, A., Ihori, N., Swing, E. L., Bushman, B. J., Sakamoto, A., Rothstein, H. R., & Saleem, M. (2010) · Psychological Bulletin · doi:10.1037/a0018251 · Cited by 2,048 · cited 15×
“We also find that Anderson et al. (2010) did not rigidly apply their own standards.”
BackgroundResultInfluentialCriminal Justice and Behavior: An Editorial Retrospective
Brodsky, S. L. (1980) · Criminal Justice and Behavior · doi:10.1177/009385488000700401 · Cited by 1,723
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
The Effects of Television Violence on Antisocial Behavior: A Meta-Analysis1
PAIK, H., & COMSTOCK, G. (1994) · Communication Research · doi:10.1177/009365094021004004 · Cited by 856 · cited 2×
“We also noted (as did Paik & Comstock, 1994) that the best measures of aggression and violence produced the weakest effects and that problematic unstandardized use of some aggression measures, particularly in experimental studies, tended to inflate effects.”
BackgroundResultAn update on the effects of playing violent video games
Anderson, C. A. (2004) · Journal of Adolescence · doi:10.1016/j.adolescence.2003.10.009 · Cited by 738 · cited 11×
“Although including unpublished studies in meta-analyses is certainly common, is it really as “widely accepted” as they claim? Further, does their meta-analysis live up to their own rhetoric? First, Anderson et al. (2010) failed to note that many scholars have been critical of the inclusion of unpublished studies in me…”
BackgroundResultInfluentialMass Media Effects Research : Advances Through Meta-Analysis
Roskos‐Ewoldsen, D. R., Klinger, M. R., & Roskos‐Ewoldsen, B. (2006) · Routledge eBooks · Cited by 503
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
The effects of violent video games on aggression. A meta-analysis
Sherry, J. (2001) · Human Communication Research · doi:10.1093/hcr/27.3.409 · Cited by 444 · cited 3×
“However, readers should be aware that other recent meta-analyses on VVGs and media violence more broadly have been no more supportive of Anderson et al.’s position than our own (Savage & Yancey, 2008; Sherry, 2001, 2007).”
BackgroundKonijn, E. A., Nije Bijvank, M., & Bushman, B. J. (2007) · Developmental Psychology · doi:10.1037/0012-1649.43.4.1038 · Cited by 372
Evidence for publication bias in video game violence effects literature: A meta-analytic review
Ferguson, C. J. (2007) · Aggression and Violent Behavior · doi:10.1016/j.avb.2007.01.001 · Cited by 363 · cited 2×
“For instance, the Anderson et al. research group has assessed the “noise blast” aggression measure differently across multiple studies, with little explanation as to why (for a discussion, see Ferguson, 2007).”
BackgroundSelf-citationThe Public Health Risks of Media Violence: A Meta-Analytic Review
Ferguson, C. J., & Kilburn, J. (2009) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2008.11.033 · Cited by 327 · cited 1×
“To answer some of these questions, we engaged in a series of precise meta-analyses of VVG studies that most closely related to violent outcomes (e.g., Ferguson, 2007; Ferguson & Kilburn, 2009).”
BackgroundSelf-citationFerguson, C. J., San Miguel, C., & Hartley, R. D. (2009) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2009.06.021 · Cited by 274 · cited 2×
“Our F1 PR O O FS own research suggests that when other risk factors (e.g., depression, peers, family) are controlled, video game effects drop to near zero (Ferguson et al., 2009).”
BackgroundSelf-citationPrzybylski, A. K., Weinstein, N., Ryan, R. M., & Rigby, C. S. (2009) · CyberPsychology & Behavior · doi:10.1089/cpb.2009.0083 · Cited by 262
Should Unpublished Data Be Included in Meta-analyses?: Current Convictions and Controversies
Cook, D. J. (1993) · JAMA · doi:10.1001/jama.1993.03500210049030 · Cited by 259
Internet Fantasy Violence: A Test of Aggression in an Online Game
Williams, D., & Skoric, M. (2005) · Communication Monographs · doi:10.1080/03637750500111781 · Cited by 245 · cited 2×
“…groups that, arguably, have presented research not in line with Anderson et al.’s hypotheses may not have been contacted (e.g., Barnett, Coulson, & Foreman, 2008; Colwell & Kato, 2003; Kutner & Olson, 2008; Ryan, Rigby, & Przybylski, 2006; Unsworth, Devilly, & Ward, 2007; Williams & Skoric, 2005).”
ResultThe effects of video game play on young children's aggression, fantasy, and prosocial behavior
Silvern, S. B., & Williamson, P. A. (1987) · Journal of Applied Developmental Psychology · doi:10.1016/0193-3973(87)90033-5 · Cited by 210 · cited 1×
“Silvern and Williamson (1987) reported only a pretest/posttest design in which all children played the same video game (Space Invaders).”
Background(2008) · Cited by 194
The school shooting/violent video game link: causal relationship or moral panic?
Ferguson, C. J. (2008) · Journal of Investigative Psychology and Offender Profiling · doi:10.1002/jip.76 · Cited by 183 · cited 1×
“Figure 1 (adapted from Ferguson, 2008) presents this information for youth violence rates in the United States.”
BackgroundSelf-citationThe Effects of Media Violence Exposure On Criminal Aggression: A Meta-Analysis
Savage, J., & Yancey, C. (2008) · Criminal Justice and Behavior · doi:10.1177/0093854808316487 · Cited by 179 · cited 1×
“However, readers should be aware that other recent meta-analyses on VVGs and media violence more broadly have been no more supportive of Anderson et al.’s position than our own (Savage & Yancey, 2008; Sherry, 2001, 2007).”
BackgroundMeta-analysis: Unresolved issues and future developments
Smith, G. D., & Egger, M. (1998) · BMJ · doi:10.1136/bmj.316.7126.221 · Cited by 175
Ferguson, C. J., & Rueda, S. M. (2010) · European Psychologist · doi:10.1027/1016-9040/a000010 · Cited by 167
Self-citationColwell, J., & Kato, M. (2003) · Asian Journal of Social Psychology · doi:10.1111/1467-839x.t01-1-00017 · Cited by 157 · cited 1×
“…groups that, arguably, have presented research not in line with Anderson et al.’s hypotheses may not have been contacted (e.g., Barnett, Coulson, & Foreman, 2008; Colwell & Kato, 2003; Kutner & Olson, 2008; Ryan, Rigby, & Przybylski, 2006; Unsworth, Devilly, & Ward, 2007; Williams & Skoric, 2005).”
The effect of playing violent video games on adolescents: Should parents be quaking in their boots?
Unsworth, G., Devilly, G. J., & Ward, T. (2007) · Psychology, Crime & Law · doi:10.1080/10683160601060655 · Cited by 103
Personality, Psychopathology, and Developmental Issues in Male Adolescent Video Game Use
KESTENBAUM, G. I., & Weinstein, L. (1985) · Journal of the American Academy of Child Psychiatry · doi:10.1016/s0002-7138(09)61094-3 · Cited by 99 · cited 1×
“Kestenbaum and Weinstein (1985) reported p values, but no other statistics, and these for some outcomes but not all.”
BackgroundMedia Violence and Aggression: Science and Ideology
Grimes, T., Anderson, J. A., & Bergen, L. (2007) · Cited by 90
M-Rated Video Games and Aggressive or Problem Behavior Among Young Adolescents
Olson, C. K., Kutner, L. A., Baer, L., Beresin, E. V., Warner, D. E., & Nicholi II, A. M. (2009) · Applied Developmental Science · doi:10.1080/10888690903288748 · Cited by 69 · cited 1×
“For example, we note that several published reports (e.g., Barnett et al., 2008; Olson et al., 2009; Przybylski, Weinstein, Ryan, & Rigby, 2009) from this group of authors have been missed.”
ResultSocial Rejection, Control, Numbness, and Emotion: How Not to be Fooled by Gerber and Wheeler (2009)
Baumeister, R. F., DeWall, C. N., & Vohs, K. D. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01159.x · Cited by 67
Violent Crime: Clinical and Social Implications
Ferguson, C. J. (2010) · Sage eBooks · doi:10.4135/9781483349305 · Cited by 57
Self-citationPanee, C. D., & Ballard, M. E. (2002) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2002.tb02751.x · Cited by 55 · cited 2×
“In the Panee and Ballard (2002) study, all participants played the same violent game without any variation in game violence content.”
BackgroundYoung offenders and the media: Viewing habits and preferences
Hagell, A., & Newburn, T. (1994) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 15
Cited by
Social media use and its impact on adolescent mental health: An umbrella review of the evidence.
Valkenburg, P. M., Meier, A., & Beyens, I. (2022) · Current opinion in psychology · doi:10.1016/j.copsyc.2021.08.017 · Cited by 767
Greitemeyer, T., & Mügge, D. O. (2014) · Personality and Social Psychology Bulletin · doi:10.1177/0146167213520459 · Cited by 636
“Whereas Anderson, Bushman and colleagues (Anderson et al., 2010; Bushman et al., 2010) argue that violent video games do increase aggression, this claim has been disputed by Ferguson and his research group (e.g., Ferguson & Kilburn, 2010).”
BackgroundInfluentialFerguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603
Self-citationSensitivity Analysis for Publication Bias in Meta-Analyses
Mathur, M. B., & VanderWeele, T. J. (2020) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/rssc.12440 · Cited by 354
“…the results could be explained away by publication bias; other researchers suggested that publication bias might largely explain these results (Ferguson and Kilburn, 2010; Hilgard et al., 2017), whereas the original authors argued that the results were in fact robust to publication bias…”
ResultMedia use and ADHD-related behaviors in children and adolescents: A meta-analysis
Nikkelen, S. W. C., Valkenburg, P. M., Huizinga, M., & Bushman, B. J. (2014) · Developmental Psychology · doi:10.1037/a0037318 · Cited by 339
Metadata
- Authors
- Ferguson, C. J., & Kilburn, J.
- Affiliations
- Texas A&M International University (US)
- Venue
- Psychological Bulletin
- Published
- 2010
- Volume
- 136
- Issue
- 2
- Pages
- 174-178
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2043956774
- Semantic Scholar
- e61eecb0146f1dd5d426e836830bd424690bf0a9
- Cited by
- 311
- References
- 32
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 8 · 2023: 11 · 2022: 10 · 2021: 14 · 2020: 11 · 2019: 34 · 2018: 14 · 2017: 8 · 2016: 23 · 2015: 35 · 2014: 40 · 2013: 31 · 2012: 27
- FWCI
- 36.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Bullying, Victimization, and Aggression
- Social Sciences › Sociology and Political Science › Digital Games and Media
- Social Sciences › Sociology and Political Science › Crime Patterns and Interventions
- Keywords
- violent video games, aggression, youth violence, effect size inflation, unpublished research, cross-cultural comparison
- MeSH terms
- Adolescent, Adolescent Behavior, Aggression, Child, Child Behavior, Cross-Cultural Comparison, Humans, Japan, Research Design, United States, Violence, Publication Bias, Video Games, Benchmarking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.