Much ado about something: violent video game effects and a school of red herring: reply to Ferguson and Kilburn (2010)
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
In this article we reply to C. J. Ferguson and J. Kilburn’s (2010) critique of our meta-analysis on violent video game effects (C. A. Anderson et al., 2010). We rely on well-established methodological and statistical theory and on empirical data to show that claims of bias and misinterpretation on our part are simply wrong. One should not systematically exclude unpublished studies from meta-analytic reviews. There is no evidence of publication or selection bias in our data. We did not purposely exclude certain studies; we included all studies that met our inclusion criteria. Although C. J. Ferguson and J. Kilburn believe that the effects we obtained are trivial in size, they are larger than many effects that are deemed sufficiently large to warrant action in medical and violence domains. The claim that we (and other media violence scholars) are attempting to create a false crisis is a red herring.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, as of the 1980s, there has been a fierce debate among scholars about the effects of game violence on aggression (e.g.see the dispute in Psychological Bulletin about whether this effect is trivial or meaningful [51,52]).”
From Social media use and its impact on adolescent mental health: An umbrella review of the evidence. (2022) · cites this paper as [51]
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Self-citation(2000) · Cited by 9,198
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779 · cited 1×
“Sterne and Egger (2001) noted that it is possible that studies with smaller samples actually do have larger effects, perhaps because the smaller studies used different populations or designs than did the larger ones.”
ResultThe motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Anderson, C. A., Shibuya, A., Ihori, N., Swing, E. L., Bushman, B. J., Sakamoto, A., Rothstein, H. R., & Saleem, M. (2010) · Psychological Bulletin · doi:10.1037/a0018251 · Cited by 2,048 · cited 5×
“…of Michigan and Vrije Universiteit Hannah R. Rothstein Baruch College, City University of New York Craig A. Anderson Iowa State University In this article we reply to C. J. Ferguson and J. Kilburn’s (2010) critique of our meta-analysis on violent video game effects (C. A. Anderson et al., 2010).”
BackgroundMethodResultInfluentialSelf-citation
Cited by
Social media use and its impact on adolescent mental health: An umbrella review of the evidence.
Valkenburg, P. M., Meier, A., & Beyens, I. (2022) · Current opinion in psychology · doi:10.1016/j.copsyc.2021.08.017 · Cited by 767
Greitemeyer, T., & Mügge, D. O. (2014) · Personality and Social Psychology Bulletin · doi:10.1177/0146167213520459 · Cited by 636
“Whereas Anderson, Bushman and colleagues (Anderson et al., 2010; Bushman et al., 2010) argue that violent video games do increase aggression, this claim has been disputed by Ferguson and his research group (e.g., Ferguson & Kilburn, 2010).”
BackgroundMedia use and ADHD-related behaviors in children and adolescents: A meta-analysis
Nikkelen, S. W. C., Valkenburg, P. M., Huizinga, M., & Bushman, B. J. (2014) · Developmental Psychology · doi:10.1037/a0037318 · Cited by 339
“…movement; Christakis, 2009; Christakis, Zimmerman, DiGiuseppe, & McCarty, 2004; Geist & Gibson, 2000; Halpern, 1975; Jensen et al., 1997; Landhuis, Poulton, Welch, & Hancox, 2007; Levine & Waite, 2000) or to the overall amount of time children spent consuming media (Christakis, 2009; Zimmerman &…”
Self-citationMetaanalysis of the relationship between violent video game play and physical aggression over time
Prescott, A. T., Sargent, J. D., & Hull, J. G. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611617114 · Cited by 303
Krahé, B., Möller, I., Huesmann, L. R., Kirwil, L., Felber, J., & Berger, A. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0021711 · Cited by 236
“…of media violence to increase aggression is far from being over, as reflected in a recent issue of Psychological Bulletin (Anderson et al., 2010; Bushman et al., 2010; Ferguson & Kilburn, 2010; Huesmann, 2010) and in a 2008 special issue of the American Behavioral Scientist, in which Grimes,…”
Metadata
- Authors
- Bushman, B. J., Rothstein, H. R., & Anderson, C. A.
- Affiliations
- University of Michigan (US)
- Baruch College (US)
- Iowa State University (US)
- Venue
- Psychological Bulletin
- Published
- 2010-03
- Volume
- 136
- Issue
- 2
- Pages
- 182-187
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2100193398
- Semantic Scholar
- 0b854b5a8d89106845e7651d09d36fc7829c8509
- Cited by
- 104
- References
- 56
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 1 · 2023: 3 · 2022: 1 · 2021: 7 · 2020: 2 · 2019: 2 · 2018: 3 · 2017: 5 · 2016: 8 · 2015: 8 · 2014: 26 · 2013: 13 · 2012: 10
- FWCI
- 14.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- VU Research Portal (publishedVersion)
- Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Bullying, Victimization, and Aggression
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Digital Games and Media
- Keywords
- violent video games, media violence, publication bias, selection bias, unpublished research, effect size, meta-analysis methodology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Much ado about something: violent video game effects and a school of red herring: reply to Ferguson and Kilburn (2010). https://app.cochat.ai/papers/10.1037/a0018718
- The paper
- Bushman, B. J., Rothstein, H. R., & Anderson, C. A. (2010). Much ado about something: violent video game effects and a school of red herring: reply to Ferguson and Kilburn (2010). Psychological Bulletin. https://doi.org/10.1037/a0018718
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.