Evaluating the quality of evidence for gaming disorder: A summary of systematic reviews of associations between gaming disorder and depression or anxiety
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Gaming disorder has been described as an urgent public health problem and has garnered many systematic reviews of its associations with other health conditions. However, review methodology can contribute to bias in the conclusions, leading to research, policy, and patient care that are not truly evidence-based. This study followed a pre-registered protocol (PROSPERO 2018 CRD42018090651) with the objective of identifying reliable and methodologically-rigorous systematic reviews that examine the associations between gaming disorder and depression or anxiety in any population. We searched PubMed and PsycInfo for published systematic reviews and the gray literature for unpublished systematic reviews as of June 24, 2020. Reviews were classified as reliable according to several quality criteria, such as whether they conducted a risk of bias assessment of studies and whether they clearly described how outcomes from each study were selected. We assessed possible selective outcome reporting among the reviews. Seven reviews that included a total of 196 studies met inclusion criteria. The overall number of participants was not calculable because not all reviews reported these data. All reviews specified eligibility criteria for studies, but not for outcomes within studies. Only one review assessed risk of bias. Evidence of selective outcome reporting was found in all reviews-only one review incorporated any of the null findings from studies it included. Thus, none were classified as reliable according to prespecified quality criteria. Systematic reviews related to gaming disorder do not meet methodological standards. As clinical and policy decisions are heavily reliant on reliable, accurate, and unbiased evidence synthesis; researchers, clinicians, and policymakers should consider the implications of selective outcome reporting. Limitations of the current summary include using counts of associations and restricting to systematic reviews published in English. Systematic reviewers should follow established guidelines for review conduct and transparent reporting to ensure evidence about technology use disorders is reliable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Pathological Video Game Use Among Youths: A Two-Year Longitudinal Study
Gentile, D. A., Choo, H., Liau, A., Sim, T., Li, D., Fung, D., & Khoo, A. (2011) · Pediatrics · doi:10.1542/peds.2010-1353 · Cited by 1,314
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Internet Gaming Addiction: A Systematic Review of Empirical Research
Kuss, D. J., & Griffiths, M. D. (2012) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-011-9318-5 · Cited by 1,113
The ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838
Page, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catalá-López, F., Li, L., Reid, E. K., Sarkis-Onofre, R., et al. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002028 · Cited by 768 · cited 2×
“Recent decades have witnessed a surge in the number of systematic reviews conducted [8].”
BackgroundMihara, S., & Higuchi, S. (2017) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12532 · Cited by 611 · cited 2×
“Most reviews discussed limitations at the study, outcome, and review level, but two reviews did not discuss limitations systematically [27,29].”
BackgroundThe relationships between behavioral addictions and the five-factor model of personality
Andreassen, C. S., Griffiths, M. D., Gjertsen, S. R., Krossbakken, E., Kvam, S., & Pallesen, S. (2013) · Journal of Behavioral Addictions · doi:10.1556/jba.2.2013.003 · Cited by 589
External Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001350 · Cited by 569 · cited 1×
“This definition, in turn, was informed by items identified from the Critical Appraisal Skills Programme (CASP), A Measurement Tool to Assess systematic Reviews (AMSTAR), and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) tools [9,22,23].”
Method
Cited by
Video game play is positively correlated with well-being
Johannes, N., Vuorre, M., & Przybylski, A. K. (2021) · Royal Society Open Science · doi:10.1098/rsos.202049 · Cited by 330
Future of Mental Health in the Metaverse
Usmani, S. S., Sharath, M., & Mehendale, M. (2022) · General Psychiatry · doi:10.1136/gpsych-2022-100825 · Cited by 262
Subtyping treatment-seeking gaming disorder patients
Granero, R., Fernández-Aranda, F., Castro-Calvo, J., Billieux, J., Valero-Solís, S., Mora-Maltas, B., Rivas-Pérez, S., Valenciano-Mendoza, E., del Pino-Gutiérrez, A., Gómez-Peña, M., et al. (2021) · Addictive Behaviors · doi:10.1016/j.addbeh.2021.107086 · Cited by 23
Throuvala, M. A., Griffiths, M. D., Rennoldson, M., & Kuss, D. J. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.648512 · Cited by 19
“…et al., 2020), with academic debates arguing the thresholds of normative and problematic behaviours (Bucksch et al., 2016; Boers et al., 2019; Hygen et al., 2020) and the choice of more appropriate methodological approaches in studies (Rumpf et al., 2019; Colder Carras et al., 2020; Orben, 2020).”
Background
Metadata
- Authors
- Colder Carras, M., Shi, J., Hard, G., & Saldanha, I. J.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-10-26
- Volume
- 15
- Issue
- 10
- Pages
- e0240032
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W3093863699
- Cited by
- 43
- References
- 30
- FWCI
- 1.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.