Cross‐national validation of the social media disorder scale: findings from adolescents from 44 countries
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Background and aims: There is currently no cross‐national validation of a scale that measures problematic social media use (SMU). The present study investigated and compared the psychometric properties of the social media disorder (SMD) scale among young adolescents from different countries. Design: Validation study. Setting and participants: Data came from 222 532 adolescents from 44 countries participating in the health behaviour in school‐aged children (HBSC) survey (2017/2018). The HBSC survey was conducted in the European region and Canada. Participants were on average aged 13.54 years (standard deviation = 1.63) and 51.24% were girls. Measurement: Problematic SMU was measured using the nine‐item SMD scale with dichotomous response options. Findings: Confirmatory factor analyses (CFA) showed good model fit for a one‐factor model across all countries (minimum comparative fit index (CFI) and Tucker–Lewis index (TLI) = 0.963 and 0.951, maximum root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) = 0.057 and 0.060), confirming structural validity. The internal consistency of the items was adequate in all countries (minimum alpha = 0.840), indicating that the scale provides reliable scores. Multi‐group CFA showed that the factor structure was measurement invariant across countries (ΔCFI = −0.010, ΔRMSEA = 0.003), suggesting that adolescents’ level of problematic SMU can be reliably compared cross‐nationally. In all countries, gender and socio‐economic invariance was established, and age invariance was found in 43 of 44 countries. In line with prior research, in almost all countries, problematic SMU related to poorer mental wellbeing (range β STDY = 0.193–0.924, P < 0.05) and higher intensity of online communication (range β STDY = 0.163–0.635, P < 0.05), confirming appropriate criterion validity. Conclusions: The social media disorder scale appears to be suitable for measuring and comparing problematic social media use among young adolescents across many national contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Costello, A. B., & Osborne, J. (2005) · University of Massachusetts Amherst · doi:10.7275/jyj1-4868 · Cited by 10,297
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978
Conventional wisdom on measurement: A structural equation perspective.
Bollen, K., & Lennox, R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.2.305 · Cited by 3,618
A “components” model of addiction within a biopsychosocial framework
Griffiths, M. (2005) · Journal of Substance Use · doi:10.1080/14659890500114359 · Cited by 3,088 · cited 1×
“This implies that alongside the six items referring to the core criteria of addiction [4,12], the three additional items that distinguish the SMD scale from other problematic SMU scales [11,21], including problems, displacement and”
BackgroundRhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012) · Psychological Methods · doi:10.1037/a0029315 · Cited by 2,816 · cited 1×
“The CFAs, internal consistency and measurement invariance analyses were conducted using weighted least square means and variance adjusted (WLSMV) estimation with a probit regression link, as appropriate for analyses with categorical outcomes [59].”
MethodAndreassen, C. S., Billieux, J., Griffiths, M. D., Kuss, D. J., Demetrovics, Z., Mazzoni, E., & Pallesen, S. (2016) · Psychology of Addictive Behaviors · doi:10.1037/adb0000160 · Cited by 2,095 · cited 3×
“One of the most widely adopted scales is the Bergen Social Media Addiction Scale [11], which covers six items that parallel the core criteria of addiction, including preoccupation (i.”
BackgroundMethodA checklist for testing measurement invariance
van de Schoot, R., Lugtig, P., & Hox, J. (2012) · European Journal of Developmental Psychology · doi:10.1080/17405629.2012.686740 · Cited by 2,064 · cited 2×
“Measurement invariance means that the scale measures the same underlying construct across subpopulations, which is required in order to reliably compare the level of problematic SMU across subpopulations [28].”
BackgroundDevelopment of a Facebook Addiction Scale
Andreassen, C. S., Torsheim, T., Brunborg, G. S., & Pallesen, S. (2012) · Psychological Reports · doi:10.2466/02.09.18.pr0.110.2.501-517 · Cited by 1,884 · cited 1×
“This implies that alongside the six items referring to the core criteria of addiction [4,12], the three additional items that distinguish the SMD scale from other problematic SMU scales [11,21], including problems, displacement and”
BackgroundZubaida, S. D., & Cantril, H. (1967) · The British Journal of Sociology · doi:10.2307/588624 · Cited by 1,496 · cited 1×
“Life satisfaction was measured using the Cantril ladder, where respondents rated their life on a scale ranging from 0, worst possible life to 10, best possible life [33].”
MethodMultiple Imputation by Chained Equations (MICE): Implementation in Stata
Royston, P., & White, I. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i04 · Cited by 1,248
Problematic social media use: Results from a large-scale nationally representative adolescent sample
Bányai, F., Zsila, Á., Király, O., Maraz, A., Elekes, Z., Griffiths, M. D., Andreassen, C. S., & Demetrovics, Z. (2017) · PLOS ONE · doi:10.1371/journal.pone.0169839 · Cited by 984
The social media disorder scale
van den Eijnden, R. J. J. M., Lemmens, J. S., & Valkenburg, P. M. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.03.038 · Cited by 948
Parry, D. A., Davidson, B. I., Sewall, C. J. R., Fisher, J. T., Mieczkowski, H., & Quintana, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01117-5 · Cited by 793
How can we conceptualize behavioural addiction without pathologizing common behaviours?
Kardefelt‐Winther, D., Heeren, A., Schimmenti, A., van Rooij, A., Maurage, P., Carras, M., Edman, J., Blaszczynski, A., Khazaal, Y., & Billieux, J. (2017) · Addiction · doi:10.1111/add.13763 · Cited by 780 · cited 2×
“However, this conceptualization may not sufficiently measure the detrimental impact of this behaviour for daily life, which is considered one of the core aspects of addiction-like behaviours [13,14].”
BackgroundEU Kids Online 2020: survey results from 19 countries
(2020) · OAR@UM (University of Malta) · doi:10.21953/lse.47fdeqj01ofo · Cited by 663
Marino, C., Gini, G., Vieno, A., & Spada, M. M. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.10.007 · Cited by 658 · cited 1×
“as life satisfaction, and a positive moderate association between problematic SMU and negative mental wellbeing, for instance depression [7,53].”
BackgroundSelf-citationGriffiths, M. D., Kuss, D. J., & Demetrovics, Z. (2014) · Behavioral Addictions · doi:10.1016/b978-0-12-407724-9.00006-9 · Cited by 583
Monacis, L., de Palo, V., Griffiths, M. D., & Sinatra, M. (2017) · Journal of Behavioral Addictions · doi:10.1556/2006.6.2017.023 · Cited by 446
Adolescents’ Intense and Problematic Social Media Use and Their Well-Being in 29 Countries
Boer, M., van den Eijnden, R. J. J. M., Boniel-Nissim, M., Wong, S.-L., Inchley, J. C., Badura, P., Craig, W. M., Gobina, I., Kleszczewska, D., Klanšček, H. J., et al. (2020) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2020.02.014 · Cited by 434 · cited 2×
“SMU activities [52,54], which supports the suggestion that the intensity of SMU activities and problematic SMU should be regarded as related but different dimensions of SMU [10,32,54].”
BackgroundMethodSelf-citationA meta-analysis of the problematic social media use and mental health
Huang, C. (2022) · International Journal of Social Psychiatry · doi:10.1177/0020764020978434 · Cited by 399 · cited 1×
“as life satisfaction, and a positive moderate association between problematic SMU and negative mental wellbeing, for instance depression [7,53].”
BackgroundA comprehensive meta-analysis on Problematic Facebook Use
Marino, C., Gini, G., Vieno, A., & Spada, M. M. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.02.009 · Cited by 378 · cited 1×
“that problematic users use online communication intensively [51,52].”
BackgroundSelf-citationA weak scientific basis for gaming disorder: Let us err on the side of caution
van Rooij, A. J., Ferguson, C. J., Colder Carras, M., Kardefelt-Winther, D., Shi, J., Aarseth, E., Bean, A. M., Bergmark, K. H., Brus, A., Coulson, M., et al. (2018) · Journal of Behavioral Addictions · doi:10.1556/2006.7.2018.19 · Cited by 346
Boer, M., Stevens, G. W. J. M., Finkenauer, C., de Looze, M. E., & van den Eijnden, R. J. J. M. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106645 · Cited by 335
Self-citationBoer, M., Stevens, G., Finkenauer, C., & van den Eijnden, R. (2020) · Child Development · doi:10.1111/cdev.13334 · Cited by 157
Self-citationPortuguese validation of the Bergen Facebook Addiction Scale: an empirical study
Pontes, H. M., Andreassen, C. S., & Griffiths, M. D. (2016) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-016-9694-y · Cited by 90
Raudsepp, L. (2019) · Journal of Adolescence · doi:10.1016/j.adolescence.2019.09.005 · Cited by 83 · cited 2×
“If these associations occur because problematic SMU leads to significant psychological harm, as suggested by some longitudinal studies [10,50], then problematic SMU may reflect addiction-like behaviour, which has been questioned [13].”
BackgroundPiteo, E. M., & Ward, K. (2020) · Child and Adolescent Mental Health · doi:10.1111/camh.12373 · Cited by 75
R., V. (2009) · Frontiers in Neuroengineering · doi:10.3389/conf.neuro.14.2009.06.054 · Cited by 33
Cited by
Boniel-Nissim, M., van den Eijnden, R. J. J. M., Furstova, J., Marino, C., Lahti, H., Inchley, J., Šmigelskas, K., Vieno, A., & Badura, P. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107144 · Cited by 96
Self-citationAssessing problematic use of social media: where do we stand and what can be improved?
Cataldo, I., Billieux, J., Esposito, G., & Corazza, O. (2022) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2022.101145 · Cited by 90
Morningstar, B., Clayborne, Z., Wong, S. L., Roberts, K. C., Prince, S. A., Gariépy, G., Goldfield, G. S., Janssen, I., & Lang, J. J. (2023) · Canadian Journal of Public Health · doi:10.17269/s41997-023-00754-9 · Cited by 22
Metadata
- Authors
- Boer, M., van den Eijnden, R. J. J. M., Finkenauer, C., Boniel‐Nissim, M., Marino, C., Inchley, J., Cosma, A., Paakkari, L., & Stevens, G. W. J. M.
- Venue
- Addiction
- Publisher
- Wiley
- Published
- 2021-10-24
- Volume
- 117
- Issue
- 3
- Pages
- 784-795
- ISSN
- 0965-2140 (ISSN-L)
- 1360-0443
- OpenAlex
- W3204082179
- Cited by
- 93
- References
- 31
- FWCI
- 17.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.