Problematic smartphone use and academic achievement: A systematic review and meta-analysis
Open accessAbstract
Background and aims: The present study aimed to synthesize existing quantitative evidence on the relationship between problematic smartphone use (PSU) and academic achievement with a focus on quantifying its magnitude and examining its potential moderators. Methods: Eligible studies were searched for up to February 10, 2023 in six different databases (i.e., MEDLINE, Current Contents Connect, PsycINFO, Web of Science, SciELO, and Dissertations & Theses Global ). Studies were considered eligible if they provided information derived from self-report instruments that allowed statistical calculation of the relationship between PSU and academic achievement. Pooled effect sizes ( r ) were computed using a random-effects model. Meta-regressions were conducted to test the influence of study-level moderators on the relationship of interest. Influence analyses and a three-parameter selection model (3PSM) were conducted to examine the robustness of the results and publication bias, respectively. Results: A total of 33 effect sizes from 29 studies ( n = 48,490) were retrieved. Results showed a small effect size ( r = −0.110), which tended to be larger in samples consisting of students from elementary and middle schools. Discussion and Conclusions: Findings from the present study contribute to the understanding of a potential determinant of decreased academic achievement by providing evidence that PSU may be one of them.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A recent meta-analysis found a small negative correlation between smartphone addiction and academic performance, which tended to be stronger in primary and secondary school samples.
“En un reciente metaanálisis se encontró una correlación negativa pequeña entre estas variables, la cual tendía a ser más fuerte en muestras de estudiantes de primaria y secundaria (Paterna et al. , 2024).”
From Adicción al smartphone, nomofobia, rendimiento académico e intención de abandonar los estudios: un modelo estructural en estudiantes universitarios peruanos (2025) · cites this paper as Paterna et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283 · see citing works
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · see citing works
The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · International Journal of Surgery · doi:10.1016/j.ijsu.2021.105906 · Cited by 11,748 · see citing works
International Journal of Environmental Research and Public Health
Casariego Vales, E., A.M., C.-C., J.L., L., R.M., M.-P., D., O.-B., M., O.-C., P., R.-S., & F.J., S. (2013) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph · Cited by 7,742 · see citing works
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · see citing works
Evaluating Effect Size in Psychological Research: Sense and Nonsense
Funder, D. C., & Ozer, D. J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847202 · Cited by 3,295 · cited 1× · see citing works
“Point mean estimates of effect sizes were interpreted as very small (0.00 – 0.10), small (0.10 – 0.20), medium (0.20 – 0.30), large (0.30 – 0.40), and very large (>0.40) (Funder & Ozer, 2019).”
Influential(2019) · Eastern Economic Journal · doi:10.1057/41302.1939-4632 · Cited by 2,707 · see citing works
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.010 · Cited by 2,053 · see citing works
Humphreys, L. G., & Torgerson, W. S. (1965) · American Psychologist · doi:10.1037/h0021468 · Cited by 1,618 · see citing works
The influence of academic self-efficacy on academic performance: a systematic review.
Honicke, T., & Broadbent, J. (2016) · Educational Research Review · doi:10.1016/j.edurev.2015.11.002 · Cited by 1,554 · see citing works
Jones, H. E. (2010) · Paediatric and Perinatal Epidemiology · doi:10.1111/j.1365-3016.2010.01108.x · Cited by 1,447 · see citing works
Cheung, M. W.-L. (2014) · Psychological Methods · doi:10.1037/a0032968 · Cited by 1,342 · see citing works
Relationships among smartphone addiction, stress, academic performance, and satisfaction with life
Samaha, M., & Hawi, N. S. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.12.045 · Cited by 1,246 · see citing works
Billieux, J., Maurage, P., Lopez-Fernandez, O., Kuss, D. J., & Griffiths, M. D. (2015) · Current Addiction Reports · doi:10.1007/s40429-015-0054-y · Cited by 1,205 · see citing works
Self-citationWriting meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108 · see citing works
A comparison of heterogeneity variance estimators in simulated random‐effects meta‐analyses
Langan, D., Higgins, J. P. T., Jackson, D., Bowden, J., Veroniki, A. A., Kontopantelis, E., Viechtbauer, W., & Simmonds, M. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1316 · Cited by 1,074 · see citing works
International Journal of Mental Health and Addiction
(2013) · International Journal of Mental Health and Addiction · doi:10.1007/11469.1557-1882 · Cited by 1,058 · see citing works
Vignier, N., Moussaoui, S., Marsaudon, A., Wittwer, J., Jusot, F., & Dourgnon, P. (1944) · Public Health · doi:10.1016/s0033-3506(44)80333-x · Cited by 925 · see citing works
Sun, M. (2012) · Nova Science Publishers eBooks · Cited by 907 · see citing works
Handbook of Applied Multivariate Statistics and Mathematical Modeling
Tinsley, H. E. A., & Brown, S. D. (2000) · Elsevier eBooks · doi:10.1016/b978-0-12-691360-6.x5000-9 · Cited by 842 · see citing works
Doing Meta-Analysis with R: A Hands-On Guide
Harrer, M., Cuijpers, P. J., Furukawa, T. A., & Ebert, D. D. (2021) · VU Research Portal · Cited by 840 · see citing works
Problematic use of the mobile phone: A literature review and a pathways model
Billieux, J. (2012) · Current Psychiatry Reviews · doi:10.2174/157340012803520522 · Cited by 794 · see citing works
Parry, D. A., Davidson, B. I., Sewall, C. J. R., Fisher, J. T., Mieczkowski, H., & Quintana, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01117-5 · Cited by 793 · see citing works
Children and Youth Services Review
Zhan, M., & Sherraden, M. W. (2011) · Cited by 746 · see citing works
Fu, R., Gartlehner, G., Grant, M., Shamliyan, T., Sedrakyan, A., Wilt, T. J., Griffith, L., Oremus, M., Raina, P., Ismaila, A., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.08.010 · Cited by 730 · see citing works
MEDICINE AND SCIENCE IN SPORTS AND EXERCISE???1984
Tipton, C. M. (1984) · Medicine & Science in Sports & Exercise · doi:10.1249/00005768-198401000-00002 · Cited by 611 · see citing works
Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods
Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847196 · Cited by 588 · see citing works
Does Burnout Affect Academic Achievement? A Meta-Analysis of over 100,000 Students
Madigan, D. J., & Curran, T. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09533-1 · Cited by 585 · see citing works
Reynolds, C. R. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese0548 · Cited by 486 · see citing works
Learning and Individual Differences
Chen, J., & Usher, E. L. (2013) · Cited by 469 · see citing works
Pigott, T. D. (2012) · doi:10.1007/978-1-4614-2278-5 · Cited by 453 · see citing works
(2013) · Educational Psychology Review · doi:10.1007/10648.1573-336x · Cited by 432 · see citing works
Big Five personality traits and academic performance: A meta‐analysis
Mammadov, S. (2021) · Journal of Personality · doi:10.1111/jopy.12663 · Cited by 417 · see citing works
Yang, J., Fu, X. B., Liao, X., & Li, Y. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112686 · Cited by 410 · see citing works
Mueller, M., D’Addario, M., Egger, M., Cevallos, M., Dekkers, O., Mugglin, C., & Scott, P. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0495-9 · Cited by 400 · see citing works
The Relation Between Family Socioeconomic Status and Academic Achievement in China: A Meta-analysis
Liu, J., Peng, P., & Luo, L. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09494-0 · Cited by 384 · see citing works
Journal of Behavioral Addictions
(2013) · repository of the Library and Information Centre, Hungarian Academy of Sciences (REAL-J) · Cited by 374 · see citing works
Hawi, N. S., & Samaha, M. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.03.007 · Cited by 360 · see citing works
Bias caused by sampling error in meta-analysis with small sample sizes
Lin, L. (2018) · PLoS ONE · doi:10.1371/journal.pone.0204056 · Cited by 338 · see citing works
Smartphone Addiction and Associated Health Outcomes in Adult Populations: A Systematic Review
Ratan, Z. A., Parrish, A., Zaman, S. B., Alotaibi, M. S., & Hosseinzadeh, H. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182212257 · Cited by 322 · see citing works
Rozgonjuk, D., Sindermann, C., Elhai, J. D., & Montag, C. (2020) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106487 · Cited by 315 · see citing works
Becker, B. J. (2000) · Elsevier eBooks · doi:10.1016/b978-012691360-6/50018-5 · Cited by 287 · see citing works
Problematic Mobile Phone and Smartphone Use Scales: A Systematic Review
Harris, B., Regan, T., Schueler, J., & Fields, S. A. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00672 · Cited by 275 · see citing works
GOSH – a graphical display of study heterogeneity
Olkin, I., Dahabreh, I. J., & Trikalinos, T. A. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1053 · Cited by 270 · see citing works
Smartphone use and academic performance: A literature review
Amez, S., & Baert, S. (2020) · International Journal of Educational Research · doi:10.1016/j.ijer.2020.101618 · Cited by 268 · see citing works
The influence of technology on academic distraction: A review
Dontre, A. J. (2021) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.229 · Cited by 257 · see citing works
Journal of Clinical Epidemiology
Feinstein, A. R. (2005) · Encyclopedia of Biostatistics · doi:10.1002/0470011815.b2a17078 · Cited by 247 · see citing works
Csibi, S., Griffiths, M. D., Demetrovics, Z., & Szabó, A. (2019) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-019-00095-0 · Cited by 239 · see citing works
Self-citationImpact of Smartphone's on Society
Sarwar, M. S., Emirates, U. A., & Soomro, T. R. (2013) · Cited by 232 · see citing works
Griffiths, M. D., Pontes, H. M., & Kuss, D. J. (2015) · Neuroscience and Neuroeconomics · doi:10.2147/nan.s60982 · Cited by 230 · see citing works
Self-citationCommunity Mental Health Journal
Braswell, C. (1968) · Journal of Music Therapy · doi:10.1093/jmt/5.4.119 · Cited by 227 · see citing works
The effects of mobile phone use on academic performance: A meta-analysis
Kates, A. W., Wu, H., & Coryn, C. L. S. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.08.012 · Cited by 222 · see citing works
Chen, I.-H., Pakpour, A. H., Leung, H., Potenza, M. N., Su, J.-A., Lin, C.-Y., & Griffiths, M. D. (2020) · Journal of Behavioral Addictions · doi:10.1556/2006.2020.00023 · Cited by 213 · see citing works
Self-citationRathakrishnan, B., Bikar Singh, S. S., Kamaluddin, M. R., Yahaya, A., Mohd Nasir, M. A., Ibrahim, F., & Ab Rahman, Z. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18168291 · Cited by 189 · see citing works
Children's use of mobile devices, smartphone addiction and parental mediation in Taiwan
Chang, F.-C., Chiu, C.-H., Chen, P.-H., Chiang, J.-T., Miao, N.-F., Chuang, H.-Y., & Liu, S. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.11.048 · Cited by 183 · see citing works
Watson, J. B. (2013) · J B Lippincott Company eBooks · doi:10.1037/14262-002 · Cited by 174 · see citing works
Mental Health Concerns in the Digital Age
Scott, D. A., Valley, B., & Simecka, B. A. (2016) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-016-9684-0 · Cited by 169 · see citing works
French, M. T., Homer, J. F., Popovici, I., & Robins, P. K. (2015) · Eastern Economic Journal · doi:10.1057/eej.2014.22 · Cited by 160 · see citing works
Reinberg, A. (1979) · Behavioural Processes · doi:10.1016/0376-6357(79)90034-2 · Cited by 157 · see citing works
Human Behavior and Emerging Technologies
(2022) · Human Behavior and Emerging Technologies · doi:10.1002/(issn)2578-1863 · Cited by 154 · see citing works
Alotaibi, M., Fox, M., Coman, R., Ratan, Z., & Hosseinzadeh, H. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19063710 · Cited by 144 · see citing works
Patient-Driven Second Opinions in Oncology: A Systematic Review
Hillen, M. A., Medendorp, N. M., Daams, J. G., & Smets, E. M. A. (2017) · The Oncologist · doi:10.1634/theoncologist.2016-0429 · Cited by 141 · see citing works
Passive objective measures in the assessment of problematic smartphone use: A systematic review
Ryding, C., & Kuss, D. J. (2020) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2020.100257 · Cited by 129 · see citing works
Ibrahim, N. K., Baharoon, B., Banjar, W. F., Jar, A. A., Ashor, R. M., Aman, A. A., & Al-Ahmadi, J. (2018) · PubMed Central · Cited by 109 · see citing works
How students' self-control and smartphone-use explain their academic performance
Troll, E. S., Friese, M., & Loschelder, D. D. (2020) · doi:10.31234/osf.io/27stp · Cited by 107 · see citing works
International Journal of Surgery
(2023) · doi:10.60122/j.ijs · Cited by 105 · see citing works
Investigation of Problematic Mobile Phones Use and Fear of Missing Out (FoMO) Level in Adolescents
Coşkun, S., & Muslu, G. K. (2019) · Community Mental Health Journal · doi:10.1007/s10597-019-00422-8 · Cited by 104 · see citing works
Musshafen, L. A., Tyrone, R. S., Abdelaziz, A., Sims-Gomillia, C. E., Pongetti, L. S., Teng, F., Fletcher, L. M., & Reneker, J. C. (2021) · Sleep Medicine · doi:10.1016/j.sleep.2021.04.015 · Cited by 101 · see citing works
Do Friendships Afford Academic Benefits? A Meta-analytic Study
Wentzel, K. R., Jablansky, S., & Scalise, N. R. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9447-5 · Cited by 99 · see citing works
A Nudge-Based Intervention to Reduce Problematic Smartphone Use: Randomised Controlled Trial
Olson, J. A., Sandra, D. A., Chmoulevitch, D., Raz, A., & Veissière, S. P. L. (2022) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-022-00826-w · Cited by 99 · see citing works
Smartphone Addiction in University Students and Its Implication for Learning
Lee, J., Cho, B., Kim, Y., & Noh, J. (2015) · Lecture Notes in Educational Technology · doi:10.1007/978-3-662-44188-6_40 · Cited by 97 · see citing works
Alinejad, V., Parizad, N., Yarmohammadi, M., & Radfar, M. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04186-6 · Cited by 79 · see citing works
Owen, K. B., Foley, B. C., Wilhite, K. L., Booker, B., Lonsdale, C., & Reece, L. J. (2021) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000002786 · Cited by 78 · see citing works
Applied Research in Quality of Life
Sirgy, M. J., Estes, R. J., & Michalos, A. C. (2022) · Springer eBooks · doi:10.1007/978-3-319-69909-7_4048-2 · Cited by 77 · see citing works
Smartphone use and academic performance: Correlation or causal relationship?
Baert, S., Vujić, S., Amez, S., Claeskens, M., Daman, T., Maeckelberghe, A., Omey, E., & De Marez, L. (2020) · Kyklos · doi:10.1111/kykl.12214 · Cited by 77 · see citing works
The relationship between smartphone use and students` academic performance
Sapci, O., Elhai, J. D., Amialchuk, A., & Montag, C. (2021) · Learning and Individual Differences · doi:10.1016/j.lindif.2021.102035 · Cited by 72 · see citing works
Smartphone use and study behavior: A Korean and Australian comparison
Winskel, H., Kim, T., Kardash, L., & Belic, I. (2019) · Heliyon · doi:10.1016/j.heliyon.2019.e02158 · Cited by 71 · see citing works
Cyberpsychology Journal of Psychosocial Research on Cyberspace
(2020) · Cyberpsychology Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp · Cited by 68 · see citing works
Olufadi, Y. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.03.005 · Cited by 67 · see citing works
Bai, C., Chen, X., & Han, K. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2020.105406 · Cited by 66 · see citing works
Addictive phone use and academic performance in adolescents
Domoff, S. E., Foley, R. P., & Ferkel, R. C. (2019) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.171 · Cited by 65 · see citing works
Does academic achievement during childhood and adolescence benefit later health?
Lê-Scherban, F., Diez Roux, A. V., Li, Y., & Morgenstern, H. (2014) · Annals of Epidemiology · doi:10.1016/j.annepidem.2014.02.008 · Cited by 65 · see citing works
Gugushvili, N., Täht, K., Rozgonjuk, D., Raudlam, M., Ruiter, R. A. C., & Verduyn, P. (2020) · Cyberpsychology Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2020-2-3 · Cited by 54 · see citing works
Okada, R. (2023) · Japanese Psychological Research · doi:10.1111/jpr.12380 · Cited by 54 · see citing works
Buctot, D. B., Kim, N., & Kim, S.-H. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18105219 · Cited by 53 · see citing works
(2018) · Research Synthesis Methods · doi:10.1002/(issn)1759-2887 · Cited by 53 · see citing works
Effect of technology addiction on academic success and fatigue among Turkish university students
Sert, H., Yılmaz, F. T., Kumsar, A. K., & Aygın, D. (2019) · Fatigue Biomedicine Health & Behavior · doi:10.1080/21641846.2019.1585598 · Cited by 52 · see citing works
Elhai, J. D., Sapci, O., Yang, H., Amialchuk, A., Rozgonjuk, D., & Montag, C. (2021) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.254 · Cited by 49 · see citing works
Przepiórka, A., Błachnio, A., Cudo, A., & Kot, P. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104286 · Cited by 46 · see citing works
Yang, Z., Asbury, K., & Griffiths, M. D. (2021) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-019-00204-z · Cited by 45 · see citing works
Self-citationWeinberg, N. (2019) · Routledge eBooks · doi:10.4324/9780429033124-6 · Cited by 36 · see citing works
Zhou, D., Liu, J., Wang, T., Liu, J., & Li, G. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107171 · Cited by 36 · see citing works
Eoh, Y., Lee, E., & Park, S. H. (2022) · Applied Research in Quality of Life · doi:10.1007/s11482-022-10080-w · Cited by 36 · see citing works
Precht, L.-M., Mertens, F., Brickau, D., Kramm, R. J., Margraf, J., Stirnberg, J., & Brailovskaia, J. (2023) · Journal of Public Health · doi:10.1007/s10389-023-01832-5 · Cited by 33 · see citing works
Perspectives in Psychiatric Care
(2022) · Perspectives In Psychiatric Care · doi:10.1111/(issn)1744-6163 · Cited by 31 · see citing works
Neuroscience and Neuroeconomics
(2017) · Neuroscience and Neuroeconomics · doi:10.2147/nan · Cited by 31 · see citing works
(2019) · Current Psychiatry Reviews · doi:10.2174/cpsr-15734005-618 · Cited by 27 · see citing works
The effect of smartphone use on mental effort, learning, and creativity
Aru, J., & Rozgonjuk, D. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.07.002 · Cited by 26 · see citing works
Ekşi, F., Demırcı, İ., & Tanyeri, H. (2020) · Addicta The Turkish Journal on Addictions · doi:10.5152/addicta.2020.19077 · Cited by 25 · see citing works
Problematic Mobile Phone Use by Hong Kong Adolescents
Wu, J., & Siu, A. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.551804 · Cited by 25 · see citing works
Han, S. (2022) · Technology in Society · doi:10.1016/j.techsoc.2022.102002 · Cited by 23 · see citing works
Latchem, C. (2005) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2005.00465_10.x · Cited by 23 · see citing works
Hilt, J. A. (2019) · Apuntes Universitarios · doi:10.17162/au.v9i3.384 · Cited by 21 · see citing works
Yadav, M. S., Malar Kodi, S., & Deol, R. (2021) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_915_20 · Cited by 20 · see citing works
Zhou, D., Liu, J., Ye, G., Wang, T., Xia, X., & Liu, J. (2022) · Behavioral Sciences · doi:10.3390/bs12110454 · Cited by 20 · see citing works
Alan, H., Bekar, E. Ö., & Gungor, S. (2021) · Perspectives in psychiatric care · doi:10.1111/ppc.13006 · Cited by 19 · see citing works
A Weight and Meta-Analysis on the Academic Achievement of High School Students
Nunes, C., Oliveira, T., Santini, F. D. O., Castelli, M., & Cruz‐Jesus, F. (2022) · Education Sciences · doi:10.3390/educsci12050287 · Cited by 16 · see citing works
Smartphone addiction among medical students in Bisha, Saudi Arabia
AlShahrani, M. S. (2020) · Journal of Family Medicine and Primary Care · doi:10.4103/jfmpc.jfmpc_1205_20 · Cited by 15 · see citing works
Fernández‐Andújar, M., Alonso, M. O., Sorribes, E., Villalba, V., & Calderón, C. (2022) · Mathematics · doi:10.3390/math10152631 · Cited by 15 · see citing works
Profiles of Problematic Smartphone Users: A Comparison of South Korean and U.S. College Students
Panek, E. T., Khang, H., Liu, Y., & Chae, Y. (2018) · Korea Observer - Institute of Korean Studies · doi:10.29152/koiks.2018.49.3.437 · Cited by 13 · see citing works
Examining the Interplay of Smartphone Use Disorder, Mental Health, and Physical Symptoms
Reer, F., Wehden, L.-O., Janzik, R., & Quandt, T. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.834835 · Cited by 13 · see citing works
Smartphone Addiction and Pedestrian Accidents Among US College Students
Rosenthal, S. R., Li, Y., & Gately, K. A. (2022) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-022-00269-z · Cited by 5 · see citing works
Japanese Psychological Research
(2020) · Japanese Psychological Research · doi:10.1111/jpr.12310 · Cited by 3 · see citing works
Kemp, W. M. (2018) · ProQuest LLC eBooks · Cited by 2 · see citing works
Smartphone Addiction and Traffic Accidents: the Moderating Role of Texting While Driving
Rosenthal, S., Li, Y., Wensley, I., Perez, D., & Gately, K. A. (2022) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-022-00265-3
Flagged first, then by citations
2 of the 118 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Freelon, D. (2013). ReCal OIR: Ordinal, interval, and ratio intercoder reliability as a web service. International Journal of Internet Science, 8(1), 10– 16.
- Garakouei, S. A., Mousavi, S. V., Rezaei, S., & Lafmejani, A. Q. (2020). The examination of mediating effects for self-control and time management in relationship among problematic cell-phone use with loneliness and educational performance of high school students. Journal of Educational Sciences & Psychology, 10(1), 127– 140.
- Pathak, V. R., & Mhaske, R. S. (2019). Self-esteem, academic performance, and mobile phone addiction among college students. Indian Journal of Psychological Science, 12, 57– 66.
- Spiratos, K. N. (2021). Problematic smartphone use among high school students and its relationships with depression, stress, self-esteem, grit and academic performance, Doctoral dissertation. California State University.
Cited by
Sorted by citations
Soraci, P., Demetrovics, Z., Bevan, N., Pisanti, R., Servidio, R. C., Bernardo, C. D., Chini, E., & Griffiths, M. D. (2025) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-024-01432-8 · Cited by 61 · see citing works
Self-citationSmartphone Addiction in Youth: A Narrative Review of Systematic Evidence and Emerging Strategies
Giansanti, D. (2025) · Psychiatry International · doi:10.3390/psychiatryint6040118 · Cited by 49 · see citing works
Digital Detox Strategies and Mental Health: A Comprehensive Scoping Review of Why, Where, and How
Setia, S., Gilbert, F., Tichy, M. L., Redpath, J., Shahzad, N., & Marraccini, M. E. (2025) · Cureus · doi:10.7759/cureus.78250 · Cited by 32 · see citing works
Pyhältö, K., Rekola, H., Salovuori, S., Kosola, S. K., & Anttila, H. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.105645 · Cited by 14 · see citing works
Smartphone addiction in Iranian schoolchildren: a population-based study
Azizi, A., Emamian, M. H., Hashemi, H., & Fotouhi, A. (2024) · Scientific Reports · doi:10.1038/s41598-024-73816-8 · Cited by 12 · see citing works
Çelikkaleli, Ö., Ata, R., Alpaslan, M. M., TANGÜLÜ, Z., & Ulubey, Ö. (2025) · Behavioral Sciences · doi:10.3390/bs15030241 · Cited by 15 · see citing works
Development and validation of a digital burnout scale in artificial intelligence era
Zhao, L., Zhao, J., Cao, E. Y., Li, K., Pan, L., Zou, Y., & Sun, X. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1580422 · Cited by 15 · see citing works
Holtzman, S., Bakker, A. M., Godard, R., Wiebe, S., & Avnoor, A. (2025) · Mindfulness · doi:10.1007/s12671-025-02665-x · Cited by 9 · see citing works
Digital addiction: Are children in danger? Are parents aware?
Kurt, F. Y., Öner, B., & Bulut, A. (2024) · Journal of Pediatric Nursing · doi:10.1016/j.pedn.2024.11.018 · Cited by 13 · see citing works
Chen, Y., Gu, Q., Zheng, Q., Hu, B., Gu, C., Hu, Q., & Cao, Y. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1590057 · Cited by 7 · see citing works
Impacto del uso de tecnologías móviles en el rendimiento académico de estudiantes de Bachillerato.
Ledesma, J. G. C., Yañez, R., Tisalema, A. M. E., & Obando, M. D. J. Y. (2025) · ASCE MAGAZINE · doi:10.70577/asce/795.811/2025 · Cited by 6 · see citing works
Muñoz-Carril, P.-C., Bargiela, I., Estévez, I., & Bonilla-del-Río, M. (2025) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe15100201 · Cited by 8 · see citing works
Huang, L., Zeng, M., Jiao, T., Yang, F., & Zhang, Y. (2025) · Journal of Youth and Adolescence · doi:10.1007/s10964-025-02268-8 · Cited by 5 · see citing works
Vanluydt, E., van den Eijnden, R. J. J. M., Vonk, L., Putrik, P., van Amelsvoort, T., Delespaul, P., Levels, M., & Huijts, T. (2026) · Journal of Youth and Adolescence · doi:10.1007/s10964-025-02313-6 · Cited by 5 · see citing works
Wiedemann, H., Lüdecke, D., Thomasius, R., & Paschke, K. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.100958 · Cited by 7 · see citing works
Marino, C., Zagaria, A., Casale, S., Vieno, A., Canale, N., Franceschini, C., Mansueto, G., & Spada, M. M. (2025) · Journal of Behavioral Addictions · doi:10.1556/2006.2025.00055 · Cited by 5 · see citing works
Effectiveness of exercise as an intervention for internet addiction in adolescents: a meta-analysis
Wang, L., Chen, Y., Cho, J. H., Yang, H., & Seo, J. C. (2025) · PeerJ · doi:10.7717/peerj.19999 · Cited by 4 · see citing works
Academic pressure and academic procrastination: The mediating role of negative coping strategies
Xue, C., Helian, Z., & Li, Y. (2025) · PLoS ONE · doi:10.1371/journal.pone.0338956 · Cited by 3 · see citing works
Rong, F., Cheng, J., Hu, J., Wang, Y. C., Xu, Z., Guan, M., Zhang, N., & Yu, Y. (2025) · Journal of Behavioral Addictions · doi:10.1556/2006.2025.00015 · Cited by 3 · see citing works
Boonyapison, K., Sittironnarit, G., & Rattanaumpawan, P. (2025) · Scientific Reports · doi:10.1038/s41598-025-01038-7 · Cited by 2 · see citing works
Cheng, J., Chen, Y., Liu, J., Gao, S., Ju, Y., Liu, B., Liu, Z., & Zhang, Y. (2025) · BMC Public Health · doi:10.1186/s12889-025-24119-8 · Cited by 2 · see citing works
Lukram, H., Baishya, R., & Chakma, S. (2026) · Cureus · doi:10.7759/cureus.101440 · Cited by 2 · see citing works
Hernández-Chávez, A., Uriarte-Ortiz, J. B., Barajas-Martínez, A., & Sampieri-Cabrera, R. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1736060 · Cited by 2 · see citing works
Wang, X., Madon, Z., Ghani, M. S. A., & Long, X. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1768092 · Cited by 2 · see citing works
Cruz, G. V., Rosa, C. D., & Khazaal, Y. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1784927 · Cited by 2 · see citing works
Liang, H., Wang, S., Guo, Y., Zhou, H., Wei, X., Jiang, H., & Li, J. (2025) · Current Psychology · doi:10.1007/s12144-025-08377-8 · Cited by 2 · see citing works
Babakhani, D., Shojaei, A., zad, E. P., Kazemi, M., & Foroughi, A. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100826 · Cited by 2 · see citing works
Construction and validation of the motives for smartphone use questionnaire
Sullivan, B. M., George, A. M., & Rickwood, D. (2025) · Journal of Behavioral Addictions · doi:10.1556/2006.2025.00006 · Cited by 1 · see citing works
Chen, Y., & Huo, Y. (2025) · Youth & Society · doi:10.1177/0044118x251347309 · Cited by 1 · see citing works
Crawford, C. A., Minor, K. S., Cyders, M. A., & Stewart, J. C. (2025) · Sleep Medicine · doi:10.1016/j.sleep.2025.106824 · Cited by 1 · see citing works
Alnasser, B., & Kumar, R. (2025) · Healthcare · doi:10.3390/healthcare13192512 · Cited by 4 · see citing works
The role of usage time and type in problematic smartphone use among university students
Seregély, B., Varga, R., Szöllősi, C., Zatykó, L., Debreczeni, Z., & Takács, J. (2025) · Developments in Health Sciences · doi:10.1556/2066.2025.00088 · Cited by 1 · see citing works
Xie, Z., Zhang, Z., Sun, J., & Han, J. (2025) · Sleep Medicine · doi:10.1016/j.sleep.2025.108694 · Cited by 1 · see citing works
Jegorow, D. (2025) · Social Sciences · doi:10.3390/socsci15010012 · Cited by 1 · see citing works
Adicción en dispositivos móviles y concentración académica en estudiantes
Balseca, C. A. T., Sánchez, Y. J. P., Sánchez, G. C. L., Verdugo, R. P. V., & Calderón, V. P. J. (2026) · Impact Research Journal · doi:10.63380/irj.v4n1.2026.298 · Cited by 1 · see citing works
Ten years of screen time among medical students in Dresden, Germany: unveiling the trends
Liebig, L., Gräfe, W., Lynch, N. J., Gottschall, M., Birkás, B., Balogh, E., Faubl, N., Zelko, E., & Riemenschneider, H. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09024-x · Cited by 1 · see citing works
Chen, Y., 殷小秋, Li, L., Chen, S., Cai, L., & Zhang, H. (2026) · Journal of Children and Media · doi:10.1080/17482798.2026.2661336 · Cited by 1 · see citing works
Li, S. C., Cheung, S., Lui, M. A., Lui, A. K.-F., & Chan, J. W. W. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.109033 · Cited by 1 · see citing works
Tong, S., Liu, Y., Wan, Z., Zhu, X., Caselli, G., Gao, L., & Fu, C. (2026) · Addictive Behaviors · doi:10.1016/j.addbeh.2026.108734 · Cited by 2 · see citing works
Liu, S., Lin, Y., Hu, W., Meng, Y., & Liu, X. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.122007 · Cited by 1 · see citing works
Cruz, G. V., & Rosa, C. D. (2026) · Psychiatry International · doi:10.3390/psychiatryint7040185 · Cited by 1 · see citing works
Gai, Y., Liu, X., Sun, S., Wang, P., & Wang, S. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1907886 · Cited by 1 · see citing works
Qu, B., Chen, J., Tian, Q., Niu, Q., Sun, J., Xie, M., Huang, Y.-E., Xue, B., Tong, X., & Wu, R.-P. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100890 · Cited by 2 · see citing works
Felices-Yupari, A., Mendoza-Fernandez, L., Orellana, M. E., & Loayza-Rivas, J. (2025) · Aloma: Revista de Psicologia, Ciències de l'Educació i de l'Esport · doi:10.51698/aloma.2025.43.2.22-31
“Sin em-bargo, la posible naturaleza problemática del uso del móvil y sus efectos ha despertado un creciente interés entre los investigadores de diversas disciplinas (Amez y Baert, 2020; Candussi et al. , 2023; Paterna et al. , 2024; Yang et al. , 2020).”
InfluentialInternet and Smartphone Addiction: Characteristics, Impacts, Diagnosis, and Treatment
Semolini, F. F., da Silva, L. S., Vitta, A. S. L., Freires, É. M., & Andrade, A. L. M. (2025) · Springer eBooks · doi:10.1007/978-3-031-87986-9_2 · Cited by 1 · see citing works
Ali, M. M., & Saher, S. (2025) · Trends in Social Sciences · doi:10.21124/tss.2025.35.40
Li, J., Li, W., Li, X., Zhao, Y., & Yang, C. C. (2025) · Trauma Violence & Abuse · doi:10.1177/15248380251383917
Uso del Celular en Horas de Estudio y Rendimiento Académico
Ocaña, V. L. L., Vargas-García, E. S., Vergara-Castillo, M. A., Díaz-Parra, A. D., & Herrera-Carrión, Á. P. (2025) · Erevna Research Reports · doi:10.70171/7b4xk232
Smartphone use and stroop performance in a university workforce: A survey-experiment
Ntelezos, K., Kyriakopoulou, G., Dafni, M. F., Tsamourgeli, A. M., Lalou, G., Sampanai, R., Bistola, A., & Delitzakis, D. (2025) · Open Health · doi:10.1515/ohe-2025-0080
Lizárraga, F. D. L. C. S., Varela, C. G. L., Silva, J. F. H., & González, E. A. C. (2025) · High Rate Consulting / REOALCEI eBooks · doi:10.38202/seriesinvreoalcei3-05
Mohammadi, M., Ghanbari, N., & Kuss, D. J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6350919
A Quantitative Study on Social Media Use and Academic Performance
Mirza, Q. U. A. Z. Z., Kanwal, R., Ashraf, H., Jhanjhi, N., & Saepudin, S. (2025) · International Conference on Mathematics, Actuarial Science, Computer Science and Statistics (MACS) · doi:10.1109/macs68476.2025.11453362
Karthik, M. S., Alagu, S., & Deborah Dilip, A. (2026) · ShodhKosh Journal of Visual and Performing Arts · doi:10.29121/shodhkosh.v7.i11s.2026.8229
Zhou, D., Liu, S., Liu, J., Li, H., & Ma, Y. (2026) · Behavioral Sciences · doi:10.3390/bs16050781
Ataei-Goujani, H., Karimi, K., Gharajeh, A., Salehi, S., Farzi, Y., Khalafehnilsaz, M., Akbarpour, S., & Azizpour, Y. (2026) · Health Science Reports · doi:10.1002/hsr2.72581
Leśniak, M., Polanowska, K., & Malinowska, E. (2026) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2026.45.3.275
Digital Addictions and Public Health From Theoretical Models to Community-Based Interventions
Olğaç, K. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-2468-3.ch011
Zhou, T., Liu, T., Yang, J.-M., & Liu, Z. (2026) · The Journal of Genetic Psychology · doi:10.1080/00221325.2026.2690503
Peçe, Z. A., & Dost, M. T. (2026) · Buca eğitim fakültesi dergisi (Online)/Buca Eğitim Fakültesi dergisi · doi:10.53444/deubefd.1776998
Horváth, Z., Tibot, J., Király, O., Yu, S. M., Paksi, B., Eisinger, A., Griffiths, M. D., Bőthe, B., Zavagni, M., Carter, H., et al. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101193
Self-citationShen, G., Han, Y., Xu, S., Chen, L., Xu, X., Hu, X., Ye, Z., Chen, L., & Li, Y. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1873653
Dawood, E., Barnawi, N. A., Shereda, H. M. A., Alharbi, A., Aloumi, H., Alqamayza, N., & Alghamdi, A. (2026) · JMIR Formative Research · doi:10.2196/93666
Tian, Y., & Ding, H. (2026) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2026.108241
Ma, H., Liu, L., Liu, T., Huang, S., Yin, Z., & Cheng, W. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1903004
Liu, S.-J., Liu, T., Ma, H.-L., Yin, Z.-G., Zhu, C., & Cheng, W. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1853224
Terze, L., Klapez, A., Petricevic, I., Dodig, I. P., Pecotić, R., & Dogas, Z. (2026) · Behavioral Science · doi:10.3390/bs16081379
Dini, A. L. P., & Aka, K. A. (2026) · International Journal of Learning Reformation in Elementary Education · doi:10.56741/iistr.ijlree.002204
Díaz, M. D. L. R., Méndez, I., Ros, N. A., & Esteban, C. R. (2026) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe16090124
Reynoso, A. A. M., Montesdeoca, C. M. S., Ayovi, B. M. O., Murillo, R. J. H., Paredes, M. P. L., & Camacho, S. P. A. (2026) · Revista Interdisciplinaria de Educación, Salud, Actividad Física y Deporte. · doi:10.70262/riesafd.v3i3.2026.114
Risk of social networks addiction and emotional dependence in a sample of university students
Klimenko, O., Hernández-Flórez, N., & Vásquez-Tobón, D. (2026) · CES Psicología · doi:10.21615/cesp.7953
Giansanti, D. (2026) · AI · doi:10.3390/ai7090355 · Cited by 1 · see citing works
Prevalencia de riesgo de conductas adictivas en adolescentes
Lino-Solis, L. P., Rumiguano, D. V. P., & Chimbo, J. A. P. (2026) · Ciencia Interdisciplinaria Internacional · doi:10.70577/cieninter.v4i3.116
Xu, Y., Zhao, S., Zhu, Y., Du, W., Wang, C., Man, S., An, S., Zheng, C., & Zeng, P. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1856492
任, 沅. (2026) · Advances in Psychology · doi:10.12677/ap.2026.169441
Christidis, N., Lärfars, M., Khattar, P., Markus, D., Canales, G. D. L. T., & Christidis, M. (2026) · BMC Medical Education · doi:10.1186/s12909-026-10445-x
Dialing in or Locking Out? Mapping Texas Districts’ Cell Phone Policy Types
Rangel, V. S., & Pham, V. (2026) · Leadership and Policy in Schools · doi:10.1080/15700763.2026.2737329
Huang, D., Mu, X., Luo, Y., & Huang, C. (2026) · Child & Family Social Work · doi:10.1111/cfs.70284
Skowron, M., Skowron, W., Łapot, M., Hober, K., Krupnik, D., Bzdak, W., Szwemińska, P., Górak, J., & Neumann, W. (2026) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.3(51).2026.6242
Padmapriya, N., Chandrasekaran, M., Khan, S. A., Nishika, R., Huiyun, G. L., Chong, D., Sanabria, A. S., Raeside, R., Holly, L., Chia, A., et al. (2026) · EClinicalMedicine · doi:10.1016/j.eclinm.2026.104225
Shi, Y., Zhang, Q., Liu, Z., Wang, J., Wen, X., & liu, H. (2026) · Research Square · doi:10.21203/rs.3.rs-10141103/v1
Li, L., Peng, B., Liu, J., Tang, D., & Ma, R. (2026) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.70388
Nan, H., Yan, Y., & Gai, X. (2026) · Behavioral Sciences · doi:10.3390/bs16112017
Heim, C., & Heim, C. (2026) · The Journal of Mental Health Training Education and Practice · doi:10.1108/jmhtep-03-2026-0031
Digital Technology Utilization at Lataban National High School: Digitization Model
Gungob, G. C. (2026) · International Journal of Global Goals and Sustainable Development · doi:10.65339/ijggsd.v1.i1.8
Kannappan, S. V., & Chokkalingam, S. (2026) · TNOA Journal of Ophthalmic Science and Research · doi:10.4103/tjosr.tjosr_60_26
- Authors
- Paterna, A., Alcaraz-Ibáñez, M., Aguilar-Parra, J. M., Salavera, C., Demetrovics, Z., & Griffiths, M. D.
- Affiliations
- Health Research Centre and Department of Education, University of Almería, Spain
- Universidad de Zaragoza (ES)
- Eötvös Loránd University (HU)
- Nottingham Trent University (GB)
- ORCID
- Venue
- Journal of Behavioral Addictions
- Publisher
- Akademiai Kiado Zrt.
- Published
- 2024-06-26
- Volume
- 13
- Issue
- 2
- Pages
- 313-326
- ISSN
- 2062-5871 (ISSN-L)
- 2063-5303
- PMC
- PMC11220804
- OpenAlex
- W4395666745
- Cited by
- 83
- References
- 118
- Citations by year
- 2026: 48 · 2025: 33 · 2024: 2
- FWCI
- 8.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Behavioral Addictions (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Nottingham Trent University's Institutional Repository (Nottingham Trent Repository) (acceptedVersion, cc-by-nc)
- Repository of the Academy's Library (Library of the Hungarian Academy of Sciences) (acceptedVersion, cc-by-nc)
- Zaguan (University of Zaragoza Repository) (submittedVersion, cc-by-nc)
- Funders
- Ministerio de Universidades (UAL RRA202101)
- Hungarian National Research, Development and Innovation Office (KKP126835)
- Topics
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Social Sciences › Education › Child Development and Digital Technology
- Social Sciences › Psychology › Clinical Psychology › Sexuality, Behavior, and Technology
- Keywords
- smartphone addiction, academic performance, students, primary and secondary school students, effect size, publication bias
- MeSH terms
- Smartphone, Academic Success, Internet Addiction Disorder, Child, Humans, Students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review