The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index; 7 of the 35 sources its claims cite were checked for support.
Banning mobile phones in schools: evidence from regional-level policies in Spain
Open accessAbstract
The autonomous governments of two regions in Spain established mobile bans in schools as of the year 2015. Exploiting the across-region variation introduced by such a quasi-natural experiment, this study aims to perform a comparative-case analysis to investigate the impact of this non-spending-based policy on regional Programme for International Student Assessment (PISA) scores in maths and sciences and bullying incidence. The authors apply the synthetic control method and diff-in-diff estimation to compare the treated regions with the rest of regions in Spain before and after the intervention. The results show noticeable reductions of bullying incidence among teenagers in the two treated regions. The authors also find positive and significant effects of this policy on the PISA scores of the Galicia region that are equivalent to 0.6–0.8 years of learning in maths and around 0.72 to near one year of learning in sciences.
Overview
CoChat Summary
TL;DR
Using regional variation from mobile-phone bans in Galicia and Castilla-La Mancha (CLM) from 2015, this paper finds improved PISA maths/science scores in Galicia and reduced bullying among teenagers in both treated regions. The authors interpret the results as suggestive evidence that non-spending school policies can affect academic and social outcomes.
Key findings
- Synthetic control estimates for Galicia show post-ban PISA gains by 2017 of 10.676 points in maths and 12.731 points in sciences versus a synthetic Galicia; these are equivalent to 0.6–0.8 years of learning in maths and around 0.72 to near one year in sciences.
- Difference-in-differences for Galicia show average post-ban increases of 6.371 points in maths (p < 0.05) and 8.395 points in sciences (p < 0.10), with no evidence of pre-treatment differences.
- Bullying fell among 12–14 year-olds by around 15% in Galicia and 18% in CLM, and among 15–17 year-olds by around 18% in Galicia and 9.5% in CLM; no significant effects were found for under-12s, which the authors treat as a placebo check.
- CLM PISA results are positive but inconclusive: maths effects are not statistically significant, and the pre-treatment dummy is significant in maths and sciences, so the authors caution that CLM estimates are limited by missing PISA data.
Methods
- Quasi-natural experiment: Galicia and CLM banned mobile phones in primary and secondary schools as of 2015, while other Spanish regions did not regulate their use. The authors build a region-year panel using PISA maths/science scores from five installments (2006–2018, lagged and interpolated to 2006–2017) and officially reported bullying cases per 10,000 students for 2012–2017 across under-12, 12–14, and 15–17 age intervals.
- For Galicia PISA outcomes, the authors apply the synthetic control method, constructing a weighted combination of untreated regions as the counterfactual. They also use difference-in-differences for Galicia and CLM PISA scores and for bullying in both regions, with region and year fixed effects and covariates for mobile phone ownership, public education spending per student, and real disposable income per capita.
- Inference uses SCM placebo/permutation tests and DID placebo checks; bullying regressions exclude Cataluña and País Vasco because they did not report bullying data.
Limitations
- The paper states that the aggregate nature of the data and modest sample sizes mean findings should be interpreted as suggestive evidence, and that longer or finer-grained data would be valuable.
- The paper states that the policy was not a categorical prohibition: mobile phones could still be used as a learning tool, and the authors lack information on how intensively schools did so, so effects should be understood as resulting from enforcement of learning-only use rather than prohibition per se.
- The paper states that CLM did not participate in PISA 2006 and 2012, preventing reliable pre-trend analysis and SCM for CLM; it also notes that bullying data cover only police-reported cases, which are likely particularly aggressive incidents rather than all bullying, and that the short bullying estimation sample makes those DID results suggestive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 1 Not valid · 22 Not checked · 85 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Thus, results for this age group may serve as a placebo check in our analysis below [7].”
What the sources say
- Could not verifycites [7] 2020, Smartphone use and academic performance: a literature review, International Journal of Educational Research sourceExperimental — accuracy not yet measured
The reviewed studies discussed in the empirical-literature section concern students’ smartphone use and academic performance. Searches for an under-12 age group and a placebo or falsification check found no passage addressing either point, so our copy does not substantiate the proposed check. (LLM, conf=0.76)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results show noticeable reductions of bullying incidence among teenagers in the two treated regions.”
- Also stated in: § Óscar Vicente-Chirivella · p. 5 · plain
“Jointly with this, bullying incidence fell by around 9.5% to 18%over its pre-intervention levels among teenagers in the treated regions.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Óscar Vicente-Chirivella · p. 5 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The authors also fi nd positive and signi fi cant effects of this policy on the PISA scores of the Galicia region that are equivalent to 0.6 -0.8 years of learning in maths and around 0.72 to near one year of learning in sciences.”
- Also stated in: § Óscar Vicente-Chirivella · p. 5 · plain
“To anticipate our results, we fi nd that, after less than three years since the mobile phones ban was in force (from 2015 to 2017), students ' PISA scores in Galicia improved by around 10 points in maths and 12 points in sciences as compared to a synthetic Galicia that had followed exactly the same trend in these scores before the intervention.”
plainstates a causeSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Óscar Vicente-Chirivella · p. 5 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Further, in the standard DID estimation applied to the PISA data that we offer below, we fi nd that regions with a higher percentage of teenagers ' mobile phones users have experienced, other things equal, a larger and signi fi cant decline on PISA results in the past years.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Interestingly enough, and as mentioned above, the results also suggest that, beyond the in-school use of mobile phones, a higher percentage of children using mobile phones in the region is negatively associated to their academic results.”
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
47 more claims
Create a free account to see all 114 claims and to verify the 2 references still open.
- Probably not a substantial claim. 32
- It may state two separate claims as one. 37
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“All states administer standardized assessments in these grades, allowing us to obtain comparable achievement data across the country and over time.6”
From The Effects of School Phone Bans: National Evidence from Lockable Pouches (2026) · cites this paper as [6]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“One peer-reviewed study from Spain169 found associations between school phone bans and less bullying and greater academic scores.”
From Digital Ecosystems, Children, and Adolescents: Technical Report (2026) · cites this paper as [169]
The cited source says what the claim attributes to it.
In the citing paper
“Beneito and Vicente-Chirivella [26] used data from Spanish regions with and without smartphone bans, employing control procedures and a difference-in-differences analysis.”
From To Ban or Not to Ban? A Rapid Review on the Impact of Smartphone Bans in Schools on Social Well-Being and Academic Performance (2024) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“This applies, for example, to bullying among pupils.”
From To Ban or Not to Ban? A Rapid Review on the Impact of Smartphone Bans in Schools on Social Well-Being and Academic Performance (2024) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Beneito and VicenteChirivella (2022) find a positive effect of about 0.10 s.d. in PISA scores and reductions in bullying incidence in Spain”
From The Educational Impacts of School Phone Bans: Evidence from Brazil (2026) · cites this paper as Beneito and VicenteChirivella (2022)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 3. Results · p. 13
“| PISA Pre-2015 mean | 489 | 495 |”
§ 3. Results · p. 15
“| Pre-treatment avg (treated region) | 491 | 509 | 483 | 481 | |”
Citations
Cites
Abadie, A., Diamond, A., & Hainmueller, J. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08746 · Cited by 5,513
The economic costs of conflict: a case study of the Basque Country
Abadie, A., & Gardeazabal, J. (2003) · American Economic Review · doi:10.1257/000282803321455188 · Cited by 4,517
Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects
Abadie, A. (2021) · Journal of Economic Literature · doi:10.1257/jel.20191450 · Cited by 1,486
Human Capital and Regional Development *
Gennaioli, N., La Porta, R., Lopez-de-Silanes, F., & Shleifer, A. (2013) · The Quarterly Journal of Economics · doi:10.1093/qje/qjs050 · Cited by 1,082
Lepp, A., Barkley, J. E., & Karpinski, A. C. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.10.049 · Cited by 990
Facebook and texting made me do it: Media-induced task-switching while studying
Rosen, L. D., Mark Carrier, L., & Cheever, N. A. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2012.12.001 · Cited by 875
No A 4 U: The relationship between multitasking and academic performance
Junco, R., & Cotten, S. R. (2012) · Computers & Education · doi:10.1016/j.compedu.2011.12.023 · Cited by 810
The wired generation: Academic and social outcomes of electronic media use among university students
Jacobsen, W. C., & Forste, R. (2011) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2010.0135 · Cited by 710
Examining the impact of off-task multi-tasking with technology on real-time classroom learning
Wood, E., Zivcakova, L., Gentile, P., Archer, K., De Pasquale, D., & Nosko, A. (2012) · Computers & Education · doi:10.1016/j.compedu.2011.08.029 · Cited by 565
The Impact of Mobile Phone Usage on Student Learning
Kuznekoff, J. H., & Titsworth, S. (2013) · Communication Education · doi:10.1080/03634523.2013.767917 · Cited by 417
Research works printed but not linked: 3
- 2010, The High Cost of Low Educational Performance: The Long-Run Economic Impact of Improving PISA Outcomes
- 2015, The Relationship between Cell Phone Use and Academic Performance in a Sample of U.S. College Students, 5
- 2003, Mobile learning: challenges, perspectives, and reality, 151
Cited by
Evidence for and against banning mobile phones in schools: a scoping review.
Campbell, M., Edwards, E. J., Pennell, D., Poed, S., Lister, V., Gillett-Swan, J., Kelly, A., Zec, D., & Nguyen, T.-A. (2024) · Journal of Psychologists and Counsellors in Schools · doi:10.1177/20556365241270394 · Cited by 66
“Several studies found a small reduction in bullying incidents (pre-post) in schools that imposed mobile phone bans especially in older students (Abrahamsson, n.d.; Beneito & Vicente-Chirivella, 2022; Guldvik & Kvinnsland, 2018; Toth, 2022).”
InfluentialBöttger, T., & Zierer, K. (2024) · Education Sciences · doi:10.3390/educsci14080906 · Cited by 60
“The studies by Abrahamsson [25] and Beneito and Vicente-Chirivella [26] reported a total of three effects related to bullying.”
MethodResultBorgonovi, F., Pokropek, M., & Pokropek, A. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104807 · Cited by 62
Gath, M. E., Monk, L., Scott, A., & Gillon, G. T. (2024) · Education Sciences · doi:10.3390/educsci14040351 · Cited by 90
“Research from Spain [16], Belgium [17], and the United Kingdom [5] has demonstrated that banning students from using mobile phones in schools improves academic performance, and this is particularly the case for low-performing students.”
BackgroundKing, D. L., Radünz, M., Galanis, C. R., Quinney, B. A., & Wade, T. D. (2024) · Journal of Behavioral Addictions · doi:10.1556/2006.2024.00058 · Cited by 42
Metadata
- Authors
- Beneito, P., & Vicente-Chirivella, Ó.
- Affiliations
- Universitat de València (ES)
- Corresponding author
- Vicente-Chirivella, Óscar
- Venue
- Applied Economic Analysis
- Publisher
- Emerald
- Published
- 2022-01-25
- Volume
- 30
- Issue
- 90
- Pages
- 153-175
- ISSN
- 2632-7627 (ISSN-L)
- OpenAlex
- W4207043903
- Cited by
- 49
- References
- 38
- Citations by year
- 2026: 13 · 2025: 12 · 2024: 14 · 2023: 7 · 2022: 3
- FWCI
- 19.40
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- www.emerald.com/insight/site-policies (tdm)
- Locations
- Applied Economic Analysis (publishedVersion, cc-by)
- Repository of Digital Objects for Teaching Research and Culture (University of Valencia) (submittedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Generalitat Valenciana (501100011033, MCIN/AEI/10.13039/501100011033/)
- European Regional Development Fund (10.13039/501100011033, 13039/501100011033, 501100011033, MCIN/ AEI/ 10.13039/501100011033)
- Agencia Estatal de Investigación (AEI//10.13039/501100011033/, 501100011033, 10.13039/501100011033, MCIN/AEI/10.13039/501 100 011 033, 13039, .13039/501100011033, 10.13039, ECO2017- 86793-R)
- Topics
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Social Sciences › Psychology › Social Psychology › Bullying, Victimization, and Aggression
- Keywords
- school policy, bullying, PISA results, academic performance, mathematics achievement, science achievement, adolescent students, regional policy, Spain, Galicia
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Banning mobile phones in schools: evidence from regional-level policies in Spain. https://app.cochat.ai/papers/10.1108/aea-05-2021-0112
- The paper
- Beneito, P., & Vicente-Chirivella, Ó. (2022). Banning mobile phones in schools: evidence from regional-level policies in Spain. Applied Economic Analysis. https://doi.org/10.1108/aea-05-2021-0112
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.