The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Cognitive Advantage in Bilingualism: An Example of Publication Bias?
Open accessAbstract
It is a widely held belief that bilinguals have an advantage over monolinguals in executive-control tasks, but is this what all studies actually demonstrate? The idea of a bilingual advantage may result from a publication bias favoring studies with positive results over studies with null or negative effects. To test this hypothesis, we looked at conference abstracts from 1999 to 2012 on the topic of bilingualism and executive control. We then determined which of the studies they reported were subsequently published. Studies with results fully supporting the bilingual-advantage theory were most likely to be published, followed by studies with mixed results. Studies challenging the bilingual advantage were published the least. This discrepancy was not due to differences in sample size, tests used, or statistical power. A test for funnel-plot asymmetry provided further evidence for the existence of a publication bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“In fact, the file-drawer problem is not the only bias that marks scientific literature: The well-known publication bias is another obvious one (see Chambers, 2013; Cumming, 2014; Easterbrook, Gopalan, Berlin, & Matthews, 1991; Fanelli, 2010; Francis, 2012).”
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Bilingualism, Aging, and Cognitive Control: Evidence From the Simon Task.
Bialystok, E., Craik, F. I. M., Klein, R., & Viswanathan, M. (2004) · Psychology and Aging · doi:10.1037/0882-7974.19.2.290 · Cited by 1,618
A systematic review and meta-analysis of the cognitive correlates of bilingualism
Adesope, O. O., Lavin, T., Thompson, T., & Ungerleider, C. (2010) · Review of Educational Research · doi:10.3102/0034654310368803 · Cited by 1,132
There is no coherent evidence for a bilingual advantage in executive processing
Paap, K. R., & Greenberg, Z. I. (2013) · Cognitive Psychology · doi:10.1016/j.cogpsych.2012.12.002 · Cited by 1,131
Bilingualism aids conflict resolution: Evidence from the ANT task
Costa, A., Hernández, M., & Sebastián-Gallés, N. (2008) · Cognition · doi:10.1016/j.cognition.2006.12.013 · Cited by 1,051
Publication prejudices: An experimental study of confirmatory bias in the peer review system
Mahoney, M. J. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173636 · Cited by 1,013
Attention and inhibition in bilingual children: evidence from the dimensional change card sort task
Bialystok, E., & Martin, M. M. (2004) · Developmental Science · doi:10.1111/j.1467-7687.2004.00351.x · Cited by 969
Cognitive control and lexical access in younger and older bilinguals.
Bialystok, E., Craik, F., & Luk, G. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.34.4.859 · Cited by 925
On the bilingual advantage in conflict processing: Now you see it, now you don’t
Costa, A., Hernández, M., Costa-Faidella, J., & Sebastián-Gallés, N. (2009) · Cognition · doi:10.1016/j.cognition.2009.08.001 · Cited by 800 · cited 3×
“In the flanker task used by Costa et al. (2009), the effect size of bilingualism was .61. Null-effect flanker-task studies (8 studies) on average had a medium probability (.62) of detecting this effect. In a task-switching paradigm, Gold et al. (2013) found a bilingualism effect size of .”
Hilchey, M. D., & Klein, R. M. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0116-7 · Cited by 791
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734
Is the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697
Understanding the consequences of bilingualism for language processing and cognition
Kroll, J. F., & Bialystok, E. (2013) · Journal of Cognitive Psychology · doi:10.1080/20445911.2013.799170 · Cited by 673
A bilingual advantage in task switching
PRIOR, A., & MACWHINNEY, B. (2010) · Bilingualism: Language and Cognition · doi:10.1017/s1366728909990526 · Cited by 625
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · cited 1×
“This rejection is often based on the argument that null effects are difficult to interpret, the result of poor stimulus design, or the result of a Type II error (Ferguson & Heene, 2012).”
Registered Reports: A new publishing initiative at Cortex
Chambers, C. D. (2013) · Cortex · doi:10.1016/j.cortex.2012.12.016 · Cited by 570
Lifelong Bilingualism Maintains Neural Efficiency for Cognitive Control in Aging
Gold, B. T., Kim, C., Johnson, N. F., Kryscio, R. J., & Smith, C. D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3837-12.2013 · Cited by 372
The psycholinguistics of bilingualism
Taura, H. (2014) · International Journal of Bilingual Education and Bilingualism · doi:10.1080/13670050.2013.825170 · Cited by 362
Gathercole, V. C. M., Thomas, E. M., Kennedy, I., Prys, C., Young, N., Viñas Guasch, N., Roberts, E. J., Hughes, E. K., & Jones, L. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00011 · Cited by 357
Sterne, J. A. C., Becker, B. J., & Egger, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch5 · Cited by 341
Unpublished results hide the decline effect
Schooler, J. (2011) · Nature · doi:10.1038/470437a · Cited by 333
Luk, G., Anderson, J. A. E., Craik, F. I. M., Grady, C., & Bialystok, E. (2010) · Brain and Cognition · doi:10.1016/j.bandc.2010.09.004 · Cited by 256
Too good to be true: Publication bias in two prominent studies from experimental psychology
Francis, G. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0227-9 · Cited by 206
The effect of bilingualism and age on inhibitory control
Lee Salvatierra, J., & Rosselli, M. (2011) · International Journal of Bilingualism · doi:10.1177/1367006910371021 · Cited by 166
Paap, K. R. (2014) · Journal of Cognitive Psychology · doi:10.1080/20445911.2014.891597 · Cited by 101
Spatial negative priming in bilingualism
Treccani, B., Argyri, E., Sorace, A., & Sala, S. D. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.320 · Cited by 75
Self-citationPaap, K. R., & Liu, Y. (2013) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2013.09.002 · Cited by 59
Introduction to the Special Section: Data, Data, Everywhere . . . Especially in My File Drawer
Spellman, B. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611432124 · Cited by 58
Cognitive Control and Lexical Access in Younger and Older Bilinguals
Bialystok, C. (2016) · doi:10.4324/9781315440446-24 · Cited by 38
What bilinguals tell us about cognitive control: Overview to the special issue
Bobb, S. C., Wodniecka, Z., & Kroll, J. F. (2013) · Journal of Cognitive Psychology · doi:10.1080/20445911.2013.822724 · Cited by 12
Cited by
Paap, K. R., Johnson, H. A., & Sawi, O. (2015) · Cortex · doi:10.1016/j.cortex.2015.04.014 · Cited by 810
Is bilingualism associated with enhanced executive functioning in adults? A meta-analytic review.
Lehtonen, M., Soveri, A., Laine, A., Järvenpää, J., de Bruin, A., & Antfolk, J. (2018) · Psychological Bulletin · doi:10.1037/bul0000142 · Cited by 632
Self-citationThe Advantages of Bilingualism Debate
Antoniou, M. (2019) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-011718-011820 · Cited by 373
Characterizing the social diversity of bilingualism using language entropy
Gullifer, J. W., & Titone, D. (2020) · Bilingualism: Language and Cognition · doi:10.1017/s1366728919000026 · Cited by 330
Matthews, D., Biney, H., & Abbot-Smith, K. (2018) · Language Learning and Development · doi:10.1080/15475441.2018.1455584 · Cited by 284
Metadata
- Authors
- de Bruin, A., Treccani, B., & Della Sala, S.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2014-12-04
- Volume
- 26
- Issue
- 1
- Pages
- 99-107
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2136519314
- Cited by
- 599
- References
- 34
- FWCI
- 23.32
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.