Local Literature Bias in Genetic Epidemiology: An Empirical Evaluation of the Chinese Literature
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Postulated epidemiological associations are subject to several biases. We evaluated whether the Chinese literature on human genome epidemiology may offer insights on the operation of selective reporting and language biases. METHODS AND FINDINGS: We targeted 13 gene-disease associations, each already assessed by meta-analyses, including at least 15 non-Chinese studies. We searched the Chinese Journal Full-Text Database for additional Chinese studies on the same topics. We identified 161 Chinese studies on 12 of these gene-disease associations; only 20 were PubMed-indexed (seven English full-text). Many studies (14-35 per topic) were available for six topics, covering diseases common in China. With one exception, the first Chinese study appeared with a time lag (2-21 y) after the first non-Chinese study on the topic. Chinese studies showed significantly more prominent genetic effects than non-Chinese studies, and 48% were statistically significant per se, despite their smaller sample size (median sample size 146 versus 268, p < 0.001). The largest genetic effects were often seen in PubMed-indexed Chinese studies (65% statistically significant per se). Non-Chinese studies of Asian-descent populations (27% significant per se) also tended to show somewhat more prominent genetic effects than studies of non-Asian descent (17% significant per se). CONCLUSION: Our data provide evidence for the interplay of selective reporting and language biases in human genome epidemiology. These biases may not be limited to the Chinese literature and point to the need for a global, transparent, comprehensive outlook in molecular population genetics and epidemiologic studies in general.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jemal, A., Bray, F., Center, M. M., Ferlay, J., Ward, E., & Forman, D. (2011) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.20107 · Cited by 54,679
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763 · cited 1×
“ranges between 0% and 100% and represents the proportion of between-study variability that can be attributed to heterogeneity rather than chance (considered large for values of 75% and higher) [”
BackgroundGlobal Cancer Statistics, 2002
Parkin, D. M., Bray, F., Ferlay, J., & Pisani, P. (2005) · CA: A Cancer Journal for Clinicians · doi:10.3322/canjclin.55.2.74 · Cited by 18,196 · cited 1×
“). Chinese data were typically sparse if the disease was relatively uncommon in China compared with other countries, e.g., bladder cancer (bladder cancer is almost 10-fold less common in China than in Europe or the United States) [”
ResultWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“In some of these postulated associations, the observed effect sizes may simply be estimates of the prevailing bias [38].”
BackgroundSelf-citationCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“]. Heterogeneity due to ancestry should not have led always to larger effect sizes in all probed gene-disease associations. Therefore, the most likely explanation is publication bias against “negative” results [”
ResultQuantitative Synthesis in Systematic Reviews
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-9-199711010-00008 · Cited by 2,517 · cited 2×
“For each meta-analysis and for each group of studies, we estimated the summary odds ratio with inverse variance random effects models, which allow for between-study heterogeneity and incorporate it in the calculations [13].”
BackgroundMethodSelf-citationReplication validity of genetic association studies
Ioannidis, J. P. A., Ntzani, E. E., Trikalinos, T. A., & Contopoulos-Ioannidis, D. G. (2001) · Nature Genetics · doi:10.1038/ng749 · Cited by 1,832 · cited 3×
“The exact search strategy and eligibility criteria for these meta-analyses have been described previously [10,11].”
BackgroundSelf-citationContradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465 · cited 1×
“There is strong evidence that early-published European and American studies that appeared in the most prestigious journals tended to have inflated results [11,35,36].”
BackgroundSelf-citation
Research works printed but not linked: 3
- Thomas, 2002, Cancer Epidemiol Biomarkers Prev, 11, 505
- Wacholder, 2002, Cancer Epidemiol Biomarkers Prev, 11, 513
- Di Castelnuovo, 2001, Thromb Haemost, 85, 626, 10.1055/s-0037-1615644 · doi:10.1055/s-0037-1615644
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374
Self-citationGRADE guidelines: 5. Rating the quality of evidence—publication bias
Guyatt, G. H., Oxman, A. D., Montori, V., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Djulbegovic, B., Atkins, D., Falck-Ytter, Y., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.011 · Cited by 1,819
“Another test examines whether the number of statistically significant results is larger than what would be expected under plausible assumptions [40].”
BackgroundWhy Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Self-citationMorrison, A., Polisena, J., Husereau, D., Moulton, K., Clark, M., Fiander, M., Mierzwinski-Urban, M., Clifford, T., Hutton, B., & Rabb, D. (2012) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462312000086 · Cited by 1,257
“concluded that Chinese studies are crucial in molecular medicine (18).”
BackgroundAn exploratory test for an excess of significant findings
Ioannidis, J. P., & Trikalinos, T. A. (2007) · Clinical Trials · doi:10.1177/1740774507079441 · Cited by 751
“However, in fields where unadjusted estimates are appropriate, for example, genetic association studies, the test can be readily applied [49].”
BackgroundSelf-citationDonoho, D. (2017) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2017.1384734 · Cited by 695
Languages Are Still a Major Barrier to Global Science
Amano, T., González-Varo, J. P., & Sutherland, W. J. (2016) · PLOS Biology · doi:10.1371/journal.pbio.2000933 · Cited by 595
Assessment of cumulative evidence on genetic associations: interim guidelines
Ioannidis, J. P., Boffetta, P., Little, J., O'Brien, T. R., Uitterlinden, A. G., Vineis, P., Balding, D. J., Chokkalingam, A., Dolan, S. M., Flanders, W. D., et al. (2008) · International Journal of Epidemiology · doi:10.1093/ije/dym159 · Cited by 552
Self-citationWhy Current Publication Practices May Distort Science
Young, N. S., Ioannidis, J. P. A., & Al-Ubaydli, O. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050201 · Cited by 502
Self-citationGreen tea (Camellia sinensis) for the prevention of cancer
Filippini, T., Malavolti, M., Borrelli, F., Izzo, A. A., Fairweather-Tait, S. J., Horneber, M., & Vinceti, M. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005004.pub3 · Cited by 327
Uitterlinden, A. G., Ralston, S. H., Brandi, M. L., Carey, A. H., Grinberg, D., Langdahl, B. L., Lips, P., Lorenc, R., Obermayer-Pietsch, B., Reeve, J., et al. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-4-200608150-00005 · Cited by 252
Self-citationNon-Replication and Inconsistency in the Genome-Wide Association Setting
Ioannidis, J. P. A. (2007) · Human Heredity · doi:10.1159/000103512 · Cited by 245
“Clusters may be defined by functional or ontology pathways or some other, still unknown common denominator among exchangeable genes.We have no proof of concept yet of such exchangeable variants, but more work is indicated in this direction. For a large population sample, each exchangeable variant would still have some…”
InfluentialSelf-citationA road map for efficient and reliable human genome epidemiology.
The Human Genome Epidemiology Network and the Network of Investigator Networks, Ioannidis, J. P. A., Gwinn, M., Little, J., Higgins, J. P. T., Bernstein, J. L., Boffetta, P., Bondy, M., Bray, M. S., Brenchley, P. E., et al. (2006) · Nature Genetics · doi:10.1038/ng0106-3 · Cited by 244
Self-citationMeta‐research: The art of getting it wrong
Ioannidis, J. P. A. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.19 · Cited by 227
“Even for the simple decision of whether some data are amenable to quantitative synthesis or not, opinions and practices are completely divergent across authors on what are good enough reasons or excuses for synthesizing data quantitatively or not (Pan et al., 2005).”
BackgroundSelf-citationGohil, R., Peck, G., & Sharma, P. (2009) · Thrombosis and Haemostasis · doi:10.1160/th09-01-0013 · Cited by 196
Ralston, S. H., Uitterlinden, A. G., Brandi, M. L., Balcells, S., Langdahl, B. L., Lips, P., Lorenc, R., Obermayer-Pietsch, B., Scollen, S., Bustamante, M., et al. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030090 · Cited by 182
“The approach also eliminates the problem of publication bias within the confines of our consortium [27].”
BackgroundSelf-citationLimitations are not properly acknowledged in the scientific literature
Ioannidis, J. P. A. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.09.011 · Cited by 180
“While some empirical evaluations have suggested that major journals may sometimes foster exaggerated results [5], significance chasing is probably characteristic of the whole scientific literature [6], down to local nonEnglish language journals [7].”
BackgroundSelf-citationA Review of Genetic Association Studies of Obstructive Sleep Apnea: Field Synopsis and Meta-Analysis
Varvarigou, V., Dahabreh, I. J., Malhotra, A., & Kales, S. N. (2011) · Sleep · doi:10.5665/sleep.1376 · Cited by 106
Panagiotou, O. A., Contopoulos-Ioannidis, D. G., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f707 · Cited by 89
Self-citationArticle Commentary: On the Persistence of Low Power in Psychological Science
Vankov, I., Bowers, J., & Munafò, M. R. (2014) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.885986 · Cited by 82
Bennett, C., Underdown, A., & Barlow, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005038.pub3 · Cited by 81
Understanding Biases and Disparities in Radiology AI Datasets: A Review
Tripathi, S., Gabriel, K., Dheer, S., Parajuli, A., Augustin, A. I., Elahi, A., Awan, O., & Dako, F. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.06.015 · Cited by 75
de Winter, J. C., & Dodou, D. (2015) · PeerJ · doi:10.7717/peerj.733 · Cited by 78
Nikolopoulos, G. K., Bagos, P. G., Tsangaris, I., Tsiara, C. G., Kopterides, P., Vaiopoulos, A., Kapsimali, V., Bonovas, S., & Tsantes, A. E. (2014) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2013-1124 · Cited by 42
Metadata
- Authors
- Pan, Z., Trikalinos, T. A., Kavvoura, F. K., Lau, J., & Ioannidis, J. P. A.
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2005-11-22
- Volume
- 2
- Issue
- 12
- Pages
- e334
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- OpenAlex
- W1985224860
- Cited by
- 168
- References
- 46
- FWCI
- 17.33
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.