Selective Outcome Reporting Bias in Randomized Controlled Trials on Dental Caries in Children and Adolescents: A Meta-Research Study
The DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index.
Abstract
INTRODUCTION: Selective outcome reporting (SOR) is a bias that can occur in randomized controlled trials (RCTs), defined as the alteration or omission of primary outcome in the publication compared to the original protocol. Researchers may modify outcomes to highlight statistically significant results. This study aimed to assess the prevalence of SOR in RCTs related to dental caries in children and adolescents. METHODS: We conducted a search on ClinicalTrials.gov and the International Clinical Trials Registry Platform (ICTRP), using a comprehensive search strategy with terms related to pediatric dentistry and dental caries, up to February 2023. Two independent reviewers included trials with two or more arms focusing on dental caries in pediatric dentistry. Registrations that did not result in at least one published article were excluded. Data on the characteristics and outcomes from the protocols and corresponding publications were extracted. The primary outcome was the prevalence of SOR in the included RCTs. A chi-square test, with a significance level of 5%, was used to assess the association between SOR and pre-specified variables, which was the secondary outcome. RESULTS: A total of 175 protocols and their corresponding publications were included. SOR was identified in 58.9% (n = 103) of the studies, with 41.1% (n = 72) showing discrepancies in the primary outcome's time frame. Retrospective registrations accounted for 73.7% of the studies. SOR was significantly associated with discrepancies in the follow-up period (p < 0.001) and with study design type (parallel assignment, split-mouth, cluster RCT, and no information) (p = 0.048). CONCLUSIONS: The high prevalence of SOR in dental caries RCTs in pediatric dentistry highlights the need for attention to this issue. Ensuring transparency in the research process requires implementing an appropriate pre-registered protocol, disclosing deviations from it, and enabling stakeholders to compare the protocol with the published outcomes which can help reduce research waste.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363 · cited 1×
“To promote transparency in protocols, guidelines such as “ Standard Protocol Items: Recommendations for Interventional Trials ” (SPIRIT) for reporting protocols and “ Consolidated Standards of Reporting Trials ” (CON-SORT) for reporting RCTs have been introduced [25, 26].”
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 3×
“More than one modi fi ed criterion from Chan et al. 2004 can be found in a publication regarding the registry.”
InfluentialGlobal Burden of Untreated Caries: A Systematic Review and Metaregression
Kassebaum, N. J., Bernabé, E., Dahiya, M., Bhandari, B., Murray, C. J. L., & Marcenes, W. (2015) · Journal of Dental Research · doi:10.1177/0022034515573272 · Cited by 1,679
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 1×
“The pressure to publish signi fi cant results can lead to SOR, where researchers present outcomes that increase their chances of publication [24].”
Murad, M. H., Asi, N., Alsawas, M., & Alahdab, F. (2016) · Evidence Based Medicine · doi:10.1136/ebmed-2016-110401 · Cited by 1,388
Reporting of Patient-Reported Outcomes in Randomized Trials: The CONSORT PRO Extension
Calvert, M., Blazeby, J., Altman, D. G., Revicki, D. A., Moher, D., Brundage, M. D., & CONSORT PRO Group, F. T. (2013) · JAMA · doi:10.1001/jama.2013.879 · Cited by 1,386
Clinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133 · cited 1×
“Additionally, as required by some journals, authors should af fi rm that their manuscript accurately and transparently reports all aspects of the study, without omitting important details [50, 51].”
Boutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842 · cited 1×
“The Declaration of Hel-sinki asserts that “ authors have a duty to make publicly available the results of their research on humans and are accountable for the integrity and accuracy of their reports ” [13 – 15].”
Global economic impact of dental diseases
Listl, S., Galloway, J., Mossey, P. A., & Marcenes, W. (2015) · Journal of Dental Research · doi:10.1177/0022034515602879 · Cited by 840 · cited 2×
“From 1990 to 2019, over 3 million new cases of caries lesions in permanent teeth and over a million in primary teeth were reported [5], resulting in substantial treatment costs [6].”
Generation of allocation sequences in randomised trials: chance, not choice
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07683-3 · Cited by 774
Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., & Moher, D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000030.pub2 · Cited by 740 · cited 2×
“Adherence to CONSORT guidelines is crucial to ensure transparent and comprehensive reporting of RCTs as these guidelines specify the essential items that must be included in a publication [26 – 29].”
Guidelines for Reporting Outcomes in Trial Reports: The CONSORT-Outcomes 2022 Extension
Butcher, N. J., Monsour, A., Mew, E. J., Chan, A.-W., Moher, D., Mayo-Wilson, E., Terwee, C. B., Chee-A-Tow, A., Baba, A., Gavin, F., et al. (2022) · JAMA · doi:10.1001/jama.2022.21022 · Cited by 719 · cited 1×
“The 2022 update to the CONSORT extension has enhanced the transparency and quality of reported results [28], making them more valid and reliable for clinical practice and decision-making [29].”
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715 · cited 1×
“Some studies suggest that journals favor publishing signi fi cant results, contributing to selective non-publication of negative results RCTs, which can distort interpretations and meta-analyses [52].”
Clinical Trial Registration — Looking Back and Moving Ahead
Laine, C., Horton, R., DeAngelis, C. D., Drazen, J. M., Frizelle, F. A., Godlee, F., Haug, C., Hébert, P. C., Kotzin, S., Marusic, A., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejme078110 · Cited by 320
Cochrane Reviews on the Benefits/Risks of Fluoride Toothpastes
Wong, M. C. M., Clarkson, J., Glenny, A.-M., Lo, E. C. M., Marinho, V. C. C., Tsang, B. W. K., Walsh, T., & Worthington, H. V. (2011) · Journal of Dental Research · doi:10.1177/0022034510393346 · Cited by 267
Noordzij, M., Dekker, F. W., Zoccali, C., & Jager, K. J. (2011) · Nephron Clinical Practice · doi:10.1159/000322830 · Cited by 217
Rodríguez del Águila, M., & González-Ramírez, A. (2014) · Allergologia et Immunopathologia · doi:10.1016/j.aller.2013.03.008 · Cited by 192
Qin, X., Zi, H., & Zeng, X. (2022) · Heliyon · doi:10.1016/j.heliyon.2022.e10714 · Cited by 163
Andrade, C. (2015) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.15f10377 · Cited by 133
The end of the primary outcome measure: A research agenda for constructing its replacement
Reyes, A. D. L., Kundey, S. M. A., & Wang, M. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.03.011 · Cited by 122
Gimenez, T., Bispo, B. A., Souza, D., Viganó, M. E. F., Wanderley, M. T., Mendes, F. M., Bönecker, M., & Braga, M. M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164903 · Cited by 114
Self-citationCherry-picking by trialists and meta-analysts can drive conclusions about intervention efficacy
Mayo-Wilson, E., Li, T., Fusco, N., Bertizzolo, L., Canner, J. K., Cowley, T., Doshi, P., Ehmsen, J., Gresham, G., Guo, N., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.07.014 · Cited by 108
Mhaskar, R., Djulbegovic, B., Magazin, A., Soares, H. P., & Kumar, A. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.10.016 · Cited by 102
Hannink, G., Gooszen, H. G., & Rovers, M. M. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e3182864fa3 · Cited by 102
Registering a clinical trial in ClinicalTrials.gov.
Zarin, D., & Keselman, A. (2007) · Chest · doi:10.1378/chest.06-2450 · Cited by 100
The good, the bad and the rude peer-review
Mavrogenis, A. F., Quaile, A., & Scarlat, M. M. (2020) · International Orthopaedics · doi:10.1007/s00264-020-04504-1 · Cited by 85
Guidelines for randomized clinical trial protocol content: a systematic review
Tetzlaff, J. M., Chan, A.-W., Kitchen, J., Sampson, M., Tricco, A. C., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-43 · Cited by 81
Saquib, N., Saquib, J., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f4313 · Cited by 68
Quality of Registration for Clinical Trials Published in Emergency Medicine Journals
Jones, C. W., & Platts‐Mills, T. F. (2012) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2012.02.005 · Cited by 51
Outcome reporting recommendations for clinical trial protocols and reports: a scoping review
Butcher, N. J., Mew, E. J., Monsour, A., Chan, A.-W., Moher, D., & Offringa, M. (2020) · Trials · doi:10.1186/s13063-020-04440-w · Cited by 48
Factors Influencing the Publication of Randomized Controlled Trials in Child Health Research
Hartling, L., Craig, W. R., Russell, K., Stevens, K., & Klassen, T. P. (2004) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.158.10.983 · Cited by 47
McDonald, K., Seltzer, E. W., Lu, M., et al. (2023) · Trials · doi:10.1186/s13063-023-07277-1 · Cited by 45
Koufatzidou, M., Koletsi, D., Fleming, P. S., Polychronopoulou, A., & Pandis, N. (2019) · European Journal of Orthodontics · doi:10.1093/ejo/cjy046 · Cited by 44
Clinically relevant outcomes in dental clinical trials: challenges and proposals
PANNUTI, C. M., SENDYK, D. I., GRAÇAS, Y. T. D., TAKAI, S. L., SABÓIA, V. D. P. A., ROMITO, G. A., & MENDES, F. M. (2020) · Brazilian Oral Research · doi:10.1590/1807-3107bor-2020.vol34.0073 · Cited by 41
Self-citationFifteen common mistakes encountered in clinical research
Clark, G. T., & Mulligan, R. (2011) · Journal of Prosthodontic Research · doi:10.1016/j.jpor.2010.09.002 · Cited by 40
Split-mouth design in Paediatric Dentistry clinical trials.
Pozos‐Guillén, A., Chavarría‐Bolaños, D., & Garrocho‐Rangel, A. (2017) · PubMed · doi:10.23804/ejpd.2017.18.01.13 · Cited by 38
Selective outcome reporting in randomized clinical trials of dental implants
Sendyk, D. I., Rovai, E. S., Souza, N. V., Deboni, M. C. Z., & Pannuti, C. M. (2019) · Journal of Clinical Periodontology · doi:10.1111/jcpe.13128 · Cited by 35
Self-citationFrencken, J. E., Innes, N., & Schwendicke, F. (2016) · Advances in Dental Research · doi:10.1177/0022034516639272 · Cited by 33
Vilela, N., Nicolini, A. C., dos Reis, I. N. R., Sendyk, D. I., Cavagni, J., & Pannuti, C. M. (2022) · Journal of Periodontal Research · doi:10.1111/jre.13066 · Cited by 20
Self-citationScience, interrupted: Funding delays reduce research activity but having more grants helps
Tham, W. Y. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280576 · Cited by 17
Elagami, R. A., Tedesco, T. K., Pannuti, C. M., da Silva, G. S., Braga, M. M., Mendes, F. M., & Raggio, D. P. (2022) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.13024 · Cited by 14
Self-citationKrstičević, M., Saric, D., Šarić, F., Slapnicar, E., Borić, K., Došenović, S., Kadić, A. J., Kegalj, M. J., & Puljak, L. (2019) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2019-0068 · Cited by 12
A Note on Cherry-Picking in Meta-Analyses
Yoneoka, D., & Rieck, B. (2023) · Entropy · doi:10.3390/e25040691 · Cited by 12
RANDOMIZED CONTROLLED TRIALS IN DENTAL JOURNALS ON CHILDREN AND ADOLESCENTS: A BIBLIOMETRIC ANALYSIS
Jiang, C. M., Lee, G. H. M., Lo, E. C. M., Chu, C. H., & Wong, M. C. M. (2021) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2021.101621 · Cited by 10
A road map for designing and reporting clinical trials in paediatric dentistry
Araújo, M. P., Al‐Yaseen, W., & Innes, N. (2020) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.12746 · Cited by 9
Selective outcome reporting across psychopharmacotherapy randomized controlled trials
Lancee, M., Schuring, M., Tijdink, J. K., Chan, A., Vinkers, C. H., & Luykx, J. J. (2022) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1900 · Cited by 8 · cited 1×
“While previous research has addressed bias in fi elds such as psycho-pharmacotherapy [31] and dental implants [32], there has only been one meta-research study examining the prevalence of SOR speci fi cally in RCTs related to re-storative treatments in pediatric dentistry [33].”
A IMPORTÂNCIA DOS ESTUDOS CLÍNICOS RANDOMIZADOS E SEU IMPACTO NA TOMADA DE DECISÃO CLÍNICA
Raggio, D. P., Gallegos, C. J. L., Laux, C. M., & Elagami, R. A. (2022) · Revista Científica do CRO-RJ · doi:10.29327/244963.7.1-2 · Cited by 7
Self-citation
Research works printed but not linked: 1
- 10.1371/journal.pone.0003081 · DOI · Paper page
Cited by
Mouthwash use in children and adolescents: should parents be worried?
Veseli, E., & Breznica, E. (2024) · European Archives of Paediatric Dentistry · doi:10.1007/s40368-024-00991-7 · Cited by 1
Meneses, É. S., Pascareli-Carlos, A. M., Castilho, J. P. F., Migues, L. P. C., Marques, F. S., Montagner, A. F., Mendes, F. M., Lara, J. S., Imparato, J. C. P., Rodrigues, M. C., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9500070/v1
Self-citationdos Santos, L. G., Montagner, A. F., Lucena, C., Lima, G. D. S., Segundo, J. D. D. B., Moher, D., & Pereira‐Cenci, T. (2026) · Journal of Dentistry · doi:10.1016/j.jdent.2026.106988
Metadata
- Authors
- da Rosa Oliveira, L., Elagami, R. A., Reis, T. M., Tedesco, T. K., Mendes, F. M., Braga, M. M., Pannuti, C. M., & Raggio, D. P.
- Affiliations
- Universidade de São Paulo (BR)
- ORCID
- Venue
- Caries Research
- Publisher
- S. Karger AG
- Published
- 2024-11-26
- Volume
- 59
- Issue
- 3
- Pages
- 207-218
- ISSN
- 0008-6568 (ISSN-L)
- 1421-976X
- OpenAlex
- W4404743006
- Cited by
- 3
- References
- 54
- Citations by year
- 2026: 2 · 2024: 1
- FWCI
- 0.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- karger.com/pages/terms-and-conditions (vor)
- karger.com/pages/terms-and-conditions (tdm)
- Locations
- Caries Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- selective outcome reporting, reporting bias, dental caries, children and adolescents, pediatric dentistry, clinical trial registration, preregistration, research transparency, research waste
- MeSH terms
- Adolescent, Child, Dental Caries, Humans, Research Design, Bias, Randomized Controlled Trials as Topic, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.