Concern noted: a descriptive study of editorial expressions of concern in PubMed and PubMed Central
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: An editorial expression of concern (EEoC) is issued by editors or publishers to draw attention to potential problems in a publication, without itself constituting a retraction or correction. METHODS: We searched PubMed, PubMed Central (PMC), and Google Scholar to identify EEoCs issued for publications in PubMed and PMC up to 22 August 2016. We also searched the archives of the Retraction Watch blog, some journal and publisher websites, and studies of EEoCs. In addition, we searched for retractions of EEoCs and affected articles in PubMed up to 8 December 2016. We analyzed overall historical trends, as well as reported reasons and subsequent editorial actions related to EEoCs issued between August 2014 and August 2016. RESULTS: After screening 5,076 records, we identified 230 EEoCs that affect 300 publications indexed in PubMed, the earliest issued in 1985. Half of the primary EEoCs were issued between 2014 and 2016 (52%). We found evidence of some EEoCs that had been removed by the publisher without leaving a record and some were not submitted for PubMed or PMC indexing. A minority of publications affected by EEoCs had been retracted by early December 2016 (25%). For the subset of 92 EEoCs issued between August 2014 and August 2016, affecting 99 publications, the rate of retraction was similar (29%). The majority of EEoCs were issued because of concerns with validity of data, methods, or interpretation of the publication (68%), and 31% of cases remained open. Issues with images were raised in 40% of affected publications. Ongoing monitoring after the study identified another 17 EEoCs to year's end in 2016, increasing the number of EEoCs to 247 and publications in PubMed known to be affected by EEoCs to 320 at the end of 2016. CONCLUSIONS: EEoCs have been rare publishing events in the biomedical literature, but their use has been increasing. Most have not led to retractions, and many remain unresolved. Lack of prominence and inconsistencies in management of EEoCs reduce the ability of these notices to alert the scientific community to potentially serious problems in publications. EEoCs will be made identifiable in PubMed in 2017.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092
The oligopoly of academic publishers in the digital era
Larivière, V., Haustein, S., & Mongeon, P. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127502 · Cited by 1,240 · cited 1×
“In addition, the 6 largest publishers (by number of publications) in natural and medical sciences and social sciences and humanities were searched [19].”
BackgroundMisconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · cited 1×
“reported that, for more than 2000 retracted English-language articles indexed in PubMed to May 2012, the mean time to retraction was 33 ± 34 months [35].”
BackgroundWhy has the number of scientific retractions increased?
Steen, R. G., Casadevall, A., & Fang, F. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068397 · Cited by 415 · cited 1×
“’s analyses used the date of hard-copy publication in the journal to retraction notice [36], whereas we”
MethodA Comprehensive Survey of Retracted Articles from the Scholarly Literature
Grieneisen, M. L., & Zhang, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044118 · Cited by 355 · cited 1×
“They identified EEoCs affecting 58 publications between 2000 and 2011 across 30 journals, with 70% occurring since 2008 [12].”
BackgroundThe Retraction Penalty: Evidence from the Web of Science
Lu, S. F., Jin, G. Z., Uzzi, B., & Jones, B. (2013) · Scientific Reports · doi:10.1038/srep03146 · Cited by 191
The (lack of) Impact of Retraction on Citation Networks
Madlock-Brown, C. R., & Eichmann, D. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-014-9532-1 · Cited by 89
The persistence of error: a study of retracted articles on the Internet and in personal libraries
Davis, P. M. (2012) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.100.3.008 · Cited by 74
Visibility of retractions: a cross-sectional one-year study
Decullier, E., Huot, L., Samson, G., & Maisonneuve, H. (2013) · BMC Research Notes · doi:10.1186/1756-0500-6-238 · Cited by 69 · cited 1×
“[33] and the definitions for research misconduct by the HHS Office of Research Integrity [34].”
BackgroundAnalysis of Citations to Biomedical Articles Affected by Scientific Misconduct
Neale, A. V., Dailey, R. K., & Abrams, J. (2010) · Science and Engineering Ethics · doi:10.1007/s11948-009-9151-4 · Cited by 66 · cited 1×
“Drawing attention more quickly and effectively to affected publications is an essential first step to reducing the lengthy persistence of known error in the biomedical literature [34, 35, 36, 37].”
Background
Cited by
Byrne, J. A., & Christopher, J. (2020) · FEBS Letters · doi:10.1002/1873-3468.13747 · Cited by 133
When beauty is but skin deep: dealing with problematic studies in systematic reviews
Boughton, S. L., Wilkinson, J., & Bero, L. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.ed000152 · Cited by 32
Bakker, C., Boughton, S., Faggion, C. M., Fanelli, D., Kaiser, K., & Schneider, J. (2024) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-111921 · Cited by 28
“47 on D e c e m be r 5 , 2023 b y gue s t.”
Byrne, J. A., Park, Y., West, R. A., Capes-Davis, A., Favier, B., Cabanac, G., & Labbé, C. (2021) · Scientometrics · doi:10.1007/s11192-021-03871-9 · Cited by 21
Amending published articles: time to rethink retractions and corrections?
Barbour, V., Bloom, T., Lin, J., & Moylan, E. (2017) · doi:10.1101/118356
Metadata
- Authors
- Vaught, M., Jordan, D. C., & Bastian, H.
- Venue
- Research Integrity and Peer Review
- Published
- 2017-05-27
- Volume
- 2
- Issue
- 1
- ISSN
- 2058-8615 (ISSN-L)
- OpenAlex
- W2952811427
- Cited by
- 34
- References
- 10
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Concern noted: a descriptive study of editorial expressions of concern in PubMed and PubMed Central. https://app.cochat.ai/papers/10.1186/s41073-017-0030-2
- The paper
- Vaught, M., Jordan, D. C., & Bastian, H. (2017). Concern noted: a descriptive study of editorial expressions of concern in PubMed and PubMed Central. Research Integrity and Peer Review. https://doi.org/10.1186/s41073-017-0030-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.