Should Systematic Reviewers Search for Randomized, Controlled Trials Published as Letters?
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Letters6 May 2008Should Systematic Reviewers Search for Randomized, Controlled Trials Published as Letters?Alla E. Iansavichene, MLIS, Margaret Sampson, MLIS, Jessie McGowan, MLIS, and Isola S.Y. Ajiferuke, PhDAlla E. Iansavichene, MLISFrom London Health Sciences Centre and University of Western Ontario, London, Ontario, Canada, and Children's Hospital of Eastern Ontario Research Institute and Institute of Population Health, University of Ottawa, Ottawa, Ontario, Canada.Search for more papers by this author, Margaret Sampson, MLISFrom London Health Sciences Centre and University of Western Ontario, London, Ontario, Canada, and Children's Hospital of Eastern Ontario Research Institute and Institute of Population Health, University of Ottawa, Ottawa, Ontario, Canada.Search for more papers by this author, Jessie McGowan, MLISFrom London Health Sciences Centre and University of Western Ontario, London, Ontario, Canada, and Children's Hospital of Eastern Ontario Research Institute and Institute of Population Health, University of Ottawa, Ottawa, Ontario, Canada.Search for more papers by this author, and Isola S.Y. Ajiferuke, PhDFrom London Health Sciences Centre and University of Western Ontario, London, Ontario, Canada, and Children's Hospital of Eastern Ontario Research Institute and Institute of Population Health, University of Ottawa, Ottawa, Ontario, Canada.Search for more papers by this authorAuthor, Article, and Disclosure Informationhttps://doi.org/10.7326/0003-4819-148-9-200805060-00023 SectionsAboutFull TextPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail Background: A report by Deeks and Altman (1) found randomized, controlled trials (RCTs) published as letters to be incompletely reported and noncompliant with the Consolidated Standards of Reporting Trials (CONSORT). The authors recommended that journals reexamine their policies of publishing RCTs as short reports.We examined RCTs published as letters before and after these recommendations. Our interest stems from our involvement in information retrieval for systematic reviews. A rigorous search strategy is a key component in identifying evidence (2), because an inadequate search strategy could result in missed studies and misleading conclusions. Yet, these searches often exclude certain publication types, ...References1. Deeks JJ, Altman DG. Inadequate reporting of controlled trials as short reports [Letter]. Lancet. 1998;352:1908. [PMID: 9863796] CrossrefMedlineGoogle Scholar2. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet. 1999;354:1896-900. [PMID: 10584742] CrossrefMedlineGoogle Scholar3. Haynes RB, Wilczynski N, McKibbon KA, Walker CJ, Sinclair JC. Developing optimal search strategies for detecting clinically sound studies in MEDLINE. J Am Med Inform Assoc. 1994;1:447-58. [PMID: 7850570] CrossrefMedlineGoogle Scholar4. Dickersin K. How important is publication bias? A synthesis of available data. AIDS Educ Prev. 1997;9:15-21. [PMID: 9083596] MedlineGoogle Scholar5. Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences. JAMA. 2005;293:2362-6. [PMID: 15900006] CrossrefMedlineGoogle Scholar6. Hopewell S, Clarke M, Askie L. Reporting of trials presented in conference abstracts needs to be improved. J Clin Epidemiol. 2006;59:681-4. [PMID: 16765270] CrossrefMedlineGoogle Scholar Author, Article, and Disclosure InformationAuthors: Alla E. Iansavichene, MLIS; Margaret Sampson, MLIS; Jessie McGowan, MLIS; Isola S.Y. Ajiferuke, PhDAffiliations: From London Health Sciences Centre and University of Western Ontario, London, Ontario, Canada, and Children's Hospital of Eastern Ontario Research Institute and Institute of Population Health, University of Ottawa, Ottawa, Ontario, Canada.Acknowledgment: The authors thank N.J. Barrowman for generating the random sample and D. Moher for the insight regarding Lancet letters.Disclosures: None disclosed. PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetails Metrics Cited byPRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic ReviewsRisk factors for the progression of finger interphalangeal joint osteoarthritis: a systematic reviewSearching for and selecting studies 6 May 2008Volume 148, Issue 9Page: 714-715KeywordsClinical trial reportingConflicts of interestDatabasesInformation retrievalInterquartile rangeSystematic reviews ePublished: 6 May 2008 Issue Published: 6 May 2008 Copyright & PermissionsCopyright © 2008 by American College of Physicians. All Rights Reserved.PDF downloadLoading ...
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is important for transparency and reproducibility that any database limits applied when running the search are reported accurately, as their use has high potential for introducing bias into a search [1, 64, 100, 101].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [101]
Citations
Cites
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Developing Optimal Search Strategies for Detecting Clinically Sound Studies in MEDLINE
Haynes, R. B., Wilczynski, N., McKibbon, K. A., Walker, C. J., & Sinclair, J. C. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95153434 · Cited by 765
Relative Citation Impact of Various Study Designs in the Health Sciences
Patsopoulos, N. A. (2005) · JAMA · doi:10.1001/jama.293.19.2362 · Cited by 498
How important is publication bias? A synthesis of available data.
Dickersin, K. (1997) · PubMed · Cited by 311
Reporting of trials presented in conference abstracts needs to be improved
Hopewell, S., Clarke, M. J., & Askie, L. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.09.016 · Cited by 98
Inadequate reporting of controlled trials as short reports
Deeks, J. J., & Altman, D. G. (1998) · The Lancet · doi:10.1016/s0140-6736(05)60399-6 · Cited by 25
Research works printed but not linked: 1
- Dickersin K, 1997, AIDS Educ Prev, 9, 15
Cited by
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., & Koffel, J. (2019) · doi:10.31219/osf.io/sfc38 · Cited by 3,696
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., PRISMA-S Group, Blunt, H., Brigham, T., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01542-z · Cited by 3,714
Self-citationSearching for and selecting studies
Lefebvre, C., Glanville, J., Briscoe, S., Littlewood, A., Marshall, C., Metzendorf, M., Noel‐Storr, A., Rader, T., Shokraneh, F., Thomas, J., et al. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch4 · Cited by 647
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., & Group, P.-S. (2021) · Journal of the Medical Library Association · doi:10.5195/jmla.2021.962 · Cited by 409
“It is important for transparency and reproducibility that any database limits applied when running the search are reported accurately, as their use has high potential for introducing bias into a search [52, 64, 100, 101].”
Background
Metadata
- Authors
- Iansavichene, A. E., Sampson, M., McGowan, J., & Ajiferuke, I. S. Y.
- Affiliations
- From London Health Sciences Centre and University of Western Ontario, London, Ontario, Canada, and Children's Hospital of Eastern Ontario Research Institute and Institute of Population Health, University of Ottawa, Ottawa, Ontario, Canada.
- Western University (CA)
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2008-05-06
- Volume
- 148
- Issue
- 9
- Pages
- 714-715
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2062154332
- Cited by
- 9
- References
- 6
- Citations by year
- 2024: 2 · 2021: 3 · 2020: 1 · 2019: 1 · 2015: 1
- FWCI
- 0.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- randomized controlled trials, publication types, search strategies, systematic reviews, information retrieval, trial reporting quality, editorial policy, bibliographic databases, MEDLINE, Embase, CINAHL, PsycINFO, Cochrane Library
- MeSH terms
- Publishing, Correspondence as Topic, Randomized Controlled Trials as Topic, MEDLINE
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Should Systematic Reviewers Search for Randomized, Controlled Trials Published as Letters? https://app.cochat.ai/papers/10.7326/0003-4819-148-9-200805060-00023
- The paper
- Iansavichene, A. E., Sampson, M., McGowan, J., & Ajiferuke, I. S. Y. (2008). Should Systematic Reviewers Search for Randomized, Controlled Trials Published as Letters? Annals of Internal Medicine. https://doi.org/10.7326/0003-4819-148-9-200805060-00023
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.