What is meant by intention to treat analysis? Survey of published randomised controlled trials
Open accessAbstract
Abstract Objectives: To assess the methodological quality of intention to treat analysis as reported in randomised controlled trials in four large medical journals. Design: Survey of all reports of randomised controlled trials published in 1997 in the BMJ, Lancet, JAMA, and New England Journal of Medicine. Main outcome measures: Methods of dealing with deviations from random allocation and missing data. Results: 119 (48%) of the reports mentioned intention to treat analysis. Of these, 12 excluded any patients who did not start the allocated intervention and three did not analyse all randomised subjects as allocated. Five reports explicitly stated that there were no deviations from random allocation. The remaining 99 reports seemed to analyse according to random allocation, but only 34 of these explicitly stated this. 89 (75%) trials had some missing data on the primary outcome variable. The methods used to deal with this were generally inadequate, potentially leading to a biased treatment effect. 29 (24%) trials had more than 10% of responses missing for the primary outcome, the methodsof handling the missing responses were similar in this subset. Conclusions: The intention to treat approach is often inadequately described and inadequately applied. Authors should explicitly describe the handling of deviations from randomised allocation and missing responses and discuss the potential effect of any missing response. Readers should critically assess the validity of reported intention to treat analyses. Key messages Intention to treat gives a pragmatic estimate of the benefit of a change in treatment policy rather than of potential benefit in patients who receive treatment exactly as planned Full application of intention to treat is possible only when complete outcome data are available for all randomised subjects About half of all published reports of randomised controlled trials stated that intention to treat was used, but handling of deviations from randomised allocation varied widely Many trials had some missing data on the primary outcome variable, and methods used to deal with this were generally inadequate, potentially leading to bias Intention to treat analyses are often inadequately described and inadequately applied
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
All randomised CSOs will be included in the statistical analyses, that is, an intention-to-treat analysis will be used.
“All randomised CSOs will be included in the statistical analyses, that is, an intention-to-treat analysis will be used.61”
"Intention to treat" analysis is a widely misused term.
“We replaced mention of “intention to treat” analysis, a widely misused term, by a more explicit request for information about retaining participants in their original assigned groups [26].”
From CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials (2010) · cites this paper as [26]
None of the included studies performed a full intention-to-treat analysis according to the definition of intention-to-treat given by Hollis and Campbell.
“None of the studies performed a full intention-to-treat analysis according to the definition of intention-to-treat given by Hollis and Campbell [38]”
From Internet-based physical activity interventions: a systematic review of the literature. (2007) · cites this paper as [38]
A full application of the intention-to-treat model may not be possible for most physical activity studies because there will be at least some subjects who drop out, refuse to complete final assessments, or change residence.
“However, a full application of the intent-to-treat model according to the definition given by Hollis and Campbell [38] may not be possible for most physical activity studies because, in most of these studies, there will be at least some subjects who drop out, refuse to complete final assessments, or change residence.”
From Internet-based physical activity interventions: a systematic review of the literature. (2007) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,384 · see citing works
Time Series Analysis: Forecasting and Control
Kleiner, B., Box, G. E. P., & Jenkins, G. M. (1977) · Technometrics · doi:10.2307/1267710 · Cited by 6,447 · see citing works
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127 · see citing works
Time series analysis forecasting and control
Janacek, G. J. (2009) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.2009.00643.x · Cited by 2,603 · see citing works
Roderick J.A. Little, Donald B. Rubin — Statistical Analysis with Missing Data
Bo., N., Little, R. J. A., & Rubin, D. B. (1988) · Population · doi:10.2307/1533221 · Cited by 2,155 · see citing works
Randomised study of radical surgery versus radiotherapy for stage Ib-IIa cervical cancer
Landoni, F., Maneo, A., Colombo, A., Placa, F., Milani, R., Perego, P., Favini, G., Ferri, L., & Mangioni, C. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02250-2 · Cited by 1,668 · see citing works
Post Coronary Artery Bypass Graft Trial Investigators (1997) · New England Journal of Medicine · doi:10.1056/nejm199701163360301 · Cited by 953 · see citing works
Users' Guides to the Medical Literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.1993.03510210084032 · Cited by 941 · see citing works
Nashan, B., Moore, R. H., Amlot, P. L., Schmidt, A.-G., Abeywickrama, K. H., & Soulillou, J. (1997) · The Lancet · doi:10.1016/s0140-6736(97)09278-7 · Cited by 746 · see citing works
Intention-to-Treat Analysis: Implications for Quantitative and Qualitative Research
NEWELL, D. J. (1992) · International Journal of Epidemiology · doi:10.1093/ije/21.5.837 · Cited by 715 · see citing works
Understanding controlled trials: What are pragmatic trials?
Roland, M. O., & Torgerson, D. J. (1998) · BMJ · doi:10.1136/bmj.316.7127.285 · Cited by 704 · see citing works
The Coronary Drug Project Research Group (1980) · New England Journal of Medicine · doi:10.1056/nejm198010303031804 · Cited by 659 · see citing works
Probucol and Multivitamins in the Prevention of Restenosis after Coronary Angioplasty
Tardif, J.-C., Côté, G., Lespérance, J., Bourassa, M., Lambert, J., Doucet, S., Bilodeau, L., Nattel, S., & de Guise, P. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708073370601 · Cited by 565 · see citing works
BORROWING STRENGTH FROM EXTERNAL TRIALS IN A META-ANALYSIS
Higgins, J. P. T., & WHITEHEAD, A. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19961230)15:24 · Cited by 553 · see citing works
Comparison of Conventional Anterior Surgery and Laparoscopic Surgery for Inguinal-Hernia Repair
Liem, M. S. L., van der Graaf, Y., van Steensel, C. J., Boelhouwer, R. U., Clevers, G. J., Meijer, W. S., Stassen, L. P. S., Vente, J. P., Weidema, W. F., Schrijvers, G., et al. (1997) · New England Journal of Medicine · doi:10.1056/nejm199705293362201 · Cited by 540 · see citing works
Interferon Alfa-2b Combined with Cytarabine versus Interferon Alone in Chronic Myelogenous Leukemia
Guilhot, F., Chastang, C., Michallet, M., Guerci‐Bresler, A., Harousseau, J., Maloisel, F., Bouabdallah, R., Guyotat, D., Cheron, N., Nicolini, F. E., et al. (1997) · New England Journal of Medicine · doi:10.1056/nejm199707243370402 · Cited by 536 · see citing works
Preoperative Amiodarone as Prophylaxis against Atrial Fibrillation after Heart Surgery
Daoud, E. G., Strickberger, S. A., Man, K. C., Goyal, R., Deeb, G. M., Bolling, S. F., Pagani, F. D., Bitar, C., Meissner, M. D., & Morady, F. (1997) · New England Journal of Medicine · doi:10.1056/nejm199712183372501 · Cited by 527 · see citing works
Stent Placement Compared with Balloon Angioplasty for Obstructed Coronary Bypass Grafts
Savage, M. P., Douglas, J. S., Fischman, D. L., Pepine, C. J., King, S. B., Werner, J. A., Bailey, S. R., Overlie, P. A., Fenton, S. H., Brinker, J. A., et al. (1997) · New England Journal of Medicine · doi:10.1056/nejm199709113371103 · Cited by 486 · see citing works
Statistical Issues in Drug Development
Senn, S. (2007) · doi:10.1002/9780470723586 · Cited by 448 · see citing works
Jacobson, J. M., Greenspan, J. S., Spritzler, J., Ketter, N., Fahey, J. L., Jackson, J. B., Fox, L., Chernoff, M., Wu, A. W., MacPhail, L. A., et al. (1997) · New England Journal of Medicine · doi:10.1056/nejm199705223362103 · Cited by 411 · see citing works
Intent-to-Treat Analysis for Longitudinal Studies with Drop-Outs
Little, R. J. A., & Yau, L. (1996) · Biometrics · doi:10.2307/2532847 · Cited by 380 · see citing works
Fazekas, F., Deisenhammer, F., Strasser‐Fuchs, S., Nahler, G., & Mamoli, B. (1997) · The Lancet · doi:10.1016/s0140-6736(96)09377-4 · Cited by 378 · see citing works
Kaplan, L. D., Straus, D. J., Testa, M. A., Roenn, J. V., Dezube, B. J., Cooley, T. P., HERNDIER, B. G., Northfelt, D., Huang, J. O., Tulpule, A., et al. (1997) · New England Journal of Medicine · doi:10.1056/nejm199706053362304 · Cited by 370 · see citing works
Alcohol policy and the public good
Kendell, R. E. (1995) · Addiction · doi:10.1111/j.1360-0443.1995.tb01027.x · Cited by 368 · see citing works
On estimating efficacy from clinical trials
Sommer, A. H., & Zeger, S. L. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100110 · Cited by 325 · see citing works
Time Series Analysis: A Comprehensive Introduction for Social Scientists.
Ray, W. D., & Gottman, J. M. (1982) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2982108 · Cited by 316 · see citing works
Compliance as an Explanatory Variable in Clinical Trials
Efron, B., & Feldman, D. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10474996 · Cited by 307 · see citing works
Minimum effective dose of folic acid for food fortification to prevent neural-tube defects
Daly, S., Mills, J. L., Molloy, A. M., Conley, M. R., Lee, Y. J., Kirke, P. N., Weir, D. G., & Scott, J. M. (1997) · The Lancet · doi:10.1016/s0140-6736(97)07247-4 · Cited by 294 · see citing works
Bollini, P., Pampaliona, S., Tibaldi, G., Kupelnick, B., & Munizza, C. (1999) · British Journal of Psychiatry · doi:10.1192/bjp.174.4.297 · Cited by 274 · see citing works
CAESAR Coordinating Committee, [., Study group members AMC, :., Kroon, E. D. M. B., & Wit, F. W. N. M. (1997) · The Lancet · doi:10.1016/s0140-6736(97)04441-3 · Cited by 245 · see citing works
Correlates of alcoholic beverage preference: traits of persons who choose wine, liquor or beer
Klatsky, A. L., Armstrong, M. A., & Kipp, H. (1990) · British Journal of Addiction · doi:10.1111/j.1360-0443.1990.tb01604.x · Cited by 237 · see citing works
Intention to treat – who should use ITT?
Lewis, J., & Machin, D. (1993) · British Journal of Cancer · doi:10.1038/bjc.1993.402 · Cited by 236 · see citing works
Statistical Issues in Drug Development
Ziegel, E. R., & Senn, S. J. (1999) · Technometrics · doi:10.2307/1271380 · Cited by 224 · see citing works
Wechsler, H., & McFadden, M. (1979) · Journal of Studies on Alcohol · doi:10.15288/jsa.1979.40.969 · Cited by 213 · see citing works
Epidemiology of cirrhosis of the liver: national mortality data.
Terris, M. (1967) · American Journal of Public Health and the Nations Health · doi:10.2105/ajph.57.12.2076 · Cited by 197 · see citing works
Apparent Per Capita Alcohol Consumption: National, State, and Regional Trends 1977-2016
Kaplan, J. (2018) · ICPSR Data Holdings · doi:10.3886/e105583v1 · Cited by 193 · see citing works
Rutgeerts, P. J., Rauws, E. A., Wara, P., Swain, P. C., Hoos, A., Solleder, E. M., Halttunen, J., Dobrilla, G., Richter, G., & Prassler, R. (1997) · The Lancet · doi:10.1016/s0140-6736(97)03233-9 · Cited by 185 · see citing works
O’Connor, H., Broadbent, J. A. M., Magos, A. L., & McPherson, K. (1997) · The Lancet · doi:10.1016/s0140-6736(96)07285-6 · Cited by 178 · see citing works
Schulz, K. F., Grimes, D. A., Altman, D. G., & Hayes, R. J. (1996) · BMJ · doi:10.1136/bmj.312.7033.742 · Cited by 163 · see citing works
Zidovudine, Didanosine, or Both as the Initial Treatment for Symptomatic HIV-Infected Children
Englund, J. A., Baker, C. J., Raskino, C., McKinney, R. E., Petrie, B., Fowler, M. G., Pearson, D. A., Gershon, A. A., McSherry, G., Abrams, E. J., et al. (1997) · New England Journal of Medicine · doi:10.1056/nejm199706123362403 · Cited by 156 · see citing works
Sackett, D. L. (1998) · Spine · doi:10.1097/00007632-199805150-00001 · Cited by 134 · see citing works
Friedlr, K., King, M., Lloyd, M., & Horder, J. (1997) · The Lancet · doi:10.1016/s0140-6736(97)05298-7 · Cited by 108 · see citing works
Alcohol policy and the public good
Kendell, R. E. (1995) · Addiction · doi:10.1080/09652149542490 · Cited by 105 · see citing works
CORONARY-ARTERY BYPASS SURGERY IN STABLE ANGINA PECTORIS: SURVIVAL AT TWO YEARS
(1979) · The Lancet · doi:10.1016/s0140-6736(79)91372-2 · Cited by 103 · see citing works
Don't You Know There's a War On? The American Home Front, 1941-1945
Polenberg, R., & Lingeman., R. R. (1971) · The American Historical Review · doi:10.2307/1870652 · Cited by 91 · see citing works
Behavioral and social consequences related to the consumption of different beverage types.
Smart, R. G. (1996) · Journal of Studies on Alcohol · doi:10.15288/jsa.1996.57.77 · Cited by 86 · see citing works
The Impact of Per Capita Consumption on Swedish Cirrhosis Mortality
Norström, T. (1987) · British Journal of Addiction · doi:10.1111/j.1360-0443.1987.tb01439.x · Cited by 83 · see citing works
A psychosocial comparison of drunken drivers and alcoholics.
Selzer, M. L., Vinokur, A. D., & Wilson, T. D. (1977) · Journal of Studies on Alcohol · doi:10.15288/jsa.1977.38.1294 · Cited by 65 · see citing works
The relationship of alcohol sales to cirrhosis mortality.
Gruenewald, P. J., & Ponicki, W. R. (1995) · Journal of Studies on Alcohol · doi:10.15288/jsa.1995.56.635 · Cited by 58 · see citing works
Compliance as an Explanatory Variable in Clinical Trials
Efron, B., & Feldman, D. (1991) · Journal of the American Statistical Association · doi:10.2307/2289707 · Cited by 50 · see citing works
Adjusting for early treatment termination in comparative clinical trials
Lagakos, S. W., Lim, L. L.-Y., & Robins, J. M. (1990) · Statistics in Medicine · doi:10.1002/sim.4780091204 · Cited by 47 · see citing works
Measurement of ethanol consumed in distilled spirits.
Kling, W. (1989) · Journal of Studies on Alcohol · doi:10.15288/jsa.1989.50.456 · Cited by 43 · see citing works
Smart, R. G., & Mann, R. E. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb00802.x · Cited by 40 · see citing works
Comparison of Conventional Anterior Surgery and Laparoscopic Surgery for Inguinal Hernia Repair
Liem, M. S. L., van der Graaf, Y., van Steensel, C. J., Boelhouwer, R. U., Clevers, G. J., Meijer, W. S., Stassen, L. P. S., Vente, J. P., Weidema, W. F., Schrijvers, G., et al. (1997) · Survey of Anesthesiology · doi:10.1097/00132586-199712000-00056 · Cited by 39 · see citing works
Can individually directed interventions reduce population-level alcohol-involved problems?
Holder, H. D. (1997) · Addiction · doi:10.1080/09652149738628 · Cited by 25 · see citing works
Beverage Specific Drinking Contexts
Harford, T. C. (1979) · International Journal of the Addictions · doi:10.3109/10826087909060365 · Cited by 24 · see citing works
Effect of non‐random missing data mechanisms in clinical trials
Choi, S. C., & Lu, I.-L. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142407 · Cited by 19 · see citing works
"Alcoholic," "unspecified" and "other specified" cirrhosis mortality: a study in validity.
Hyman, M. M. (1981) · Journal of Studies on Alcohol · doi:10.15288/jsa.1981.42.336 · Cited by 19 · see citing works
Can individually directed interventions reduce population-level alcohol-involved problems?
Holder, H. D. (1997) · Addiction · doi:10.1111/j.1360-0443.1997.tb03632.x · Cited by 18 · see citing works
Numans, M. E., & Quartero, A. O. (1997) · The Lancet · doi:10.1016/s0140-6736(05)61784-9 · Cited by 17 · see citing works
Ethnicity, distilled spirits consumption and mortality in Pennsylvania.
Longnecker, M. P., WOLZ, M. M., & Parker, D. A. (1981) · Journal of Studies on Alcohol · doi:10.15288/jsa.1981.42.791 · Cited by 10 · see citing works
Hosmer (1997) · doi:10.1002/(sici)1097-0258(19970515)16:9
Flagged first, then by citations
2 of the 67 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- Skog O-J. Interpreting trends in alcohol consumption and alcohol related damage. Alcohol Alcohol 1988;22:193-202.
- Robinson WS. Ecological correlations and the behavior of individual. American Sociological Review 1950;15:351-7.
- Skog O-J. Liver cirrhosis epidemiology: some methodological problems. Br J Addiction 1980;75:227-43.
- Hilton ME. Trends in U.S. drinking patterns: further evidence from the past twenty years. In: Clark WB, Hilton ME, eds. Alcohol in America: drink- ing practices and problems. Albany: State University of New York Press, 1991:121-38.
- Schmidt DN. Apparent risk factors for chronic and acute pancreatitis in Stockholm county: spirits but not wine and beer. Int J Pancreatol 1991;8:45-50.
- Kling W. Measurement of ethanol consumed in distilled spirits: revision. J Stud Alcohol 1991;52:503-4.
- Derr RF. Wine, alcohol, nutrition, and the risk of human mortality: corre- lation with rat and baboon studies. Biochem Arch 1996;12:277-82.
- Cochrane Controlled Trials Register. Cochrane library. Cochrane Collabo- ration. Oxford: Update Software, 1997.
- Cuzick J, Edwards R, Segnan N. Adjusting for non-compliance and con- tamination in randomized clinical trials. Stat Med 1997;16:1017-29.
- Goetghebeur EJ, Shapiro SH. Analysing non-compliance in clinical trials: ethical imperative or mission impossible? Stat Med 1996;15:2813-26.
Cited by
Sorted by citations
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · see citing works
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251 · see citing works
Practical methods for incorporating summary time-to-event data into meta-analysis.
Tierney, J. F., Stewart, L. A., Ghersi, D., Burdett, S., & Sydes, M. R. (2007) · Trials · doi:10.1186/1745-6215-8-16 · Cited by 6,208 · see citing works
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373 · see citing works
CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group* (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-11-201006010-00232 · Cited by 3,824 · see citing works
“Item 16 (numbers analyzed)—We replaced mention of “intention to treat” analysis, a widely misused term, by a more explicit request for information about retaining participants in their original assigned groups (26).”
BackgroundThe Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835 · see citing works
(2008) · Cited by 3,790 · see citing works
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · see citing works
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,237 · see citing works
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755 · see citing works
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345 · see citing works
CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000251 · Cited by 2,296 · see citing works
CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72352 · Cited by 2,165 · see citing works
“We also eliminated text on ‘‘how the success of blinding (masking) was assessed’’ because of a lack of empirical evidence supporting the practice as well as theoretical concerns about the validity of any such assessment [23,24] Item 12a (statistical methods)dWe added that statistical methods should also be provided fo…”
Intention-to-treat concept: A review
Gupta, S. (2011) · Perspectives in Clinical Research · doi:10.4103/2229-3485.83221 · Cited by 1,921 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Trials · doi:10.1186/1745-6215-11-32 · Cited by 1,871 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858 · see citing works
Assessing risk of bias in a randomized trial
Higgins, J. P., Savović, J., Page, M. J., Elbers, R. G., & Sterne, J. A. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch8 · Cited by 1,765 · see citing works
Moher, D., Schulz, K. F., Altman, D. G., & for the CONSORT Group* (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00011 · Cited by 1,426 · see citing works
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338 · see citing works
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181 · see citing works
CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2011) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.09.004 · Cited by 1,044 · see citing works
CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials.
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.005 · Cited by 1,022 · see citing works
Enden, T., Haig, Y., Kløw, N.-E., Slagsvold, C.-E., Sandvik, L., Ghanima, W., Hafsahl, G., Holme, P. A., Holmen, L. O., Njaastad, A. M., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(11)61753-4 · Cited by 990 · see citing works
Colonoscopy versus Fecal Immunochemical Testing in Colorectal-Cancer Screening
Quintero, E., Castells, A., Bujanda, L., Cubiella, J., Salas, D., Lanas, Á., Andreu, M. G., Carballo, F., Morillas, J. D., Hernández, C., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1108895 · Cited by 914 · see citing works
Direction and impact of language bias in meta-analyses of controlled trials: empirical study
Jüni, P., Holenstein, F., Sterne, J., Bartlett, C., & Egger, M. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.115 · Cited by 892 · see citing works
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872 · see citing works
Post-randomisation exclusions: the intention to treat principle and excluding patients from analysis
Fergusson, D., Aaron, S. D., Guyatt, G., & Hébert, P. (2002) · BMJ · doi:10.1136/bmj.325.7365.652 · Cited by 708 · see citing works
Glucosamine Sulfate Use and Delay of Progression of Knee Osteoarthritis
Pavelká, K., Gatterová, J., Olejarová, M., Macháček, S., Giacovelli, G., & Rovati, L. C. (2002) · Archives of Internal Medicine · doi:10.1001/archinte.162.18.2113 · Cited by 682 · see citing works
Green, B. B. (2008) · JAMA · doi:10.1001/jama.299.24.2857 · Cited by 653 · see citing works
Sample size slippages in randomised trials: exclusions and the lost and wayward.
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07882-0 · Cited by 642 · see citing works
Bias in clinical intervention research.
Gluud, L. L. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj069 · Cited by 636 · see citing works
The Intention-to-Treat Principle: How to Assess the True Effect of Choosing a Medical Treatment
Detry, M. A., & Lewis, R. J. (2014) · JAMA · doi:10.1001/jama.2014.7523 · Cited by 634 · see citing works
Probiotics for the prevention of pediatric antibiotic-associated diarrhea
Goldenberg, J. Z., Lytvyn, L., Steurich, J., Parkin, P. C., Mahant, S., & Johnston, B. C. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004827.pub4 · Cited by 625 · see citing works
Observational and interventional study design types; an overview
Thiese, M. S. (2014) · Biochemia Medica · doi:10.11613/bm.2014.022 · Cited by 615 · see citing works
Imaging strategies for low-back pain: systematic review and meta-analysis
Chou, R., Fu, R. F., Carrino, J. A., & Deyo, R. A. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60172-0 · Cited by 612 · see citing works
Self-management education programmes by lay leaders for people with chronic conditions
Foster, G., Taylor, S. J., Eldridge, S. M., Ramsay, J., & Griffiths, C. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005108.pub2 · Cited by 596 · see citing works
Honey as a topical treatment for wounds
Jull, A., Cullum, N. A., Dumville, J. C., Westby, M. J., Deshpande, S., & Walker, N. K. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005083.pub4 · Cited by 573 · see citing works
Wood, A., White, I. R., & Thompson, S. G. (2004) · Clinical Trials · doi:10.1191/1740774504cn032oa · Cited by 546 · see citing works
van Rongen, A., Robroek, S. J., van Lenthe, F. J., & Burdorf, A. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.12.007 · Cited by 541 · see citing works
Facemasks and Hand Hygiene to Prevent Influenza Transmission in Households
Cowling, B. J., Chan, K., Fang, V. J., Cheng, C. K. Y., Fung, R. O. P., Wai, W., Sin, J., Seto, W., Yung, R. W. H., Chu, D. W., et al. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-7-200910060-00142 · Cited by 536 · see citing works
Klamroth-Marganska, V., Blanco, J., Campen, K., Curt, A. E. P., Dietz, V., Ettlin, T. M., Felder, M., Fellinghauer, B. A. G., Guidali, M., Kollmar, A., et al. (2014) · The Lancet Neurology · doi:10.1016/s1474-4422(13)70305-3 · Cited by 523 · see citing works
López, N., Smith, P. C., & Gutiérrez, J. (2002) · Journal of Periodontology · doi:10.1902/jop.2002.73.8.911 · Cited by 525 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomized trials
Schulz, K., Altman, D., & Moher, D. (2010) · Obstetrics and Gynecology · doi:10.1097/aog.0b013e3181d9d421 · Cited by 3,952 · see citing works
Exercise Training in Adults With CKD: A Systematic Review and Meta-analysis
Heiwe, S., & Jacobson, S. H. (2014) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2014.03.020 · Cited by 519 · see citing works
Melnyk, B. M., Feinstein, N. F., Alpert-Gillis, L., Fairbanks, E., Crean, H. F., Sinkin, R. A., Stone, P. W., Small, L., Tu, X., & Gross, S. J. (2006) · Pediatrics · doi:10.1542/peds.2005-2580 · Cited by 623 · see citing works
Lederman, R. J., Mendelsohn, F. O., Anderson, R. D., Saucedo, J. F., Tenaglia, A. N., Hermiller, J. B., Hillegass, W. B., Rocha‐Singh, K. J., Moon, T. E., Whitehouse, M. J., et al. (2002) · The Lancet · doi:10.1016/s0140-6736(02)08937-7 · Cited by 510 · see citing works
Hopewell, S., Dutton, S., Yu, L.-M., Chan, A.-W., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c723 · Cited by 504 · see citing works
Physical exercise intervention in depressive disorders: Meta‐analysis and systematic review
Josefsson, T., Lindwall, M., & Archer, T. (2014) · Scandinavian Journal of Medicine & Science in Sports · doi:10.1111/sms.12050 · Cited by 483 · see citing works
Exercise training for adults with chronic kidney disease
Heiwe, S., & Jacobson, S. H. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003236.pub2 · Cited by 491 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomized trials.
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · PubMed Central · Cited by 488 · see citing works
Mindfulness-Based Eating Awareness Training (MB-EAT) for Binge Eating: A Randomized Clinical Trial
Kristeller, J., Wolever, R. Q., & Sheets, V. (2014) · Mindfulness · doi:10.1007/s12671-012-0179-1 · Cited by 469 · see citing works
Reporting attrition in randomised controlled trials
Dumville, J. C., Torgerson, D. J., & Hewitt, C. E. (2006) · BMJ · doi:10.1136/bmj.332.7547.969 · Cited by 443 · see citing works
Avery, A. J., Rodgers, S., Cantrill, J. A., Armstrong, S., Cresswell, K. M., Eden, M., Elliott, R. A., Howard, R., Kendrick, D., Morris, C. J., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(11)61817-5 · Cited by 457 · see citing works
Mummah, S. A., Robinson, T. N., King, A. C., Gardner, C. D., & Sutton, S. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5927 · Cited by 388 · see citing works
Simpson, F. O., & Doig, G. S. (2004) · Intensive Care Medicine · doi:10.1007/s00134-004-2511-2 · Cited by 440 · see citing works
Self-monitoring of oral anticoagulation: a systematic review and meta-analysis
Heneghan, C. J., Alonso‐Coello, P., García-Alamino, J., Perera, R., Meats, E., & Glasziou, P. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68139-7 · Cited by 437 · see citing works
GELLATLY, J., BOWER, P., HENNESSY, S., RICHARDS, D., GILBODY, S., & LOVELL, K. (2007) · Psychological Medicine · doi:10.1017/s0033291707000062 · Cited by 419 · see citing works
Handling missing data in RCTs; a review of the top medical journals
Bell, M. L., Fiero, M., Horton, N. J., & Hsu, C.-H. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-118 · Cited by 395 · see citing works
Early Contact versus Separation: Effects on Mother–Infant Interaction One Year Later
Bystrova, K., Ivanova, V., Edhborg, M., Matthiesen, A., Ransjö‐Arvidson, A., Mukhamedrakhimov, R. J., Uvnäs‐Moberg, K., & Widström, A. (2009) · Birth · doi:10.1111/j.1523-536x.2009.00307.x · Cited by 427 · see citing works
Gillies, M. C., SUTTER, F., Simpson, J. M., LARSSON, J., ALI, H., & ZHU, M. (2006) · Ophthalmology · doi:10.1016/j.ophtha.2006.02.065 · Cited by 423 · see citing works
Lord, S. R., Castell, S., Corcoran, J., Dayhew, J., Matters, B., Shan, A., & Williams, P. (2003) · Journal of the American Geriatrics Society · doi:10.1046/j.1532-5415.2003.51551.x · Cited by 416 · see citing works
Evidence-based behavioral medicine: What is it and how do we achieve it?
Davidson, K. W., Goldstein, M. G., Kaplan, R. M., Kaufmann, P. G., Knatterud, G. L., Orleans, C. T., Spring, B. J., Trudeau, K. J., & Whitlock, E. P. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2603_01 · Cited by 407 · see citing works
Lee, C., Gong, Y., Brok, J. S., Boxall, E. H., & Gluud, C. N. (2006) · BMJ · doi:10.1136/bmj.38719.435833.7c · Cited by 400 · see citing works
Mindfulness training for smoking cessation: Results from a randomized controlled trial
Brewer, J. A., Mallik, S., Babuscio, T. A., Nich, C., Johnson, H. E., Deleone, C. M., Minnix-Cotton, C. A., Byrne, S. A., Kober, H., Weinstein, A. J., et al. (2011) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2011.05.027 · Cited by 383 · see citing works
Leeuw, M., Goossens, M. E. J. B., van Breukelen, G. J. P., de Jong, J. R., Heuts, P. H. T. G., Smeets, R. J. E. M., Köke, A. J. A., & Vlaeyen, J. W. S. (2008) · Pain · doi:10.1016/j.pain.2007.12.009 · Cited by 393 · see citing works
Kwok, O.-M., Underhill, A. T., Berry, J. W., Luo, W., Elliott, T. R., & Yoon, M. (2008) · Rehabilitation Psychology · doi:10.1037/a0012765 · Cited by 388 · see citing works
Interventions for treating depression after stroke
Hackett, M. L., Anderson, C. S., House, A., & Xia, J. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003437.pub3 · Cited by 387 · see citing works
Long-term pharmacotherapy for obesity and overweight
Padwal, R. S., Rucker, D., Li, S. K., Curioni, C., & Lau, D. C. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004094.pub2 · Cited by 384 · see citing works
Xia (2009) · doi:10.1192/pb.bp.108.021949 · Cited by 381 · see citing works
Internet-based physical activity interventions: a systematic review of the literature.
van den Berg, M. H., Schoones, J. W., & Vliet Vlieland, T. P. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.3.e26 · Cited by 377 · see citing works
Powell, R., Scott, N. W., Manyande, A., Bruce, J., Vögele, C., Byrne-Davis, L. M., Unsworth, M., Osmer, C., & Johnston, M. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008646.pub2 · Cited by 369 · see citing works
Non-absorbable disaccharides for hepatic encephalopathy: systematic review of randomised trials
Als-Nielsen, B. E. T., Gluud, L. L., & Gluud, C. N. (2004) · BMJ · doi:10.1136/bmj.38048.506134.ee · Cited by 367 · see citing works
Vascular risk factors promote conversion from mild cognitive impairment to Alzheimer disease
Li, J., Wang, Y. J., Zhang, M., Xu, Z. Q., Gao, C. Y., Fang, C. Q., Yan, J. C., & Zhou, H. D. (2011) · Neurology · doi:10.1212/wnl.0b013e318217e7a4 · Cited by 367 · see citing works
Puffer, S., Torgerson, D., & Watson, J. (2003) · BMJ · doi:10.1136/bmj.327.7418.785 · Cited by 351 · see citing works
Akl, E. A., Briel, M., You, J. J., Sun, X., Johnston, B. C., Busse, J. W., Mulla, S., Lamontagne, F., Bassler, D., Vera, C., et al. (2012) · BMJ · doi:10.1136/bmj.e2809 · Cited by 350 · see citing works
Armijo-Olivo, S., Warren, S., & Magee, D. (2009) · Physical Therapy Reviews · doi:10.1179/174328809x405928 · Cited by 361 · see citing works
Vuerstaek, J. D. D., Vainas, T., Wuite, J., Nelemans, P. J., NEUMANN, M. H. A. M., & VERAART, J. C. J. M. (2006) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2006.07.030 · Cited by 356 · see citing works
Interventions for preventing unintended pregnancies among adolescents
Oringanje, C. M., Meremikwu, M. M., Eko, H., Esu, E., Meremikwu, A. N., & Ehiri, J. E. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005215.pub3 · Cited by 355 · see citing works
Aiello, A. E., Murray, G. F., Perez, V., Coulborn, R. M., Davis, B. M., Uddin, M., Shay, D. K., Waterman, S. H., & Monto, A. S. (2010) · The Journal of Infectious Diseases · doi:10.1086/650396 · Cited by 354 · see citing works
Imputation methods for missing outcome data in meta-analysis of clinical trials
Higgins, J. P. T., White, I. R., & Wood, A. (2008) · Clinical Trials · doi:10.1177/1740774508091600 · Cited by 352 · see citing works
Padwal, R., Li, S. K., & Lau, D. C. W. (2003) · International Journal of Obesity · doi:10.1038/sj.ijo.0802475 · Cited by 348 · see citing works
Post-traumatic stress disorder-related symptoms in relatives of patients following intensive care
Jones, C., Skirrow, P. M., Griffiths, R. D., Humphris, G., Ingleby, S., EDDLESTON, J. M., Waldmann, C. S., & Gager, M. (2004) · Intensive Care Medicine · doi:10.1007/s00134-003-2149-5 · Cited by 340 · see citing works
Methylphenidate for children and adolescents with attention deficit hyperactivity disorder (ADHD)
Storebø, O. J., Ramstad, E., Krogh, H. B., Nilausen, T. D., Skoog, M., Holmskov, M., Rosendal, S., Groth, C., Magnusson, F. L., Moreira-Maia, C. R., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009885.pub2 · Cited by 347 · see citing works
Razvi, S., Shakoor, A., Vanderpump, M., Weaver, J. U., & Pearce, S. H. S. (2008) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2008-0167 · Cited by 330 · see citing works
Afshari, A., Wikkelsø, A. J., Brok, J. S., Møller, A. M., & Wetterslev, J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007871.pub2 · Cited by 324 · see citing works
Petterson, S. C., Mizner, R. L., Stevens, J. E., Raisis, L., Bodenstab, A. B., Newcomb, W., & Snyder‐Mackler, L. (2009) · Arthritis Care & Research · doi:10.1002/art.24167 · Cited by 326 · see citing works
Corley, D. A., Katz, P. O., Wo, J. M., Stefan, A. M., Patti, M. G., Rothstein, R. I., Edmundowicz, S. A., Kline, M. M., Mason, R. J., & Wolfe, M. M. (2003) · Gastroenterology · doi:10.1016/s0016-5085(03)01052-7 · Cited by 323 · see citing works
Quality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397 · see citing works
Value of Flow Diagrams in Reports of Randomized Controlled Trials
Egger, M. (2001) · JAMA · doi:10.1001/jama.285.15.1996 · Cited by 317 · see citing works
Family involvement in residential long-term care: A synthesis and critical review
Gaugler, J. E. (2005) · Aging & Mental Health · doi:10.1080/13607860412331310245 · Cited by 310 · see citing works
Femoral nerve blocks for acute postoperative pain after knee replacement surgery
Chan, E., Fransen, M., Parker, D. A., Assam, P. N., & Chua, N. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009941.pub2 · Cited by 308 · see citing works
Including all individuals is not enough: lessons for intention-to-treat analysis
White, I., Carpenter, J., & Horton, N. (2012) · Clinical Trials · doi:10.1177/1740774512450098 · Cited by 299 · see citing works
Macnamara, B. N., & Burgoyne, A. P. (2022) · Psychological Bulletin · doi:10.1037/bul0000352 · Cited by 358 · see citing works
Aligning Work and Circadian Time in Shift Workers Improves Sleep and Reduces Circadian Disruption
Vetter, C., Fischer, D. R., Matera, J. L., & Roenneberg, T. (2015) · Current Biology · doi:10.1016/j.cub.2015.01.064 · Cited by 305 · see citing works
Emami, E., Heydecke, G., Rompre, P. H., de Grandmont, P., & Feine, J. S. (2009) · Clinical Oral Implants Research · doi:10.1111/j.1600-0501.2008.01693.x · Cited by 299 · see citing works
Gillies, M. C., Lim, L. L., Campain, A. E., Quin, G., Salem, W., Li, J., Goodwin, S., Aroney, C., McAllister, I. L., & Fraser‐Bell, S. (2014) · Ophthalmology · doi:10.1016/j.ophtha.2014.07.002 · Cited by 298 · see citing works
Guerrero, A., Griffiths, G. S., Nibali, L., Suvan, J. E., Moles, D. R., Laurell, L., & Tonetti, M. S. (2005) · Journal Of Clinical Periodontology · doi:10.1111/j.1600-051x.2005.00814.x · Cited by 294 · see citing works
- Authors
- Hollis, S., & Campbell, F.
- Affiliations
- Lancaster University (GB)
- AstraZeneca (United Kingdom) (GB)
- Corresponding author
- Hollis, S.
- ORCID
- Campbell, F.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 1999-09-11
- Volume
- 319
- Issue
- 7211
- Pages
- 670-674
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- PMC
- PMC28218
- OpenAlex
- W1984052453
- Cited by
- 2,160
- References
- 67
- Citations by year
- 2026: 32 · 2025: 42 · 2024: 40 · 2023: 67 · 2022: 68 · 2021: 66 · 2020: 78 · 2019: 82 · 2018: 74 · 2017: 73 · 2016: 106 · 2015: 107 · 2014: 144 · 2013: 128 · 2012: 128
- FWCI
- 7.30
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- intention-to-treat analysis, randomized controlled trials, methodological quality, missing data, bias in treatment effect estimation, reporting practices, medical journals
- MeSH terms
- Data Collection, Decision Making, Randomized Controlled Trials as Topic, Treatment Refusal, Treatment Outcome, Patient Selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review