Systematic qualitative review of the literature on data monitoring committees for randomized controlled trials
Abstract
Aims To systematically review the published literature on data monitoring committees (DMCs) for randomized controlled trials (RCT) and summarize information and opinions on best practice. This was part of the DAMOCLES project. Methods A systematic and comprehensive search of five online bibliographic databases was performed, identifying 4007 potentially relevant articles. These were assessed in two stages by the authors. The 84 most relevant articles were agreed and were supplemented with extracts from 16 books: ultimately, 100 sources were reviewed. A series of 23 questions plus subquestions were developed to structure the data extraction and interpretation process. Results Much has been written about DMCs but by a rather small community of authors. The papers included some results of surveys, but were mainly opinion pieces based on the authors' beliefs, practices and experiences. There is a lack of empirical evidence for many aspects of DMCs. There was a great range of detail in the literature relating to the prespecified questions. It was generally agreed that interim monitoring of accumulating data was necessary in some form for most trials. Questions such as membership of the DMC featured widely in the literature with opinions and practice ranging from 3–20 members, of whom between none and all should be independent. There was a consensus that formal statistical methods should be used as tools to guide decision making rather than as hard rules. Conversely, topics such as the training and experience required for DMC membership were discussed in very few papers. Conclusions There is a consensus in the published literature in a number of areas, although there are many different models for structure and functions of a DMC. While uncertainty remains about some issues, it is strongly recommended that an explicit set of guidelines (Charter) is prepared for each DMC prior to the start of the trial specifying clearly how it will operate.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Data monitoring committees may not be needed for trials that are of short duration, have known minimal risks, are designed to demonstrate principles, or are on behavioural or administrative issues.
“DMCs may not be needed: 1) for trials that are of short duration (where it may not be feasible to convene a DMC in a timely fashion to review the data); 2) for trials with known risks that are minimal; 3) for trials in which the objective is to demonstrate principles (such as in early-phase clinical trials); or 4) for trials on behavioural or administrative issues.”
Cites
Designing Clinical Research: An Epidemiologic Approach
Hulley, S., Cummings, S., & Browner, W. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90023-8 · Cited by 1,043 · see citing works
(1999) · Choice Reviews Online · doi:10.5860/choice.36-3094 · Cited by 569 · see citing works
Meinert, C. L. (1986) · DigitalGeorgetown (Georgetown University Library) · doi:10.1093/acprof:oso/9780195035681.001.0001 · Cited by 509 · see citing works
Statistical Issues in Drug Development
Senn, S. (2007) · doi:10.1002/9780470723586 · Cited by 448 · see citing works
Designing Clinical Research: An Epidemiologic Approach
Riesenberg, D. (1989) · JAMA · doi:10.1001/jama.1989.03430110130046 · Cited by 418 · see citing works
Data Monitoring Committees in Clinical Trials
Ellenberg, S. S., Fleming, T. R., & DeMets, D. L. (2002) · Wiley eBooks · doi:10.1002/0470854162 · Cited by 390 · see citing works
Factors that limit the quality, number and progress of randomised controlled trials
Prescott, Counsell, Gillespie, Grant, Russell, Kiauka, Colthart, Ross, Shepherd, & Russell (1999) · Health Technology Assessment · doi:10.3310/hta3200 · Cited by 390 · see citing works
META-ANALYSIS IN THE DESIGN AND MONITORING OF CLINICAL TRIALS
DerSimonian, R. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960630)15:12 · Cited by 257 · see citing works
When to stop a clinical trial.
Pocock, S. J. (1992) · BMJ · doi:10.1136/bmj.305.6847.235 · Cited by 255 · see citing works
Statistical Issues in Drug Development
Ziegel, E. R., & Senn, S. J. (1999) · Technometrics · doi:10.2307/1271380 · Cited by 224 · see citing works
Critical appraisal of epidemiological studies and clinical trials
Elwood, M. (1998) · Cited by 220 · see citing works
Goodness-of-fit statistics for age-specific reference intervals
Royston, P. J., & Wright, E. M. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001115)19:21 · Cited by 208 · see citing works
Monitoring of clinical trials: Issues and recommendations
Fleming, T. R., & DeMets, D. L. (1993) · Controlled Clinical Trials · doi:10.1016/0197-2456(93)90002-u · Cited by 141 · see citing works
Designing Clinical Research: an Epidemiologic Approach, 2nd Ed.
Walline, J. J. (2001) · Optometry and Vision Science · doi:10.1097/00006324-200108000-00005 · Cited by 126 · see citing works
The agonising negative trend in monitoring of clinical trials
DeMets, D. L., Pocock, S. J., & Julian, D. G. (1999) · The Lancet · doi:10.1016/s0140-6736(99)03464-9 · Cited by 126 · see citing works
Trials stopped early: too good to be true?
Pocock, S., & White, I. R. (1999) · The Lancet · doi:10.1016/s0140-6736(98)00379-1 · Cited by 113 · see citing works
(1993) · European Journal of Cancer · doi:10.1016/s0959-8049(05)80323-5 · Cited by 105 · see citing works
Freedman, L. S., Anderson, G. L., Kipnis, V., Prentice, R. L., Wang, C. Y., Rossouw, J. E., Wittes, J. T., & DeMets, D. L. (1996) · Controlled Clinical Trials · doi:10.1016/s0197-2456(96)00016-5 · Cited by 102 · see citing works
Practical aspects in data monitoring: A brief review
DeMets, D. L. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060706 · Cited by 89 · see citing works
Monitoring and Ensuring Safety During Clinical Research
Morse, M. A. (2001) · JAMA · doi:10.1001/jama.285.9.1201 · Cited by 87 · see citing works
Randomised Controlled Clinical Trials
Bulpitt, C. J. (1996) · Springer eBooks · doi:10.1007/978-1-4615-6347-1 · Cited by 87 · see citing works
Policies for study monitoring and interim reporting of results.
Green, S., Fleming, T. R., & O'Fallon, J. R. (1987) · Journal of Clinical Oncology · doi:10.1200/jco.1987.5.9.1477 · Cited by 81 · see citing works
Be skeptical about unexpected large apparent treatment effects:
Wheatley, K., & Clayton, D. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00273-8 · Cited by 75 · see citing works
Statistical and ethical issues in monitoring clinical trials
Pocock, S. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121512 · Cited by 75 · see citing works
Interim analysis in clinical trials
Armitage, P. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100613 · Cited by 72 · see citing works
Behind closed doors: The data monitoring board in randomized clinical trials
Wittes, J. T. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120504 · Cited by 65 · see citing works
Biostatistics in Clinical Trials
(2002) · Technometrics · doi:10.1198/tech.2002.s735 · Cited by 61 · see citing works
The Data and Safety Monitoring Board and Acquired immune deficiency syndrome (AIDS) clinical trials
DeMets, D. L., Fleming, T. R., Whitley, R. J., Childress, J. F., Ellenberg, S. S., Foulkes, M. A., Mayer, K. H., O'Fallon, J. R., Pollard, R. B., Rahal, J. J., et al. (1995) · Controlled Clinical Trials · doi:10.1016/s0197-2456(95)00073-9 · Cited by 60 · see citing works
Masked Monitoring in Clinical Trials — Blind Stupidity?
Meinert, C. L. (1998) · New England Journal of Medicine · doi:10.1056/nejm199805073381911 · Cited by 59 · see citing works
Data Monitoring Committees and Interim Monitoring Guidelines
Freidlin, B., Korn, E. L., & George, S. L. (1999) · Controlled Clinical Trials · doi:10.1016/s0197-2456(99)00017-3 · Cited by 57 · see citing works
Smith, M. A., Ungerleider, R. S., Korn, E. L., Rubinstein, L., & Simon, R. (1997) · Journal of Clinical Oncology · doi:10.1200/jco.1997.15.7.2736 · Cited by 49 · see citing works
Sydes, M. R., Altman, D. G., Babikera, A. B., Parmar, M. K., Spiegelhalter, D. J., & DAMOCLES group (2004) · Clinical Trials · doi:10.1191/1740774504cn003oa · Cited by 49 · see citing works
Self-citationGreen, S., Benedetti, J., & Crowley, J. (1997) · Springer eBooks · doi:10.1007/978-1-4899-3352-2 · Cited by 49 · see citing works
Data and Safety Monitoring Boards
Friedman, L. M. (2002) · Elsevier eBooks · doi:10.1016/b978-012274065-7/50008-3 · Cited by 48 · see citing works
Randomised Controlled Clinical Trials
Bulpitt, C. J. (1983) · Springer eBooks · doi:10.1007/978-1-4757-6358-4 · Cited by 47 · see citing works
Clinical Trial Data and Safety Monitoring Boards
Armstrong, P. W., & Furberg, C. D. (1995) · Circulation · doi:10.1161/01.cir.91.3.901 · Cited by 46 · see citing works
Introduction to Clinical Trials
Friedman, L. M., Furberg, C. D., DeMets, D. L., Reboussin, D. M., & Granger, C. B. (2015) · Springer eBooks · doi:10.1007/978-3-319-18539-2_1 · Cited by 42 · see citing works
Stopping guidelines for clinical trials with multiple treatments
Hughes, M. D. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121002 · Cited by 42 · see citing works
Biostatistics in Clinical Trials:
Bethel, J. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00212-x · Cited by 37 · see citing works
Monitoring clinical trials—interim data should be publicly available
Lilford, R. J., Braunholtz, D., Edwards, S., & Stevens, A. J. (2001) · BMJ · doi:10.1136/bmj.323.7310.441 · Cited by 35 · see citing works
Termination of a randomized controlled trial of two vasectomy techniques
Chen-Mok, M., Bangdiwala, S. I., Dominik, R., Hays, M. A., Irsula, B., & Sokal, D. C. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00267-2 · Cited by 33 · see citing works
The NHLBI model: A 25 year history
Friedman, L. M. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120505 · Cited by 32 · see citing works
Early stopping rules ‐ clinical perspectives and ethical considerations
Baum, M., Houghton, J., & Abrams, K. R. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131322 · Cited by 32 · see citing works
Some practical aspects of the interim monitoring of clinical trials
Simon, R. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131315 · Cited by 31 · see citing works
Stopping the active intervention:
Bowen, D. J., Thornquist, M. D., Anderson, K., Barnett, M. J., Powell, C., Goodman, G. E., & Omenn, G. S. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00277-5 · Cited by 30 · see citing works
Ellenberg, S. S., Myers, M. W., Blackwelder, W. C., & Hoth, D. F. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120510 · Cited by 30 · see citing works
Clinical Trials and Treatment Effects Monitoring
Meinert, C. L. (1998) · Controlled Clinical Trials · doi:10.1016/s0197-2456(98)00027-0 · Cited by 30 · see citing works
Some FDA perspectives on data monitoring in clinical trials in drug development
O’Neill, R. T. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120529 · Cited by 30 · see citing works
Interim analyses, stopping rules and data monitoring in clinical trials in europe
Buyse, M. E. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120517 · Cited by 30 · see citing works
Design and analysis of clinical trials : concept and methodologies
Chow, S., & Liu, J. (1998) · Medical Entomology and Zoology · Cited by 29 · see citing works
The Role of an Independent Statistical Analysis Center in the Institutes of Health Model
Fisher, M. R., Roecker, E. B., & DeMets, D. L. (2001) · Drug Information Journal · doi:10.1177/009286150103500113 · Cited by 28 · see citing works
Should local research ethics committees monitor research they have approved?
Pickworth, E. (2000) · Journal of Medical Ethics · doi:10.1136/jme.26.5.330 · Cited by 28 · see citing works
Hawkins, B. S. (1991) · Controlled Clinical Trials · doi:10.1016/0197-2456(91)90021-d · Cited by 27 · see citing works
Data monitoring committees and capturing relevant information of high quality
Fleming, T. R. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120524 · Cited by 26 · see citing works
Should Data and Safety Monitoring Boards Share Confidential Interim Data?
Dixon, D. O., & Lagakos, S. W. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(99)00042-2 · Cited by 26 · see citing works
Geller, N. L., & Stylianou, M. P. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120520 · Cited by 22 · see citing works
Critical appraisal of epidemiological studies and clinical trials
Martínez‐González, M. Á. (2008) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2007.068643 · Cited by 22 · see citing works
Liberati, A. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131326 · Cited by 21 · see citing works
How Should Results from Completed Studies Influence Ongoing Clinical Trials?
Laupacis, A., Connolly, S. J., Gent, M., Roberts, R. S., Cairns, J. A., Joyner, C. D., & CAFA Study Group (1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-115-10-818 · Cited by 21 · see citing works
A survey of monitoring practices in cancer clinical trials
George, S. L. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120507 · Cited by 20 · see citing works
Data monitoring committees and early stopping guidelines: The southwest oncology group experience
Crowley, J. J., Green, S., Liu, P. Y., & Wolf, M. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131314 · Cited by 20 · see citing works
Data monitoring committees and problems of lower-than-expected accrual or event rates
Korn, E. L., & Simon, R. (1996) · Controlled Clinical Trials · doi:10.1016/s0197-2456(96)00088-8 · Cited by 20 · see citing works
Data monitoring committees: The moral case for maximum feasible independence
Walters, L. B. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120526 · Cited by 19 · see citing works
The case against independent monitoring committees
Harrington, D. P., Crowley, J. J., George, S. L., Pajak, T. F., Redmond, C. K., & Wieand, S. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131316 · Cited by 19 · see citing works
Procedures of Data and Safety Monitoring Committees
Pocock, S., & Furberg, C. D. (2001) · American Heart Journal · doi:10.1067/mhj.2001.113082 · Cited by 18 · see citing works
Should all trials have a Data Safety and Monitoring Committee?
Cairns, J. A., Hallstrom, A. P., & Held, P. (2001) · American Heart Journal · doi:10.1067/mhj.2001.112501 · Cited by 18 · see citing works
Monitoring of clinical trials and interim analyses from a drug Sponsor's point of view
Williams, G. W., Davis, R. L., Getson, A. J., Gould, A. L., Hwang, I. K., Matthews, H., Shih, W. J., Snapinn, S. M., & Walton-Bowen, K. L. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120513 · Cited by 18 · see citing works
Rockhold, F. W., & Enas, G. G. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120512 · Cited by 17 · see citing works
Role of external evidence in monitoring clinical trials: experience from a perinatal trial
Brocklehurst, P. S. (2000) · BMJ · doi:10.1136/bmj.320.7240.995 · Cited by 17 · see citing works
Current Controlled Trials in Cardiovascular Medicine
Lièvre, M. M., Cucherat, M., & Leizorovicz, A. (2002) · Cited by 16 · see citing works
O’Brien, P. C. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat04931 · Cited by 15 · see citing works
O’Neill, R. T. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131327 · Cited by 15 · see citing works
Gilpin, A. M. K., Holbrook, J. T., Jabs, D. A., & Meinert, C. L. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00268-4 · Cited by 14 · see citing works
Statistical approaches and policies for the operations of Data and Safety Monitoring Committees
Califf, R. M., & Ellenberg, S. S. (2001) · American Heart Journal · doi:10.1067/mhj.2001.113152 · Cited by 14 · see citing works
Data monitoring committees for southwest oncology group clinical trials
Green, S., & Crowley, J. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120508 · Cited by 14 · see citing works
Terms of reference for Data and Safety Monitoring Committees
Packer, M., Wittes, J., & Stump, D. C. (2001) · American Heart Journal · doi:10.1067/mhj.2001.113838 · Cited by 14 · see citing works
Introduction to Clinical Trials
Friedman, L. M., Furberg, C. D., & DeMets, D. L. (1998) · Springer eBooks · doi:10.1007/978-1-4757-2915-3_1 · Cited by 14 · see citing works
Operational and policy considerations of data monitoring in clinical trials:
Siebert, C., & Clark, C. M. (1993) · Controlled Clinical Trials · doi:10.1016/0197-2456(93)90048-i · Cited by 13 · see citing works
Data monitoring boards in the pharmaceutical industry
Herson, J. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120522 · Cited by 13 · see citing works
Personal paper: Clinical trial safety committees: the devil's spoon
Hampton, J. R. (2000) · BMJ · doi:10.1136/bmj.320.7229.244 · Cited by 12 · see citing works
Data and safety monitoring committees: Philosophy and practice
Califf, R. M., & Lee, K. L. (2001) · American Heart Journal · doi:10.1067/mhj.2001.112500 · Cited by 11 · see citing works
Regulatory issues for Data and Safety Monitoring Committees
Fisher, L. D., & Klibaner, M. I. (2001) · American Heart Journal · doi:10.1067/mhj.2001.113839 · Cited by 9 · see citing works
The Use of Data Monitoring Committees in Clinical Trials
Ellenberg, S. S. (1996) · Drug Information Journal · doi:10.1177/009286159603000231 · Cited by 9 · see citing works
Monitoring and evaluating clinical trials data
Whitehead, J. (2000) · Intensive Care Medicine · doi:10.1007/s001340051123 · Cited by 8 · see citing works
Relationships Between Data Monitoring Committees
DeMets, D. L. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(99)00048-3 · Cited by 8 · see citing works
Discussion of ‘the what, why and how of bayesian clinical trials monitoring’
Machin, D. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131313 · Cited by 8 · see citing works
Early stopping, interim analyses, and monitoring committees: what are the tradeoffs?
Zelen, M. (1987) · Journal of Clinical Oncology · doi:10.1200/jco.1987.5.9.1314 · Cited by 8 · see citing works
The Data and Safety Monitoring Committee: Some final thoughts
DeMets, D. L., & Yusuf, S. (2001) · American Heart Journal · doi:10.1067/mhj.2001.113837 · Cited by 7 · see citing works
Sheon, A. R. (1995) · AIDS Research and Human Retroviruses · doi:10.1089/aid.1995.11.1309 · Cited by 7 · see citing works
Johnatty, R. N. (2000) · Trials · doi:10.1186/cvm-1-1-055 · Cited by 5 · see citing works
Panel discussion: The operation of data monitoring committees
(1993) · Statistics in Medicine · doi:10.1002/sim.4780120519 · Cited by 5 · see citing works
Data handling in clinical trials: an ongoing debate
Jongen, P. (1995) · Multiple Sclerosis Journal · doi:10.1177/1352458519950101060 · Cited by 4 · see citing works
Data-monitoring committees in clinical trials
Sleight, P. (1993) · The Lancet · doi:10.1016/0140-6736(93)91053-o · Cited by 4 · see citing works
Herson, J., Ognibene, F. P., Peura, D. A., & Silen, W. (1992) · Journal of clinical research · Cited by 4 · see citing works
[Roaming through the methodology. XIV. The premature ending of a randomized trial].
Vandenbroucke, J. P. (1999) · PubMed · Cited by 3 · see citing works
Secrecy for data monitoring committees: inferior ethics, bad policy.
Wells, R. J. (1998) · Journal of Clinical Oncology · doi:10.1200/jco.1998.16.1.390 · Cited by 3 · see citing works
[Monitoring of clinical trials and interim analysis. 1. Monitoring committee].
Boutitie, F., Bellissant, É., Blanchard, J., Boissel, J., Cauquil, J., Chauvin, F., Derzko, G., Ducruet, T., Durrleman, S., & Jp, G. (1992) · PubMed · Cited by 3 · see citing works
Defending data-monitoring committees
Lancet, T. (1998) · The Lancet · doi:10.1016/s0140-6736(98)21016-6 · Cited by 3 · see citing works
Guidelines for data and safety monitoring committees of NASCET
Hall, Z. W. (1995) · Annals of Neurology · doi:10.1002/ana.410380520 · Cited by 2 · see citing works
Are Safety Committees Really Safe?
Bergqvist, D., Forbes, C., Minder, C. E., Planès, A., & ten Cate, J. W. (1998) · Scottish Medical Journal · doi:10.1177/003693309804300205 · Cited by 2 · see citing works
SHARPLES, K. J., Fleming, T. R., MacMahon, S., Moore, A., Reid, I., & Scoggins, B. (2002) · Informa Healthcare eBooks · doi:10.1201/9781420025934.ch9 · Cited by 2 · see citing works
George, S. M., Green, S., Crowley, J. J., Ellenberg, S. S., Meinert, C., Friedman, L., Brown, Pocock, S., Armitage, P., Simon, R., et al. (1993) · Statistics in Medicine · Cited by 2 · see citing works
Discussion: Jay Herson, data monitoring boards in the pharmaceutical industry
Herson, J., & Tognoni, G. (1993) · Statistics in Medicine · Cited by 2 · see citing works
(1993) · Statistics in Medicine · doi:10.1002/sim.4780120509 · Cited by 1 · see citing works
(1993) · Statistics in Medicine · doi:10.1002/sim.4780120518 · Cited by 1 · see citing works
Buyse, M. (1999) · doi:10.1002/(sici)1097-0258(19991230)18:24
Flagged first, then by citations
4 of the 111 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Multiplicity in randomised trials II: subgroup and interim analyses
Schulz, K. F., & Grimes, D. A. (2005) · The Lancet · doi:10.1016/s0140-6736(05)66516-6 · Cited by 357 · see citing works
A proposed charter for clinical trial data monitoring committees: helping them to do their job well
(2005) · The Lancet · doi:10.1016/s0140-6736(05)17965-3 · Cited by 324 · see citing works
"Brimful of STARLITE": toward standards for reporting literature searches.
Booth, A. (2006) · Europe PMC (PubMed Central) · Cited by 267 · see citing works
Antihypertensive treatment of acute cerebral hemorrhage*
Antihypertensive Treatment of Acute Cerebral Hemorrhage (ATACH) investigators (2010) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181b9e1a5 · Cited by 213 · see citing works
Chou, R., Aronson, N., Atkins, D. C., Ismaila, A., Santaguida, P. L., Smith, D. H., Whitlock, E. P., Wilt, T. J., & Moher, D. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.06.007 · Cited by 195 · see citing works
DANIELS, J. P., Gray, J. W., Pattison, H. M., Roberts, T. E., Edwards, E. A., Milner, P., Spicer, L., King, E., Hills, R. K., Gray, R. G., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13420 · Cited by 63 · see citing works
Sydes, M. R., Altman, D. G., Babikera, A. B., Parmar, M. K., Spiegelhalter, D. J., & DAMOCLES group (2004) · Clinical Trials · doi:10.1191/1740774504cn003oa · Cited by 49 · see citing works
Self-citationTharmanathan, P., Calvert, M., Hampton, J., & Freemantle, N. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-12 · Cited by 42 · see citing works
Fernandes, R. M. F., van der Lee, J. H., & Offringa, M. (2009) · BMC Pediatrics · doi:10.1186/1471-2431-9-77 · Cited by 107 · see citing works
Establishing a data monitoring committee for clinical trials.
Lin, J. Y.-C., & Lü, Y. (2014) · Europe PMC (PubMed Central) · doi:10.3969/j.issn.1002-0829.2014.01.009 · Cited by 36 · see citing works
Buchanan, D. R., & Miller, F. G. (2005) · Kennedy Institute of Ethics journal · doi:10.1353/ken.2005.0010 · Cited by 36 · see citing works
Exploring the role and function of trial steering committees: results of an expert panel meeting
Harman, N. L., Conroy, E. J., Lewis, S. C., Murray, G., Norrie, J., Sydes, M. R., Lane, J. A., Altman, D. G., Baigent, C., Bliss, J. M., et al. (2015) · Trials · doi:10.1186/s13063-015-1125-z · Cited by 33 · see citing works
Self-citationData and safety monitoring in social behavioral intervention trials: the REACH II experience
Czaja, S. J., Schulz, R., Belle, S. H., Burgio, L. D., Armstrong, N., Gitlin, L. N., Coon, D. W., Martindale-Adams, J. L., Klinger, J., & Stahl, S. M. (2006) · Clinical Trials · doi:10.1191/1740774506cn136oa · Cited by 31 · see citing works
Rodgers, J., Goodwin, J., Parr, J. R., Grahame, V., Wright, C., Padget, J., Garland, D., Osborne, M., Labus, M., Kernohan, A., et al. (2019) · Trials · doi:10.1186/s13063-019-3479-0 · Cited by 30 · see citing works
SCT Working Group on Data Monitoring, Dixon, D. O., Freedman, R. S., Herson, J., Hughes, M., Kim, K., Silverman, M. H., & Tangen, C. M. (2006) · Clinical Trials · doi:10.1191/1740774506cn149oa · Cited by 27 · see citing works
Ballard, A., Khadra, C., Adler, S., Trottier, E. D., Bailey, B., Poonai, N., Théroux, J., & May, S. L. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-023214 · Cited by 27 · see citing works
Adaptive Clinical Trial Designs with Surrogates: When Should We Bother?
Anderer, A., Bastani, H., & Silberholz, J. (2019) · Management Science · doi:10.1287/mnsc.2021.4096 · Cited by 28 · see citing works
Data monitoring in randomized controlled trials: surveys of recent practice and policies
Clemens, F., Elbourne, D. R., Darbyshire, J. H., Pocock, S., & DAMOCLES Group (2005) · Clinical Trials · doi:10.1191/1740774505cn064oa · Cited by 26 · see citing works
Self-citationDaykin, A. R., Selman, L. E., Cramer, H., McCann, S., Shorter, G. W., Sydes, M. R., Gamble, C. L., Macefield, R. C., Lane, J. A., & Shaw, A. R. G. (2016) · Trials · doi:10.1186/s13063-016-1425-y · Cited by 24 · see citing works
Self-citationWolf, S. M., & Jones, C. M. (2011) · Journal of Nanoparticle Research · doi:10.1007/s11051-011-0237-y · Cited by 21 · see citing works
Coordinating Data Monitoring Committees and Adaptive Clinical Trial Designs
Herson, J. (2008) · Drug Information Journal · doi:10.1177/009286150804200401 · Cited by 20 · see citing works
Stopping clinical trials early
Grant, A. (2004) · BMJ · doi:10.1136/bmj.329.7465.525 · Cited by 20 · see citing works
Larson, B. A., Bii, M., Tsikhutsu, I., Halim, N., Wolfman, V., Coakley, P., Sugut, W. K., & Sawe, F. (2018) · Trials · doi:10.1186/s13063-018-2975-y · Cited by 18 · see citing works
Importance and role of independent data monitoring committees (IDMCs) in oncology clinical trials
Schöffski, P. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047294 · Cited by 16 · see citing works
Modlin, C., Sugarman, J., Chongwe, G., KASS, N. E., Nazziwa, W. B., Tegli, J. K., Shrestha, P., & Ali, J. (2023) · Wellcome Open Research · doi:10.12688/wellcomeopenres.18915.2 · Cited by 16 · see citing works
Rabusin, C. L., Menz, H. B., McClelland, J. A., Evans, A., Landorf, K. B., Malliaras, P., Docking, S., & Munteanu, S. E. (2019) · Journal of Foot and Ankle Research · doi:10.1186/s13047-019-0325-2 · Cited by 16 · see citing works
Walker, A. E., McLeer, S., & DAMOCLES group (2004) · Clinical Trials · doi:10.1191/1740774504cn023oa · Cited by 16 · see citing works
Self-citationProtecting Clinical Trial Participants and Protecting Data Integrity: Are We Meeting the Challenges?
Ellenberg, S. S. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001234 · Cited by 15 · see citing works
Bikic, A., Dalsgaard, S., Olsen, K. D., & Sukhodolsky, D. G. (2021) · Trials · doi:10.1186/s13063-021-05499-9 · Cited by 14 · see citing works
Shah, S. K., London, A. J., MOFENSON, L. M., Lavery, J. V., John-Stewart, G. C., Flynn, P. M., Theron, G. B., Bangdiwala, S. I., Moodley, D., Chinula, L., et al. (2021) · Clinical Trials · doi:10.1177/17407745211045734 · Cited by 14 · see citing works
Uslu, A. S., Gerber, S. M., Schmidt, N., Röthlisberger, C., Wyss, P., Vanbellingen, T., Schaller, S., Wyss, C., Koenig‐Bruhin, M., Berger, T., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037702 · Cited by 14 · see citing works
Assessing Harms When Comparing Medical Interventions
Chou, R., Aronson, N., Atkins, D. C., Ismaila, A., Santaguida, P. L., Smith, D. H., Whitlock, E. P., Wilt, T. J., & Moher, D. (2008) · Cited by 14 · see citing works
Are Large Fracture Trials Possible?
Jeray, K. J., Tanner, S. L., Schemitsch, E. H., & Bhandari, M. (2010) · Journal of Orthopaedic Trauma · doi:10.1097/bot.0b013e3181cec62a · Cited by 12 · see citing works
Should Sponsors and DSMBs Share Interim Results Across Trials?
Shah, S. K., Dawson, L., Dixon, D. O., & Lie, R. K. (2011) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0b013e318236eca3 · Cited by 11 · see citing works
Dixon, D. O., Weiss, S., Cahill, K. M., Fox, L. M., Love, J., McNamara, J., & Soto-Torres, L. E. (2011) · Clinical Trials · doi:10.1177/1740774511425181 · Cited by 10 · see citing works
Dangis, G., Terho, K., Graichen, J., Günther, S. A., Rosio, R., Salanterä, S., Staake, T., Stingl, C., & Pakarinen, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280686 · Cited by 9 · see citing works
Zuckerman, J., van der Schalie, B., & Cahill, K. M. (2015) · Clinical Trials · doi:10.1177/1740774515591498 · Cited by 9 · see citing works
Ellenberg, S. S. (2008) · Wiley Encyclopedia of Clinical Trials · doi:10.1002/9780471462422.eoct531 · Cited by 9 · see citing works
Andrews, P., & Citerio, G. (2010) · Intensive Care Medicine · doi:10.1007/s00134-010-2031-1 · Cited by 9 · see citing works
Bikic, A., Smith‐Nielsen, J., Dalsgaard, S., Swain, J. E., Fonagy, P., & Leckman, J. F. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265676 · Cited by 9 · see citing works
Independent Data Monitoring Committees
Snapinn, S. M., & Jiang, Q. (2010) · CRC Press eBooks · doi:10.1201/b10279-22 · Cited by 6 · see citing works
Wolf, S. M., & Jones, C. M. (2020) · Routledge eBooks · doi:10.4324/9781003074960-30 · Cited by 6 · see citing works
Chen-Mok, M., VanRaden, M. J., Higgs, E. S., & Dominik, R. (2006) · Clinical Trials · doi:10.1177/1740774506070710 · Cited by 5 · see citing works
Eckstein, L., Rid, A., Kamuya, D., & Shah, S. K. (2021) · Clinical Infectious Diseases · doi:10.1093/cid/ciab239 · Cited by 5 · see citing works
Fischer, T. (2008) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-008-0588-4 · Cited by 5 · see citing works
Pontoppidan, M., Nygaard, L., Thorsager, M., Friis-Hansen, M., Davis, D. L., & Nohr, E. A. (2022) · Trials · doi:10.1186/s13063-022-06022-4 · Cited by 4 · see citing works
Drawing Contingent Generalizations from Case Studies
Bennett, A. J. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108688253.005 · Cited by 4 · see citing works
Data monitoring committees and selective outcome reporting
Ting, J. Y. S. (2011) · BMJ · doi:10.1136/bmj.d635 · Cited by 3 · see citing works
Monitoring data on data monitoring
Ellenberg, S. S. (2004) · Clinical Trials · doi:10.1191/1740774504cn001ed · Cited by 3 · see citing works
Prospective adverse event risk evaluation in clinical trials
Kundu, A., Feijoo, F., Martínez, D. A., Hermosilla, M., & Matis, T. I. (2021) · Health Care Management Science · doi:10.1007/s10729-021-09584-y · Cited by 2 · see citing works
Nielsen, T., Ahrenkiel, L., Petersen, M. R., & Pontoppidan, M. (2023) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2023.100268 · Cited by 2 · see citing works
Major‐Pedersen, A., McCullen, M. K., Sabol, M. E., Adetunji, O., Massaro, J. M., Neugut, A. I., Sosa, J. A., & Hollenberg, A. N. (2020) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5172 · Cited by 2 · see citing works
Bourke, J., Munteanu, S. E., Garofolini, A., Taylor, S. B., & Malliaras, P. (2024) · Trials · doi:10.1186/s13063-024-08185-8 · Cited by 2 · see citing works
Harvie, D. S., Olthof, N. A., Hams, A. H., Thomson, H., & Coppieters, M. W. (2021) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2021.100820 · Cited by 1 · see citing works
A Sponsor’s Best Practice and Operating Principles to Manage Data Monitoring Committees
Birck, M. M., Rasmussen, J. S., Helmark, I. C., & Lollike, K. (2025) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-025-00742-w · Cited by 1 · see citing works
Goodman, S. N. (2013) · Clinical Trials · doi:10.1177/1740774513511178 · Cited by 1 · see citing works
The data and safety monitoring board in sponsored pediatric clinical trials: practical applications
Lad, P. M., & Dahl, R. (2015) · Journal of Hospital Administration · doi:10.5430/jha.v4n1p57 · Cited by 1 · see citing works
Cândia, R., & Gabriel Rada, G. (2015) · ARS MEDICA Revista de Ciencias Médicas · doi:10.11565/arsmed.v39i1.9 · Cited by 1 · see citing works
Exploring the role and functionality of trial steering committees
Harman, N., Conroy, E. J., Lewis, S. C., Murray, G. D., Norrie, J. D., Sydes, M. R., Lane, J. A., Altman, D. G., Baigent, C., Bliss, J. M., et al. (2015) · Trials · doi:10.1186/1745-6215-16-s2-p189 · Cited by 1 · see citing works
Self-citationImplementing the Trial Protocol
Oughton, J. B., & Lilley-Kelly, A. (2022) · Springer eBooks · doi:10.1007/978-3-319-52636-2_37 · Cited by 1 · see citing works
Data Monitoring Committees Including Operational Issues
Ellenberg, S. S. (2015) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat07068.pub2
Monitoring Clinical Trial Data Using an Unblinded Industry Statistician
Baggs, G. E., Seth, A. K., Oliver, J. S., Jones, W. M., Liu, L., & Toth, S. M. (2008) · Drug Information Journal · doi:10.1177/009286150804200211
Schulz, K. F., & Grimes, D. A. (2007) · Zeitschrift für ärztliche Fortbildung und Qualität im Gesundheitswesen - German Journal for Quality in Health Care · doi:10.1016/j.zgesun.2006.12.007
Implementing the Trial Protocol
Oughton, J. B., & Lilley-Kelly, A. (2021) · Springer eBooks · doi:10.1007/978-3-319-52677-5_37-1
Data Monitoring Committees including Operational Issues
Ellenberg, S. S. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat07068
Ellenberg, S. S., Fleming, T. R., & DeMets, D. L. (2019) · doi:10.1002/9781119512684.ch1
Eldridge, S. M., & Kerry, S. (2012) · doi:10.1002/9781119966241.ch9
Faculty Opinions recommendation of Antihypertensive treatment of acute cerebral hemorrhage.
Sansing, L. H. (2017) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.4502960.793538774
Considerations in Developing Data and Safety Monitoring Plans: A Framework
Zucker, D. R. (2004) · Journal of Investigative Medicine · doi:10.1177/108155890405200735
Bourke, J., Munteanu, S., Garofolini, A., Taylor, S. B., & Malliaras, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725526
Bourke, J., Munteanu, S., Garofolini, A., Taylor, S. B., & Malliaras, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725529
Bourke, J., Munteanu, S., Garofolini, A., Taylor, S. B., & Malliaras, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725523
Bourke, J., Munteanu, S., Garofolini, A., Taylor, S. B., & Malliaras, P. (2024) · Figshare · doi:10.6084/m9.figshare.26725532
Monitoring committee in clinical trials
Chu, D. Y., Moura, S. P., Dingle, A. M., & Poore, S. O. (2026) · Elsevier eBooks · doi:10.1016/b978-0-323-91168-9.00062-4
Allaway, E., Soulsby, I., Keyworth, N., Stanton, L., Saunders, G. N., Caddy, J., Boxall, C., & Griffiths, G. O. (2026) · Trials · doi:10.1186/s13063-026-09559-w
Collister, D., Romero, R. A., Cherepak, K., Tangri, N., Herrington, G., Delgado, L., Lee, S. F., Girimonte, R., Ferguson, T., & Walsh, M. (2026) · Kidney Medicine · doi:10.1016/j.xkme.2026.101451
- Authors
- Sydes, M. R., Spiegelhalter, D. J., Altman, D. G., Babiker, A. B., Parmar, M. K., & DAMOCLES Group
- Affiliations
- MRC Clinical Trials Unit at UCL (GB)
- MRC Biostatistics Unit (GB)
- Cancer Research UK (GB)
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2004-02
- Volume
- 1
- Issue
- 1
- Pages
- 60-79
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2026423245
- Cited by
- 76
- References
- 111
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 5 · 2023: 3 · 2022: 4 · 2021: 7 · 2020: 3 · 2019: 5 · 2018: 1 · 2017: 1 · 2016: 1 · 2015: 6 · 2014: 2 · 2013: 1 · 2012: 2
- FWCI
- 0.72
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Trials (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (submittedVersion)
- Funders
- National Cancer Institute
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Keywords
- data monitoring committees, randomized controlled trials, interim analysis, best practice guidelines
- MeSH terms
- Humans, Randomized Controlled Trials as Topic, Clinical Trials Data Monitoring Committees
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review