Issues in data monitoring and interim analysis of trials

Abstract

OBJECTIVES: To address issues about data monitoring committees (DMCs) for randomised controlled trials (RCTs). DATA SOURCES: Electronic databases. Handsearching of selected books. Personal contacts with experts in the field. REVIEW METHODS: Systematic literature reviews of DMCs and small group processes in decision-making; sample surveys of: reports of RCTs, recently completed and ongoing RCTs and policies of major organisations involved in RCTs; case studies of four DMCs; and interviews with experienced DMC members. All focused on 23 prestated questions. RESULTS: Although still a minority, RCTs increasingly have DMCs. There is wide agreement that nearly all trials need some form of data monitoring. Central to the role of the DMC is monitoring accumulating evidence related to benefit and toxicity; variation in emphasis has been reflected in the plethora of names. DMCs for trials performed for regulatory purposes should be aware of any special requirements and regulatory consequences. Advantages were identified for both larger and smaller DMCs. There is general agreement that a DMC should be independent and multidisciplinary. Consumer and ethicist membership is controversial. The chair is recognised as being particularly influential, and likely to be most effective if he or she is experienced, understands both statistical and clinical issues, and is facilitating in style and impartial. There is no evidence available to judge suggested approaches to training. The review suggested that costs should be covered, but other rewards must be so minimal as to not affect decision-making. It is usual to have a minimum frequency of DMC meetings, with evidence that face-to-face meetings are preferable. It is common to have open sessions and a closed session. A report to a DMC should cover benefits and risks in a balanced way, summarised in an accessible style, avoiding excessive detail, and be as current as possible. Disadvantages of blinded analyses seem to outweigh advantages. Information about comparable studies should be included, although interaction with the DMCs of similar ongoing trials is controversial. A range of formal statistical approaches can be used, although this is only one of a number of considerations. DMCs usually reach decisions by consensus, but other approaches are sometimes used. The general, but not unanimous, view is that DMCs should be advisory rather than executive on the basis that it is the trial organisers who are ultimately responsible for the conduct of the trial. CONCLUSIONS: Some form of data monitoring should be considered for all RCTs, with reasons given where there is no DMC or when any member is not independent. An early DMC meeting is helpful, determining roles and responsibilities; planned operations can be agreed with investigators and sponsors/funders. A template for a DMC charter is suggested. Competing interests should be declared. DMC size (commonly three to eight people) is chosen to optimise performance. Members are usually independent and drawn from appropriate backgrounds, and some, particularly the chair, are experienced. A minimum frequency of meetings is usually agreed, with flexibility for more if needed. The DMC should understand and agree the statistical approach (and guidelines) chosen, with both the DMC statistician and analysis statistician competent to apply the method. A DMC's primary purpose is to ensure that continuing a trial according to its protocol is ethical, taking account of both individual and collective ethics. A broader remit in respect of wider ethical issues is controversial; arguably, these are primarily the responsibility of research ethics committees, trial steering committees and investigators. The DMC should know the range of recommendations or decisions open to it, in advance. A record should be kept describing the key issues discussed and the rationale for decisions taken. Errors are likely to be reduced if a DMC makes a thorough review of the evidence and has a clear understanding of how it should function, there is active participation by all members, differences are resolved through discussion and there is systematic consideration of the various decision options. DMCs should be encouraged to comment on draft final trial reports. These should include information about the data monitoring process and detail the DMC membership. It is recommended that groups responsible for data monitoring be given the standard name 'Data Monitoring Committee' (DMC). Areas for further research include: widening DMC membership beyond clinicians, trialists and statisticians; initiatives to train DMC members; methods of DMC decision-making; 'open' data monitoring; DMCs covering a portfolio of trials rather than single trials; DMC size and membership, incorporating issues of group dynamics; empirical study of the workings of DMCs and their decision-making, and which trials should or should not have a DMC.