The DOI matches its Crossref record; 160 of the 160 references it cites were found in a registry or an index.
Issues in data monitoring and interim analysis of trials
Open accessAbstract
OBJECTIVES: To address issues about data monitoring committees (DMCs) for randomised controlled trials (RCTs). DATA SOURCES: Electronic databases. Handsearching of selected books. Personal contacts with experts in the field. REVIEW METHODS: Systematic literature reviews of DMCs and small group processes in decision-making; sample surveys of: reports of RCTs, recently completed and ongoing RCTs and policies of major organisations involved in RCTs; case studies of four DMCs; and interviews with experienced DMC members. All focused on 23 prestated questions. RESULTS: Although still a minority, RCTs increasingly have DMCs. There is wide agreement that nearly all trials need some form of data monitoring. Central to the role of the DMC is monitoring accumulating evidence related to benefit and toxicity; variation in emphasis has been reflected in the plethora of names. DMCs for trials performed for regulatory purposes should be aware of any special requirements and regulatory consequences. Advantages were identified for both larger and smaller DMCs. There is general agreement that a DMC should be independent and multidisciplinary. Consumer and ethicist membership is controversial. The chair is recognised as being particularly influential, and likely to be most effective if he or she is experienced, understands both statistical and clinical issues, and is facilitating in style and impartial. There is no evidence available to judge suggested approaches to training. The review suggested that costs should be covered, but other rewards must be so minimal as to not affect decision-making. It is usual to have a minimum frequency of DMC meetings, with evidence that face-to-face meetings are preferable. It is common to have open sessions and a closed session. A report to a DMC should cover benefits and risks in a balanced way, summarised in an accessible style, avoiding excessive detail, and be as current as possible. Disadvantages of blinded analyses seem to outweigh advantages. Information about comparable studies should be included, although interaction with the DMCs of similar ongoing trials is controversial. A range of formal statistical approaches can be used, although this is only one of a number of considerations. DMCs usually reach decisions by consensus, but other approaches are sometimes used. The general, but not unanimous, view is that DMCs should be advisory rather than executive on the basis that it is the trial organisers who are ultimately responsible for the conduct of the trial. CONCLUSIONS: Some form of data monitoring should be considered for all RCTs, with reasons given where there is no DMC or when any member is not independent. An early DMC meeting is helpful, determining roles and responsibilities; planned operations can be agreed with investigators and sponsors/funders. A template for a DMC charter is suggested. Competing interests should be declared. DMC size (commonly three to eight people) is chosen to optimise performance. Members are usually independent and drawn from appropriate backgrounds, and some, particularly the chair, are experienced. A minimum frequency of meetings is usually agreed, with flexibility for more if needed. The DMC should understand and agree the statistical approach (and guidelines) chosen, with both the DMC statistician and analysis statistician competent to apply the method. A DMC's primary purpose is to ensure that continuing a trial according to its protocol is ethical, taking account of both individual and collective ethics. A broader remit in respect of wider ethical issues is controversial; arguably, these are primarily the responsibility of research ethics committees, trial steering committees and investigators. The DMC should know the range of recommendations or decisions open to it, in advance. A record should be kept describing the key issues discussed and the rationale for decisions taken. Errors are likely to be reduced if a DMC makes a thorough review of the evidence and has a clear understanding of how it should function, there is active participation by all members, differences are resolved through discussion and there is systematic consideration of the various decision options. DMCs should be encouraged to comment on draft final trial reports. These should include information about the data monitoring process and detail the DMC membership. It is recommended that groups responsible for data monitoring be given the standard name 'Data Monitoring Committee' (DMC). Areas for further research include: widening DMC membership beyond clinicians, trialists and statisticians; initiatives to train DMC members; methods of DMC decision-making; 'open' data monitoring; DMCs covering a portfolio of trials rather than single trials; DMC size and membership, incorporating issues of group dynamics; empirical study of the workings of DMCs and their decision-making, and which trials should or should not have a DMC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Journal of the American Statistical Association
Koehler, A. B. (1995) · International Journal of Forecasting · doi:10.1016/0169-2070(95)90067-5 · Cited by 5,337
Studies of independence and conformity: I. A minority of one against a unanimous majority
Asch, S. E. (1956) · Psychological Monographs: General and Applied · doi:10.1037/h0093718 · Cited by 4,267
Decision making: A psychological analysis of conflict, choice, and commitment
(1978) · Evaluation and Program Planning · doi:10.1016/0149-7189(78)90042-3 · Cited by 3,946
Effects of a combination of beta carotene and vitamin A on lung cancer and cardiovascular disease
Omenn, G. S., Goodman, G. E., Thornquist, M. D., Balmes, J., Cullen, M. R., Glass, A., Keogh, J. P., Meyskens, F. L., Valanis, B., Williams, J. H., et al. (1996) · New England Journal of Medicine · doi:10.1056/nejm199605023341802 · Cited by 3,638
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
The theory of decision making.
Edwards, W. (1954) · Psychological Bulletin · doi:10.1037/h0053870 · Cited by 2,697
Consensus development methods, and their use in clinical guideline development.
Murphy, Black, Lamping, McKee, Sanderson, Askham, & Marteau (1998) · Health Technology Assessment · doi:10.3310/hta2030 · Cited by 2,051
Organizational behavior and human decision processes
Armstrong, J. S. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90125-2 · Cited by 1,753
TEAMS IN ORGANIZATIONS: Recent Research on Performance and Effectiveness
Guzzo, R. A., & Dickson, M. W. (1996) · Annual Review of Psychology · doi:10.1146/annurev.psych.47.1.307 · Cited by 1,613
Group Sequential Methods with Applications to Clinical Trials
Jennison, C., & Turnbull, B. W. (1999) · Chapman & Hall/CRC eBooks · doi:10.1201/9780367805326 · Cited by 1,336
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Self-citationSPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Self-citationConsort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Self-citation(2013) · European Heart Journal · doi:10.1093/eurheartj/eht150 · Cited by 2,809
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Self-citationBayesian Approaches to Clinical Trials and Health‐Care Evaluation
Spiegelhalter, D. J., Abrams, K. R., & Myles, J. P. (2003) · Wiley eBooks · doi:10.1002/0470092602 · Cited by 1,673
Self-citationKrijthe, B. P., Kunst, A., Benjamin, E. J., Lip, G. Y. H., Franco, O. H., Hofman, A., Witteman, J. C. M., Stricker, B. H., & Heeringa, J. (2013) · European Heart Journal · doi:10.1093/eurheartj/eht280 · Cited by 1,419
Trial Sequential Analysis in systematic reviews with meta-analysis
Wetterslev, J., Jakobsen, J. C., & Gluud, C. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0315-7 · Cited by 1,189
Authors/Task Force Members, Brignole, M., Auricchio, A., Baron-Esquivias, G., Bordachar, P., Boriani, G., Breithardt, O.-A., Cleland, J., Deharo, J.-C., Delgado, V., et al. (2013) · Europace · doi:10.1093/europace/eut206 · Cited by 1,124
Trial of the Route of Early Nutritional Support in Critically Ill Adults
Harvey, S. E., Parrott, F., Harrison, D. A., Bear, D. E., Segaran, E., Beale, R., Bellingan, G., Leonard, R., Mythen, M. G., & Rowan, K. M. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1409860 · Cited by 618
Hegedus, E. J., Goode, A. P., Cook, C. E., Michener, L., Myer, C. A., Myer, D. M., & Wright, A. A. (2012) · British Journal of Sports Medicine · doi:10.1136/bjsports-2012-091066 · Cited by 538
Gilbody, S., Littlewood, E., Hewitt, C., Brierley, G., Tharmanathan, P., Araya, R., Barkham, M., Bower, P., Cooper, C., Gask, L., et al. (2015) · BMJ · doi:10.1136/bmj.h5627 · Cited by 409
Autologous Chondrocyte Implantation: A Systematic Review
Harris, J. D., Siston, R. A., Pan, X., & Flanigan, D. C. (2010) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.j.00049 · Cited by 409
Schmidt, R. L., Hall, B. J., Wilson, A. R., & Layfield, L. J. (2011) · American Journal of Clinical Pathology · doi:10.1309/ajcpoie0cznat6sq · Cited by 362
Evaluation of DNA from the Papanicolaou test to detect ovarian and endometrial cancers.
Kinde, I., Bettegowda, C., Wang, Y., Wu, J., Agrawal, N., Shih, I.-M., Kurman, R., Dao, F., Levine, D. A., Giuntoli, R., et al. (2013) · Science Translational Medicine · doi:10.1126/scitranslmed.3004952 · Cited by 327
CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081124 · Cited by 205
Self-citationDavis, R. C., Hobbs, F. D. R., Kenkre, J. E., Roalfe, A. K., Iles, R., Lip, G. Y. H., & Davies, M. K. (2012) · Europace · doi:10.1093/europace/eus087 · Cited by 180
Ensuring trial validity by data quality assurance and diversification of monitoring methods
Baigent, C., Harrell, F. E., Buyse, M., Emberson, J. R., & Altman, D. G. (2008) · Clinical Trials · doi:10.1177/1740774507087554 · Cited by 163
Self-citationGoldberg, S. E., Bradshaw, L. E., Kearney, F. C., Russell, C., Whittamore, K. H., Foster, P. E. R., Mamza, J., Gladman, J. R. F., Jones, R. G., Lewis, S. A., et al. (2013) · BMJ · doi:10.1136/bmj.f4132 · Cited by 156
Livingston, G., Barber, J., Marston, L., Rapaport, P., Livingston, D., Cousins, S., Robertson, S., La Frenais, F., & Cooper, C. (2017) · BJPsych Open · doi:10.1192/bjpo.bp.117.005181 · Cited by 148
SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials
Hróbjartsson, A., Boutron, I., Hopewell, S., Moher, D., Schulz, K. F., Collins, G. S., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081660 · Cited by 171
Self-citationSystematic review and statistical analysis of the integrity of 33 randomized controlled trials
Bolland, M. J., Avenell, A., Gamble, G. D., & Grey, A. (2016) · Neurology · doi:10.1212/wnl.0000000000003387 · Cited by 106
Kearley, K., Selwood, M., Van den Bruel, A., Thompson, M., Mant, D., Hobbs, F. R., Fitzmaurice, D., & Heneghan, C. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-004565 · Cited by 106
Health anxiety: the silent, disabling epidemic
Tyrer, P., Eilenberg, T., Fink, P., Hedman, E., & Tyrer, H. (2016) · BMJ · doi:10.1136/bmj.i2250 · Cited by 47
Exploring the role and function of trial steering committees: results of an expert panel meeting
Harman, N. L., Conroy, E. J., Lewis, S. C., Murray, G., Norrie, J., Sydes, M. R., Lane, J. A., Altman, D. G., Baigent, C., Bliss, J. M., et al. (2015) · Trials · doi:10.1186/s13063-015-1125-z · Cited by 33
Self-citationStegert, M., Kasenda, B., von Elm, E., You, J. J., Blümle, A., Tomonaga, Y., Saccilotto, R., Amstutz, A., Bengough, T., Briel, M., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.05.023 · Cited by 30
Floriani, I., Rotmensz, N., Albertazzi, E., Torri, V., De Rosa, M., Tomino, C., & de Braud, F. (2008) · Trials · doi:10.1186/1745-6215-9-46 · Cited by 8
Metadata
- Authors
- Grant, A., Altman, D., Babiker, A., Campbell, M., Clemens, F., Darbyshire, J., Elbourne, D., McLeer, S., Parmar, M., Pocock, S., Spiegelhalter, D., Sydes, M., Walker, A., & Wallace, S.
- Venue
- Health Technology Assessment
- Published
- 2005-03
- Volume
- 9
- Issue
- 7
- Pages
- 1-238, iii
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W1993690981
- Cited by
- 269
- References
- 160
- FWCI
- 10.61
- Type
- journal article
- Language
- en
- Open access
- diamond
- Funders
- Health Technology Assessment programme (98/25/06)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.