Content and quality of 2000 controlled trials in schizophrenia over 50 years
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To provide a comprehensive survey of the content and quality of intervention studies relevant to the treatment of schizophrenia. DESIGN: Data were extracted from 2000 trials on the Cochrane Schizophrenia Group's register. MAIN OUTCOME MEASURES: Type and date of publication, country of origin, language, size of study, treatment setting, participant group, interventions, outcomes, and quality of study. RESULTS: Hospital based drug trials undertaken in the United States were dominant in the sample (54%). Generally, studies were short (54%<6 weeks), small (mean number of patients 65), and poorly reported (64% had a quality score of <=2 (maximum score 5)). Over 600 different interventions were studied in these trials, and 640 different rating scales were used to measure outcome. CONCLUSIONS: Half a century of studies of limited quality, duration, and clinical utility leave much scope for well planned, conducted, and reported trials. The drug regulatory authorities should stipulate that the results of both explanatory and pragmatic trials are necessary before a compound is given a licence for everyday use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Zhang, Q., Wang, C., Zheng, M., Li, Y., Li, J., Zhang, L., Shang, X., & Yan, C. (2015) · Cerebrovascular Diseases · doi:10.1159/000369778 · Cited by 11,533
Dong, Y., Hao, L., Shi, Z., Wang, G., Zhang, Z., & Han, C. (2013) · Urologia Internationalis · doi:10.1159/000351405 · Cited by 4,540
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Bias in treatment assignment in controlled clinical trials
Chalmers, T. C., Celano, P., Sacks, H. S., & Smith, H. (1983) · New England Journal of Medicine · doi:10.1056/nejm198312013092204 · Cited by 864
Understanding controlled trials: What are pragmatic trials?
Roland, M., & Torgerson, D. J. (1998) · BMJ · doi:10.1136/bmj.316.7127.285 · Cited by 702
Chalmers, I., Hetherington, J., Newdick, M., Mutch, L., GRANT, A. M., Enkin, M. W., Enkin, E., & Dickersin, K. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90038-3 · Cited by 138
Schizophrenia: A review of the syndrome.
(1958) · Logos eBooks · doi:10.1037/10604-000 · Cited by 112
Nicolucci, A. (1989) · JAMA · doi:10.1001/jama.262.15.2101 · Cited by 73
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
“The median sample size was 54 patients in 196 trials in arthritis [108], 46 patients in 73 trials in dermatology [8], and 65 patients in 2000 trials in schizophrenia [33].”
BackgroundMethodResultInfluentialMeta-analyses involving cross-over trials: methodological issues
Elbourne, D. R., Altman, D. G., Higgins, J. P., Curtin, F., Worthington, H. V., & Vail, A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.140 · Cited by 2,305
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
A Meta-Analysis of Cognitive Remediation for Schizophrenia: Methodology and Effect Sizes
Wykes, T., Huddy, V., Cellard, C., McGurk, S. R., & Czobor, P. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10060855 · Cited by 1,693
Moher, D., Schulz, K. F., Altman, D. G., & for the CONSORT Group* (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00011 · Cited by 1,426
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Some Practical Guidelines for Effective Sample Size Determination
Lenth, R. V. (2001) · The American Statistician · doi:10.1198/000313001317098149 · Cited by 1,139
Wykes, T., Steel, C., Everitt, B., & Tarrier, N. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbm114 · Cited by 1,029
“The average number of participants in each trial is relatively small (average 66), but this is the same as for drug trials in schizophrenia over the past 35 years.(35) The measure of trial quality, CTAM, detected methodological variability even in studies that had already passed some methodological inclusion criteria.”
ResultDirection and impact of language bias in meta-analyses of controlled trials: empirical study
Jüni, P., Holenstein, F., Sterne, J., Bartlett, C., & Egger, M. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.115 · Cited by 892
Family intervention for schizophrenia
Pharoah, F., Mari, J., Rathbone, J., & Wong, W. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000088.pub2 · Cited by 737
Leucht, S., Wahlbeck, K., Hamann, J., & Kissling, W. (2003) · The Lancet · doi:10.1016/s0140-6736(03)13306-5 · Cited by 725
Savović, J., Jones, H., Altman, D., Harris, R., Jűni, P., Pildal, J., Als-Nielsen, B., Balk, E., Gluud, C., Gluud, L., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16350 · Cited by 668
Burr, J., Mowatt, G., Hernández, R., Siddiqui, M., Cook, J., Lourenco, T., Ramsay, C., Vale, L., Fraser, C., Azuara-Blanco, A., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11410 · Cited by 549
Interventions to Improve Medication Adherence in Schizophrenia
Zygmunt, A., Olfson, M., Boyer, C. A., & Mechanic, D. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.10.1653 · Cited by 542
Standardising outcomes for clinical trials and systematic reviews
Clarke, M. (2007) · Trials · doi:10.1186/1745-6215-8-39 · Cited by 483
Heres, S., Davis, J., Maino, K., Jetzinger, E., Kissling, W., & Leucht, S. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.2.185 · Cited by 450
Leucht, C., Heres, S., Kane, J. M., Kissling, W., Davis, J. M., & Leucht, S. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2010.11.020 · Cited by 419
Family intervention for schizophrenia
Pharoah, F., Mari, J. J., Rathbone, J., & Wong, W. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000088.pub3 · Cited by 398
Tiihonen, J., Walhbeck, K., Lönnqvist, J., Klaukka, T., Ioannidis, J. P. A., Volavka, J., & Haukka, J. (2006) · BMJ · doi:10.1136/bmj.38881.382755.2f · Cited by 385
Xia (2009) · doi:10.1192/pb.bp.108.021949 · Cited by 381
Factors That Can Affect the External Validity of Randomised Controlled Trials
Rothwell, P. M. (2006) · PLoS Clinical Trials · doi:10.1371/journal.pctr.0010009 · Cited by 376
Electroconvulsive therapy for schizophrenia
Tharyan, P., & Adams, C. E. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000076.pub2 · Cited by 354
Self-citationMishara, A. L., & Goldberg, T. E. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.01.027 · Cited by 310
Systematic meta-review of depot antipsychotic drugs for people with schizophrenia
Adams, C. E., Fenton, M. K. P., Quraishi, S., & David, A. S. (2001) · British Journal of Psychiatry · doi:10.1192/bjp.179.4.290 · Cited by 288
Self-citationMohamed, S., Rosenheck, R., McEvoy, J., Swartz, M., Stroup, S., & Lieberman, J. A. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn067 · Cited by 258
“Psychopharmacological and psychological treatments have both been found to significantly decrease symptoms in schizophrenia and improve functional capacity.(5,6) The”
Backgroundfor the CONSORT Group*, Moher, D., Schulz, K. F., & Altman, D. G. (2003) · Clinical Oral Investigations · doi:10.1007/s00784-002-0188-x · Cited by 258
Uses and abuses of meta-analysis
Egger, M., Smith, G. D., & Sterne, J. A. (2001) · Clinical Medicine · doi:10.7861/clinmedicine.1-6-478 · Cited by 255
Statistics in medical journals: some recent trends
Altman, D. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001215)19:23<3275::aid-sim626>3.0.co;2-m · Cited by 254
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · Journal of the American Podiatric Medical Association · doi:10.7547/87507315-91-8-437 · Cited by 193
Outcome selection bias in meta-analysis
Williamson, P. R., Gamble, C., Altman, D. G., & Hutton, J. L. (2005) · Statistical Methods in Medical Research · doi:10.1191/0962280205sm415oa · Cited by 188
The pragmatic randomised controlled trial
Hotopf, M. (2002) · Advances in Psychiatric Treatment · doi:10.1192/apt.8.5.326 · Cited by 188
Cognitive behavioural therapy for psychosis prevention: a systematic review and meta-analysis
Hutton, P., & Taylor, P. J. (2014) · Psychological Medicine · doi:10.1017/s0033291713000354 · Cited by 184
Markiewicz, M. R., Brady, M. F., Ding, E. L., & Dodson, T. B. (2008) · Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.joms.2008.04.022 · Cited by 184
Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time
Trikalinos, T. A., Churchill, R., Ferri, M., Leucht, S., Tuunainen, A., Wahlbeck, K., & Ioannidis, J. P. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.02.018 · Cited by 177
“Large RCTs have been increasingly common in a few medical fields, notably in cardiology and oncology, but mental health and most other medical areas are dominated by small RCTs [14].”
BackgroundSelecting outcome measures in mental health: the views of service users
Crawford, M. J., Robotham, D., Thana, L., Patterson, S., Weaver, T., Barber, R., Wykes, T., & Rose, D. (2011) · Journal of Mental Health · doi:10.3109/09638237.2011.577114 · Cited by 172
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/819 · Cited by 168
Medications as Social Phenomena
Cohen, D., McCubbin, M., Collin, J., & Pérodeau, G. (2001) · Health: An Interdisciplinary Journal for the Social Study of Health, Illness and Medicine · doi:10.1177/136345930100500403 · Cited by 150
Olivares, J. M., Rodriguez-Morales, A., Diels, J., Povey, M., Jacobs, A., Zhao, Z., & Lam, A. (2009) · European Psychiatry · doi:10.1016/j.eurpsy.2008.12.002 · Cited by 141
“However, the short duration of the majority of RCTs, and the very defined patient inclusion criteria, suggest that such studies do not reflect either the duration of the disease in real clinical practice or patients with schizophrenia in the community [16,28,30].”
BackgroundIdentification and impact of outcome selection bias in meta‐analysis
Williamson, P. R., & Gamble, C. (2005) · Statistics in Medicine · doi:10.1002/sim.2025 · Cited by 132
Patient-reported outcome measures: Are they patient-generated, patient-centred or patient-valued?
Trujols, J., Portella, M. J., Iraurgi, I., Campins, M. J., Siñol, N., & Cobos, J. P. D. L. (2013) · Journal of Mental Health · doi:10.3109/09638237.2012.734653 · Cited by 129
“This call to involve patients in selecting outcome variables and designing outcome measures is not new: more than a decade ago Thornley and Adams (1998) called for clinical trials in which the outcome assessment included both patient and clinician perspectives.”
BackgroundUnbiased, relevant, and reliable assessments in health care
Chalmers, I. (1998) · BMJ · doi:10.1136/bmj.317.7167.1167 · Cited by 98
Teferra, S., Hanlon, C., Beyero, T., Jacobsson, L., & Shibre, T. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-168 · Cited by 97
“of symptoms [1,2].”
Safety Reporting in Randomized Trials of Mental Health Interventions
Papanikolaou, P. N., Churchill, R., Wahlbeck, K., Ioannidis, J. P. A., & The EU-PSI Project (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.9.1692 · Cited by 84
Tosh, G., Soares-Weiser, K., & Adams, C. E. (2011) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2011.13.2/gtosh · Cited by 84
Self-citationLeucht, S., Schneider‐Thoma, J., Burschinski, A., Peter, N., Wang, D., Dong, S., Huhn, M., Nikolakopoulou, A., Salanti, G., & Davis, J. M. (2023) · World Psychiatry · doi:10.1002/wps.21089 · Cited by 78
Meta-analysis in medical research: Potentials and limitations
Zwahlen, M., Renehan, A., & Egger, M. (2008) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2006.12.001 · Cited by 70
“[10] Thornley B, Adams C.”
BackgroundGalandi, D., Schwarzer, G., & Antes, G. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-30 · Cited by 59
“This observation confirms developments in other general health care journals, but is in clear contrast to high impact international general and specialist journals where a constant number of RCTs has been observed over past decades [5-7].”
Compliance of randomized controlled trials in trauma surgery with the CONSORT statement
Lee, S.-Y., Teoh, P. J., Camm, C. F., & Agha, R. A. (2013) · Journal of Trauma and Acute Care Surgery · doi:10.1097/ta.0b013e3182a5399e · Cited by 44
Altman (2005) · doi:10.1016/s0025-7753(05)72203-x · Cited by 43
Knüppel, H., Metz, C., Meerpohl, J. J., & Strech, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075995 · Cited by 31
“Although inadequate quality of reporting and selective reporting of trial data have often and recently been demonstrated for psychiatric disorders [6,7,8,9,17,19,20,21], no study has so far investigated the extent to which author instructions in psychiatry journals endorse reporting guidelines and trial registration a…”
BackgroundResult
Metadata
- Authors
- Thornley, B., & Adams, C.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 1998-10-31
- Volume
- 317
- Issue
- 7167
- Pages
- 1181-1184
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W2110841701
- Cited by
- 364
- References
- 16
- FWCI
- 14.15
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.