Changes in Clinical Trials Methodology Over Time: A Systematic Review of Six Decades of Research in Psychopharmacology
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
BACKGROUND: There have been many changes in clinical trials methodology since the introduction of lithium and the beginning of the modern era of psychopharmacology in 1949. The nature and importance of these changes have not been fully addressed to date. As methodological flaws in trials can lead to false-negative or false-positive results, the objective of our study was to evaluate the impact of methodological changes in psychopharmacology clinical research over the past 60 years. METHODOLOGY/PRINCIPAL FINDINGS: We performed a systematic review from 1949 to 2009 on MEDLINE and Web of Science electronic databases, and a hand search of high impact journals on studies of seven major drugs (chlorpromazine, clozapine, risperidone, lithium, fluoxetine and lamotrigine). All controlled studies published 100 months after the first trial were included. Ninety-one studies met our inclusion criteria. We analyzed the major changes in abstract reporting, study design, participants' assessment and enrollment, methodology and statistical analysis. Our results showed that the methodology of psychiatric clinical trials changed substantially, with quality gains in abstract reporting, results reporting, and statistical methodology. Recent trials use more informed consent, periods of washout, intention-to-treat approach and parametric tests. Placebo use remains high and unchanged over time. CONCLUSIONS/SIGNIFICANCE: Clinical trial quality of psychopharmacological studies has changed significantly in most of the aspects we analyzed. There was significant improvement in quality reporting and internal validity. These changes have increased study efficiency; however, there is room for improvement in some aspects such as rating scales, diagnostic criteria and better trial reporting. Therefore, despite the advancements observed, there are still several areas that can be improved in psychopharmacology clinical trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374
Moher, D., Schulz, K. F., Altman, D. G., & for the CONSORT Group* (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00011 · Cited by 1,426
Placebo Response in Studies of Major Depression: Variable, Substantial, and Growing
Walsh, B. T., Seidman, S. N., Sysko, R., & Gould, M. (2002) · JAMA · doi:10.1001/jama.287.14.1840 · Cited by 1,109 · cited 1×
“Another important issue is that placebo response in comparison to the active group has increased over time [55], which could theoretically reflect an improvement in internal validity, as robust studies are less susceptible to accidentally breaking blinding.”
BackgroundCalabrese, J. R., Bowden, C. L., Sachs, G. S., Ascher, J. A., Monaghan, E., Rudd, G. D., & The Lamictal 602 Study Group (1999) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v60n0203 · Cited by 1,054
Moher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027 · cited 1×
“However, our results showed that abstract reporting improved significantly before CONSORT; on the other hand, recent reviews [47,48] of abstract reporting in top impact-factor journals showed improvement also after CONSORT and also that many top journals had not been referring to CONSORT or alternative abstract guidel…”
ResultAllocation concealment in randomised trials: defending against deciphering
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07750-4 · Cited by 923 · cited 1×
“This is surprising, as inadequate methods of randomization and allocation are considered major sources of bias [59,60].”
MethodMcDougle, C. J., Epperson, C. N., Pelton, G. H., Wasylink, S., & Price, L. H. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.8.794 · Cited by 571 · cited 1×
“For example, one article [24] reported funding from a NIH grant, two foundations award grants, and a public, local mental health grant.”
BackgroundCalabrese, J. R., Suppes, T., Bowden, C. L., Sachs, G. S., Swann, A. C., McElroy, S. L., Kusumakar, V., Ascher, J. A., Earl, N. L., Greene, P. L., et al. (2000) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v61n1106 · Cited by 498
CONSORT for reporting randomised trials in journal and conference abstracts
Hopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., & Schulz, K. F. (2008) · The Lancet · doi:10.1016/s0140-6736(07)61835-2 · Cited by 458 · cited 1×
“We designed a semi-structured checklist, based on previous methodological reviews of clinical trials [19,20,21,22,23] to address the following aspects:”
MethodReporting methods of blinding in randomized trials assessing nonpharmacological treatments
Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040061 · Cited by 389
Cited by
Brunoni, A. R., Nitsche, M. A., Bolognini, N., Bikson, M., Wagner, T., Merabet, L., Edwards, D. J., Valero-Cabre, A., Rotenberg, A., Pascual-Leone, A., et al. (2012) · Brain stimulation · doi:10.1016/j.brs.2011.03.002 · Cited by 1,445
“One is methodologic; how to study tDCS in neuropsychiatry that historically has been heavily pharmacotherapy-based.(23) Specifically, what are the optimal approaches regarding study design (eg, two-arm, three-arm versus factorial), study methodology (blinding, use of placebo, concomitant use of drugs), sample requirem…”
Self-citationBrunoni, A. R., Amadera, J., Berbel, B., Volz, M. S., Rizzerio, B. G., & Fregni, F. (2011) · International Journal of Neuropsychopharmacology · doi:10.1017/s1461145710001690 · Cited by 1,234
Self-citationCipriani, A., Zhou, X., Del Giovane, C., Hetrick, S. E., Qin, B., Whittington, C., Coghill, D., Zhang, Y., Hazell, P., Leucht, S., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30385-3 · Cited by 734
Samara, M. T., Dold, M., Gianatsi, M., Nikolakopoulou, A., Helfer, B., Salanti, G., & Leucht, S. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2955 · Cited by 300
Razza, L. B., Moffa, A. H., Moreno, M. L., Carvalho, A. F., Padberg, F., Fregni, F., & Brunoni, A. R. (2018) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.10.016 · Cited by 172
Self-citation
Metadata
- Authors
- Brunoni, A. R., Tadini, L., & Fregni, F.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-03-03
- Volume
- 5
- Issue
- 3
- Pages
- e9479
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2058313277
- Cited by
- 39
- References
- 13
- FWCI
- 0.51
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Changes in Clinical Trials Methodology Over Time: A Systematic Review of Six Decades of Research in Psychopharmacology. https://app.cochat.ai/papers/10.1371/journal.pone.0009479
- The paper
- Brunoni, A. R., Tadini, L., & Fregni, F. (2010). Changes in Clinical Trials Methodology Over Time: A Systematic Review of Six Decades of Research in Psychopharmacology. PLoS ONE. https://doi.org/10.1371/journal.pone.0009479
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.