Clinical trial design in non-invasive brain stimulation psychiatric research: Clinical design in NIBS trials
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Major depressive disorder (MDD) trials - investigating either non-pharmacological or pharmacological interventions - have shown mixed results. Many reasons explain this heterogeneity, but one that stands out is the trial design due to specific challenges in the field. We aimed therefore to review the methodology of non-invasive brain stimulation (NIBS) trials and provide a framework to improve clinical trial design. We performed a systematic review for randomized, controlled MDD trials whose intervention was transcranial magnetic stimulation (rTMS) or transcranial direct current stimulation (tDCS) in MEDLINE and other databases from April 2002 to April 2008. We created an unstructured checklist based on CONSORT guidelines to extract items such as power analysis, sham method, blinding assessment, allocation concealment, operational criteria used for MDD, definition of refractory depression and primary study hypotheses. Thirty-one studies were included. We found that the main methodological issues can be divided in to three groups: (1) issues related to phase II/small trials, (2) issues related to MDD trials and, (3) specific issues of NIBS studies. Taken together, they can threaten study validity and lead to inconclusive results. Feasible solutions include: estimating the sample size a priori; measuring the degree of refractoriness of the subjects; specifying the primary hypothesis and statistical tests; controlling predictor variables through stratification randomization methods or using strict eligibility criteria; adjusting the study design to the target population; using adaptive designs and exploring NIBS efficacy employing biological markers. In conclusion, our study summarizes the main methodological issues of NIBS trials and proposes a number of alternatives to manage them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643
The Meaning of Translational Research and Why It Matters
Woolf, S. H. (2008) · JAMA · doi:10.1001/jama.2007.26 · Cited by 1,910
Sen, S., Duman, R., & Sanacora, G. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.005 · Cited by 1,232
Brunoni, A. R., Lopes, M., & Fregni, F. (2008) · International Journal of Neuropsychopharmacology · doi:10.1017/s1461145708009309 · Cited by 972
Self-citationHopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., Schulz, K. F., & and the CONSORT Group (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050020 · Cited by 674 · cited 2×
“We constructed an unstructured checklist based on the CONSORT statement and other methodological reviews analyzing pitfalls in clinical trials (Boutron et al., 2007; Glasser and Howard, 2006; Hopewell et al., 2008; Leucht et al., 2008; Zlowodzki et al., 2006).”
MethodAdaptive design methods in clinical trials–a review
Chow, S.-C., & Chang, M. (2008) · Orphanet Journal of Rare Diseases · doi:10.1186/1750-1172-3-11 · Cited by 482
Reporting methods of blinding in randomized trials assessing nonpharmacological treatments
Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040061 · Cited by 389
Lisanby, S. H., Husain, M. M., Rosenquist, P. B., Maixner, D., Gutierrez, R., Krystal, A., Gilmer, W., Marangell, L. B., Aaronson, S., Daskalakis, Z. J., et al. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.118 · Cited by 333
Avery, D. H., Holtzheimer, P. E., Fawaz, W., Russo, J., Neumaier, J., Dunner, D. L., Haynor, D. R., Claypoole, K. H., Wajdik, C., & Roy-Byrne, P. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.07.003 · Cited by 318
Berlim, M. T., & Turecki, G. (2007) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2007.03.009 · Cited by 249 · cited 4×
“Another threat is that the trials reviewed used four different diagnostic criteria to define TRD – in fact, TRD refers to a specific subgroup (15–40%) of patients failing to achieve significant clinical improvement after at least two antidepressant trials (Berlim and Turecki, 2007).”
BackgroundMethodInfluential
Cited by
Brunoni, A. R., Nitsche, M. A., Bolognini, N., Bikson, M., Wagner, T., Merabet, L., Edwards, D. J., Valero-Cabre, A., Rotenberg, A., Pascual-Leone, A., et al. (2012) · Brain stimulation · doi:10.1016/j.brs.2011.03.002 · Cited by 1,445
Self-citationBrunoni, A. R., Chaimani, A., Moffa, A. H., Razza, L. B., Gattaz, W. F., Daskalakis, Z. J., & Carvalho, A. F. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.3644 · Cited by 520
Self-citationtDCS‐Induced Analgesia and Electrical Fields in Pain‐Related Neural Networks in Chronic Migraine
DaSilva, A. F., Mendonca, M. E., Zaghi, S., Lopes, M., DosSantos, M. F., Spierings, E. L., Bajwa, Z., Datta, A., Bikson, M., & Fregni, F. (2012) · Headache: The Journal of Head and Face Pain · doi:10.1111/j.1526-4610.2012.02141.x · Cited by 305
Self-citationRazza, L. B., Moffa, A. H., Moreno, M. L., Carvalho, A. F., Padberg, F., Fregni, F., & Brunoni, A. R. (2018) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.10.016 · Cited by 172
Self-citationSomatic therapies for treatment-resistant depression: ECT, TMS, VNS, DBS
Cusin, C., & Dougherty, D. D. (2012) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-2-14 · Cited by 98
“This analysis showed a statistically significant difference; however, other papers critically analyzed the methods applied in the clinical trials [23-25] and suggested that though the results showed strong statistical evidence of efficacy, the clinical results were not sufficient to recommend the implementation of TMS…”
Result
Metadata
- Authors
- Brunoni, A. R., & Fregni, F.
- Venue
- International Journal of Methods in Psychiatric Research
- Publisher
- Wiley
- Published
- 2011-05-02
- Volume
- 20
- Issue
- 2
- Pages
- e19-e30
- ISSN
- 1049-8931 (ISSN-L)
- OpenAlex
- W1904458493
- Cited by
- 65
- References
- 15
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Clinical trial design in non-invasive brain stimulation psychiatric research: Clinical design in NIBS trials. https://app.cochat.ai/papers/10.1002/mpr.338
- The paper
- Brunoni, A. R., & Fregni, F. (2011). Clinical trial design in non-invasive brain stimulation psychiatric research: Clinical design in NIBS trials. International Journal of Methods in Psychiatric Research. https://doi.org/10.1002/mpr.338
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.