Clinical trial design in non-invasive brain stimulation psychiatric research: Clinical design in NIBS trials
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Major depressive disorder (MDD) trials - investigating either non-pharmacological or pharmacological interventions - have shown mixed results. Many reasons explain this heterogeneity, but one that stands out is the trial design due to specific challenges in the field. We aimed therefore to review the methodology of non-invasive brain stimulation (NIBS) trials and provide a framework to improve clinical trial design. We performed a systematic review for randomized, controlled MDD trials whose intervention was transcranial magnetic stimulation (rTMS) or transcranial direct current stimulation (tDCS) in MEDLINE and other databases from April 2002 to April 2008. We created an unstructured checklist based on CONSORT guidelines to extract items such as power analysis, sham method, blinding assessment, allocation concealment, operational criteria used for MDD, definition of refractory depression and primary study hypotheses. Thirty-one studies were included. We found that the main methodological issues can be divided in to three groups: (1) issues related to phase II/small trials, (2) issues related to MDD trials and, (3) specific issues of NIBS studies. Taken together, they can threaten study validity and lead to inconclusive results. Feasible solutions include: estimating the sample size a priori; measuring the degree of refractoriness of the subjects; specifying the primary hypothesis and statistical tests; controlling predictor variables through stratification randomization methods or using strict eligibility criteria; adjusting the study design to the target population; using adaptive designs and exploring NIBS efficacy employing biological markers. In conclusion, our study summarizes the main methodological issues of NIBS trials and proposes a number of alternatives to manage them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643
The Meaning of Translational Research and Why It Matters
Woolf, S. H. (2008) · JAMA · doi:10.1001/jama.2007.26 · Cited by 1,910
Sen, S., Duman, R., & Sanacora, G. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.005 · Cited by 1,232
Brunoni, A. R., Lopes, M., & Fregni, F. (2008) · International Journal of Neuropsychopharmacology · doi:10.1017/s1461145708009309 · Cited by 972
Self-citationHopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., Schulz, K. F., & and the CONSORT Group (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050020 · Cited by 674 · cited 2×
“We constructed an unstructured checklist based on the CONSORT statement and other methodological reviews analyzing pitfalls in clinical trials (Boutron et al., 2007; Glasser and Howard, 2006; Hopewell et al., 2008; Leucht et al., 2008; Zlowodzki et al., 2006).”
MethodAdaptive design methods in clinical trials–a review
Chow, S.-C., & Chang, M. (2008) · Orphanet Journal of Rare Diseases · doi:10.1186/1750-1172-3-11 · Cited by 482
Reporting methods of blinding in randomized trials assessing nonpharmacological treatments
Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040061 · Cited by 389
Lisanby, S. H., Husain, M. M., Rosenquist, P. B., Maixner, D., Gutierrez, R., Krystal, A., Gilmer, W., Marangell, L. B., Aaronson, S., Daskalakis, Z. J., et al. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.118 · Cited by 333
Avery, D. H., Holtzheimer, P. E., Fawaz, W., Russo, J., Neumaier, J., Dunner, D. L., Haynor, D. R., Claypoole, K. H., Wajdik, C., & Roy-Byrne, P. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.07.003 · Cited by 318
Fergusson, D. (2004) · BMJ · doi:10.1136/bmj.37952.631667.ee · Cited by 264
Berlim, M. T., & Turecki, G. (2007) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2007.03.009 · Cited by 249 · cited 4×
“Another threat is that the trials reviewed used four different diagnostic criteria to define TRD – in fact, TRD refers to a specific subgroup (15–40%) of patients failing to achieve significant clinical improvement after at least two antidepressant trials (Berlim and Turecki, 2007).”
BackgroundMethodInfluentialTranscranial direct current stimulation in severe, drug-resistant major depression
Ferrucci, R., Bortolomasi, M., Vergari, M., Tadini, L., Salvoro, B., Giacopuzzi, M., Barbieri, S., & Priori, A. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.02.015 · Cited by 228
Treatment of Vascular Depression Using Repetitive Transcranial Magnetic Stimulation
Jorge, R. E., Moser, D. J., Acion, L., & Robinson, R. G. (2008) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2007.45 · Cited by 211 · cited 5×
“…et al., 2006; Hausmann et al., 2004; Herwig et al., 2007; Herwig et al., 2003; Holtzheimer et al., 2004; Hoppner et al., 2003; Januel et al., 2006; Jorge et al., 2008; Jorge et al., 2004; Koerselman et al., 2004; Loo et al., 2003; Loo et al., 2007; Mogg et al., 2008; Mosimann et al., 2004;…”
BackgroundMethodInfluentialMosimann, U. P., Schmitt, W., Greenberg, B. D., Kosel, M., Müri, R. M., Berkhoff, M., Hess, C. W., Fisch, H. U., & Schlaepfer, T. E. (2004) · Psychiatry Research · doi:10.1016/j.psychres.2003.10.006 · Cited by 192
Brunoni, A. R., Lopes, M., Kaptchuk, T. J., & Fregni, F. (2009) · PLoS ONE · doi:10.1371/journal.pone.0004824 · Cited by 173 · cited 5×
“Along these lines, a recent meta‐analysis showed that the placebo sham response is similar to a placebo pill response (Brunoni et al., 2009).”
BackgroundResultInfluentialSelf-citationBortolomasi, M., Minelli, A., Fuggetta, G., Perini, M., Comencini, S., Fiaschi, A., & Manganotti, P. (2007) · Psychiatry Research · doi:10.1016/j.psychres.2006.04.010 · Cited by 68 · cited 3×
“Therefore, alternative blinding methods – especially for rTMS – should be used, such as avoiding contact between subjects of different groups, excluding patients non‐naïve to rTMS, avoiding crossover trials and blinding raters to treatment applied (Boutron et al., 2007).”
BackgroundMethod
Cited by
Brunoni, A. R., Nitsche, M. A., Bolognini, N., Bikson, M., Wagner, T., Merabet, L., Edwards, D. J., Valero-Cabre, A., Rotenberg, A., Pascual-Leone, A., et al. (2012) · Brain stimulation · doi:10.1016/j.brs.2011.03.002 · Cited by 1,445
Self-citationBrunoni, A. R., Chaimani, A., Moffa, A. H., Razza, L. B., Gattaz, W. F., Daskalakis, Z. J., & Carvalho, A. F. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.3644 · Cited by 520
Self-citationtDCS‐Induced Analgesia and Electrical Fields in Pain‐Related Neural Networks in Chronic Migraine
DaSilva, A. F., Mendonca, M. E., Zaghi, S., Lopes, M., DosSantos, M. F., Spierings, E. L., Bajwa, Z., Datta, A., Bikson, M., & Fregni, F. (2012) · Headache: The Journal of Head and Face Pain · doi:10.1111/j.1526-4610.2012.02141.x · Cited by 305
Self-citationRazza, L. B., Moffa, A. H., Moreno, M. L., Carvalho, A. F., Padberg, F., Fregni, F., & Brunoni, A. R. (2018) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.10.016 · Cited by 172
Self-citationSomatic therapies for treatment-resistant depression: ECT, TMS, VNS, DBS
Cusin, C., & Dougherty, D. D. (2012) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-2-14 · Cited by 98
“This analysis showed a statistically significant difference; however, other papers critically analyzed the methods applied in the clinical trials [23-25] and suggested that though the results showed strong statistical evidence of efficacy, the clinical results were not sufficient to recommend the implementation of TMS…”
Result
Metadata
- Authors
- Brunoni, A. R., & Fregni, F.
- Venue
- International Journal of Methods in Psychiatric Research
- Publisher
- Wiley
- Published
- 2011-05-02
- Volume
- 20
- Issue
- 2
- Pages
- e19-e30
- ISSN
- 1049-8931 (ISSN-L)
- OpenAlex
- W1904458493
- Cited by
- 65
- References
- 16
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.