Effectiveness studies: advantages and disadvantages
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
In recent years, so-called "effectiveness studies," also called "real-world studies" or "pragmatic trials," have gained increasing importance in the context of evidence-based medicine. These studies follow less restrictive methodological standards than phase III studies in terms of patient selection, comedication, and other design issues, and their results should therefore be better generalizable than those of phase III trials. Effectiveness studies, like other types of phase IV studies, can therefore contribute to knowledge about medications and supply relevant information in addition to that gained from phase III trials. However, the less restrictive design and inherent methodological problems of phase IV studies have to be carefully considered. For example, the greater variance caused by the different kinds of confounders as well as problematic design issues, such as insensitive primary outcome criteria, unblinded treatment conditions, inclusion of chronic refractory patients, etc, can lead to wrong conclusions. Due to these methodological problems, effectiveness studies are on a principally lower level of evidence, adding only a complementary view to the results of phase III trials without falsifying their results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effectiveness of Antipsychotic Drugs in Patients with Chronic Schizophrenia
Lieberman, J. A., Stroup, T. S., McEvoy, J. P., Swartz, M. S., Rosenheck, R. A., Perkins, D. O., Keefe, R. S. E., Davis, S. M., Davis, C. E., Lebowitz, B. D., et al. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa051688 · Cited by 5,892
Trivedi, M. H., Rush, A. J., Wisniewski, S. R., Nierenberg, A. A., Warden, D., Ritz, L., Norquist, G., Howland, R. H., Lebowitz, B., McGrath, P. J., et al. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.1.28 · Cited by 3,879 · cited 1×
“Of special methodological interest is the finding that the outcome difference between an a posteriori defined efficacy sample and an effectiveness sample was not as huge as hypothesized.(54) This finding was supported by the results of a naturalistic study on about 1000 depressive inpatients where a similar approach o…”
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474 · cited 1×
“This corresponds with the rules of the methodology of empirical research.(4,5) Thus, randomized control-group studies have a higher value than nonrandomized or uncontrolled studies.”
Sequenced treatment alternatives to relieve depression (STAR*D): Rationale and design
Rush, A. J., Fava, M., Wisniewski, S. R., Lavori, P. W., Trivedi, M. H., Sackeim, H. A., Thase, M. E., Nierenberg, A. A., Quitkin, F. M., Kashner, T. M., et al. (2004) · Controlled Clinical Trials · doi:10.1016/s0197-2456(03)00112-0 · Cited by 1,076 · cited 1×
“So far, the current interest in effectiveness studies is principally positive.(10,18,19) However, the results of these effectiveness studies should not be overinterpreted due to their principal methodological limitations (as demonstrated, eg, for the Clinical Antipsychotic Trials of Intervention Effectiveness [CATIE]…”
Research designs for studies evaluating the effectiveness of change and improvement strategies
Eccles, M. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.47 · Cited by 586
Zimmerman, M., Chelminski, I., & Posternak, M. A. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.7.1370 · Cited by 144
Möller, H.-J. (2009) · The World Journal of Biological Psychiatry · doi:10.1080/15622970802264606 · Cited by 107 · cited 1×
“They give a complementary view to the observer rating of the same construct/dimension.(36,37) The correlation between the observer ratings and self-ratings might not be high and may be quite changeable, depending on the psychopathological state in terms of severity and type of symptoms.”
Dossenbach, M., Erol, A., Kessaci, M. E. M., Shaheen, M. O., Sunbol, M. M., Boland, J., Hodge, A., O'Halloran, R. A., Bitter, I., & IC-SOHO Study Group (2004) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v65n0305 · Cited by 80
Cited by
Vázquez, G. H., Holtzman, J. N., Lolich, M., Ketter, T. A., & Baldessarini, R. J. (2015) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.07.013 · Cited by 102
“…dyscontrol, and high suicidal risk, typically are excluded from long-term, randomized, controlled trials (RCTs), potentially further limiting generalizability of findings to broader clinical populations (Persons & Silberschatz, 1998; Moller, 2011; Baldessarini, 2013; Baldessarini et al., 2014).”
Outcomes of prolonged exposure therapy for veterans with posttraumatic stress disorder
Goodson, J. T., Lefkowitz, C. M., Helstrom, A. W., & Gawrysiak, M. J. (2013) · Journal of Traumatic Stress · doi:10.1002/jts.21830 · Cited by 88
Machado, M. P. A., Opaleye, E. S., Bedendo, A., Bowen, S., & Noto, A. R. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1381489 · Cited by 3
“In this light, pragmatic studies, quasi-experimental designs, and mixed methods appear to be the most appropriate alternatives (48–51).”
Metadata
- Authors
- Möller, H.-J.
- Venue
- Dialogues in Clinical Neuroscience
- Publisher
- Informa UK Limited
- Published
- 2011-06-30
- Volume
- 13
- Issue
- 2
- Pages
- 199-207
- ISSN
- 1294-8322 (ISSN-L)
- 1958-5969
- OpenAlex
- W4296605327
- Cited by
- 69
- References
- 8
- FWCI
- 1.67
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effectiveness studies: advantages and disadvantages. https://app.cochat.ai/papers/10.31887/dcns.2011.13.2/hmoeller
- The paper
- Möller, H.-J. (2011). Effectiveness studies: advantages and disadvantages. Dialogues in Clinical Neuroscience. https://doi.org/10.31887/dcns.2011.13.2/hmoeller
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.