Reporting Quality of Social and Psychological Intervention Trials: A Systematic Review of Reporting Guidelines and Trial Publications
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Previous reviews show that reporting guidelines have improved the quality of trial reports in medicine, yet existing guidelines may not be fully suited for social and psychological intervention trials. OBJECTIVE/DESIGN: We conducted a two-part study that reviewed (1) reporting guidelines for and (2) the reporting quality of social and psychological intervention trials. DATA SOURCES: (1) To identify reporting guidelines, we systematically searched multiple electronic databases and reporting guideline registries. (2) To identify trials, we hand-searched 40 journals with the 10 highest impact factors in clinical psychology, criminology, education, and social work. ELIGIBILITY: (1) Reporting guidelines consisted of articles introducing a checklist of reporting standards relevant to social and psychological intervention trials. (2) Trials reported randomised experiments of complex interventions with psychological, social, or health outcomes. RESULTS: (1) We identified 19 reporting guidelines that yielded 147 reporting standards relevant to social and psychological interventions. Social and behavioural science guidelines included 89 standards not found in CONSORT guidelines. However, CONSORT guidelines used more recommended techniques for development and dissemination compared to other guidelines. (2) Our review of trials (n = 239) revealed that many standards were poorly reported, such as identification as a randomised trial in titles (20% reported the information) and abstracts (55%); information about blinding (15%), sequence generation (23%), and allocation concealment (17%); and details about actual delivery of experimental (43%) and control interventions (34%), participant uptake (25%), and service environment (28%). Only 11 of 40 journals referenced reporting guidelines in "Instructions to Authors." CONCLUSION: Existing reporting guidelines have important limitations in content, development, and/or dissemination. Important details are routinely missing from trial publications; most leading journals in social and behavioural sciences do not ask authors to follow reporting standards. Findings demonstrate a need to develop a CONSORT extension with updated standards for social and psychological intervention trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately, reporting of interventions tested and the methods used to evaluate them is often suboptimal, even in our best journals (Grant et al. 2013), and this often makes it difficult to judge the quality of the evidence from potentially important prevention trials.”
From Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation (2015) · cites this paper as Grant et al. 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582 · cited 1×
“Previous Guidance Through the literature search (see Figure 1), we identified 19 unique, eligible reporting guidelines and reporting quality assessment tools (see Table 1) developed between 1980 and 2010 (median 2004).[6,9,26,27,28,29,30,31,32,33,34,35,36,37,38,39, 40,41,42] Six were developed by the CONSORT Group for…”
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Zhang, Q., Wang, C., Zheng, M., Li, Y., Li, J., Zhang, L., Shang, X., & Yan, C. (2015) · Cerebrovascular Diseases · doi:10.1159/000369778 · Cited by 11,533
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
(2005) · PubMed · Cited by 7,011
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304 · cited 1×
“[51] Details of trials not related to internal and external validity are also important, such as discussing other relevant research when interpreting trial findings,[52] referencing other reports about the trial that may have a different focus (e.”
BackgroundDong, Y., Hao, L., Shi, Z., Wang, G., Zhang, Z., & Han, C. (2013) · Urologia Internationalis · doi:10.1159/000351405 · Cited by 4,540
(2005) · Cited by 3,748
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817 · cited 13×
“TREND Statement [38] 2004 RG Public Health 59”
BackgroundMethodInfluentialCONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557 · cited 2×
“CONSORT Extension for Cluster Trials [29] 2004 RG x Cluster Trials 40”
BackgroundMethodDeveloping and Evaluating Complex Interventions: New Guidance
Craig, P., Dieppe, P. A., MacIntyre, S., Michie, S., Nazareth, I., & Petticrew, M. P. (2006) · UCL Discovery (University College London) · Cited by 1,974
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813
Better Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement
Ioannidis, J. P. A., Evans, S. J. W., Gøtzsche, P. C., O'Neill, R. T., Altman, D. G., Schulz, K., Moher, D., & for the CONSORT Group* (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-141-10-200411160-00009 · Cited by 1,593 · cited 2×
“CONSORT Extension for Reporting Harms [32] 2004 RG x Harms 22”
BackgroundGuidance for Developers of Health Research Reporting Guidelines
Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000217 · Cited by 1,437 · cited 8×
“Following recommended techniques for guideline development and dissemination,[3] a structured approach to reporting guideline development should begin with a needs assessment that (i) reviews whether an adequate guideline already exists for a given research method and (ii) obtains evidence of the reporting quality of…”
BackgroundMethodInfluentialRealist synthesis - an introduction
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004) · UCL Discovery (University College London) · Cited by 893
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., & Moher, D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000030.pub2 · Cited by 740 · cited 5×
“80) for assessing the validity of evaluations of RCTs reporting quality.[8] Our own difficulty in applying some standards reaffirmed the need to develop clear, specific recommendations for social and psychological intervention trials based on best current evidence.”
BackgroundMethodInfluentialReporting standards for research in psychology: why do we need them? What might they be?
APA Publications and Communications Board Working Group on Journal Article Reporting Standards (2008) · American Psychologist · doi:10.1037/0003-066x.63.9.839 · Cited by 571
(2006) · Educational Researcher · doi:10.3102/0013189x035006033 · Cited by 543
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008-w1 · Cited by 523
CONSORT for reporting randomised trials in journal and conference abstracts
Hopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., & Schulz, K. F. (2008) · The Lancet · doi:10.1016/s0140-6736(07)61835-2 · Cited by 458 · cited 2×
“CONSORT Extension for Abstracts [28] 2008 RG x Abstracts 17”
BackgroundCan We Systematically Review Studies That Evaluate Complex Interventions?
Shepperd, S., Lewin, S., Straus, S., Clarke, M., Eccles, M. P., Fitzpatrick, R., Wong, G., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000086 · Cited by 408 · cited 2×
“For example, the CONSORT Statement and its extensions have primarily focused on standards related to internal validity, but researchers are increasingly interested in the applicability of trial findings and have called for updated standards to improve the assessment of external validity.[14,15,16,17,18,19] For example…”
BackgroundEvidence-based behavioral medicine: What is it and how do we achieve it?
Davidson, K. W., Goldstein, M., Kaplan, R. M., Kaufmann, P. G., Knatterud, G. L., Orleans, C. T., Spring, B., Trudeau, K. J., & Whitlock, E. P. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2603_01 · Cited by 408 · cited 3×
“Previous Guidance Through the literature search (see Figure 1), we identified 19 unique, eligible reporting guidelines and reporting quality assessment tools (see Table 1) developed between 1980 and 2010 (median 2004).[6,9,26,27,28,29,30,31,32,33,34,35,36,37,38,39, 40,41,42] Six were developed by the CONSORT Group for…”
BackgroundReporting Guidelines for Survey Research: An Analysis of Published Guidance and Reporting Practices
Bennett, C., Khangura, S., Brehaut, J. C., Graham, I. D., Moher, D., Potter, B. K., & M. Grimshaw, J. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001069 · Cited by 397 · cited 5×
“Following recommended techniques for guideline development and dissemination,[3] a structured approach to reporting guideline development should begin with a needs assessment that (i) reviews whether an adequate guideline already exists for a given research method and (ii) obtains evidence of the reporting quality of…”
BackgroundMethodInfluentialFactors that limit the quality, number and progress of randomised controlled trials
Prescott, Counsell, Gillespie, Grant, Russell, Kiauka, Colthart, Ross, Shepherd, & Russell (1999) · Health Technology Assessment · doi:10.3310/hta3200 · Cited by 390 · cited 1×
“For example, the CONSORT Statement and its extensions have primarily focused on standards related to internal validity, but researchers are increasingly interested in the applicability of trial findings and have called for updated standards to improve the assessment of external validity.[14,15,16,17,18,19] For example…”
BackgroundA Proposal for Structured Reporting of Randomized Controlled Trials
Andrew, E. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520240054041 · Cited by 309
Michie, S., Abraham, C., Eccles, M. P., Francis, J. J., Hardeman, W., & Johnston, M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-10 · Cited by 301
Educational Research Association
Freeman, F. N. (1923) · The Journal of Educational Research · doi:10.1080/00220671.1923.10879332 · Cited by 254
Schulz, K. (2010) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20100702 · Cited by 248
Bonell, C. P., Hargreaves, J., Cousens, S., Ross, D., Hayes, R., Petticrew, M., & Kirkwood, B. R. (2011) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2008.082602 · Cited by 223 · cited 2×
“While trials are not the only method for evaluating interventions, nor are they the only method that can benefit from updated reporting standards,[50] the importance of trial reports is growing.”
MethodGuidelines for Reporting Health Research: The EQUATOR Network's Survey of Guideline Authors
Simera, I., Altman, D. G., Moher, D., Schulz, K. F., & Hoey, J. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050139 · Cited by 220 · cited 1×
“Future directions A reporting guideline designed specifically for social and psychological interventions would help improve the quality of these trial reports.[43,45] To be acceptable and widely utilised, such a guideline should be developed using rigorous methods that engage members from all relevant stakeholder grou…”
MethodIntervention Research: Developing Social Programs
Fräser, M. W. (2009) · Cited by 217
Taking healthcare interventions from trial to practice
Glasziou, P., Chalmers, I., Altman, D. G., Bastian, H., Boutron, I., Brice, A., Jamtvedt, G., Farmer, A., Ghersi, D., Groves, T., et al. (2010) · BMJ · doi:10.1136/bmj.c3852 · Cited by 209 · cited 2×
“For example, the CONSORT Statement and its extensions have primarily focused on standards related to internal validity, but researchers are increasingly interested in the applicability of trial findings and have called for updated standards to improve the assessment of external validity.[14,15,16,17,18,19] For example…”
BackgroundReporting standards and research strategies for controlled trials
Mosteller, F., Gilbert, J. P., & McPeek, B. (1980) · Controlled Clinical Trials · doi:10.1016/s0197-2456(80)80006-7 · Cited by 206 · cited 2×
“Previous Guidance Through the literature search (see Figure 1), we identified 19 unique, eligible reporting guidelines and reporting quality assessment tools (see Table 1) developed between 1980 and 2010 (median 2004).[6,9,26,27,28,29,30,31,32,33,34,35,36,37,38,39, 40,41,42] Six were developed by the CONSORT Group for…”
BackgroundIntervention Research: Developing Social Programs
Fraser, M. W., Richman, J. M., Galinsky, M. J., & Day, S. H. (2009) · doi:10.1093/oso/9780195325492.001.0001 · Cited by 204
Road traffic crashes: operationalizing equity in the context of health sector reform
Evans, T., & Brown, H. (2003) · Injury Control and Safety Promotion · doi:10.1076/icsp.10.1.11.14117 · Cited by 203 · cited 1×
“[1,14,19] Standards in guidelines other than the CONSORT Statement include relatively more information about sample characteristics,[35,47] the extent to which trials differ from usual practice,[27] details about facilitative or obstructive aspects of the trial context,[48] and contextual factors related to feasibilit…”
MethodEgan, M., Bambra, C., Petticrew, M., & Whitehead, M. (2009) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2007.071233 · Cited by 203
Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.330.7499.1056 · Cited by 178 · cited 1×
“, those published in high impact journals) and which may be of better quality than articles published in low impact journals.[4,44] The reports assessed are probably representative of the best trial research in these disciplines.”
BackgroundImproving the reporting of public health intervention research: advancing TREND and CONSORT
Armstrong, R., Waters, E., Moore, L., Riggs, E., Cuervo, L. G., Lumbiganon, P., & Hawe, P. (2008) · Journal of Public Health · doi:10.1093/pubmed/fdm082 · Cited by 171 · cited 2×
“For example, the CONSORT Statement and its extensions have primarily focused on standards related to internal validity, but researchers are increasingly interested in the applicability of trial findings and have called for updated standards to improve the assessment of external validity.[14,15,16,17,18,19] For example…”
BackgroundBonell, C., Oakley, A., Hargreaves, J., Strange, V, & Rees, R. (2006) · BMJ · doi:10.1136/bmj.333.7563.346 · Cited by 165 · cited 6×
“For example, the CONSORT Statement and its extensions have primarily focused on standards related to internal validity, but researchers are increasingly interested in the applicability of trial findings and have called for updated standards to improve the assessment of external validity.[14,15,16,17,18,19] For example…”
BackgroundMethodInfluentialDescribing reporting guidelines for health research: a systematic review
Moher, D., Weeks, L., Ocampo, M., Seely, D., Sampson, M., Altman, D. G., Schulz, K. F., Miller, D., Simera, I., Grimshaw, J., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.09.013 · Cited by 151 · cited 5×
“We summarised adherence to recommended techniques for reporting guideline development as frequencies,[3,21] and we converted total citations of each guideline into median citations per year.”
BackgroundMethodInfluentialUsing Google Scholar to Estimate the Impact of Journal Articles in Education
van Aalst, J. (2010) · Educational Researcher · doi:10.3102/0013189x10371120 · Cited by 104 · cited 1×
“For each guideline, we also counted citations through November 2012 using Google Scholar, which provides a wide measure of impact across most publication mediums.[23] If a guideline was published in multiple journals or included an official explanatory document detailing how to adhere to its reporting standards, we co…”
MethodAndrew, E., Anis, A. H., Chalmers, T., Cho, M. K., Clarke, M. J., Felson, D. T., Gøtzsche, P. C., Greene, R., Jadad, A. R., Jonas, W. B., et al. (1994) · JAMA · doi:10.1001/jama.272.24.1926 · Cited by 90
Dechartres, A., Charles, P., Hopewell, S., Ravaud, P., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.015 · Cited by 86
Moher, D. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1040031 · Cited by 85 · cited 1×
“Implications The CONSORT Statement has been extended and modified in the past, and the CONSORT Group welcomes further extensions.[53] CONSORT guidelines have been developed and validated in the context of biomedical treatments; their applicaTable 4.”
BackgroundGuidelines for randomized clinical trial protocol content: a systematic review
Tetzlaff, J. M., Chan, A.-W., Kitchen, J., Sampson, M., Tricco, A. C., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-43 · Cited by 81 · cited 5×
“For practical reasons, we limited the search to guidelines available in English.”
BackgroundMethodInfluentialTreatment Fidelity in Social Work Intervention Research: A Review of Published Studies
Naleppa, M. J., & Cagle, J. G. (2010) · Research on Social Work Practice · doi:10.1177/1049731509352088 · Cited by 65 · cited 2×
“Several studies also indicate that deficiencies persist in the reporting of social and psychological intervention trials.[9,10,11,12,13] A common explanation is that current standards in prominent reporting guidelines are not adequately tailored to these trials.”
BackgroundClinical Trials in the Journal of Pediatric Psychology: Applying the CONSORT Statement
Stinson, J. N. (2003) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsg001 · Cited by 64 · cited 3×
“Several studies also indicate that deficiencies persist in the reporting of social and psychological intervention trials.[9,10,11,12,13] A common explanation is that current standards in prominent reporting guidelines are not adequately tailored to these trials.”
BackgroundThe impact of the CONSORT statement on reporting of randomized clinical trials in psychiatry
Han, C., Kwak, K.-P., Marks, D. M., Pae, C.-U., Wu, L.-T., Bhatia, K. S., Masand, P. S., & Patkar, A. A. (2009) · Contemporary Clinical Trials · doi:10.1016/j.cct.2008.11.004 · Cited by 62 · cited 2×
“Several studies also indicate that deficiencies persist in the reporting of social and psychological intervention trials.[9,10,11,12,13] A common explanation is that current standards in prominent reporting guidelines are not adequately tailored to these trials.”
BackgroundMethods of Randomized Controlled Clinical Trials in Health Services Research
BALAS, E. A., AUSTIN, S. M., EWIGMAN, B. G., BROWN, G. D., & MITCHELL, J. A. (1995) · MEDICAL CARE · doi:10.1097/00005650-199507000-00005 · Cited by 55 · cited 2×
“Previous Guidance Through the literature search (see Figure 1), we identified 19 unique, eligible reporting guidelines and reporting quality assessment tools (see Table 1) developed between 1980 and 2010 (median 2004).[6,9,26,27,28,29,30,31,32,33,34,35,36,37,38,39, 40,41,42] Six were developed by the CONSORT Group for…”
BackgroundPerry, A., Weisburd, D. L., & Hewitt, C. E. (2010) · Journal of Experimental Criminology · doi:10.1007/s11292-010-9099-z · Cited by 51 · cited 9×
“Coding rules were adapted from previous studies about trial reporting quality.[9,24] Before assessing the entire sample, the reviewers coded one trial report in each discipline and compared results to ensure consistent application of coding rules.”
BackgroundMethodInfluentialRandomized Controlled Trials To Investigate Occupational Therapy Research Questions
Nelson, D. L., & Mathiowetz, V. G. (2004) · American Journal of Occupational Therapy · doi:10.5014/ajot.58.1.24 · Cited by 47 · cited 3×
“Previous Guidance Through the literature search (see Figure 1), we identified 19 unique, eligible reporting guidelines and reporting quality assessment tools (see Table 1) developed between 1980 and 2010 (median 2004).[6,9,26,27,28,29,30,31,32,33,34,35,36,37,38,39, 40,41,42] Six were developed by the CONSORT Group for…”
BackgroundImproving the quality of reporting alcohol outcome studies: Effects of the CONSORT statement
Ladd, B. O., McCrady, B. S., Manuel, J. K., & Campbell, W. P. (2010) · Addictive Behaviors · doi:10.1016/j.addbeh.2010.02.009 · Cited by 37 · cited 3×
“Alcohol Outcome Studies Coding Sheet [26] 2010 AT Alcohol 36”
BackgroundMethodA comparison of randomised controlled trials in health and education
Torgerson, C. J., Torgerson, D. J., Birks, Y. F., & Porthouse, J. (2005) · British Educational Research Journal · doi:10.1080/01411920500314919 · Cited by 35
Gill, C. E. (2011) · Journal of Experimental Criminology · doi:10.1007/s11292-011-9122-z · Cited by 34 · cited 1×
“Members of previous CONSORT groups, journal editors, and researchers believe that stakeholders need to be included in guideline development to promote buy-in and to improve the relevance of CONSORT guidelines to disciplines outside medicine.[12,54] This review demonstrates that a unified set of standards could be appl…”
BackgroundPublic health evaluation: which designs work, for whom and under what circumstances?
Moore, L., & Moore, G. F. (2011) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2009.093211 · Cited by 34 · cited 1×
“For example, the CONSORT Statement and its extensions have primarily focused on standards related to internal validity, but researchers are increasingly interested in the applicability of trial findings and have called for updated standards to improve the assessment of external validity.[14,15,16,17,18,19] For example…”
BackgroundPerry, A., & Johnson, M. (2008) · Journal of Experimental Criminology · doi:10.1007/s11292-008-9051-7 · Cited by 33 · cited 2×
“Moreover, previous reviews about the reporting quality of these trials have consisted of small samples and have assessed reporting quality according to a narrow set of reporting standards.[12,13,20] We conducted a two-part study that examined:”
BackgroundMoberg-Mogren, E., & Nelson, D. L. (2006) · The American Journal of Occupational Therapy · doi:10.5014/ajot.60.2.226 · Cited by 33 · cited 3×
“Data Analysis Similar to previous studies,[9,24] we analysed guideline content by mapping identified reporting standards onto standards included in the CONSORT Statement in order to organise the checklist according to the common sections of a trial report (i.”
MethodEvaluating implementation fidelity in health information technology interventions.
Eisenstein, E. L., Lobach, D. F., Montgomery, P., Kawamoto, K., & Anstrom, K. J. (2007) · PubMed Central · Cited by 9
Self-citationBoutron, I., Moher, D., Altman, D. G., Schulz, K. F., & Ravaud, P. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.09.007 · Cited by 3
Research works printed but not linked: 1
- L Moore, 2002, Research design for the rigorous evaluation of complex educational interventions: Lessons from health services research, Building Research Capacity, 1, 4
Cited by
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Mayo-Wilson, E., Dias, S., Mavranezouli, I., Kew, K., Clark, D. M., Ades, A. E., & Pilling, S. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70329-3 · Cited by 680
Self-citationGottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015) · Prevention Science · doi:10.1007/s11121-015-0555-x · Cited by 627
“Unfortunately, reporting of interventions tested and the methods used to evaluate them is often suboptimal, even in our best journals (Grant et al. 2013), and this often makes it difficult to judge the quality of the evidence from potentially”
BackgroundMethodInfluentialLloyd-Evans, B., Mayo-Wilson, E., Harrison, B., Istead, H., Brown, E., Pilling, S., Johnson, S., & Kendall, T. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-39 · Cited by 558
Self-citationA systematic review and meta-analysis of psychological interventions to improve mental wellbeing
van Agteren, J., Iasiello, M., Lo, L., Bartholomaeus, J., Kopsaftis, Z., Carey, M., & Kyrios, M. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01093-w · Cited by 510
Metadata
- Authors
- Grant, S. P., Mayo-Wilson, E., Melendez-Torres, G. J., & Montgomery, P.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Grant, Sean P.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-05-29
- Volume
- 8
- Issue
- 5
- Pages
- e65442
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3666983
- OpenAlex
- W2162696461
- Cited by
- 111
- References
- 62
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 2 · 2023: 10 · 2022: 9 · 2021: 16 · 2020: 5 · 2019: 7 · 2018: 9 · 2017: 9 · 2016: 8 · 2015: 8 · 2014: 11 · 2013: 10
- FWCI
- 2.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Funders
- Economic and Social Research Council (ES/K00087X/1)
- Clarendon Fund
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- reporting guidelines, reporting quality, complex interventions, CONSORT extension, randomised trials, blinding, allocation concealment
- MeSH terms
- Mental Disorders, Humans, Research Design, Social Adjustment, Randomized Controlled Trials as Topic, Guidelines as Topic, Information Dissemination, Biomedical Research, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


