Methodology and reporting of systematic reviews and meta-analyses of observational studies in psychiatric epidemiology: Systematic review
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Background: Relatively little is known of the use of systematic review and synthesis methods of non-randomised psychiatric epidemiological studies, which play a vital role in aetiological research, planning and policy-making. Aims: To evaluate reviews of psychiatric epidemiological studies of functional mental disorders that employed synthesis methods such as systematic review or meta-analysis, or other forms of quantitative review. Method: We searched the literature to identify appropriate reviews published during the period 1996 to April 2009. Selected reviews were evaluated using published review guidelines. Results: We found 106 reviews in total, of which 38 (36%) did not mention method of data abstraction from primary studies at all. Many failed to mention study quality, publication bias, bias and confounding. In 73 studies that performed a meta-analysis, 58 (79%) tested for heterogeneity and of these, 47 found significant heterogeneity. Studies that detected heterogeneity made some allowance for this. A major obstacle facing reviewers is the wide variation between primary studies in the use of instruments to measure outcomes and in sampling methods used. Conclusions: Many deficiencies found in systematic reviews are potentially remediable, although synthesis of primary study findings in a field characterised by so many sources of heterogeneity will remain challenging.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Prevalence of Comorbid Depression in Adults With Diabetes
Anderson, R. J., Freedland, K. E., Clouse, R. E., & Lustman, P. J. (2001) · Diabetes Care · doi:10.2337/diacare.24.6.1069 · Cited by 3,926
(2004) · JAMA · doi:10.1001/jama.291.21.2581 · Cited by 3,448 · cited 1×
“69,70 Comparing the two periods of our review for trends in the quality and characteristics of meta-analyses in psychiatric epidemiology, few clear-cut trends emerged.”
Rates and risk of postpartum depression – a meta-analysis
O'hara, M. W., & Swain, A. M. (1996) · International Review of Psychiatry · doi:10.3109/09540269609037816 · Cited by 3,116
Pinquart, M., & Sörensen, S. (2003) · Psychology and Aging · doi:10.1037/0882-7974.18.2.250 · Cited by 2,857
Socioeconomic inequalities in depression: a meta-analysis
Lorant, V. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwf182 · Cited by 2,603
King, M., Semlyen, J., Tai, S. S., Killaspy, H., Osborn, D., Popelyuk, D., & Nazareth, I. (2008) · BMC Psychiatry · doi:10.1186/1471-244x-8-70 · Cited by 2,300 · cited 1×
“33–35 Out of the 26 studies that synthesised prevalence, 14 found significant heterogeneity in their estimates and 5 discussed heterogeneity without formally testing for it.”
Fazel, M., Wheeler, J., & Danesh, J. (2005) · The Lancet · doi:10.1016/s0140-6736(05)61027-6 · Cited by 2,292
Schizophrenia: A Concise Overview of Incidence, Prevalence, and Mortality
McGrath, J., Saha, S., Chant, D., & Welham, J. (2008) · Epidemiologic Reviews · doi:10.1093/epirev/mxn001 · Cited by 2,280
Serious mental disorder in 23 000 prisoners: a systematic review of 62 surveys
Fazel, S., & Danesh, J. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07740-1 · Cited by 2,201 · cited 3×
“20,38,39 However, in one review this led to larger confidence intervals, which might be due to the limited number of studies available for inclusion, with the result that the review was less conclusive.”
A Systematic Review of the Prevalence of Schizophrenia
Saha, S., Chant, D., Welham, J., & McGrath, J. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020141 · Cited by 2,168
Cited by
The global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013
Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J. W., Patel, V., & Silove, D. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu038 · Cited by 2,846
Vilagut, G., Forero, C. G., Barbaglia, G., & Alonso, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155431 · Cited by 982
Self-citationParenting behavior and the risk of becoming a victim and a bully/victim: A meta-analysis study
Lereya, S. T., Samara, M., & Wolke, D. (2013) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2013.03.001 · Cited by 629
Slade, T., Chapman, C., Swift, W., Keyes, K., Tonks, Z., & Teesson, M. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011827 · Cited by 463
“22 The final reporting was informed by the findings of a systematic review of meta-analyses of observational studies in psychiatric epidemiology.(23) We used EppiReviewer V.”
MethodSuicide by occupation: Systematic review and meta-analysis
Milner, A., Spittal, M. J., Pirkis, J., & LaMontagne, A. D. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.113.128405 · Cited by 387
Systematic review adherence to methodological or reporting quality
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis-Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0527-2 · Cited by 322
“Other studies have also found that methodological and reporting quality is suboptimal [2, 84, 85].”
Challenges in meta-analyses with observational studies
Metelli, S., & Chaimani, A. (2020) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300129 · Cited by 290
Marchevsky, A. M., & Wick, M. R. (2015) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2014-0106-ra · Cited by 26
Metadata
- Authors
- Brugha, T. S., Matthews, R., Morgan, Z., Hill, T., Alonso, J., & Jones, D. R.
- Venue
- British Journal of Psychiatry
- Publisher
- Royal College of Psychiatrists
- Published
- 2012-06
- Volume
- 200
- Issue
- 6
- Pages
- 446-453
- ISSN
- 0007-1250 (ISSN-L)
- 1472-1465
- OpenAlex
- W2133610505
- Cited by
- 50
- References
- 40
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.