Methodology and reporting of systematic reviews and meta-analyses of observational studies in psychiatric epidemiology: Systematic review
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Background: Relatively little is known of the use of systematic review and synthesis methods of non-randomised psychiatric epidemiological studies, which play a vital role in aetiological research, planning and policy-making. Aims: To evaluate reviews of psychiatric epidemiological studies of functional mental disorders that employed synthesis methods such as systematic review or meta-analysis, or other forms of quantitative review. Method: We searched the literature to identify appropriate reviews published during the period 1996 to April 2009. Selected reviews were evaluated using published review guidelines. Results: We found 106 reviews in total, of which 38 (36%) did not mention method of data abstraction from primary studies at all. Many failed to mention study quality, publication bias, bias and confounding. In 73 studies that performed a meta-analysis, 58 (79%) tested for heterogeneity and of these, 47 found significant heterogeneity. Studies that detected heterogeneity made some allowance for this. A major obstacle facing reviewers is the wide variation between primary studies in the use of instruments to measure outcomes and in sampling methods used. Conclusions: Many deficiencies found in systematic reviews are potentially remediable, although synthesis of primary study findings in a field characterised by so many sources of heterogeneity will remain challenging.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Prevalence of Comorbid Depression in Adults With Diabetes
Anderson, R. J., Freedland, K. E., Clouse, R. E., & Lustman, P. J. (2001) · Diabetes Care · doi:10.2337/diacare.24.6.1069 · Cited by 3,926
(2004) · JAMA · doi:10.1001/jama.291.21.2581 · Cited by 3,448 · cited 1×
“69,70 Comparing the two periods of our review for trends in the quality and characteristics of meta-analyses in psychiatric epidemiology, few clear-cut trends emerged.”
Rates and risk of postpartum depression – a meta-analysis
O'hara, M. W., & Swain, A. M. (1996) · International Review of Psychiatry · doi:10.3109/09540269609037816 · Cited by 3,116
Pinquart, M., & Sörensen, S. (2003) · Psychology and Aging · doi:10.1037/0882-7974.18.2.250 · Cited by 2,857
Socioeconomic inequalities in depression: a meta-analysis
Lorant, V. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwf182 · Cited by 2,603
King, M., Semlyen, J., Tai, S. S., Killaspy, H., Osborn, D., Popelyuk, D., & Nazareth, I. (2008) · BMC Psychiatry · doi:10.1186/1471-244x-8-70 · Cited by 2,300 · cited 1×
“33–35 Out of the 26 studies that synthesised prevalence, 14 found significant heterogeneity in their estimates and 5 discussed heterogeneity without formally testing for it.”
Fazel, M., Wheeler, J., & Danesh, J. (2005) · The Lancet · doi:10.1016/s0140-6736(05)61027-6 · Cited by 2,292
Schizophrenia: A Concise Overview of Incidence, Prevalence, and Mortality
McGrath, J., Saha, S., Chant, D., & Welham, J. (2008) · Epidemiologic Reviews · doi:10.1093/epirev/mxn001 · Cited by 2,280
Serious mental disorder in 23 000 prisoners: a systematic review of 62 surveys
Fazel, S., & Danesh, J. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07740-1 · Cited by 2,201 · cited 3×
“20,38,39 However, in one review this led to larger confidence intervals, which might be due to the limited number of studies available for inclusion, with the result that the review was less conclusive.”
A Systematic Review of the Prevalence of Schizophrenia
Saha, S., Chant, D., Welham, J., & McGrath, J. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020141 · Cited by 2,168
Antenatal risk factors for postpartum depression: a synthesis of recent literature
Robertson, E., Grace, S., Wallington, T., & Stewart, D. E. (2004) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2004.02.006 · Cited by 1,886
Prevalence of Depression During Pregnancy: Systematic Review
Bennett, H. A., Einarson, A., Taddio, A., Koren, G., & Einarson, T. R. (2004) · Obstetrics & Gynecology · doi:10.1097/01.aog.0000116689.75396.5f · Cited by 1,725
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Empirical assessment of effect of publication bias on meta-analyses
Sutton, A. J. (2000) · BMJ · doi:10.1136/bmj.320.7249.1574 · Cited by 1,398
Risk Factors for Depression Among Elderly Community Subjects: A Systematic Review and Meta-Analysis
Cole, M. G., & Dendukuri, N. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.6.1147 · Cited by 1,368
Schizophrenia and migration: A meta-analysis and review
Cantor-Graae, E., & Selten, J.-P. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.1.12 · Cited by 1,237
Gaynes, B. N., Gavin, N., Meltzer-Brody, S., Lohr, K. N., Swinson, T., Gartlehner, G., Brody, S., & Miller, W. C. (2005) · PsycEXTRA Dataset · doi:10.1037/e439372005-001 · Cited by 1,211
Prevalence and incidence studies of anxiety disorders: A systematic review of the literature
Somers, J. M., Goldner, E. M., Waraich, P., & Hsu, L. (2006) · The Canadian Journal of Psychiatry · doi:10.1177/070674370605100206 · Cited by 1,114
Pinquart, M., & Sörensen, S. (2003) · The Journals of Gerontology: Series B · doi:10.1093/geronb/58.2.p112 · Cited by 1,108
Fazel, S., Khosla, V., Doll, H., & Geddes, J. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050225 · Cited by 1,033
Is there an epidemic of child or adolescent depression?
Jane Costello, E., Erkanli, A., & Angold, A. (2006) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2006.01682.x · Cited by 983 · cited 1×
“14,37 In only 4 of these reviews of prevalence studies 34,38–40 was heterogeneity largely eliminated, for example by providing estimates for women only, 39 and by removing outliers that appeared to explain heterogeneity, 34,40 such as high-and low-risk samples, differences in period or point…”
Bonde, J. P. E. (2008) · Occupational and Environmental Medicine · doi:10.1136/oem.2007.038430 · Cited by 919
Kuehner, C. (2003) · Acta Psychiatrica Scandinavica · doi:10.1034/j.1600-0447.2003.00204.x · Cited by 839
Medically Unexplained Physical Symptoms, Anxiety, and Depression: A Meta-Analytic Review
Henningsen, P., Zimmermann, T., & Sattel, H. (2003) · Psychosomatic Medicine · doi:10.1097/01.psy.0000075977.90337.e7 · Cited by 829
Sex Differences in the Risk of Schizophrenia: Evidence From Meta-analysis
Aleman, A., Kahn, R. S., & Selten, J.-P. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.6.565 · Cited by 818
Prevalence of anxiety in adults with diabetes
Grigsby, A. B., Anderson, R. J., Freedland, K. E., Clouse, R. E., & Lustman, P. J. (2002) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(02)00417-8 · Cited by 609
Cuijpers, P., & Smit, F. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2004.00301.x · Cited by 595
Prevalence and Incidence Studies of Mood Disorders: A Systematic Review of the Literature
Waraich, P., Goldner, E. M., Somers, J. M., & Hsu, L. (2004) · The Canadian Journal of Psychiatry · doi:10.1177/070674370404900208 · Cited by 522
Kessler, R. C., Abelson, J., Demler, O., Escobar, J. I., Gibbon, M., Guyer, M. E., Howes, M. J., Jin, R., Vega, W. A., Walters, E. E., et al. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.169 · Cited by 489
A systematic review of the epidemiology of somatisation disorder and hypochondriasis
Creed, F., & Barsky, A. (2004) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(03)00622-6 · Cited by 421
Depressive disorders in caregivers of dementia patients: A systematic review
Cuijpers, P. (2005) · Aging & Mental Health · doi:10.1080/13607860500090078 · Cited by 414
Obesity effects on depression: systematic review of epidemiological studies
Atlantis, E., & Baker, M. (2008) · International Journal of Obesity · doi:10.1038/ijo.2008.54 · Cited by 399
The epidemiology of depersonalisation and derealisation
Sierra, M., David, A. S., & Hunter, E. C. M. (2004) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-004-0701-4 · Cited by 316
Prevalence of depression in patients with chronic obstructive pulmonary disease: a systematic review
van Ede, L., Yzermans, C. J., & Brouwer, H. J. (1999) · Thorax · doi:10.1136/thx.54.8.688 · Cited by 287
Excessive reassurance seeking, depression, and interpersonal rejection: A meta-analytic review.
Starr, L. R., & Davila, J. (2008) · Journal of Abnormal Psychology · doi:10.1037/a0013866 · Cited by 251
Posternak, M. A., & Miller, I. (2001) · Journal of Affective Disorders · doi:10.1016/s0165-0327(00)00304-9 · Cited by 215
Psychiatric disorders in parents of children with autism: a meta-analysis
Yirmiya, N., & Shaked, M. (2005) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2004.00334.x · Cited by 198
BRUGHA, T. S., BEBBINGTON, P. E., & JENKINS, R. (1999) · Psychological Medicine · doi:10.1017/s0033291799008880 · Cited by 191
Self-citationRelations among peritraumatic dissociation and posttraumatic stress: A meta-analysis
Lensvelt-Mulders, G., van der Hart, O., van Ochten, J. M., van Son, M. J. M., Steele, K., & Breeman, L. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2008.03.006 · Cited by 175
Meta‐analyses of the incidence and prevalence of schizophrenia: conceptual and methodological issues
Saha, S., Chant, D., & Mcgrath, J. (2008) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.240 · Cited by 130 · cited 3×
“…Saha et al also cautioned against the use of standard methods of meta-analysis compared with simpler methods of representing prevalence findings from different studies, 15,18 for example using median values, 18 and graphical representations of the variation of estimates around the central value.”
Cited by
The global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013
Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J. W., Patel, V., & Silove, D. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu038 · Cited by 2,846
Vilagut, G., Forero, C. G., Barbaglia, G., & Alonso, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155431 · Cited by 982
Self-citationParenting behavior and the risk of becoming a victim and a bully/victim: A meta-analysis study
Lereya, S. T., Samara, M., & Wolke, D. (2013) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2013.03.001 · Cited by 629
Slade, T., Chapman, C., Swift, W., Keyes, K., Tonks, Z., & Teesson, M. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011827 · Cited by 463
“22 The final reporting was informed by the findings of a systematic review of meta-analyses of observational studies in psychiatric epidemiology.(23) We used EppiReviewer V.”
MethodSuicide by occupation: Systematic review and meta-analysis
Milner, A., Spittal, M. J., Pirkis, J., & LaMontagne, A. D. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.113.128405 · Cited by 387
Metadata
- Authors
- Brugha, T. S., Matthews, R., Morgan, Z., Hill, T., Alonso, J., & Jones, D. R.
- Venue
- British Journal of Psychiatry
- Publisher
- Royal College of Psychiatrists
- Published
- 2012-06
- Volume
- 200
- Issue
- 6
- Pages
- 446-453
- ISSN
- 0007-1250 (ISSN-L)
- 1472-1465
- OpenAlex
- W2133610505
- Cited by
- 50
- References
- 40
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.