The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index; 1 of the 12 sources its claims cite were checked for support.
Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence
Open accessAbstract
BACKGROUND: Systematic reviews of qualitative and quantitative evidence can provide a rich understanding of complex phenomena. This type of review is increasingly popular, has been used to provide a landscape of existing knowledge, and addresses the types of questions not usually covered in reviews relying solely on either quantitative or qualitative evidence. Although several typologies of synthesis designs have been developed, none have been tested on a large sample of reviews. The aim of this review of reviews was to identify and develop a typology of synthesis designs and methods that have been used and to propose strategies for synthesizing qualitative and quantitative evidence. METHODS: A review of systematic reviews combining qualitative and quantitative evidence was performed. Six databases were searched from inception to December 2014. Reviews were included if they were systematic reviews combining qualitative and quantitative evidence. The included reviews were analyzed according to three concepts of synthesis processes: (a) synthesis methods, (b) sequence of data synthesis, and (c) integration of data and synthesis results. RESULTS: A total of 459 reviews were included. The analysis of this literature highlighted a lack of transparency in reporting how evidence was synthesized and a lack of consistency in the terminology used. Two main types of synthesis designs were identified: convergent and sequential synthesis designs. Within the convergent synthesis design, three subtypes were found: (a) data-based convergent synthesis design, where qualitative and quantitative evidence is analyzed together using the same synthesis method, (b) results-based convergent synthesis design, where qualitative and quantitative evidence is analyzed separately using different synthesis methods and results of both syntheses are integrated during a final synthesis, and (c) parallel-results convergent synthesis design consisting of independent syntheses of qualitative and quantitative evidence and an interpretation of the results in the discussion. CONCLUSIONS: Performing systematic reviews of qualitative and quantitative evidence is challenging because of the multiple synthesis options. The findings provide guidance on how to combine qualitative and quantitative evidence. Also, recommendations are made to improve the conducting and reporting of this type of review.
Overview
CoChat Summary
TL;DR
This review of reviews of 459 systematic mixed studies reviews identified two main synthesis designs—convergent and sequential—with three convergent subtypes: data-based, results-based, and parallel-results. It also documents substantial gaps in reporting synthesis methods, terminology, and justification for combining qualitative and quantitative evidence.
Key findings
- From 7003 records, 459 systematic mixed studies reviews were included; publications rose from nearly 10 per year to more than 100 per year over the preceding decade.
- Convergent designs dominated: data-based convergent 69.7%, parallel-results convergent 17.2%, and results-based convergent 8.5%; sequential synthesis designs were found in 4.6% of reviews.
- Reporting was often incomplete: only 24% (n = 110) gave a clear rationale for combining quantitative and qualitative evidence, and only 39% (n = 179) fully described synthesis methods with methodological references; 90 reviews provided no synthesis information.
- The most commonly mentioned synthesis method was thematic synthesis (n = 129), followed by narrative synthesis (n = 64), narrative summary (n = 30), content analysis (n = 30), meta-analysis (n = 27), and meta-synthesis (n = 25).
Methods
- A review of systematic reviews combining qualitative and quantitative evidence was conducted; six databases (Medline, PsycInfo, Embase, CINAHL, AMED, Web of Science) were searched from inception to December 8, 2014, with free-text searching and English/French limits.
- Reviews were included if they combined qualitative, quantitative, and/or mixed methods studies, described search and selection strategies, and appraised included studies; a three-step selection process with independent screening was used.
- Data were extracted in NVivo 10 and analyzed using visual mapping and a deductive-inductive “process-data conceptualization” focused on synthesis methods, sequence of data synthesis, and integration of data and synthesis results.
Limitations
- The authors state the search was not comprehensive: it was limited to six mainly health-related databases, no hand searching was performed, and only peer-reviewed journal articles were included, potentially missing gray literature or conference abstracts.
- The authors also state that synthesis methods were not classified as aggregative versus configurative, and that interpretation of some synthesis methods was debatable.
- Evident from the text: data extraction was performed by one reviewer, and the included reviews were not critically appraised for quality, although the authors justify this by focusing on synthesis processes rather than review findings.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
1 Valid · 0 Not valid · 9 Not checked · 55 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, a focus on quantitative evidence is insufficient in areas where research is not dominated by RCTs [2].”
§ Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence > Background
What the sources say
- Supportedcites [2] Goldsmith MR, Bankhead CR, Austoker J. Synthesising quantitative and qualitative research in evidence-based patient information. J Epidemiol Community Health. 2007;61(3):262–70. doi: 10.1136/jech.2006.046110 . source
The 'LIMITATIONS OF TRADITIONAL HIERARCHIES OF EVIDENCE' section states that hierarchies taking the randomised trial as the premier form of evidence 'become problematic in areas of research dominated by nontrial quantitative evidence', and that wider questions ('How does it work?', 'What are patients' experiences?') are 'best answered by evidence from a variety of sources'. The 'QUALITATIVE RESEARCH' section adds that qualitative evidence answers questions 'not easily evaluated by experimental studies' and may 'inform evidence-based practice independently of other research methodologies', and 'IMPORTANCE OF A RANGE OF EVIDENCE' frames synthesis of different research types as an unresolved methodological need. Together these carry the paraphrased point that a purely quantitative/RCT-centred focus is insufficient where research is not RCT-dominated. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only 39% (n = 179) of included reviews provided a full description of the synthesis method(s) with methodological references.”
§ Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence > Results > Description of included reviews
plainn = 179- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Two main types of synthesis designs were identified: convergent and sequential synthesis designs.”
- Also stated in: § Synthesis of results · plain
“Based on the sequence and integration concepts, two main types of synthesis designs were identified (Fig. 3): convergent and sequential synthesis designs.”
§ Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Synthesis of results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Among the SMSRs that provided information on the synthesis methods, the most common method mentioned was thematic synthesis (n = 129)”
§ Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence > Results > Description of included reviews
plainn = 129- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Within the convergent synthesis design, three subtypes were found: data-based, results-based, and parallel-results convergent synthesis designs.”
§ Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence > Results > Synthesis of results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
24 more claims
Create a free account to see all 65 claims and to verify the 11 references still open.
- Probably not a substantial claim. 20
- It may state two separate claims as one. 23
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“a data-driven convergent synthesis approach was selected for thematic syntheses of LLM applications and limitations in patient care19.”
From Current applications and challenges in large language models for patient care: a systematic review (2025) · cites this paper as [19]
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601 · cited 1×
“Qualitative content analysis [29] To understand a phenomenon of interest by focusing on the manifest (patent) content or contextual meaning of text.”
BackgroundContent Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
The integrative review: updated methodology
Whittemore, R., & Knafl, K. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03621.x · Cited by 10,241 · cited 3×
“Whittemore R, Knafl K.”
BackgroundMethodMethods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Achieving integration in mixed methods designs-principles and practices
Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013) · Health Services Research · doi:10.1111/1475-6773.12117 · Cited by 7,219 · cited 1×
“and the interpretation and reporting [35, 36].”
(2006) · Cited by 7,081
Strategies for Theorizing from Process Data
Langley, A. (1999) · The Academy of Management Review · doi:10.5465/amr.1999.2553248 · Cited by 7,008 · cited 1×
“Thus, a “process-data conceptualization” was conducted [16] using a deductive-inductive approach, i.”
MethodPrimary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 1×
“Secondary analysis is used to designate the reanalysis of primary data to answer new questions [52] Table 1 Typology of synthesis designs suggested in the literature”
MethodRealist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 1×
“Realist synthesis [67, 68] To unpack how interventions work in particular contexts through theoretical explanation (middle-range theory).”
BackgroundConfigurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques
Rihoux, B., & Ragin, C. (2009) · SAGE Publications · doi:10.4135/9781452226569 · Cited by 3,089
Research works printed but not linked: 5
- Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A. Integrative approaches to qualitative and quantitative evidence. London, UK: Health Development Agency; 2004. Report No.: 1842792555.
- Plano Clark VL, Ivankova NV. Mixed methods research: a guide to the field. SAGE mixed methods research series. Thousand Oaks: SAGE Publications; 2015.
- Neuendorf KA. The content analysis guidebook. Thousand Oaks: SAGE Publications; 2002.
- Creswell JW. Research design: qualitative, quantitative, and mixed methods approaches. Thousand Oaks: SAGE Publications; 2013.
- Denzin NK, Lincoln YS. The Sage handbook of qualitative research. Thousand Oaks: SAGE Publications; 2005.
Cited by
Time to challenge the spurious hierarchy of systematic over narrative reviews?
Greenhalgh, T., Thorne, S., & Malterud, K. (2018) · European Journal of Clinical Investigation · doi:10.1111/eci.12931 · Cited by 1,267
Hong, Q. N., Gonzalez‐Reyes, A., & Pluye, P. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12884 · Cited by 1,107
“The first label refers to combining qualitative, quantitative, and/or mixed methods studies, while the second one can also refer to combining qualitative and quantitative methods (such as thematic synthesis and meta‐analysis).(7) Hereinafter, we will use the term “systematic mixed studies reviews” to designate this ty…”
MethodSelf-citationImproving the content validity of the mixed methods appraisal tool: a modified e-Delphi study
Hong, Q. N., Pluye, P., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.03.008 · Cited by 1,082
“The first was a review of systematic mixed studies reviews that was carried out in 2015 [22].”
BackgroundMethodSelf-citationMethodological guidance for the conduct of mixed methods systematic reviews
Stern, C., Lizarondo, L., Carrier, J., Godfrey, C., Rieger, K., Salmond, S., Apóstolo, J., Kirkpatrick, P., & Loveday, H. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-19-00169 · Cited by 700
“Since the introduction of this guidance, there have been significant developments in the area of mixed methods synthesis.(13,15,17,23-25) As such, the methodology group recognized the need to revise the guidance to ensure it was accurate and aligned with the current evidence base.”
InfluentialNoyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497
Metadata
- Authors
- Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M.
- Affiliations
- McGill University (CA)
- Corresponding author
- Hong, Quan Nha
- Venue
- Systematic Reviews
- Published
- 2017-03-23
- Volume
- 6
- Issue
- 1
- Pages
- 61-61
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC5364694
- OpenAlex
- W2599225410
- Semantic Scholar
- 7d52e90b26094da10fe066037dcdcf7e8742aea0
- Cited by
- 754
- References
- 72
- Citations by year
- 2026: 72 · 2025: 104 · 2024: 139 · 2023: 118 · 2022: 90 · 2021: 109 · 2020: 69 · 2019: 34 · 2018: 14 · 2017: 4
- FWCI
- 8.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship@McGill (McGill) (submittedVersion, cc-by)
- Funders
- Fonds de Recherche du Québec - Santé (29308)
- Canadian Institutes of Health Research (301011)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Education › Qualitative Research Methods and Applications
- Keywords
- convergent synthesis, sequential synthesis, reporting transparency, terminology consistency
- MeSH terms
- Evaluation Studies as Topic, Humans, Research Design, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence. https://app.cochat.ai/papers/10.1186/s13643-017-0454-2
- The paper
- Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017). Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence. Systematic Reviews. https://doi.org/10.1186/s13643-017-0454-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.