The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.
Quality assessment with diverse studies (QuADS): an appraisal tool for methodological and reporting quality in systematic reviews of mixed- or multi-method studies
Open accessAbstract
Background: In the context of the volume of mixed- and multi-methods studies in health services research, the present study sought to develop an appraisal tool to determine the methodological and reporting quality of such studies when included in systematic reviews. Evaluative evidence regarding the design and use of our existing Quality Assessment Tool for Studies with Diverse Designs (QATSDD) was synthesised to enhance and refine it for application across health services research. Methods: Secondary data were collected through a literature review of all articles identified using Google Scholar that had cited the QATSDD tool from its inception in 2012 to December 2019. First authors of all papers that had cited the QATSDD (n=197) were also invited to provide further evaluative data via a qualitative online survey. Evaluative findings from the survey and literature review were synthesised narratively and these data used to identify areas requiring refinement. The refined tool was subject to inter-rater reliability, face and content validity analyses. Results: Key limitations of the QATSDD tool identified related to a lack of clarity regarding scope of use of the tool and in the ease of application of criteria beyond experimental psychological research. The Quality Appraisal for Diverse Studies (QuADS) tool emerged as a revised tool to address the limitations of the QATSDD. The QuADS tool demonstrated substantial inter-rater reliability (k=0.66), face and content validity for application in systematic reviews with mixed, or multi-methods health services research. Conclusion: Our findings highlight the perceived value of appraisal tools to determine the methodological and reporting quality of studies in reviews that include heterogeneous studies. The QuADS tool demonstrates strong reliability and ease of use for application to multi or mixed-methods health services research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Connolly, F., Byrne, D., Lydon, S., Walsh, C., & O'Connor, P. (2017) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzx148 · Cited by 40,211
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737 · cited 1×
“other tools that focused on appraising the methodological quality to provide an expanded analysis where needed [100].”
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070
Standard Quality Assessment Criteria for Evaluating Primary Research Papers from a Variety of Fields
Kmet, L. M., Cook, L. S., & Lee, R. C. (2004) · University of Alberta Library · doi:10.7939/r37m04f16 · Cited by 1,682
Pace, R., Pluye, P., Bartlett, G., Macaulay, A. C., Salsberg, J., Jagosh, J., & Seller, R. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.07.002 · Cited by 1,331
Improving the content validity of the mixed methods appraisal tool: a modified e-Delphi study
Hong, Q. N., Pluye, P., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.03.008 · Cited by 1,082 · cited 1×
“across a diverse range of study designs [99].”
How can systematic reviews incorporate qualitative research? A critical perspective
Dixon-Woods, M., Bonas, S., Booth, A., Jones, D. R., Miller, T., Sutton, A. J., Shaw, R. L., Smith, J. A., & Young, B. (2006) · Qualitative Research · doi:10.1177/1468794106058867 · Cited by 860
Mixed Method Design: Principles and Procedures
Morse, J. M. (2019) · Cited by 782
Reviewing studies with diverse designs: the development and evaluation of a new tool
Sirriyeh, R., Lawton, R., Gardner, P., & Armitage, G. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2011.01662.x · Cited by 715
Self-citationGuidance on the conduct of narrative synthesis in sytematic reviews
Popay, J., Roberts, H. M., Sowden, A. J., Petticrew, M. P., Arai, L., Rodgers, M., & Britten, N. (2006) · Cited by 690
Cited by
Oxidative Stress in Type 2 Diabetes: Impacts from Pathogenesis to Lifestyle Modifications
Caturano, A., D’Angelo, M., Mormone, A., Russo, V., Mollica, M. P., Salvatore, T., Galiero, R., Rinaldi, L., Vetrano, E., Marfella, R., et al. (2023) · Current Issues in Molecular Biology · doi:10.3390/cimb45080420 · Cited by 579
Meunier, P.-Y., Raynaud, C., Guimaraes, E., Gueyffier, F., & Letrilliart, L. (2023) · The Annals of Family Medicine · doi:10.1370/afm.2908 · Cited by 149
Clinical signs in functional cognitive disorders: A systematic review and diagnostic meta-analysis
Cabreira, V., Frostholm, L., McWhirter, L., Stone, J., & Carson, A. (2023) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2023.111447 · Cited by 43
Alwadi, M. A., AlJameel, A. H., Baker, S. R., & Owens, J. (2024) · BMC Oral Health · doi:10.1186/s12903-024-04767-9 · Cited by 29
Churruca, K., Falkland, E., Saba, M., Ellis, L. A., & Braithwaite, J. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-09857-y · Cited by 18
Metadata
- Authors
- Harrison, R., Jones, B., Gardner, P., & Lawton, R.
- Venue
- BMC Health Services Research
- Published
- 2021-02-15
- Volume
- 21
- Issue
- 1
- Pages
- 144-144
- ISSN
- 1472-6963 (ISSN-L)
- OpenAlex
- W3131481318
- Cited by
- 480
- References
- 95
- FWCI
- 1.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quality assessment with diverse studies (QuADS): an appraisal tool for methodological and reporting quality in systematic reviews of mixed- or multi-method studies. https://app.cochat.ai/papers/10.1186/s12913-021-06122-y
- The paper
- Harrison, R., Jones, B., Gardner, P., & Lawton, R. (2021). Quality assessment with diverse studies (QuADS): an appraisal tool for methodological and reporting quality in systematic reviews of mixed- or multi-method studies. BMC Health Services Research. https://doi.org/10.1186/s12913-021-06122-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.