The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index; 2 of the 26 sources its claims cite were checked for support.
Abstract
INTRODUCTION: Appraising the quality of studies included in systematic reviews combining qualitative and quantitative evidence is challenging. To address this challenge, a critical appraisal tool was developed: the Mixed Methods Appraisal Tool (MMAT). The aim of this paper is to present the enhance ments made to the MMAT. DEVELOPMENT: The MMAT was initially developed in 2006 based on a literature review on systematic reviews combining qualitative and quantitative evidence. It was subject to pilot and interrater reliability testing. A revised version of the MMAT was developed in 2018 based on the results from usefulness testing, a literature review on critical appraisal tools and a modified e-Delphi study with methodological experts to identify core criteria. TOOL DESCRIPTION: The MMAT assesses the quality of qualitative, quantitative, and mixed methods studies. It focuses on methodological criteria and includes five core quality criteria for each of the following five categories of study designs: (a) qualitative, (b) randomized controlled, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods. CONCLUSION: The MMAT is a unique tool that can be used to appraise the quality of different study designs. Also, by limiting to core criteria, the MMAT can provide a more efficient appraisal.
Overview
CoChat Summary
TL;DR
This paper presents version 2018 of the Mixed Methods Appraisal Tool (MMAT), a single critical appraisal tool for assessing the methodological quality of qualitative, quantitative, and mixed methods studies in mixed studies reviews. It describes the tool's 25 criteria across five study design categories, its development history, and guidance for use.
Key findings
The MMAT version 2018 includes a total of 25 criteria and 2 screening questions, covering five categories of study designs: (a) qualitative, (b) randomized controlled trial, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods, with five core criteria per category rated as yes, no, or can't tell. The tool was developed from a 2006 first version (15 criteria across four categories), revised in 2011, and further revised into the 2018 version based on usefulness testing with 20 researchers, a literature review on critical appraisal tools, and a modified e-Delphi study with 73 methodological experts. Two interrater reliability studies used 32 and 261 papers respectively and showed the need to clarify criteria, particularly for nonrandomized and qualitative studies. The paper argues the MMAT offers a time-efficient alternative by limiting to core criteria and uniquely includes specific criteria for mixed methods studies, though its criteria are harder to judge because they target methodological rather than reporting quality.
Methods
This is a tool description paper (third in a three-part series on systematic reviews for information professionals) rather than an empirical study; it narrates the development of the MMAT and explains how to apply it. Development drew on a literature review on mixed studies reviews, pilot testing in workshops with four reviewers appraising six studies, two interrater reliability studies (32 and 261 papers), usefulness testing via interviews with 20 researchers, a literature review on critical appraisal tools, and a modified e-Delphi study with 73 methodological experts. Use involves three steps: two optional screening questions, selection of the appropriate design category (or categories), and rating each criterion as yes, no, or can't tell, with detailed presentation of ratings advised over an overall numerical score.
Limitations
The paper states that revision of the MMAT has so far focused on content validity and usefulness, and that further testing on its validity and reliability will be needed; it also notes that modifications may be necessary as evidence develops. It states that MMAT criteria are more difficult to judge than other appraisal tools because they focus on methodological quality rather than reporting quality. Evident from the text: the tool's development evidence base is described only in summary form, with reliability and validity results reported by reference to prior studies rather than presented here.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 0 Not valid · 18 Not checked · 11 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“To further its development, usefulness testing was performed by interviewing 20 researchers who have used the MMAT in a systematic review or have contacted the developer of the tool for questions or permission to use the tool (18).”
What the sources say
- Supportedcites [18] 18. Hong QN, Gonzalez-Reyes A, Pluye P. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT). J Eval Clin Pract. 2018;24(3):459-67. source
The Abstract reports semi-structured interviews with 20 participants to explore the MMAT’s usefulness. The Study Participants section says researchers were recruited through systematic reviews that used the MMAT and a list of people who had contacted its developer for permission or guidance. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The results of this study were helpful to identify changes to be made in the MMAT.”
What the sources say
- Supportedcites [18] 18. Hong QN, Gonzalez-Reyes A, Pluye P. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT). J Eval Clin Pract. 2018;24(3):459-67. source
The Discussion says the study explored MMAT users’ experiences to help revise the tool and identified themes suggesting areas for improvement. The Recommendations for Improving the MMAT then proposes specific changes on the basis of those results. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
In the paper
“Moreover, it includes specific criteria for mixed methods studies, which is not often found in other tools (21).”
What the sources say
- Not matchedcites [21] 21. Pluye P. Critical appraisal tools for assessing the methodological quality of qualitative, quantitative and mixed methods studies included in systematic mixed studies reviews. J Eval Clin Pract. 2013;19(4):722.
We searched by its title and found no matching paper.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“To address this challenge, a critical appraisal tool for assessing the quality of quantitative, qualitative and mixed methods studies was developed: the Mixed Methods Appraisal Tool (MMAT) (7).”
What the sources say
- Not checked — no full text of the sourcecites [7] 7. Pluye P, Gagnon MP, Griffiths F, Johnson-Lafleur J. A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. Int J Nurs Stud. 2009;46(4):529-46. source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Moreover, it includes specific criteria for mixed methods studies, which is not often found in other tools (21).”
What the sources say
- Not matchedcites [21] 21. Pluye P. Critical appraisal tools for assessing the methodological quality of qualitative, quantitative and mixed methods studies included in systematic mixed studies reviews. J Eval Clin Pract. 2013;19(4):722.
We searched by its title and found no matching paper.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
5 more claims
Create a free account to see all 31 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 7
- Probably not a substantial claim. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Quality was assessed using two validated tools by study design. Quantitative studies were appraised using the Mixed Methods Appraisal Tool Version 2018, which evaluates five methodological criteria on a binary scale (Hong et al., 2018). Qualitative studies were additionally appraised using the Critical Appraisal Skills Programme Qualitative Checklist, which evaluates 10 criteria (CASP UK, 2018).”
From Cultural stigma and caregiver burden among family caregivers of people with nervous system disorders in the Middle East and North Africa: A mixed-methods systematic review (2026) · cites this paper as Hong et al., 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The quality of the included studies was assessed using the 2018 version of the Mixed Methods Appraisal Tool (MMAT).15”
From Psychosocial interventions for siblings of children with cancer: A mixed methods systematic review (2021) · cites this paper as [15]
The cited source says what the claim attributes to it.
In the citing paper
“To further limit risks of bias, a formal risk of bias assessment tool (ROB-tool), the Mixed Methods Appraisal Tool [52], was used to evaluate the overall study quality.”
From Mediators of outcome in adolescent psychotherapy and their implications for theories and mechanisms of change: a systematic review (2024) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“LM, with the support of a research assistant, assessed the methodological quality of empirical studies (qualitative, quantitative and mixed methods) using the Mixed Methods Appraisal Tool (MMAT) [45].”
From Transnationalism and care of migrant families during pregnancy, postpartum and early-childhood: an integrative review (2020) · cites this paper as [45]
The cited source says what the claim attributes to it.
In the citing paper
“The quality of the included studies was independently assessed by two authors using the Mixed Methods Appraisal Tool (MMAT) (Hong et al., 2018).Disagreements were resolved through discussion.”
From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Hong et al., 2018
29 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4. Conclusion · p. 5
“## 4. Conclusion”
§ 4. How to use the MMAT? · p. 4
“## 4. How to use the MMAT?”
Citations
Cites
Pace, R., Pluye, P., Bartlett, G., Macaulay, A. C., Salsberg, J., Jagosh, J., & Seller, R. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.07.002 · Cited by 1,331 · cited 2×
“Then, two interrater reliability studies on the MMAT were conducted using respectively 32 and 261 papers (Pace et al., 2012; Souto et al., 2015).”
Self-citationPluye, P., Gagnon, M.-P., Griffiths, F., & Johnson-Lafleur, J. (2009) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.01.009 · Cited by 1,119 · cited 3×
“This led to develop a first version of the MMAT that is in line with a social constructionist worldview (Pluye et al., 2009).”
InfluentialSelf-citationHong, Q. N., Gonzalez‐Reyes, A., & Pluye, P. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12884 · Cited by 1,107 · cited 3×
“To further its development, usefulness testing was performed by interviewing 20 researchers who have used the MMAT in a systematic review or had contacted the developer of the tool for questions or permission to use the tool (Hong et al., 2018a).”
Self-citationSystems to rate the strength of scientific evidence.
West, S. L., King, V., Carey, T. S., Lohr, K. N., Mckoy, N. A., Sutton, S. F., & Lux, L. J. (2002) · PubMed Central · Cited by 923
Zaza, S., Wright-De Agüero, L. K., Briss, P. A., Truman, B. I., Hopkins, D. P., Hennessy, M. H., Sosin, D. M., Anderson, L., Carande-Kulis, V. G., Teutsch, S. M., et al. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00122-1 · Cited by 464 · cited 1×
“The algorithm was developed based on several existing algorithms of quantitative study designs (Hartling et al., 2010; Hartling et al., 2011; National Institute for Health Care Excellence, 2012; Scottish Intercollegiate Guidelines Network; Seo et al., 2016; West et al., 2002; Zaza et al., 2000).”
Souto, R. Q., Khanassov, V., Hong, Q. N., Bush, P. L., Vedel, I., & Pluye, P. (2015) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2014.08.010 · Cited by 375 · cited 1×
“Then, two interrater reliability studies on the MMAT were conducted using respectively 32 and 261 papers (Pace et al., 2012; Souto et al., 2015).”
Self-citationA review of critical appraisal tools show they lack rigor: Alternative tool structure is proposed
Crowe, M., & Sheppard, L. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.008 · Cited by 261 · cited 2×
“Currently, there exist more than 500 critical appraisal tools (i.e., checklists including a list of criteria to judge the quality of a study) (Bai et al., 2012; Crowe & Sheppard, 2011; Heyvaert et al., 2013; Santiago-Delefosse et al., 2016).”
Carroll, C., Booth, A., & Lloyd-Jones, M. (2012) · Qualitative Health Research · doi:10.1177/1049732312452937 · Cited by 248 · cited 1×
“Methodological quality criteria are more difficult to interpret because the reviewers need to judge whether the reported results of a study are trustworthy (Carroll et al., 2012; Hong & Pluye, 2018a).”
Adjustment of meta-analyses on the basis of quality scores should be abandoned
Herbison, P., Hay-Smith, J., & Gillespie, W. J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.008 · Cited by 207 · cited 1×
“Currently in the literature, it is discouraged to calculate an overall score from the ratings of each criterion (Herbison et al., 2006; Higgins & Green, 2008; Viswanathan et al., 2012).”
Critical Appraisal of Mixed Methods Studies
Heyvaert, M., Hannes, K., Maes, B., & Onghena, P. (2013) · Journal of Mixed Methods Research · doi:10.1177/1558689813479449 · Cited by 168 · cited 1×
“Currently, there exist more than 500 critical appraisal tools (i.e., checklists including a list of criteria to judge the quality of a study) (Bai et al., 2012; Crowe & Sheppard, 2011; Heyvaert et al., 2013; Santiago-Delefosse et al., 2016).”
Cited by
Items 1,401–1,500 of 4,578
Sustainable digital finance and Finance 5.0: a systematic review and research agenda
Gulati, T., Singla, A., & Saini, P. (2025) · South Asian Journal of Business Studies · doi:10.1108/sajbs-03-2025-0131 · Cited by 13
Patterson, B., McKay, C. D., Critchley, M. L., Lutz, D., Cowan, S., Kolesky, N., White, V., Ezzat, A. M., Ross, A. G., Adams, W. M., et al. (2025) · British Journal of Sports Medicine · doi:10.1136/bjsports-2025-109904 · Cited by 16
A research roadmap for AI opportunities in student assessment for medical education
Rezaei-Zadeh, M., & Cerbin‐Koczorowska, M. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08078-7 · Cited by 19
“To ensure the reliability and validity of the results, the quality of the studies included in the review was appraised using the Mixed Methods Appraisal Tool (MMAT) [24].”
Rizzo, L., Pinnelli, S., & Minnaert, A. E. M. G. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1696805 · Cited by 25
Reimagining Public Service Delivery: Digitalising Initiatives for Accountability and Efficiency
Mangai, M. S., & Ayodele, A. A. (2025) · Administrative Sciences · doi:10.3390/admsci15120477 · Cited by 11
“All 64 studies demonstrated clear research questions, robust methodology, meticulous data collection, sound analysis, and coherent findings, with quality scores ranging from 89.1% to 100% across MMAT dimensions.”
InfluentialNonsuicidal Self-injury in Southeast Asia: A Systematic Literature Review
Fernandez, J. A., Jaladin, R. A. M., & Lau, P. L. (2022) · Millennial Asia · doi:10.1177/09763996221095146 · Cited by 11
“The authors used the mixed-method appraisal tool (MMAT) by Hong et al. (2018) to critically assess the selected studies.”
BackgroundMethodYun, K., Jo, M., & Lee, Y. (2022) · Journal of Hospice and Palliative Nursing · doi:10.1097/njh.0000000000000899 · Cited by 11
Dyadic interventions in older people with chronic diseases: An integrative review
Xiong, Z., Yin, Y., Zhang, J., & Wang, A. (2022) · Geriatric Nursing · doi:10.1016/j.gerinurse.2022.10.012 · Cited by 14
Salvage treatments for locally recurrent nasopharyngeal cancer: Systematic review and meta‐analysis
Wang, D., Liao, M., Wu, J., Luo, W., Qi, S., Liu, B., & Li, J. (2022) · Head & Neck · doi:10.1002/hed.27253 · Cited by 11
“The Mixed Methods Appraisal Tool (MMAT) (version 2018) was employed to assess the methodological quality of the eligible studies.(19) Specifically, the MMAT is a critical appraisal tool designed for the appraisal stage of systematic mixed studies reviews, i.”
MethodHaron, Z., Sutan, R., Zakaria, R., & Mahdy, Z. A. (2023) · Belitung Nursing Journal · doi:10.33546/bnj.2396 · Cited by 25
“The MMAT enables researchers to critically select quality empirical studies through a proper risk of bias screening based on the study methodology reported.”
InfluentialKeaver, L., O’Callaghan, N., LaVertu, A. E., Semple, C. J., Hughes, C., Hanna, J. R., & Ryan, L. (2023) · Journal of Cancer Survivorship · doi:10.1007/s11764-023-01359-4 · Cited by 13
A systematic review of ironic effects of motor task performance under pressure: The past 25 years
Bartura, K., Görgülü, R., Abrahamsen, F. E., & Gustafsson, H. (2023) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2023.2193966 · Cited by 18
“Table 1 summarizes the MMAT quality assessment (for details, see Table S3).”
InfluentialEaton, A. D., Scheadler, T. R., Bradley, C., McInroy, L. B., Beer, O. W. J., Beckwell, E., Busch, A., & Shuper, P. A. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02355-6 · Cited by 11
“Quality assessment The Mixed Methods Appraisal Tool (MMAT) Version 2018 [37] will be used to assess the quality of evidence of each included study.”
MethodStephenson, Z., Jackson, A., & Wilkes, V. (2023) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2023.2282941 · Cited by 11
“The eight studies were subjected to quality assessment using the Mixed Methods Appraisal Tool (MMAT) (Hong et al. 2018) by two of the authors.”
Martínez-Saura, H.-F., Calderón, A., & López, M. C. S. (2024) · Revista Complutense de Educación · doi:10.5209/rced.82389 · Cited by 28
“No se introdujeron estudios descriptivos según la clasificación de Hong et al. (2018).”
BackgroundInfluentialRoldán-Pardo, M., Lila, M., Santirso, F. A., & Gracia, E. (2024) · Trauma Violence & Abuse · doi:10.1177/15248380241226655 · Cited by 16
“The quality of studies was assessed using the Mixed Methods Appraisal Tool (MMAT; Hong et al., 2018) developed by the Department of Family Medicine at McGill University.”
Bozicevic, L., Lucas, C., Magai, D. N., Ooi, Y., Maliwichi, L., Sharp, H. M., & Gladstone, M. (2024) · Journal of Reproductive and Infant Psychology · doi:10.1080/02646838.2024.2321615 · Cited by 15
“To assess the quality of each paper, we used the Mixed Methods Appraisal Tool (MMAT) (Hong et al., 2018).”
InfluentialWilkinson, D., Chopra, I., & Badger, S. (2024) · Journal of Criminal Psychology · doi:10.1108/jcp-09-2023-0054 · Cited by 15
Casey, M. M., Dabkowski, E., de Gracia, M. R. L., Moore, K. A., Kennedy, G. A., Porter, J. E., Nasstasia, Y., & Alvarenga, M. E. (2024) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0000000000002337 · Cited by 17
A systematic review of callous-unemotional traits and attachment in children and adolescents
Craig, S. G., Dawson, A., Chen, S. E., Moretti, M. M., & Pepler, D. J. (2024) · Attachment & Human Development · doi:10.1080/14616734.2024.2349569 · Cited by 16
“We also noted any methodological limitations of each study (e.g. low power, small sample size, etc.) Each article was also assessed for quality using the Mixed Methods Appraisal Tool (MMAT; Hong et al., 2018).”
MethodAutistic Women’s Experiences of the Perinatal Period: A Systematic Mixed Methods Review
Westgate, V., Sewell, O., Caramaschi, D., & O’Mahen, H. (2024) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-024-00461-2 · Cited by 19
Self-Concept and Achievement in Individuals with Intellectual Disabilities
Falk, K., & Sansour, T. (2024) · Disabilities · doi:10.3390/disabilities4020023 · Cited by 11
“…and of achievement constructs, (v) studies published in English and German, (vi) studies that were peer reviewed and met the criteria of the MMAT [33], (vii) studies that used methods for identifying/exploring the self-concept of people with intellectual disabilities (e.g., interviews or tests)…”
BackgroundMethodInfluentialMedenica, V., Ivanović, L., & Milošević, N. (2024) · Applied Neuropsychology Adult · doi:10.1080/23279095.2024.2364229 · Cited by 19
Ford, K., Duddle, M., Turner, M. R., et al. (2024) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2024.151673 · Cited by 11
Kim, S. (2024) · Sport Education and Society · doi:10.1080/13573322.2024.2379941 · Cited by 17
“A standardized assessment of quality was conducted using the Mixed Methods Appraisal Tool (MMAT), Version 2018 (Hong et al., 2018).”
Nurses' experiences and perceptions of running nurse‐led clinics: A scoping review
Pu, X., Malik, G., & Murray, C. (2024) · International Journal of Nursing Practice · doi:10.1111/ijn.13285 · Cited by 16
Ethical Standards in Social Science Publications
Purvis, A. J., & Crawford, J. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/hqnqr710 · Cited by 85
“The absence of a statement about ethical approval where human participants are involved in primary research is usually considered as a significant limitation and a marker of low-quality in assessment tools, for example the Mixed Methods Assessment Tool (MMAT) by Hong et al. (2018).”
BackgroundHamza, M., Edwards, R. C., Beaumont, J. D., Pretto, L. D., & Torn, A. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2024.117265 · Cited by 15
Yip, Y. Y., Makmor‐Bakry, M., & Chong, W. W. (2024) · Journal of Medical Internet Research · doi:10.2196/59742 · Cited by 21
“Joanna Briggs Institute (JBI) critical appraisal tools were used for cross-sectional studies, randomized trials, and quasi-experimental studies [26] whereas, the Mixed Methods Assessment Tool (MMAT) was used for mixed methods studies [27].”
A scoping review of coaching in occupational therapy: Mapping methods, populations and outcomes
Graham, F. P., Kessler, D., Nott, M. T., et al. (2024) · Australian Occupational Therapy Journal · doi:10.1111/1440-1630.12991 · Cited by 11
Terceiro, L., Mustafa, M. I., Hägglund, M., & Kharko, A. (2024) · JMIR Research Protocols · doi:10.2196/65099 · Cited by 13
“The study plans to use the mixed-methods assessment tool (MMAT) for quality assessment and critical appraisal [39].”
van Beurden, K., Vereijken, F. R., Frielink, N., & Embregts, P. J. C. M. (2024) · Journal of Intellectual Disability Research · doi:10.1111/jir.13199 · Cited by 18
“Finally, in the inclusion phase, the quality of the remaining 23 articles were assessed using the Mixed Methods Appraisal Tool (MMAT; Hong et al .”
Lloyd, P., Fowler, A. J., Wozniak, A. M., Rattenberry, W., Scott, S., Tripurneni, V., Earl, M., Pearse, R. M., Watson, S.-L., Abbott, T. E. F., et al. (2024) · BJA Open · doi:10.1016/j.bjao.2024.100362 · Cited by 22
Lillekroken, D., Halvorsrud, L., Bjørge, H., Gandhi, S., Sivakumar, P. T., & Goyal, A. R. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-12146-x · Cited by 20
“The quality assessment of the publications was conducted by four authors in pairs (ARG and DL, LH and HB) using the Mixed Methods Appraisal Tool (MMAT) which facilitates the description and appraisal of five types of studies [37].”
Liu, J., Yu, H., Cheung, W. C., Bleakney, A., & Jan, Y. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e42081 · Cited by 22
“The methodological quality of the selected studies was evaluated utilizing the Mixed Methods Appraisal Tool (MMAT) [9], selected for its suitability in appraising studies employing qualitative, quantitative, and mixed methods.”
Kusmaryanto, S., & Santoso, C. B. (2025) · Cogent Business & Management · doi:10.1080/23311975.2025.2461734 · Cited by 26
“this review study includes a rigorous quality appraisal of the selected literature, an essential step in systematic reviews (Hong et al., 2018). the authors utilized the Mixed Methods appraisal tool (MMat) to evaluate the quality of the studies. the MMat is a distinctive tool designed specifically…”
InfluentialPaes, V. M., Ting, A., Masters, J., et al. (2025) · Bone & Joint Open · doi:10.1302/2633-1462.63.bjo-2024-0104.r1 · Cited by 11
Birkeli, G. H., Lindahl, A. K., Hammersbøen, Å. M., Deilkås, E. C. T., & Ballangrud, R. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12680-2 · Cited by 18
“It is advised to present a detailed result of the quality appraisal, and calculation of an overall quality score is discouraged [44].”
Persson, V., & Wickman, U. L. (2025) · Healthcare · doi:10.3390/healthcare13080950 · Cited by 18
“The articles were quality-reviewed using the Mixed Methods Appraisal Tool (MMAT, version 2018) [50].”
Malkowski, O. S., Harvey, J., Townsend, N. P., Kelson, M. J., Foster, C. E., Western, M. J., AlKhatib, A. H., Bourassa, K. J., Burnett, H., Cajita, M., et al. (2025) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-025-01775-y · Cited by 18
“The Mixed Methods Appraisal Tool (MMAT) was used to assess risk of bias based on the content of the original studies, rather than the sub-samples included in the meta-analyses [23].”
Allum, L., Apps, C., Hart, N., Pattison, N. A., Connolly, B. A., & Rose, L. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01414-6 · Cited by 10
“We will use the results of the MMAT [40] to help inform conclusions and recommendations from the scoping review, as a robust tool for describing quality of mixed-methods studies.”
MethodInfluentialThe use of health information technology in renal transplantation: A systematic review
Sharma, V., Piscoran, O., Summers, A., Woywodt, A., van der Veer, S. N., Ainsworth, J. D., & Augustine, T. (2021) · Transplantation Reviews · doi:10.1016/j.trre.2021.100607 · Cited by 11
Horlait, M., Baes, S., Regge, M. D., & Leys, M. (2021) · Cancer Nursing · doi:10.1097/ncc.0000000000000923 · Cited by 21
Promoting advance care planning via mediated health resources: A systematic mixed studies review
Diegelmann, S., Bidmon, S., & Terlutter, R. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2021.06.008 · Cited by 13
Does acupuncture improve sexual dysfunction? A systematic review
Abdi, F., Alimoradi, Z., Roozbeh, N., Amjadi, M. A., & Robatjazi, M. (2021) · Journal of Complementary and Integrative Medicine · doi:10.1515/jcim-2021-0194 · Cited by 14
Goodman, W., Bagnall, A., Ashley, L., Azizoddin, D. R., Muehlensiepen, F., Blum, D., Bennett, M., & Allsop, M. J. (2022) · JMIR Cancer · doi:10.2196/33355 · Cited by 13
“The risk of bias for randomized controlled trials (RCTs) and nonrandomized studies was assessed using the Mixed Methods Appraisal Tool [25].”
MethodPractice nurses’ communication with people living with type 2 diabetes: A scoping review
Hills, S., Terry, D. R., Gazula, S., & Browning, C. J. (2022) · Patient Education and Counseling · doi:10.1016/j.pec.2022.03.024 · Cited by 16
Gathen, J. M., Slettebø, T., & Skjeggestad, E. (2022) · Nordisk välfärdsforskning | Nordic Welfare Research · doi:10.18261/nwr.7.1.4 · Cited by 19
Byun, K., Aristizabal, S., Wu, Y., Mullan, A. F., Carlin, J. D., West, C. P., & Mazurek, K. A. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.897241 · Cited by 11
Paz-Sabillón, M., Torres‐Sánchez, L., Piña‐Pozas, M., Razo, L. M. D., & Quintanilla‐Vega, B. (2022) · Biological Trace Element Research · doi:10.1007/s12011-022-03323-2 · Cited by 12
“The quality assessment of the articles included in this review was carried out using the five criteria for quantitative nonrandomized studies described in the Mixed Methods Appraisal Tool (MMAT) [23].”
MethodInfluentialThe HIV pre-exposure prophylaxis continuum of care among women who inject drugs: A systematic review
Guy, D., Doran, J., White, T. M., van Selm, L., Noori, T., & Lazarus, J. V. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.951682 · Cited by 11
“Each study received a quality score ranging from 0 (meeting no criteria) to 5 (meeting all criteria) based on the MMAT criteria.”
MethodNortey, R. A., Kretchy, I. A., Koduah, A., & Buabeng, K. O. (2022) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2022.11.011 · Cited by 9
Use of the Tilburg frailty indicator in longitudinal studies with older adults: A scoping review
Lee, J., Kim, G. S., Kim, S., Park, J., Lee, H., Shim, M., Ryu, G. W., Park, J., & Yoo, J. (2023) · Journal of Advanced Nursing · doi:10.1111/jan.15675 · Cited by 11
Tunmore, J., Kontou, E., Moghaddam, N. G., Hufton, L., & das Nair, R. (2023) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2023.2213847 · Cited by 15
“Quality assessment and study specific risk of bias The Mixed Methods Appraisal Tool (MMAT; Hong et al., 2018) was used to assess the quality of the included studies.”
MethodDuma, N. E., Hlongwa, M., Benjamin‐Damons, N., & Hlongwana, K. W. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02280-8 · Cited by 17
“variety of study methods namely; qualitative, randomized trials, non-randomized trials, quantitative, and mixed methods [23].”
BackgroundMethodInfluentialWang, J., Zhen, X., Coyte, P. C., Shao, D., Zhao, N., Chang, L., Feng, Y., & Sun, X. (2023) · Journal of Medical Internet Research · doi:10.2196/46953 · Cited by 19
“After the completion of qualitative analysis, we performed the second stage of data integration, during which we used the qualitative findings to explain, enrich, justify, or challenge the quantitative results [29,30,34,35].”
Physical activity for adolescents with severe mental illness: a systematic scoping review
Anthony, J., Kinnafick, F., Papathomas, A., & Breen, K. C. (2020) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2020.1833360 · Cited by 15
“Scoring from the MMAT revealed that three studies were rated as average (Diaz & Motta, 2008; Jelalian et al., 2016; Roshan et al., 2011) and seven studies were rated as high quality (Hughes et al., 2013; MacIntosh et al., 2017; Metcalfe et al., 2016; Newman & Motta, 2007; Radovic et al., 2017; Subramaniapillai et al.,…”
MethodInfluentialSaab, M. M., Landers, M. G., Egan, S., Murphy, D., & Hegarty, J. M. (2021) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000791 · Cited by 18
“23 Each item was voted on a “ yes, ” “ no, ” or “ cannot tell ” basis.”
Kukla, H., Herrler, A., Strupp, J., & Voltz, R. (2021) · Palliative Medicine · doi:10.1177/02692163211042528 · Cited by 14
Systemic constellations applied in organisations: a systematic review
Scholtens, S., Petroll, C., Rivas, C., Fleer, J., & Thege, B. K. (2021) · Gruppe Interaktion Organisation Zeitschrift für Angewandte Organisationspsychologie (GIO) · doi:10.1007/s11612-021-00592-8 · Cited by 36
Jackson, M., McTier, L., Brooks, L. A., & Wynne, R. M. (2022) · Systematic Reviews · doi:10.1186/s13643-022-01926-3 · Cited by 15
“Hong QN, Fabregues S, Bartlett G, Boardman F, Cargo M, Dagenais P, et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers.”
MethodInfluentialZlámal, J., Gjevjon, E. R., Fossum, M., Solberg, M. T., Steindal, S. A., Strandell‐Laine, C., Larsen, M. H., & Nes, A. A. G. (2022) · JMIR Nursing · doi:10.2196/37380 · Cited by 14
“Mixed Methods Appraisal Tool—article 2.”
MethodEsmaeili, M., Abdi, F., Shafiee, G., Rastad, H., Asayesh, H., Abdar, Z. E., Baygi, F., & Qorbani, M. (2021) · International Journal of Preventive Medicine · doi:10.4103/ijpvm.ijpvm_484_20 · Cited by 12
“The methodological quality of the included studies in this review was conducted by the Mixed Methods Appraisal Tool (MMAT) (23, 24).”
BackgroundMethodInfluentialPuddester, R., Pike, A. D., Maddigan, J., & Farrell, A. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12091358 · Cited by 14
“Information to be extracted in the tables include author, year, study design, study sample, intervention, key findings, study limitations and MMAT appraisal score.”
MethodInfluentialEducation and the relationships between museums and older audiences: A scoping review protocol
Araújo, O. S. C. C. E., Hinsliff‐Smith, K., & Cachioni, M. (2020) · International Journal of Educational Research · doi:10.1016/j.ijer.2020.101591 · Cited by 11
Uzzaman, N., Hammersley, V., McClatchey, K., Sheringham, J., Singh, D., Habib, G. M., & Pinnock, H. (2024) · Journal of Medical Internet Research · doi:10.2196/57708 · Cited by 13
“We used the critical appraisal skills program for qualitative studies [44,45] and mixed methods appraisal tool for mixed methods studies to appraise their methodological quality [46].”
Trompeter, N., Duffy, F., Peebles, I., Wadhera, E., Chambers, K., Sharpe, H., Maloney, E., Nicholls, D., Schmidt, U. H., Serpell, L., et al. (2025) · BMJ Public Health · doi:10.1136/bmjph-2023-000862 · Cited by 16
Godage, P., Giggins, O. M., Doyle, J., & Byrne, A. (2025) · Oxford Open Digital Health · doi:10.1093/oodh/oqaf006 · Cited by 13
“Eligible studies were assessed for risk of bias and methodological quality by the first and second authors independently using the Mixed Method Appraisal Tool (MMAT) [29].”
Yameogo, A. R., Délétroz, C., Sasseville, M., Amil, S., Da, S. M. A. R., Plaisimond, J., Bergeron, F., Tadlaoui, S., Bodenmann, P., & Gagnon, M. (2025) · Journal of Medical Internet Research · doi:10.2196/69880 · Cited by 15
Self-citationSpace to Place, Housing to Home: A Systematic Review of Sense of Place in Housing Studies
Safarkhani, M. (2025) · Sustainability · doi:10.3390/su17156842 · Cited by 19
Capetti, B., Conti, L., Ferrari, M. V., Coppini, V., Ferraris, G., Marzorati, C., Monzani, D., Grasso, R., & Pravettoni, G. (2025) · Health Psychology Review · doi:10.1080/17437199.2025.2536071 · Cited by 12
The Use and Effectiveness of Digital Tools in Elementary Music Education: A Systematic Review
Yihan, L., Cuong, T. V., Kiss, B., Oo, T. Z., Szabó, N., & Józsa, K. (2025) · Music & Science · doi:10.1177/20592043251363338 · Cited by 23
“Prior to employing the MMAT and the JBI checklist, the research team gathered to discuss and fi nalize the speci fi c indicators of each criterion.”
InfluentialTeachers’ sense of belonging in school: a scoping review
Wator, J., Patrick, P., & Yip, S. Y. (2025) · The Australian Educational Researcher · doi:10.1007/s13384-025-00897-3 · Cited by 25
“This tool demonstrates moderate to strong inter-rater reliability and has seen increased utilisation in mixed method reviews (Hong et al., 2018).”
Elsheikh, A., Al‐Thani, D., & Othman, A. (2025) · Frontiers in Robotics and AI · doi:10.3389/frobt.2025.1626471 · Cited by 18
Arkan, Z., & Bal, M. (2025) · BMC Psychology · doi:10.1186/s40359-025-03573-4 · Cited by 11
“The methodological quality of the studies was assessed using the MMAT, developed by Hong et al. [36].”
InfluentialBal, M., & Arseven, T. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.102118 · Cited by 23
Collins, S. V., & Hines, A. L. (2021) · Journal of Racial and Ethnic Health Disparities · doi:10.1007/s40615-021-01160-y · Cited by 13
Zikhali, T., Kalinda, C., & Xulu-Kasaba, Z. N. (2022) · Clinics and Practice · doi:10.3390/clinpract12040050 · Cited by 18
“The Mixed Method Appraisal Tool (MMAT) version 2018 was used to determine the quality of studies included [16].”
MethodMoenke, L., Handley, M., & Goodman, C. M. (2023) · Journal of Nursing Management · doi:10.1155/2023/9872272 · Cited by 20
“Tools used were as follows: Appraisal tool for Cross-sectional Studies (AXIS) for quantitative studies [32]; Critical Appraisal Skill Programme (CASP) for qualitative studies [33], and Mixed Methods Appraisal Tool (MMAT) for mixed-methods studies [34].”
Understanding nurse suicide using an ideation‐to‐action framework: An integrative review
Basu, N., Barinas, J. L., Williams, K., Clanton, C., & Smith, P. N. (2023) · Journal of Advanced Nursing · doi:10.1111/jan.15681 · Cited by 17
Drewniok, N., Kiselev, J., Daum, N., Mörgeli, R., Spies, C., & Schaller, S. J. (2023) · Journal of Bodywork and Movement Therapies · doi:10.1016/j.jbmt.2023.05.004 · Cited by 12
Harris, J., Nowland, R. A., Peart, J., & Thomson, G. (2023) · International Journal of Art Therapy · doi:10.1080/17454832.2023.2208208 · Cited by 15
“Data evaluation (Whittemore & Kna fl , 2005) was undertaken using the Mixed Method Assessment Tool (MMAT) (Hong et al., 2018) and Walsh and Downe ’ s (2006) quality assessment grading criteria, with studies graded on a scale of A-D (see Table 2).”
MethodDance for Multiple Sclerosis: A Systematic Review
Davis, E., Webster, A., Whiteside, B., et al. (2023) · International Journal of MS Care · doi:10.7224/1537-2073.2022-088 · Cited by 10
Spooner, C., Vivat, B., White, N., Bruun, A., Rohde, G. E., Kwek, P. X., & Stone, P. C. (2023) · Palliative Medicine · doi:10.1177/02692163231191148 · Cited by 10
“20 This tool is useful for systematic reviews of studies of mixed methodology because it enables critical appraisal of all study methodologies, including randomised and nonrandomised.”
BackgroundMethodNutritional interventions in treating menopause-related sleep disturbances: a systematic review
Polasek, D., Santhi, N., Alfonso-Miller, P., Walshe, I. H., Haskell-Ramsay, C. F., & Elder, G. J. (2024) · Nutrition Reviews · doi:10.1093/nutrit/nuad113 · Cited by 10
“main aims, was evaluated using the Mixed Methods Appraisal Tool (MMAT).(22,23) Each study was assigned a”
MethodFactors influencing teamwork in healthcare applicable to interventional and diagnostic radiology
Parra, D. A., Gladkikh, M., & Jones, L. (2023) · Clinical Radiology · doi:10.1016/j.crad.2023.09.011 · Cited by 15
Toohey, K. L., Hunter, M., Paterson, C. C., Turner, M. R., & Singh, B. (2023) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2023.09.020 · Cited by 15
Self-Guided Mental Health Apps Targeting Racial and Ethnic Minority Groups: Scoping Review
Saad, F., Eisenstadt, M., Liverpool, S., Carlsson, C., & Vainieri, I. (2023) · JMIR Mental Health · doi:10.2196/48991 · Cited by 13
“Critical appraisal was conducted following the Mixed Methods Appraisal Tool checklist [52].”
MethodAzman, N. B. N., Zhou, T. W., & Shorey, S. (2023) · Nurse Education in Practice · doi:10.1016/j.nepr.2023.103820 · Cited by 12
Inayat, S., Hayden, A., Campbell, T. S., & King‐Shier, K. M. (2023) · Journal of Cardiopulmonary Rehabilitation and Prevention · doi:10.1097/hcr.0000000000000822 · Cited by 12
Alexander, E. G., Denny, F., Gordon, M. W., McKiernan, C., & Lowe, D. J. (2023) · BMC Emergency Medicine · doi:10.1186/s12873-023-00895-7 · Cited by 10
“All reviewed articles were quality assessed using the Mixed Methods Appraisal Tool (MMAT) Version 2018 [15] by two authors.”
MethodCormick, G., Moraa, H., Zahroh, R. I., Allotey, J., da Rocha, T. J. C. M., Peña‐Rosas, J. P., Qureshi, Z. P., Hofmeyr, G. J., Mistry, H., Smits, L. J. M., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-070677 · Cited by 13
“16 Appraisal of study quality was used to inform data analysis, and not to exclude studies.”
MethodHip-Hop and Rap Music Interventions on Mental Health and Well-Being: A Systematic Review
Jefferson, L., Waddington, A. F., Johnson, S., et al. (2024) · Journal of Creativity in Mental Health · doi:10.1080/15401383.2024.2305294 · Cited by 10
“Each research structure obtains a set of quality assurance criteria to assist with the evaluation of the articles (Hong et al., 2018).”
Jansen, E. J., Czabanowska, K., de Pagter, A. P. J., & Koeijer, R. D. (2024) · The International Journal of Health Planning and Management · doi:10.1002/hpm.3761 · Cited by 20
Schubach, K., Niyonsenga, T., Turner, M. R., & Paterson, C. C. (2024) · Journal of Cancer Survivorship · doi:10.1007/s11764-024-01558-7 · Cited by 14
“In one cohort, 50% of participants aged 40–50,33%, 50–59, and 19% aged 70–79 experienced sexual issues that impacted their intimate relationships [49].”
MicroRNA Associations with Preterm Labor—A Systematic Review
Kondracka, A., Stupak, A., Rybak-Krzyszkowska, M., Kondracki, B., Oniszczuk, A., & Kwaśniewska, A. (2024) · International Journal of Molecular Sciences · doi:10.3390/ijms25073755 · Cited by 14
“The Mixed Methods Assessment Tool (MMAT) [2] assessed paper quality for the systematic literature review, ensuring comprehensive evaluation of both qualitative and quantitative studies.”
MethodAbu‐Odah, H., Chan, E. A., & Molassiotis, A. (2024) · Cancer Nursing · doi:10.1097/ncc.0000000000001357 · Cited by 14
A Scoping Review on Attitudes towards Sexuality in Residential Aged Care
Le, K., Bennich, M., & Strandberg, T. (2024) · Health & Social Care in the Community · doi:10.1155/2024/1478395 · Cited by 10
Dridi, S., Ameline, C., Heurtebise, J. M., Vincent-Bugnas, S., & Charavet, C. (2024) · Clinics and Practice · doi:10.3390/clinpract14030064 · Cited by 19
“The search for bias was blinded by the same reviewers as before, using the Mixed Methods Appraisal Tool (MMAT) [15].”
MethodChallenges and Coping Strategies in Transitioning From Caregiving to Widowhood: A Systematic Review
Baumbach, A., Hughes, M. C., & Liu, Y. (2024) · Research on Aging · doi:10.1177/01640275241254396 · Cited by 10
“Weassessed the quality of each study using the Mixed Methods Appraisal Tool version 2018 (Hong et al., 2018).”
Metadata
- Authors
- Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., Rousseau, M.-C., Vedel, I., & Pluye, P.
- Affiliations
- McGill University (CA)
- Universitat Oberta de Catalunya (ES)
- University of Warwick (GB)
- University of Canberra (AU)
- Université de Sherbrooke (CA)
- Université Laval (CA)
- University of Sheffield (GB)
- Institut National de la Recherche Scientifique (CA)
- Corresponding author
- Pluye, Pierre
- ORCID
- Venue
- Education for Information
- Publisher
- SAGE Publications
- Published
- 2018-12-18
- Volume
- 34
- Issue
- 4
- Pages
- 285-291
- ISSN
- 0167-8329 (ISSN-L)
- 1875-8649
- OpenAlex
- W2901724277
- Cited by
- 4,737
- References
- 21
- Citations by year
- 2026: 1312 · 2025: 974 · 2024: 800 · 2023: 610 · 2022: 501 · 2021: 370 · 2020: 143 · 2019: 22 · 2018: 3
- FWCI
- 102.21
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- Locations
- Education for Information (publishedVersion)
- O2 - Repositori Institucional (Universitat Oberta de Catalunya) (publishedVersion, cc-by-nc-nd)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (publishedVersion, cc-by-nc-nd)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- HAL (submittedVersion)
- eScholarship@McGill (McGill) (submittedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by-nc-nd)
- eScholarship@McGill (McGill) (submittedVersion, cc-by-nc-nd)
- EspaceINRS (National Institute for Scientific Research (Canada)) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Education › Qualitative Research Methods and Applications
- Keywords
- Mixed Methods Appraisal Tool, critical appraisal, study quality assessment, mixed methods, systematic reviews, qualitative research, quantitative research, randomized controlled trials, non-randomized studies, e-Delphi, inter-rater reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.