The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index; 2 of the 26 sources its claims cite were checked for support.
Abstract
INTRODUCTION: Appraising the quality of studies included in systematic reviews combining qualitative and quantitative evidence is challenging. To address this challenge, a critical appraisal tool was developed: the Mixed Methods Appraisal Tool (MMAT). The aim of this paper is to present the enhance ments made to the MMAT. DEVELOPMENT: The MMAT was initially developed in 2006 based on a literature review on systematic reviews combining qualitative and quantitative evidence. It was subject to pilot and interrater reliability testing. A revised version of the MMAT was developed in 2018 based on the results from usefulness testing, a literature review on critical appraisal tools and a modified e-Delphi study with methodological experts to identify core criteria. TOOL DESCRIPTION: The MMAT assesses the quality of qualitative, quantitative, and mixed methods studies. It focuses on methodological criteria and includes five core quality criteria for each of the following five categories of study designs: (a) qualitative, (b) randomized controlled, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods. CONCLUSION: The MMAT is a unique tool that can be used to appraise the quality of different study designs. Also, by limiting to core criteria, the MMAT can provide a more efficient appraisal.
Overview
CoChat Summary
TL;DR
This paper presents version 2018 of the Mixed Methods Appraisal Tool (MMAT), a single critical appraisal tool for assessing the methodological quality of qualitative, quantitative, and mixed methods studies in mixed studies reviews. It describes the tool's 25 criteria across five study design categories, its development history, and guidance for use.
Key findings
The MMAT version 2018 includes a total of 25 criteria and 2 screening questions, covering five categories of study designs: (a) qualitative, (b) randomized controlled trial, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods, with five core criteria per category rated as yes, no, or can't tell. The tool was developed from a 2006 first version (15 criteria across four categories), revised in 2011, and further revised into the 2018 version based on usefulness testing with 20 researchers, a literature review on critical appraisal tools, and a modified e-Delphi study with 73 methodological experts. Two interrater reliability studies used 32 and 261 papers respectively and showed the need to clarify criteria, particularly for nonrandomized and qualitative studies. The paper argues the MMAT offers a time-efficient alternative by limiting to core criteria and uniquely includes specific criteria for mixed methods studies, though its criteria are harder to judge because they target methodological rather than reporting quality.
Methods
This is a tool description paper (third in a three-part series on systematic reviews for information professionals) rather than an empirical study; it narrates the development of the MMAT and explains how to apply it. Development drew on a literature review on mixed studies reviews, pilot testing in workshops with four reviewers appraising six studies, two interrater reliability studies (32 and 261 papers), usefulness testing via interviews with 20 researchers, a literature review on critical appraisal tools, and a modified e-Delphi study with 73 methodological experts. Use involves three steps: two optional screening questions, selection of the appropriate design category (or categories), and rating each criterion as yes, no, or can't tell, with detailed presentation of ratings advised over an overall numerical score.
Limitations
The paper states that revision of the MMAT has so far focused on content validity and usefulness, and that further testing on its validity and reliability will be needed; it also notes that modifications may be necessary as evidence develops. It states that MMAT criteria are more difficult to judge than other appraisal tools because they focus on methodological quality rather than reporting quality. Evident from the text: the tool's development evidence base is described only in summary form, with reliability and validity results reported by reference to prior studies rather than presented here.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 0 Not valid · 18 Not checked · 11 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“To further its development, usefulness testing was performed by interviewing 20 researchers who have used the MMAT in a systematic review or have contacted the developer of the tool for questions or permission to use the tool (18).”
What the sources say
- Supportedcites [18] 18. Hong QN, Gonzalez-Reyes A, Pluye P. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT). J Eval Clin Pract. 2018;24(3):459-67. source
The Abstract reports semi-structured interviews with 20 participants to explore the MMAT’s usefulness. The Study Participants section says researchers were recruited through systematic reviews that used the MMAT and a list of people who had contacted its developer for permission or guidance. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The results of this study were helpful to identify changes to be made in the MMAT.”
What the sources say
- Supportedcites [18] 18. Hong QN, Gonzalez-Reyes A, Pluye P. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT). J Eval Clin Pract. 2018;24(3):459-67. source
The Discussion says the study explored MMAT users’ experiences to help revise the tool and identified themes suggesting areas for improvement. The Recommendations for Improving the MMAT then proposes specific changes on the basis of those results. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
In the paper
“Moreover, it includes specific criteria for mixed methods studies, which is not often found in other tools (21).”
What the sources say
- Not matchedcites [21] 21. Pluye P. Critical appraisal tools for assessing the methodological quality of qualitative, quantitative and mixed methods studies included in systematic mixed studies reviews. J Eval Clin Pract. 2013;19(4):722.
We searched by its title and found no matching paper.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“To address this challenge, a critical appraisal tool for assessing the quality of quantitative, qualitative and mixed methods studies was developed: the Mixed Methods Appraisal Tool (MMAT) (7).”
What the sources say
- Not checked — no full text of the sourcecites [7] 7. Pluye P, Gagnon MP, Griffiths F, Johnson-Lafleur J. A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. Int J Nurs Stud. 2009;46(4):529-46. source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Moreover, it includes specific criteria for mixed methods studies, which is not often found in other tools (21).”
What the sources say
- Not matchedcites [21] 21. Pluye P. Critical appraisal tools for assessing the methodological quality of qualitative, quantitative and mixed methods studies included in systematic mixed studies reviews. J Eval Clin Pract. 2013;19(4):722.
We searched by its title and found no matching paper.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
5 more claims
Create a free account to see all 31 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 7
- Probably not a substantial claim. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Quality was assessed using two validated tools by study design. Quantitative studies were appraised using the Mixed Methods Appraisal Tool Version 2018, which evaluates five methodological criteria on a binary scale (Hong et al., 2018). Qualitative studies were additionally appraised using the Critical Appraisal Skills Programme Qualitative Checklist, which evaluates 10 criteria (CASP UK, 2018).”
From Cultural stigma and caregiver burden among family caregivers of people with nervous system disorders in the Middle East and North Africa: A mixed-methods systematic review (2026) · cites this paper as Hong et al., 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The quality of the included studies was assessed using the 2018 version of the Mixed Methods Appraisal Tool (MMAT).15”
From Psychosocial interventions for siblings of children with cancer: A mixed methods systematic review (2021) · cites this paper as [15]
The cited source says what the claim attributes to it.
In the citing paper
“To further limit risks of bias, a formal risk of bias assessment tool (ROB-tool), the Mixed Methods Appraisal Tool [52], was used to evaluate the overall study quality.”
From Mediators of outcome in adolescent psychotherapy and their implications for theories and mechanisms of change: a systematic review (2024) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“LM, with the support of a research assistant, assessed the methodological quality of empirical studies (qualitative, quantitative and mixed methods) using the Mixed Methods Appraisal Tool (MMAT) [45].”
From Transnationalism and care of migrant families during pregnancy, postpartum and early-childhood: an integrative review (2020) · cites this paper as [45]
The cited source says what the claim attributes to it.
In the citing paper
“The quality of the included studies was independently assessed by two authors using the Mixed Methods Appraisal Tool (MMAT) (Hong et al., 2018).Disagreements were resolved through discussion.”
From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Hong et al., 2018
29 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4. Conclusion · p. 5
“## 4. Conclusion”
§ 4. How to use the MMAT? · p. 4
“## 4. How to use the MMAT?”
Citations
Cites
Pace, R., Pluye, P., Bartlett, G., Macaulay, A. C., Salsberg, J., Jagosh, J., & Seller, R. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.07.002 · Cited by 1,331 · cited 2×
“Then, two interrater reliability studies on the MMAT were conducted using respectively 32 and 261 papers (Pace et al., 2012; Souto et al., 2015).”
Self-citationPluye, P., Gagnon, M.-P., Griffiths, F., & Johnson-Lafleur, J. (2009) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.01.009 · Cited by 1,119 · cited 3×
“This led to develop a first version of the MMAT that is in line with a social constructionist worldview (Pluye et al., 2009).”
InfluentialSelf-citationHong, Q. N., Gonzalez‐Reyes, A., & Pluye, P. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12884 · Cited by 1,107 · cited 3×
“To further its development, usefulness testing was performed by interviewing 20 researchers who have used the MMAT in a systematic review or had contacted the developer of the tool for questions or permission to use the tool (Hong et al., 2018a).”
Self-citationSystems to rate the strength of scientific evidence.
West, S. L., King, V., Carey, T. S., Lohr, K. N., Mckoy, N. A., Sutton, S. F., & Lux, L. J. (2002) · PubMed Central · Cited by 923
Zaza, S., Wright-De Agüero, L. K., Briss, P. A., Truman, B. I., Hopkins, D. P., Hennessy, M. H., Sosin, D. M., Anderson, L., Carande-Kulis, V. G., Teutsch, S. M., et al. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00122-1 · Cited by 464 · cited 1×
“The algorithm was developed based on several existing algorithms of quantitative study designs (Hartling et al., 2010; Hartling et al., 2011; National Institute for Health Care Excellence, 2012; Scottish Intercollegiate Guidelines Network; Seo et al., 2016; West et al., 2002; Zaza et al., 2000).”
Souto, R. Q., Khanassov, V., Hong, Q. N., Bush, P. L., Vedel, I., & Pluye, P. (2015) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2014.08.010 · Cited by 375 · cited 1×
“Then, two interrater reliability studies on the MMAT were conducted using respectively 32 and 261 papers (Pace et al., 2012; Souto et al., 2015).”
Self-citationA review of critical appraisal tools show they lack rigor: Alternative tool structure is proposed
Crowe, M., & Sheppard, L. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.008 · Cited by 261 · cited 2×
“Currently, there exist more than 500 critical appraisal tools (i.e., checklists including a list of criteria to judge the quality of a study) (Bai et al., 2012; Crowe & Sheppard, 2011; Heyvaert et al., 2013; Santiago-Delefosse et al., 2016).”
Carroll, C., Booth, A., & Lloyd-Jones, M. (2012) · Qualitative Health Research · doi:10.1177/1049732312452937 · Cited by 248 · cited 1×
“Methodological quality criteria are more difficult to interpret because the reviewers need to judge whether the reported results of a study are trustworthy (Carroll et al., 2012; Hong & Pluye, 2018a).”
Adjustment of meta-analyses on the basis of quality scores should be abandoned
Herbison, P., Hay-Smith, J., & Gillespie, W. J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.008 · Cited by 207 · cited 1×
“Currently in the literature, it is discouraged to calculate an overall score from the ratings of each criterion (Herbison et al., 2006; Higgins & Green, 2008; Viswanathan et al., 2012).”
Critical Appraisal of Mixed Methods Studies
Heyvaert, M., Hannes, K., Maes, B., & Onghena, P. (2013) · Journal of Mixed Methods Research · doi:10.1177/1558689813479449 · Cited by 168 · cited 1×
“Currently, there exist more than 500 critical appraisal tools (i.e., checklists including a list of criteria to judge the quality of a study) (Bai et al., 2012; Crowe & Sheppard, 2011; Heyvaert et al., 2013; Santiago-Delefosse et al., 2016).”
Cited by
De Kock, J. H., Latham, H. A., Leslie, S. J., Grindle, M., Munoz, S.-A., Ellis, L., Polson, R., & O’Malley, C. M. (2021) · BMC Public Health · doi:10.1186/s12889-020-10070-3 · Cited by 940
Nearchou, F., Flinn, C., Niland, R., Subramaniam, S. S., & Hennessy, E. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17228479 · Cited by 577
“l ssess ent Tool [31] scree ing criteria.”
BackgroundMethodInfluentialCamouflaging in autism: A systematic review
Cook, J., Hull, L., Crane, L., & Mandy, W. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102080 · Cited by 554
Risk and protective factors of drug abuse among adolescents: a systematic review
Nawi, A. M., Ismail, R., Ibrahim, F., Hassan, M. R., Manaf, M. R. A., Amit, N., Ibrahim, N., & Shafurdin, N. S. (2021) · BMC Public Health · doi:10.1186/s12889-021-11906-2 · Cited by 506
“This tool has been shown to be useful in systematic reviews encompassing different study designs [22].”
MethodHarrison, R., Jones, B., Gardner, P., & Lawton, R. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06122-y · Cited by 480
“other tools that focused on appraising the methodological quality to provide an expanded analysis where needed [100].”
Liverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408
Lambert, S. I., Madi, M., Sopka, S., Lenes, A., Stange, H., Buszello, C.-P., & Stephan, A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00852-5 · Cited by 404
“The quality of all included articles were critically assessed by means of the Mixed Methods Appraisal Tool (MMAT) by two authors (M.M. and S.L.) 81 .”
InfluentialYoung, A. T., Amara, D., Bhattacharya, A., & Wei, M. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00132-1 · Cited by 400
Bertolazzi, A., Quaglia, V., & Bongelli, R. (2024) · BMC Public Health · doi:10.1186/s12889-024-18036-5 · Cited by 399
“The methodological quality of the selected records has been assessed using the Mixed Methods Appraisal Tool (MMAT) [57].”
MethodPoon, Y.-S. R., Lin, Y. P., Griffiths, P., Yong, K. K., Seah, B., & Liaw, S. Y. (2022) · Human Resources for Health · doi:10.1186/s12960-022-00764-7 · Cited by 394
“The Mixed Methods Appraisal Tool (MMAT) version 2018 [24] was used to appraise mixed methods studies.”
MethodGöttgens, I., & Oertelt-Prigione, S. (2021) · JMIR mHealth and uHealth · doi:10.2196/28102 · Cited by 385
“We assessed the quality of reporting and analysis of the study designs using the Mixed Methods Appraisal Tool (MMAT), which allows for the appraisal of studies for literature reviews that include qualitative, quantitative, and mixed methods studies [24].”
MethodThe association between academic pressure and adolescent mental health problems: a systematic review
Steare, T., Gutiérrez Muñoz, C., Sullivan, A., & Lewis, G. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.07.028 · Cited by 372
Current applications and challenges in large language models for patient care: a systematic review
Busch, F., Hoffmann, L., Rueger, C., van Dijk, E. H., Kader, R., Ortiz-Prado, E., Makowski, M. R., Saba, L., Hadamitzky, M., Kather, J. N., et al. (2025) · Communications Medicine · doi:10.1038/s43856-024-00717-2 · Cited by 358
“Quality assessment was also performed independently for each article within this data extraction form, usingtheMixedMethodsAppraisalTool(MMAT)2018 18 .”
Virtual reality and gamification in education: a systematic review
Lampropoulos, G., & Kinshuk (2024) · Educational technology research and development · doi:10.1007/s11423-024-10351-3 · Cited by 352
Kolimenakis, A., Heinz, S., Wilson, M. L., Winkler, V., Yakob, L., Michaelakis, A., Papachristos, D., Richardson, C., & Horstick, O. (2021) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0009631 · Cited by 342
“The Mixed Methods Appraisal Tool (MMAT) was selected for its potential to assess the methodological quality of quantitative, qualitative, and mixed methods studies [18,19].”
MethodSzinay, D., Jones, A., Chadborn, T., Brown, J., & Naughton, F. (2020) · Journal of Medical Internet Research · doi:10.2196/17572 · Cited by 289
Hu, D., Zhou, S., Crowley-McHattan, Z. J., & Liu, Z. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18063147 · Cited by 338
“As analyzed by the MMAT [38], the selected studies’ quality analysis showed that the articles that met the inclusion criteria could be regarded as high quality (Table 3).”
BackgroundMethodInfluentialButler-Henderson, K., & Crawford, J. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.104024 · Cited by 250
“Each accepted paper was reviewed for quality using the MMAT system (Hong et al., 2018) and the scores were calculated as high, medium, or low quality based on the matrix (Hong et al., 2018).”
Chu, I. Y.-H., Alam, P., Larson, H. J., & Lin, L. (2020) · Journal of Travel Medicine · doi:10.1093/jtm/taaa192 · Cited by 247
Doherty, A. J., Atherton, H., Boland, P., Hastings, R., Hives, L., Hood, K., James-Jenkinson, L., Leavey, R., Randell, E., Reed, J., et al. (2020) · BJGP Open · doi:10.3399/bjgpopen20x101030 · Cited by 244
“Study quality was assessed independently by two researchers using the Mixed Methods Analysis Tool (MMAT).(16,17) The MMAT is designed for use in the appraisal stage of systematic reviews of different types of studies.”
MethodMajor, L., Francis, G. A., & Tsapali, M. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13116 · Cited by 240
The role of health literacy in cancer care: A mixed studies systematic review
Holden, C. E., Wheelwright, S., Harle, A., & Wagland, R. (2021) · PLOS ONE · doi:10.1371/journal.pone.0259815 · Cited by 232
Martinez, A. B., Co, M., Lau, J., & Brown, J. S. L. (2020) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-020-01937-2 · Cited by 221
“The appraisals for mixed-methods studies were done separately for quantitative and qualitative components to ensure trustworthiness [24] of the quality of each assessment.”
MethodOkada, M., Mitchell, P., Finger, R. P., Eldem, B., Talks, S. J., Hirst, C., Paladini, L., Barratt, J., Wong, T. Y., & Loewenstein, A. (2021) · Ophthalmology · doi:10.1016/j.ophtha.2020.07.060 · Cited by 214
Tun, H. M., Rahman, H. A., Naing, L., & Malik, O. A. (2025) · Journal of Medical Internet Research · doi:10.2196/69678 · Cited by 210
“The Mixed Methods Appraisal Tool was used to assess the quality of studies, enabling evaluation across diverse methodological approaches [18].”
Shoesmith, A., Hall, A., Wolfenden, L., Shelton, R. C., Powell, B. J., Brown, H., McCrabb, S., Sutherland, R., Yoong, S., Lane, C., et al. (2021) · Implementation Science · doi:10.1186/s13012-021-01134-y · Cited by 209
“Quality assessment of included articles was performed independently by two authors (AS and AH) using the Mixed-Methods Appraisal Tool (MMAT) [35].”
BackgroundInfluentialRole of active patient involvement in undergraduate medical education: a systematic review
Dijk, S. W., Duijzer, E. J., & Wienold, M. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037217 · Cited by 208
Truong, L. K., Mosewich, A. D., Holt, C. J., Le, C. Y., Miciak, M., & Whittaker, J. L. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-101206 · Cited by 205
“35 37 The level of evidence represented by each record was determined with a modified version of the Oxford Centre of Evidence Based Medicine (OCEBM) 2009 model (online supplementary file 3).”
MethodKaboré, S. S., Ngangue, P., Soubeiga, D., Barro, A., Pilabré, A. H., Bationo, N., Pafadnam, Y., Drabo, K. M., Hien, H., & Savadogo, G. B. L. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1014375 · Cited by 203
“It allows the appraisal of five methodological quality categories: qualitative research, randomized controlled trials, non-randomized studies, quantitative descriptive studies, and mixed methods studies (13, 14, 16, 17).”
BackgroundInfluentialQuesada-Puga, C., Izquierdo-Espin, F. J., Membrive-Jiménez, M. J., Aguayo-Estremera, R., Cañadas-De La Fuente, G. A., Romero-Béjar, J. L., & Gómez-Urquiza, J. L. (2024) · Intensive and Critical Care Nursing · doi:10.1016/j.iccn.2024.103660 · Cited by 205
Social media’s influence on adolescents′ food choices: A mixed studies systematic literature review
Kucharczuk, A. J., Oliver, T. L., & Dowdell, E. B. (2022) · Appetite · doi:10.1016/j.appet.2021.105765 · Cited by 201
Appleton, R., Williams, J., Vera San Juan, N., Needle, J. J., Schlief, M., Jordan, H., Sheridan Rains, L., Goulding, L., Badhan, M., Roxburgh, E., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/31746 · Cited by 196
“AACODS: authority, accuracy, coverage, objectivity, date, significance (tool) CFIR: Consolidated Framework for Implementation Research CMHT: community mental health team MMAT: Mixed Methods Appraisal Tool NHS: National Health Service PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses Edited by…”
MethodInfluentialBadu, E., O’Brien, A. P., Mitchell, R., Rubin, M., James, C., McNeil, K., Nguyen, K., & Giles, M. (2020) · International Journal of Mental Health Nursing · doi:10.1111/inm.12662 · Cited by 192
Eisenstadt, M., Liverpool, S., Infanti, E., Ciuvat, R. M., & Carlsson, C. (2021) · JMIR Mental Health · doi:10.2196/31170 · Cited by 182
“The tool was recently updated in 2018 and has shown evidence of good interrater reliability, usability, and content validity [47].”
InfluentialAlotaibi, N., Wilson, C. B., & Traynor, M. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12663-3 · Cited by 176
“Each of (MMAT) Questions were rated as ‘no’, ‘yes’, and’ can’t tell’ [42].”
Women’s autonomy in healthcare decision making: a systematic review
Idris, I. B., Hamis, A. A., Bukhori, A. B. M., Hoong, D. C. C., Yusop, H., Shaharuddin, M. A.-A., Fauzi, N. A. F. A., & Kandayah, T. (2023) · BMC Women's Health · doi:10.1186/s12905-023-02792-4 · Cited by 175
“All included studies underwent a critical evaluation using the Mixed Methods Appraisal Tool (MMAT) [13].”
MethodLoot boxes, problem gambling and problem video gaming: A systematic review and meta-synthesis
Spicer, S. G., Nicklin, L. L., Uther, M., Lloyd, J., Lloyd, H., & Close, J. (2022) · New Media & Society · doi:10.1177/14614448211027175 · Cited by 172
“We utilised the Mixed Methods Appraisal Tool (MMAT; Hong et al., 2018) to assess the quality of evidence, using items relating to quantitative descriptive studies: 4.1 = appropriate sampling strategy; 4.2 = representative population; 4.3 = appropriate measures; 4.4 = low nonresponse bias; 4.5 =…”
MethodInfluentialThordardottir, B., Malmgren Fänge, A., Lethin, C., Rodriguez Gatta, D., & Chiatti, C. (2019) · BioMed Research International · doi:10.1155/2019/9196729 · Cited by 169
“The design and quality of studies according to the MMAT are presented in Table 1, which includes also more details on participants and type of data.”
MethodInfluentialShi, Y., Ma, D., Zhang, J., & Chen, B. (2023) · Journal of Public Health · doi:10.1007/s10389-021-01604-z · Cited by 163
Climate change, mental health, and reproductive decision-making: A systematic review
Dillarstone, H., Brown, L. J., & Flores, E. C. (2023) · PLOS Climate · doi:10.1371/journal.pclm.0000236 · Cited by 162
Ventista, O. M., & Brown, C. (2023) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2023.100565 · Cited by 161
Cyberbullying in elementary and middle school students: A systematic review
Evangelio, C., Saiz-González, P., Fernández‐Río, J., & González‐Víllora, S. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104356 · Cited by 242
“The scores were set as low (1-2), medium (3) and high (4–5) for quantitative studies (there were no studies with qualitative/mixed designs), based on the tool’s matrix (Hong et al., 2018).”
BackgroundGasteiger, N., Loveys, K., Law, M., & Broadbent, E. (2021) · Clinical Interventions in Aging · doi:10.2147/cia.s282709 · Cited by 153
“Quality assessments were conducted using the Mixed Methods Appraisal Tool (MMAT).(46) The MMAT was deemed appropriate as it provides a consistent tool for evaluating qualitative, quantitative randomised controlled trials, quantitative non-randomized studies, quantitative descriptive and mixed-methods research.”
MethodHoefel, L., O'Connor, A. M. C., Lewis, K. B., Boland, L., Sikora, L., Hu, J., & Stacey, D. (2020) · Medical Decision Making · doi:10.1177/0272989x20936209 · Cited by 156
“Risk of Bias in Individual Studies We used the Mixed Methods Appraisal Tool (MMAT) to describe the methodological quality of included quantitative, qualitative, and mixed-method studies.(26,27) The MMAT has moderate to almost perfect agreement between raters (k score of 0.”
MethodBarriers and facilitators for cascade testing in genetic conditions: a systematic review
Srinivasan, S., Won, N. Y., Dotson, W. D., Wright, S. T., & Roberts, M. C. (2020) · European Journal of Human Genetics · doi:10.1038/s41431-020-00725-5 · Cited by 167
Pallavicini, F., Pepe, A., & Mantovani, F. (2022) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2021.0252 · Cited by 221
“Quality assessment outcomes An overall quality score was assigned to each study using the MMAT scoring system.(72) Studies could be awarded 0, 25, 50, 75, or 100 (with 100 being the highest quality).”
MethodKrzeczkowska, A., Spalding, D. M., McGeown, W. J., Gow, A. J., Carlson, M. C., & Brown, L. A. (2021) · Ageing Research Reviews · doi:10.1016/j.arr.2021.101400 · Cited by 195
Social determinants of COVID-19 incidence and outcomes: A rapid review
Upshaw, T. L., Brown, C., Smith, R., Perri, M., Ziegler, C., & Pinto, A. D. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248336 · Cited by 142
Wong, E., Mavondo, F., & Fisher, J. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05383-3 · Cited by 205
“teria to reflect the quality of the included studies [30].”
BackgroundMarch, A., Stapley, E., Hayes, D., Town, R., & Deighton, J. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19063587 · Cited by 211
“Quality assessment of included articles was conducted using the Mixed Methods Appraisal Tool (MMAT; [28]).”
MethodBrede, J., Cage, E., Trott, J., Palmer, L., Smith, A., Serpell, L., Mandy, W., & Russell, A. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102131 · Cited by 139
“Quality assessment was performed using the Mixed Methods Appraisal Tool (MMAT-Version 18, Hong et al., 2018).”
InfluentialThe Involvement of Oxidative Stress in Psoriasis: A Systematic Review
Dobrică, E.-C., Cozma, M.-A., Găman, M., Voiculescu, V.-M., & Găman, A. M. (2022) · Antioxidants · doi:10.3390/antiox11020282 · Cited by 168
“We evaluated the methodological quality and the risk of bias of the analyzed studies using the methodological index for nonrandomized observational studies (MINORS) and the Mixed Methods Appraisal Tool (MMAT), respectively [12,13].”
MethodShahin, W., Kennedy, G. A., & Stupans, I. (2021) · Pharmacy Practice · doi:10.18549/pharmpract.2021.2.2300 · Cited by 135
Cultural Differences in Body Image: A Systematic Review
Abdoli, M., Rosato, M. S., Desousa, A., & Cotrufo, P. (2024) · Social Sciences · doi:10.3390/socsci13060305 · Cited by 213
Artificial intelligence in nursing: an integrative review of clinical and operational impacts
Hassanein, S., El Arab, R. A., Abdrbo, A., Abu-Mahfouz, M. S., Gaballah, M. K. F., Seweid, M. M., Almari, M., & Alzghoul, H. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1552372 · Cited by 134
How Adolescents Trust Health Information on Social Media: A Systematic Review
Freeman, J. L., Caldwell, P. H. Y., & Scott, K. M. (2023) · Academic Pediatrics · doi:10.1016/j.acap.2022.12.011 · Cited by 133
A scoping review of de-implementation frameworks and models
Walsh‐Bailey, C., Tsai, E., Tabak, R. G., Morshed, A. B., Norton, W. E., McKay, V., Brownson, R. C., & Gifford, S. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01173-5 · Cited by 162
“The median number of MMAT criteria met by included empirical studies was 4 (out of 5).”
BackgroundMethodInfluentialSupport needs of parents in neonatal intensive care unit: An integrative review
Adama, E. A., Adua, E., Bayes, S., & Mörelius, E. (2022) · Journal of Clinical Nursing · doi:10.1111/jocn.15972 · Cited by 130
Kapsalis, E., Jaeger, N., & Hale, J. A. (2022) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2022.2111723 · Cited by 200
“Category criteria 1 generally refer to data collection methods, data analysis strategies, risk of bias, sampling, confidence, and methodological consistency [41], and are rated either “yes,” “no” or “can’t tell.””
BackgroundMethodAn integrative review of resilience among nursing students in the context of nursing education
Aryuwat, P., Asp, M., Lövenmark, A., Radabutr, M., & Holmgren, J. (2022) · Nursing Open · doi:10.1002/nop2.1559 · Cited by 182
“4.2 | Data evaluation Records included in the final sample were appraised for quality using the Mixed Methods Appraisal Tool (MMAT; Hong et al., 2018).”
MethodInfluentialMental Health during the COVID-19 Crisis in Africa: A Systematic Review and Meta-Analysis
Chen, J., Farah, N., Dong, R. K., Chen, R. Z., Xu, W., Yin, J., Chen, B. Z., Delios, A. Y., Miller, S., Wan, X., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182010604 · Cited by 128
Rykkje, L., Søvik, M. B., Ross, L. A., McSherry, W., Cone, P. H., & Giske, T. (2021) · Journal of Clinical Nursing · doi:10.1111/jocn.16067 · Cited by 167
“…Public Healthcare Panacea Project, 2020) was used for quantitative studies, the NICE checklist appendix H (National Institute for Health Care Excellence, 2012) for qualitative studies, and the mixed-method tool (Hong et al., 2018) for studies that included both quantitative and qualitative results.”
Penney, D., Sauvé, G., Mendelson, D., Thibaudeau, É., Moritz, S., & Lepage, M. (2022) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2022.0277 · Cited by 141
Wolfson, L., Schmidt, R. A., Stinson, J., & Poole, N. (2021) · Health & Social Care in the Community · doi:10.1111/hsc.13335 · Cited by 138
“Fifty- one (n = 51) articles were assessed using the Mixed Methods Appraisal Tool (MMAT) 2018 Version, which is designed to facilitate the appraisal and inclusion of quantitative, qualitative and mixed methods studies within the same review (Hong et al., 2018).”
MethodMunro, A. K., Hunter, E. C., Hossain, S. Z., & Keep, M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257333 · Cited by 177
The application of artificial intelligence in the field of mental health: a systematic review
Dehbozorgi, R., Zangeneh, S., Khooshab, E., Nia, D. H., Hanif, H. R., Samian, P., Yousefi, M., Hashemi, F. H., Vakili, M., Jamalimoghadam, N., et al. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06483-2 · Cited by 193
Stemmer, R., Bassi, E., Ezra, S., Harvey, C. L., Joseph, J., Meyer, G., Özsaban, A., Paterson, C. C., Shifaza, F., Turner, M. R., et al. (2022) · Journal of Advanced Nursing · doi:10.1111/jan.15286 · Cited by 166
Dementia‐friendly community initiatives: An integrative review
Shannon, K., Bail, K. S., & Neville, S. J. (2018) · Journal of Clinical Nursing · doi:10.1111/jocn.14746 · Cited by 138
Mixed methods research in library and information science: A methodological review
Granikov, V., Hong, Q. N., Crist, E., & Pluye, P. (2020) · Library & Information Science Research · doi:10.1016/j.lisr.2020.101003 · Cited by 182
Self-citationLin, F. F., Wu, Z., Song, B., Coyer, F. M., & Chaboyer, W. P. (2019) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2019.103483 · Cited by 129
Use of menstruation and fertility app trackers: a scoping review of the evidence
Earle, S., Marston, H. R., Hadley, R., & Banks, D. (2020) · BMJ Sexual & Reproductive Health · doi:10.1136/bmjsrh-2019-200488 · Cited by 137
Zamzam, A. H., Wahab, A. K. A., Azizan, M. M., Satapathy, S. C., Lai, K. W., & Hasikin, K. B. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.753951 · Cited by 172
“The articles were categorised into high, moderate, and low levels that reflect the aim, input parameters, methodology technique, expected output, and desired outcomes (18).”
BackgroundTyler, N., Wright, N., & Waring, J. J. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4658-0 · Cited by 146
Kamal, A., Hodson, A., & Pearce, J. M. (2021) · Vaccines · doi:10.3390/vaccines9101121 · Cited by 116
“Hong, Q.N.; Fàbregues, S.; Bartlett, G.; Boardman, F.; Cargo, M.; Dagenais, P.; Gagnon, M.P.; Griffiths, F.; Nicolau, B.; O’Cathain, A.; et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers.”
MethodInfluentialCooper, J., Murphy, J., Woods, C., Van Nassau, F., McGrath, A., Callaghan, D., Carroll, P., Kelly, P., Murphy, N., Murphy, M., et al. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01177-w · Cited by 114
Stigma in relation to families living with parental mental illness: An integrative review
Reupert, A., Gladstone, B., Hine, R. H., Yates, S., McGaw, V. E., Charles, G., Drost, L. M., & Foster, K. (2020) · International Journal of Mental Health Nursing · doi:10.1111/inm.12820 · Cited by 156
“Assessment of methodological quality The process of assessment for the methodological quality of the identified qualitative, quantitative, and mixed method studies was undertaken using the Mixed Method Appraisal Tool (MMAT; Hong et al. 2018).”
MethodCommercial Off-The-Shelf Video Games for Reducing Stress and Anxiety: Systematic Review
Pallavicini, F., Pepe, A., & Mantovani, F. (2021) · JMIR Mental Health · doi:10.2196/28150 · Cited by 115
“An overall quality score was assigned to each study using the MMAT scoring system [98].”
MethodInfluentialPsychosocial factors and safety in high-risk industries: A systematic literature review
Derdowski, L. A., & Mathisen, G. E. (2022) · Safety Science · doi:10.1016/j.ssci.2022.105948 · Cited by 168
Lee, S. E., Choi, J., Lee, H., Sang, S., Lee, H., & Hong, H. C. (2021) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s297349 · Cited by 135
Almohanna, A. A. S., Win, K. T., & Meedya, S. (2020) · Journal of Medical Internet Research · doi:10.2196/17361 · Cited by 151
“The quality of the studies was appraised by 2 researchers (AA and SM), using the mixed methods appraisal tool [37,38].”
Hamzah, H., Hamzah, M. I., & Zulkifli, H. (2022) · Sustainability · doi:10.3390/su14020813 · Cited by 109
The Impacts of Sports Schools on Holistic Athlete Development: A Mixed Methods Systematic Review
Thompson, F., Rongen, F., Cowburn, I. H. J., & Till, K. (2022) · Sports Medicine · doi:10.1007/s40279-022-01664-5 · Cited by 181
“The MMAT can evaluate the primary studies' methodology of quantitative, qualitative, and mixed methods studies; therefore, it was deemed the most appropriate tool due to the variety of primary studies represented in the search return.”
BackgroundInfluentialA systematic review and framework for digital leadership research maturity in higher education
Jameson, J., Rumyantseva, N. L., Cai, M., Markowski, M., Essex, R., & McNay, I. (2022) · Computers and Education Open · doi:10.1016/j.caeo.2022.100115 · Cited by 247
Artificial Intelligence (AI) – Powered Documentation Systems in Healthcare: A Systematic Review
Bracken, A., Reilly, C., Feeley, A., Sheehan, E., Merghani, K., & Feeley, I. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02157-4 · Cited by 113
“1 The mixed methods appraisal tool (MMAT) [16] was used to assess the quality of eligible studies.”
The Impact of Artificial Intelligence on Inclusive Education: A Systematic Review
López, V. A. M., Basantes-Andrade, A., Mejía, C. B. G., & Martínez, E. H. (2025) · Education Sciences · doi:10.3390/educsci15050539 · Cited by 247
Abildgren, L., Lebahn-Hadidi, M., Mogensen, C. B., Toft, P., Nielsen, A. B., Frandsen, T. F., Steffensen, S. V., & Hounsgaard, L. (2022) · Advances in Simulation · doi:10.1186/s41077-022-00207-2 · Cited by 162
“Each study was scrutinised for validity, reliability, generalisability and replicability of the results using the Critical Appraisal Skills Programme checklists (CASP) [41], Mixed Methods Appraisal Tool (MMAT) [42] or Critical Appraisal of a Survey [43].”
MethodThe Impact of Virtual Consultations on the Quality of Primary Care: Systematic Review
Campbell, K., Greenfield, G., Li, E., O'Brien, N., Hayhoe, B., Beaney, T., Majeed, A., & Neves, A. L. (2023) · Journal of Medical Internet Research · doi:10.2196/48920 · Cited by 104
Hepburn, J., Williams, L., & McCann, L. (2025) · JMIR Aging · doi:10.2196/80000 · Cited by 177
Men's help‐seeking and engagement with general practice: An integrative review
Mursa, R., Patterson, C., & Halcomb, E. (2022) · Journal of Advanced Nursing · doi:10.1111/jan.15240 · Cited by 132
“Studies were appraised using the Mixed Method Appraisal Tool (MMAT) (Hong et al., 2018).”
MethodThe impact of continuing bonds following bereavement: A systematic review
Hewson, H., Galbraith, N., Jones, C., & Heath, G. (2024) · Death Studies · doi:10.1080/07481187.2023.2223593 · Cited by 101
Steindal, S. A., Nes, A. A. G., Godskesen, T., Holmen, H., Winger, A., Österlind, J., Dihle, A., & Klarare, A. (2023) · Journal of Medical Internet Research · doi:10.2196/43684 · Cited by 129
“On the basis of the study design, the methodological quality of the included studies was independently appraised by the same pairs of authors using the Mixed Methods Appraisal Tool (version 2018) [38].”
Farnood, A., Johnston, B., & Mair, F. S. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01243-6 · Cited by 100
Ozavci, G., Bucknall, T. K., Woodward‐Kron, R. E., Hughes, C. M., Jorm, C. M., Joseph, K., & Manias, E. (2020) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2020.03.023 · Cited by 107
Hussain, B., Mirza, M., Baines, R., Burns, L., Stevens, S., Asthana, S., & Chatterjee, A. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1113864 · Cited by 128
“BH and MM assessed quality of studies using 2018 version of mixed methods appraisal tool (MMAT) for quality assessment of the studies (53).”
MethodMcGrath, M., Low, M. A., Power, E., McCluskey, A., & Lever, S. (2020) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2020.09.379 · Cited by 116
Emergent gambling advertising; a rapid review of marketing content, delivery and structural features
Torrance, J., John, B., Greville, W. J., O’Hanrahan, M., Davies, N., & Roderique‐Davies, G. (2021) · BMC Public Health · doi:10.1186/s12889-021-10805-w · Cited by 127
“A final set of empirical records (n = 25) underwent quality assessment via the Mixed Methods Appraisal Tool (MMAT) 2018 [33].”
BackgroundMethodWutz, M., Hermes, M., Winter, V., & Köberlein-Neu, J. (2023) · Journal of Medical Internet Research · doi:10.2196/46548 · Cited by 99
Schwarz, J., Bärkås, A., Blease, C., Collins, L., Hägglund, M., Markham, S., & Hochwarter, S. (2021) · JMIR Mental Health · doi:10.2196/34170 · Cited by 101
(2021) · doi:10.2196/29512 · Cited by 91
Zhang, S. X., Batra, K., Xu, W., Liu, T., Dong, R. K., Yin, A., Delios, A. Y., Chen, B. Z., Chen, R. Z., Miller, S., et al. (2022) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796021000767 · Cited by 95
“The Mixed Methods Appraisal Tool (MMAT) with seven questions was used as a quality assessment tool (Hong et al., 2018; Pablo et al., 2020; Usher et al., 2020).”
Method
Metadata
- Authors
- Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., Rousseau, M.-C., Vedel, I., & Pluye, P.
- Affiliations
- McGill University (CA)
- Universitat Oberta de Catalunya (ES)
- University of Warwick (GB)
- University of Canberra (AU)
- Université de Sherbrooke (CA)
- Université Laval (CA)
- University of Sheffield (GB)
- Institut National de la Recherche Scientifique (CA)
- Corresponding author
- Pluye, Pierre
- ORCID
- Venue
- Education for Information
- Publisher
- SAGE Publications
- Published
- 2018-12-18
- Volume
- 34
- Issue
- 4
- Pages
- 285-291
- ISSN
- 0167-8329 (ISSN-L)
- 1875-8649
- OpenAlex
- W2901724277
- Cited by
- 4,737
- References
- 21
- Citations by year
- 2026: 1312 · 2025: 974 · 2024: 800 · 2023: 610 · 2022: 501 · 2021: 370 · 2020: 143 · 2019: 22 · 2018: 3
- FWCI
- 102.21
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- Locations
- Education for Information (publishedVersion)
- O2 - Repositori Institucional (Universitat Oberta de Catalunya) (publishedVersion, cc-by-nc-nd)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (publishedVersion, cc-by-nc-nd)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- HAL (submittedVersion)
- eScholarship@McGill (McGill) (submittedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by-nc-nd)
- eScholarship@McGill (McGill) (submittedVersion, cc-by-nc-nd)
- EspaceINRS (National Institute for Scientific Research (Canada)) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Education › Qualitative Research Methods and Applications
- Keywords
- Mixed Methods Appraisal Tool, critical appraisal, study quality assessment, mixed methods, systematic reviews, qualitative research, quantitative research, randomized controlled trials, non-randomized studies, e-Delphi, inter-rater reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.