The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index; 2 of the 26 sources its claims cite were checked for support.
Abstract
INTRODUCTION: Appraising the quality of studies included in systematic reviews combining qualitative and quantitative evidence is challenging. To address this challenge, a critical appraisal tool was developed: the Mixed Methods Appraisal Tool (MMAT). The aim of this paper is to present the enhance ments made to the MMAT. DEVELOPMENT: The MMAT was initially developed in 2006 based on a literature review on systematic reviews combining qualitative and quantitative evidence. It was subject to pilot and interrater reliability testing. A revised version of the MMAT was developed in 2018 based on the results from usefulness testing, a literature review on critical appraisal tools and a modified e-Delphi study with methodological experts to identify core criteria. TOOL DESCRIPTION: The MMAT assesses the quality of qualitative, quantitative, and mixed methods studies. It focuses on methodological criteria and includes five core quality criteria for each of the following five categories of study designs: (a) qualitative, (b) randomized controlled, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods. CONCLUSION: The MMAT is a unique tool that can be used to appraise the quality of different study designs. Also, by limiting to core criteria, the MMAT can provide a more efficient appraisal.
Overview
CoChat Summary
TL;DR
This paper presents version 2018 of the Mixed Methods Appraisal Tool (MMAT), a single critical appraisal tool for assessing the methodological quality of qualitative, quantitative, and mixed methods studies in mixed studies reviews. It describes the tool's 25 criteria across five study design categories, its development history, and guidance for use.
Key findings
The MMAT version 2018 includes a total of 25 criteria and 2 screening questions, covering five categories of study designs: (a) qualitative, (b) randomized controlled trial, (c) nonrandomized, (d) quantitative descriptive, and (e) mixed methods, with five core criteria per category rated as yes, no, or can't tell. The tool was developed from a 2006 first version (15 criteria across four categories), revised in 2011, and further revised into the 2018 version based on usefulness testing with 20 researchers, a literature review on critical appraisal tools, and a modified e-Delphi study with 73 methodological experts. Two interrater reliability studies used 32 and 261 papers respectively and showed the need to clarify criteria, particularly for nonrandomized and qualitative studies. The paper argues the MMAT offers a time-efficient alternative by limiting to core criteria and uniquely includes specific criteria for mixed methods studies, though its criteria are harder to judge because they target methodological rather than reporting quality.
Methods
This is a tool description paper (third in a three-part series on systematic reviews for information professionals) rather than an empirical study; it narrates the development of the MMAT and explains how to apply it. Development drew on a literature review on mixed studies reviews, pilot testing in workshops with four reviewers appraising six studies, two interrater reliability studies (32 and 261 papers), usefulness testing via interviews with 20 researchers, a literature review on critical appraisal tools, and a modified e-Delphi study with 73 methodological experts. Use involves three steps: two optional screening questions, selection of the appropriate design category (or categories), and rating each criterion as yes, no, or can't tell, with detailed presentation of ratings advised over an overall numerical score.
Limitations
The paper states that revision of the MMAT has so far focused on content validity and usefulness, and that further testing on its validity and reliability will be needed; it also notes that modifications may be necessary as evidence develops. It states that MMAT criteria are more difficult to judge than other appraisal tools because they focus on methodological quality rather than reporting quality. Evident from the text: the tool's development evidence base is described only in summary form, with reliability and validity results reported by reference to prior studies rather than presented here.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 0 Not valid · 18 Not checked · 11 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“To further its development, usefulness testing was performed by interviewing 20 researchers who have used the MMAT in a systematic review or have contacted the developer of the tool for questions or permission to use the tool (18).”
What the sources say
- Supportedcites [18] 18. Hong QN, Gonzalez-Reyes A, Pluye P. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT). J Eval Clin Pract. 2018;24(3):459-67. source
The Abstract reports semi-structured interviews with 20 participants to explore the MMAT’s usefulness. The Study Participants section says researchers were recruited through systematic reviews that used the MMAT and a list of people who had contacted its developer for permission or guidance. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The results of this study were helpful to identify changes to be made in the MMAT.”
What the sources say
- Supportedcites [18] 18. Hong QN, Gonzalez-Reyes A, Pluye P. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT). J Eval Clin Pract. 2018;24(3):459-67. source
The Discussion says the study explored MMAT users’ experiences to help revise the tool and identified themes suggesting areas for improvement. The Recommendations for Improving the MMAT then proposes specific changes on the basis of those results. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
In the paper
“Moreover, it includes specific criteria for mixed methods studies, which is not often found in other tools (21).”
What the sources say
- Not matchedcites [21] 21. Pluye P. Critical appraisal tools for assessing the methodological quality of qualitative, quantitative and mixed methods studies included in systematic mixed studies reviews. J Eval Clin Pract. 2013;19(4):722.
We searched by its title and found no matching paper.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“To address this challenge, a critical appraisal tool for assessing the quality of quantitative, qualitative and mixed methods studies was developed: the Mixed Methods Appraisal Tool (MMAT) (7).”
What the sources say
- Not checked — no full text of the sourcecites [7] 7. Pluye P, Gagnon MP, Griffiths F, Johnson-Lafleur J. A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. Int J Nurs Stud. 2009;46(4):529-46. source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Moreover, it includes specific criteria for mixed methods studies, which is not often found in other tools (21).”
What the sources say
- Not matchedcites [21] 21. Pluye P. Critical appraisal tools for assessing the methodological quality of qualitative, quantitative and mixed methods studies included in systematic mixed studies reviews. J Eval Clin Pract. 2013;19(4):722.
We searched by its title and found no matching paper.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
5 more claims
Create a free account to see all 31 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 7
- Probably not a substantial claim. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Quality was assessed using two validated tools by study design. Quantitative studies were appraised using the Mixed Methods Appraisal Tool Version 2018, which evaluates five methodological criteria on a binary scale (Hong et al., 2018). Qualitative studies were additionally appraised using the Critical Appraisal Skills Programme Qualitative Checklist, which evaluates 10 criteria (CASP UK, 2018).”
From Cultural stigma and caregiver burden among family caregivers of people with nervous system disorders in the Middle East and North Africa: A mixed-methods systematic review (2026) · cites this paper as Hong et al., 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The quality of the included studies was assessed using the 2018 version of the Mixed Methods Appraisal Tool (MMAT).15”
From Psychosocial interventions for siblings of children with cancer: A mixed methods systematic review (2021) · cites this paper as [15]
The cited source says what the claim attributes to it.
In the citing paper
“To further limit risks of bias, a formal risk of bias assessment tool (ROB-tool), the Mixed Methods Appraisal Tool [52], was used to evaluate the overall study quality.”
From Mediators of outcome in adolescent psychotherapy and their implications for theories and mechanisms of change: a systematic review (2024) · cites this paper as [52]
The cited source says what the claim attributes to it.
In the citing paper
“LM, with the support of a research assistant, assessed the methodological quality of empirical studies (qualitative, quantitative and mixed methods) using the Mixed Methods Appraisal Tool (MMAT) [45].”
From Transnationalism and care of migrant families during pregnancy, postpartum and early-childhood: an integrative review (2020) · cites this paper as [45]
The cited source says what the claim attributes to it.
In the citing paper
“The quality of the included studies was independently assessed by two authors using the Mixed Methods Appraisal Tool (MMAT) (Hong et al., 2018).Disagreements were resolved through discussion.”
From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Hong et al., 2018
29 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4. Conclusion · p. 5
“## 4. Conclusion”
§ 4. How to use the MMAT? · p. 4
“## 4. How to use the MMAT?”
Citations
Cites
Pace, R., Pluye, P., Bartlett, G., Macaulay, A. C., Salsberg, J., Jagosh, J., & Seller, R. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.07.002 · Cited by 1,331 · cited 2×
“Then, two interrater reliability studies on the MMAT were conducted using respectively 32 and 261 papers (Pace et al., 2012; Souto et al., 2015).”
Self-citationPluye, P., Gagnon, M.-P., Griffiths, F., & Johnson-Lafleur, J. (2009) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.01.009 · Cited by 1,119 · cited 3×
“This led to develop a first version of the MMAT that is in line with a social constructionist worldview (Pluye et al., 2009).”
InfluentialSelf-citationHong, Q. N., Gonzalez‐Reyes, A., & Pluye, P. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12884 · Cited by 1,107 · cited 3×
“To further its development, usefulness testing was performed by interviewing 20 researchers who have used the MMAT in a systematic review or had contacted the developer of the tool for questions or permission to use the tool (Hong et al., 2018a).”
Self-citationSystems to rate the strength of scientific evidence.
West, S. L., King, V., Carey, T. S., Lohr, K. N., Mckoy, N. A., Sutton, S. F., & Lux, L. J. (2002) · PubMed Central · Cited by 923
Zaza, S., Wright-De Agüero, L. K., Briss, P. A., Truman, B. I., Hopkins, D. P., Hennessy, M. H., Sosin, D. M., Anderson, L., Carande-Kulis, V. G., Teutsch, S. M., et al. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00122-1 · Cited by 464 · cited 1×
“The algorithm was developed based on several existing algorithms of quantitative study designs (Hartling et al., 2010; Hartling et al., 2011; National Institute for Health Care Excellence, 2012; Scottish Intercollegiate Guidelines Network; Seo et al., 2016; West et al., 2002; Zaza et al., 2000).”
Souto, R. Q., Khanassov, V., Hong, Q. N., Bush, P. L., Vedel, I., & Pluye, P. (2015) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2014.08.010 · Cited by 375 · cited 1×
“Then, two interrater reliability studies on the MMAT were conducted using respectively 32 and 261 papers (Pace et al., 2012; Souto et al., 2015).”
Self-citationA review of critical appraisal tools show they lack rigor: Alternative tool structure is proposed
Crowe, M., & Sheppard, L. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.008 · Cited by 261 · cited 2×
“Currently, there exist more than 500 critical appraisal tools (i.e., checklists including a list of criteria to judge the quality of a study) (Bai et al., 2012; Crowe & Sheppard, 2011; Heyvaert et al., 2013; Santiago-Delefosse et al., 2016).”
Carroll, C., Booth, A., & Lloyd-Jones, M. (2012) · Qualitative Health Research · doi:10.1177/1049732312452937 · Cited by 248 · cited 1×
“Methodological quality criteria are more difficult to interpret because the reviewers need to judge whether the reported results of a study are trustworthy (Carroll et al., 2012; Hong & Pluye, 2018a).”
Adjustment of meta-analyses on the basis of quality scores should be abandoned
Herbison, P., Hay-Smith, J., & Gillespie, W. J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.008 · Cited by 207 · cited 1×
“Currently in the literature, it is discouraged to calculate an overall score from the ratings of each criterion (Herbison et al., 2006; Higgins & Green, 2008; Viswanathan et al., 2012).”
Critical Appraisal of Mixed Methods Studies
Heyvaert, M., Hannes, K., Maes, B., & Onghena, P. (2013) · Journal of Mixed Methods Research · doi:10.1177/1558689813479449 · Cited by 168 · cited 1×
“Currently, there exist more than 500 critical appraisal tools (i.e., checklists including a list of criteria to judge the quality of a study) (Bai et al., 2012; Crowe & Sheppard, 2011; Heyvaert et al., 2013; Santiago-Delefosse et al., 2016).”
Cited by
Items 2,001–2,100 of 4,578
Tanner, L., Sowden, S. L., Still, M., Thomson, K. H., Bambra, C. L., & Wildman, J. M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182412978 · Cited by 7
“If eligible mixed-methods studies are identified, these will be critically appraised using the Mixed Methods Appraisal Tool (MMAT) [69].”
MethodSeif, N. A., Bastien, R. J., Wang, B., Davies, J., Isaken, M., Ball, E., Pitman, A., & Rowe, S. L. (2021) · medRxiv · doi:10.1101/2021.07.23.21261023 · Cited by 6
“version 2018 [16], which includes a checklist to appraise the methodological quality for qualitative, quantitative and specifically mixed”
BackgroundEducational outcomes of recess in elementary school children: A mixed-methods systematic review
Howie, E. K., Perryman, K. L., Moretta, J., & Cameron, L. (2023) · PLOS ONE · doi:10.1371/journal.pone.0294340 · Cited by 6
Sleep and paranoia: A systematic review and meta-analysis
Brown, P., Reeve, S., Hotton, M., Steer, N., & Steel, C. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102503 · Cited by 5
Impact of Climate Change on Adolescents' Health Outcomes: An Evidence Gap Map Review
Meherali, S. M., Nisa, S., Aynalem, Y. A., Kennedy, M., Salami, B. O., Adjorlolo, S., Ali, P. A., Silva, K. L., Aziato, L., Richter, S. M., et al. (2024) · Journal of Adolescence · doi:10.1002/jad.12455 · Cited by 9
Psychological interventions for refugees with depression: a systematic literature review
Uhr, C., Pawils, S., Nexhmedin Morina, B., Alkailani, H., & Metzner, F. (2025) · BMC Psychiatry · doi:10.1186/s12888-024-06447-y · Cited by 10
Qian, F., Yao, D., Shi, H., Tung, T., & Bi, D. (2025) · BMC Palliative Care · doi:10.1186/s12904-024-01634-w · Cited by 6
“In accordance with the MMAT recommendations, the quality appraisal was reported using descriptive responses to for each MMAT standard to report quality assessments [17].”
Hall, E. J., Ranse, J., Keijzers, G., & Crilly, J. L. (2025) · International Emergency Nursing · doi:10.1016/j.ienj.2025.101574 · Cited by 5
Mao, J., Zhang, Y., Qiu, X., Wang, C., Yang, X., & Li, Q. (2025) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2025.151811 · Cited by 7
Spencer, L. P., Carling, S., Robinson, T., Thomson, K. H., & Kaner, E. (2025) · Journal of Mental Health · doi:10.1080/09638237.2025.2460118 · Cited by 17
“Whilst score calculation is usually discouraged, responses to the 7 relevant MMAT questions (2 screening questions and 5 study design specific questions) were used to inform a grading system, whereby 0–2 “yes” responses elicited a low-quality rating; 3–5 “yes” responses elicited a moderate-quality rating; and 6–7 “yes…”
Interventions to retain emergency department nurses: A scoping review
Amarrador, A., Crilly, J. L., Brough, P. A., & Elder, E. G. (2025) · International Emergency Nursing · doi:10.1016/j.ienj.2025.101573 · Cited by 6
Khalid, N. M., Razali, A. B., Sajali, N. S., Razak, N. A. A., Muhamad, A. S., Ahmad, N., & Kari, D. N. P. M. (2025) · Chronic Illness · doi:10.1177/17423953251334123 · Cited by 5
The Roles of Public Health Nurse in Rural Area: A Narrative Review
Nam, H. J., Lee, S., & Park, H. N. (2025) · Research in Nursing & Health · doi:10.1002/nur.22470 · Cited by 5
The Influence of Family on Gambling Behaviours: A Rapid Review of Emergent Literature
Smith, J. R., Wright, S., Dighton, G., Dymond, S., & Torrance, J. (2025) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-025-01505-2 · Cited by 11
“A final set of records ( n = 36) were subjected to quality assessment using the Mixed Methods Appraisal Tool (MMAT; Bartlett et al., 2018).”
Vasileiou, D., Μoraitou, D., Diamantaras, K., Papaliagkas, V. T., Pezirkianidis, C., & Tsolaki, M. (2025) · Brain Sciences · doi:10.3390/brainsci15060580 · Cited by 7
Natsiou, G., & Tsitouridou, M. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1521473 · Cited by 8
Artificial intelligence in symptom management and clinical decision support for palliative care
Narvaez, R. A., Ferrer, M., Peco, R. A., et al. (2025) · International Journal of Palliative Nursing · doi:10.12968/ijpn.2025.0041 · Cited by 5
Callanan, F., Bradshaw, C., Tuohy, T., Noonan, M., Murphy, S., & Grealish, A. (2025) · PLoS ONE · doi:10.1371/journal.pone.0327253 · Cited by 6
Why people hesitate about dementia screening: A systematic review and meta-analysis
Jin, J., Li, B. J., & Theng, Y. L. (2025) · Social Science & Medicine · doi:10.1016/j.socscimed.2025.118360 · Cited by 11
Do Leaders Actually Influence Sports Performance? An Integrated Systematic Review and Meta-Analyses
Clare, C., Hardy, J., Roberts, R., Tod, D., & Benson, A. J. (2025) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.2024-0312 · Cited by 12
Raesi, R., Gooshki, H. S., Khoshi, A., Saadat, S. H., Daneshi, S., & Hushmandi, K. (2025) · The Open Public Health Journal · doi:10.2174/0118749445401885250704054224 · Cited by 20
Nasseri, P., Veldwijk, J., Niehot, C. D., et al. (2025) · Journal of Personalized Medicine · doi:10.3390/jpm15070315 · Cited by 5
“Quality appraisal of the included literature was conducted using the mixed meth-ods appraisal tool (MMAT) for systematic mixed studies review [31].”
Al-Kabban, A., Al-Kabban, F. M., & Obaid, O. (2025) · Cureus · doi:10.7759/cureus.88043 · Cited by 5
“…the Mixed Methods Appraisal Tool (MMAT), which provides a comprehensive framework for evaluating different study designs, including quantitative randomized controlled trials, quantitative nonrandomized studies, quantitative descriptive studies, qualitative studies, and mixed methods studies [42].”
Ghanem, J., Watson, A., Aversa, S., Au‐Yeung, C., du Sert, O. P., Starzer, M. S. K., Weibell, M. A., Hansen, H. G., Lavigne, K. M., & Lepage, M. (2025) · Psychological Medicine · doi:10.1017/s0033291725100627 · Cited by 10
“MMAT ratings for each individual study, as well as notes on study quality, are presented in Supplementary eTable 3.”
Dearman, C., Adams, N. L., Brooks, K., de Sousa, A. M., Pearce‐Smith, N., & Petrokofsky, C. (2025) · Oxford Open Climate Change · doi:10.1093/oxfclm/kgaf020 · Cited by 13
Is foreign language anxiety malleable? A systematic review of longitudinal observation studies
Sun, Q., Alhowail, A. M., & Beckmann, N. (2025) · System · doi:10.1016/j.system.2025.103782 · Cited by 24
Wilson, C., Brodie, Z. P., & Russell, K. (2025) · British Journal of Educational Psychology · doi:10.1111/bjep.70011 · Cited by 7
“Given that we sought to include quantitative, qualitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT; Hong et al., 2018) was used to critically appraise the eligible studies.”
The Effectiveness of Family Health Conversations Delivered by Nurses: A Systematic Review
Østergaard, B., Svavarsdóttir, E. K., Brødsgaard, A., Rosenstrøm, S. M., García‐Vivar, C., Konradsen, H., Dieperink, K. B., Imhof, L., Imhof, R. M., & Luttik, M. L. (2025) · Journal of Clinical Nursing · doi:10.1111/jocn.70058 · Cited by 8
“The Mixed Method Appraisal Tool (MMAT) version 2018 was used for the mixed-method studies (Hong et al. 2018).”
Stotz, T., Mackelprang, J. L., Harkin, A., Hunt, D., & Buzwell, S. (2025) · The Journal of Sexual Medicine · doi:10.1093/jsxmed/qdaf192 · Cited by 7
Broadhurst, T., Cha, Y. J., Bartlett, C., Heerden, J. V., Smith, L., Lizarondo, L. M., McGrail, M. R., Nasir, B., Hulme, A., Kondalsamy‐Chennakesavan, S., et al. (2025) · Health Promotion International · doi:10.1093/heapro/daaf140 · Cited by 5
Charting the Unseen: A Systematic Review of Risk Perception in Emerging Technologies
Feng, Y.-X., & Hwang, B. (2025) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2025.3604850 · Cited by 6
“To assess the methodological quality and potential bias, studies were evaluated using the mixed methods appraisal tool [45], which enables consistent appraisal of quantitative, qualitative, and mixed-methods studies in systematic reviews.”
Suliman, O., Almuwallad, N., Aljawi, A., Alnuwbi, A., Altuwaylie, R., Bulayl, L., Alhusayni, J., & Alanazi, N. (2025) · Cureus · doi:10.7759/cureus.91498 · Cited by 15
Ahmad, N., Kelty, S. F., Kavanagh, P. S., & Tran, T. T. (2025) · Trauma Violence & Abuse · doi:10.1177/15248380251361065 · Cited by 8
“The Mixed-Method Appraisal Tool (MMAT; Hong et al., 2018) was employed to assess the quality of each study included in this systematic review.”
Syafitri, D. U., Mawaddah, S., Lau, J. Y. F., & Brown, J. S. L. (2025) · International Journal of Social Psychiatry · doi:10.1177/00207640251367289 · Cited by 12
“The Mixed Method Appraisal Tool (MMAT) was used to assess the risk of bias in this study (Hong et al., 2018).”
Verdellen-Krauwel, N. H. T., Frielink, N., Prick, A.-E. J. C., Willems, A. P. A. M., & Embregts, P. J. C. M. (2025) · Disabilities · doi:10.3390/disabilities5040084 · Cited by 10
“Although not required in scoping reviews, a methodological quality assessment was conducted using the Mixed Methods Appraisal Tool (MMAT; [32]) to provide additional context regarding the strength of evidence.”
Fajardo-Castro, L. V., Jalili, S., & Martínez‐Tur, V. (2025) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/jar.70125 · Cited by 6
“The Methods Appraisal Tool (MMAT), version 2018 (Hong et al. 2018), was used to evaluate the quality of the studies and address possible limitations, biases, and confounding factors that could influence the results.”
Menopause and suicide: A systematic review
Hendriks, O., McIntyre, J. C., Rose, A. K., Sambrook, L., Reisel, D., Crockett, C., Newson, L. R., & Saini, P. (2025) · Women s Health · doi:10.1177/17455057251360517 · Cited by 13
“Methodologically, we rigorously followed PRISMA guidelines for study selection and quality assessment and applied the MMAT to appraise the quality of included studies.”
InfluentialPredictors of vaping intention among adolescents: a systematic review
Saruddin, M. Z., Manaf, R. A., Hamzah, K. Q. A., & Khusairi, A. A. A. (2025) · BMC Public Health · doi:10.1186/s12889-025-24518-x · Cited by 13
“The authors conducted quality appraisal of all ten studies using the Mixed Method Appraisal Tool (MMAT), version 2018 [46].”
A Systematic Research Review on Teachers’ Self-Efficacy in Educating Autistic Students
Petersson‐Bloom, L., & Hansson, E. (2025) · Autism & Developmental Language Impairments · doi:10.1177/23969415251392318 · Cited by 15
University academics’ experiences and perceptions of mental health problems
Akinlotan, O. O., O’Connor, A., & Okunzuwa, O. (2025) · Journal of Further and Higher Education · doi:10.1080/0309877x.2025.2583097 · Cited by 7
“The quality of the included studies (Table 4) was appraised using the Mixed Methods Appraisal Tool ((MMAT) (Hong et al. 2018).”
Zali, P., McElroy, L. B., Giardini, M., Chaiyawat, K., & Watson, M. C. (2025) · HERD Health Environments Research & Design Journal · doi:10.1177/19375867251391361 · Cited by 14
“Overall quality scores were calculated based on the percentage of corresponding criteria met (Hong, Fàbregues et al., 2018), and the results are presented in the Supplemental Materials (Appendix III).”
InfluentialTrauma-Focused Treatment in Early and Lifetime Psychosis: A Scoping Review
Jankowski, S. E., Bennett, R., Tao, B., Neria, Y., Dixon, L. B., Wainberg, M. L., Sweetland, A. C., & Patel, S. R. (2025) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaf202 · Cited by 7
“Three databases (PubMed, PsycINFO, Web of Science) were searched in December 2024 using specific keywords related to psychosis, trauma, and treatment: (Psychosis OR Psychoses OR Psychotic OR Schizophren ∗ ) AND (trauma ∗ OR PTSD OR “Posttraumatic stress” OR “Post traumatic stress”) AND (treatment OR intervention OR th…”
Bjerke, A. H., Hungnes, T., Bachmann, K. E., Hatlevik, O. E., & Ødemark, I. L. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100760 · Cited by 17
The use of sport for social integration amongst disadvantaged populations: a systematic review
Duan, Z., Hou, T., Liang, X., Kavussanu, M., & Chen, S. (2025) · Sport Management Review · doi:10.1080/14413523.2025.2603799 · Cited by 5
“The first was the Mixed Methods Appraisal Tool (MMAT, Hong et al., 2018), which included two screening questions for all studies, and five additional items depending on the methods used in each study (see Supplementary Material Appendix table A1 for the full list).”
Levels of active ageing and its influencing factors among older adults: a scoping review
Jiang, J., Cheong, A. T., Ghazali, S. S., Lee, K., Chu, D., Yang, L., Li, S., Wu, S., Hisham, R., & Xu, H. (2026) · BMC Public Health · doi:10.1186/s12889-025-25820-4 · Cited by 6
He, X., Jiao, Y., Ma, L., Zhang, B., & Zhu, L. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1738522 · Cited by 5
Rahmat, B. S. ‘., Mustafa, M. M. S. M., Nor, N. M., et al. (2026) · BMC Ophthalmology · doi:10.1186/s12886-025-04592-w · Cited by 5
“Where relevant, explanatory comments supported the assigned ratings [13].”
McLennan, A. I. G., Winters, E. M., Gagnon, M. M., & Hadjistavropoulos, T. (2026) · Clinical Psychology Review · doi:10.1016/j.cpr.2026.102704 · Cited by 5
Self-citationRecovery-oriented mental health training interventions: An integrative review
Inta, N., Leamy, M. C., & Grealish, A. (2026) · International Journal of Nursing Studies Advances · doi:10.1016/j.ijnsa.2026.100510 · Cited by 9
“The Mixed Methods Appraisal Tool, version 2018, was used to appraise mixed-methods studies (Hong et al., 2018).”
Masri, S. G., & El‐Fadel, M. (2026) · Frontiers in Sustainable Cities · doi:10.3389/frsc.2026.1743552 · Cited by 14
“Digital technologies are also reported to contribute to circular economy practices (Hong et al., 2018; Rosário and Dias, 2022; Santarius et al., 2023a; Ufua et al., 2021) and more sustainable supply chains through improved transparency, traceability, and sourcing (Coroama and Höjer, 2016;…”
InfluentialOrthorexia nervosa and social media: A mixed-methods scoping review using a systematic methodology
Awad, E., Alleva, J. M., Khoury, C. E., Chamma, N., Martijn, C., & Rizk, R. (2026) · PLoS ONE · doi:10.1371/journal.pone.0340219 · Cited by 8
“All studies were assessed for quality using the MMAT Version 18 [20].”
InfluentialCoutinho, E., Criekinge, T. V., Hanford, G., Nathan, R., Maden, M., & Hill, R. A. (2022) · British Journal of Music Therapy · doi:10.1177/13594575221110193 · Cited by 5
“Two researchers (T.V.C. and E.C.) assessed the risk of bias using the Mixed Methods Appraisal Tool (MMAT) (Hong et al., 2018).”
MethodInfluentialA systematic scoping review of undergraduate nursing hub-and-spoke placement models
Cleaver, K., Don, C., Chojnacka, I., Essex, R., Weldon, S. M., & Markowski, M. (2023) · British Journal of Nursing · doi:10.12968/bjon.2023.32.5.252 · Cited by 4
Decision-making capacity assessments in New Zealand and Australia: a systematised review
Mooney, N., McCann, C., Tippett, L. J., & Cheung, G. (2023) · Psychiatry Psychology and Law · doi:10.1080/13218719.2023.2214937 · Cited by 6
“The 17 empirical articles were reviewed for quality using the Mixed Methods Appraisal Tool (MMAT; Version 2018; Hong et al., 2018).”
MethodStudents’ acceptance of and preferences regarding online exams: a systematic literature review
Topuz, A. C., & Kinshuk, K. (2023) · Educational Technology Research and Development · doi:10.1007/s11423-023-10333-x · Cited by 9
“The MMAT approach was used to assess the quality of each accepted paper, and the scores were then determined as high, medium, or poor quality based on the matrix (Hong et al., 2018).”
Kim, L. E., Crellin, S. E., & Glandorf, H. L. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2023.102301 · Cited by 12
A Decade of Social Media for Learning: A Systematic Review
Purvis, A. J., & Beckingham, S. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/vvvccy83 · Cited by 15
“The MMAT appraisal tool was used to determine a judgement of high, medium, or low quality based on the matrix of answers (Hong et al., 2018) a technique used in previous systematic reviews (Butler-Henderson & Crawford, 2020).”
BackgroundMethodInfluentialStudents’ perspectives on racism and anti-racism in physical education: a systematic review
Abel, L., Galle, A. C., Ziehmann, L., & Vogt, T. (2024) · Frontiers in Sociology · doi:10.3389/fsoc.2024.1374277 · Cited by 11
“A mixed methods appraisal tool (Hong et al., 2018) was used to identify the quality of publications using a quantitative approach.”
MethodTang, X., Rousse-Malpat, A., & Duarte, J. (2024) · AILA Review · doi:10.1075/aila.23018.tan · Cited by 11
“We independently assessed the quality of the selected articles using the Mixed Methods Assessment Tool (MMAT) (Hong et al., 2018).”
MethodInfluentialWhat are the training needs of emergency department resuscitation nurses? A scoping review
Rheinberger, J., Curtis, K. A., McCloughen, A., & Wiseman, T. (2024) · Australasian Emergency Care · doi:10.1016/j.auec.2024.06.001 · Cited by 7
Li, M., Shi, T., Chen, J., Ding, J., Gao, X., Zeng, Q., Zhang, J., Ma, Q., Liu, X., Yu, H., et al. (2024) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.14042 · Cited by 8
Mind-body practices for people living with dementia and their family carers: a systematic review
van der Ploeg, E. S., Bitane, R. M., Schoones, J. W., Achterberg, W. P., & Smaling, H. J. A. (2024) · Journal of Complementary and Integrative Medicine · doi:10.1515/jcim-2024-0142 · Cited by 6
Lester, N., Twomey, K. E., & Theakston, A. (2024) · Language Learning Journal · doi:10.1080/09571736.2024.2369291 · Cited by 10
Matos, L. A., Janek, S. E., Holt, L., Ledbetter, L., & Gonzalez-Guarda, R. M. (2024) · AIDS and Behavior · doi:10.1007/s10461-024-04434-8 · Cited by 8
“The methodological quality of each study was assessed using the Mixed Methods Appraisal Tool (MMAT) [17].”
Public Engagement in Health Policy‐Making for Older Adults: A Systematic Search and Scoping Review
You, J., Ganann, R., Wilson, M. G., Carusone, S. C., MacNeil, M., Whitmore, C., Dafel, A., Dhamanaskar, R., Ling, E., Dingman, L., et al. (2024) · Health Expectations · doi:10.1111/hex.70008 · Cited by 10
“Among the included articles, 13 met all the criteria for methodological quality or the quality of grey information [17, 18].”
BackgroundMethodInfluentialMunhoz, O. L., Morais, B. X., da Luz, E. M. F., Greco, P. B. T., Ilha, S., & Magnago, T. S. B. D. S. (2024) · Revista Latino-Americana de Enfermagem · doi:10.1590/1518-8345.7218.4275 · Cited by 7
Betson, J., Fein, E. C., Long, D. N., & Horrocks, P. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05949-3 · Cited by 5
“Methodological validity and risk-of-bias appraisal, undertaken concurrently with data charting, was performed via the Mixed Methods Appraisal Tool (MMAT) version 2018 critical appraisal instrument designed by Hong, et al. [23].”
MethodThe Impact of Diet on Parkinson's Disease: A Systematic Review
Anwar, L., Ahmad, E., Imtiaz, M., Ahmad, M. I., Aziz, M. F., & Ibad, T. (2024) · Cureus · doi:10.7759/cureus.70337 · Cited by 16
“Thus, the Mixed Method Appraisal Tool (MMAT) was selected, as it can assess the quality of various study designs including prospective cohorts, case-control studies, cross-sectional analyses, and reviews [33].”
MethodAddressing Registered Nurse Retention and Attrition in Thailand Hospitals: An Integrative Review
Phakdeechanuan, K., Kellett, U., Henderson, S., Corones‐Watkins, K., Saito, A., & Thiangchanya, P. (2024) · Asia Pacific Journal of Public Health · doi:10.1177/10105395241282972 · Cited by 11
“22 In nine of the 35 sources critically appraised, at least one methodological quality criterion was not met.”
Parent concerns prior to an assessment of autism spectrum disorder: A systematic review
Solia, D., Albarqouni, L., Stehlik, P., Conroy, A., & Thomas, R. (2024) · Autism · doi:10.1177/13623613241287573 · Cited by 13
“See Supplementary File 6 for MMAT appraisal results.”
InfluentialPredictors of climate anxiety: a systematic review article
Quiroga, A. R., Bongiardino, L., Malleville, M. E., Yosa, C., Botero, C., Arredondo, A. Y., Borensztein, L., & Aufenacker, S. I. (2024) · Journal of Psychology & Clinical Psychiatry · doi:10.15406/jpcpy.2024.15.00794 · Cited by 7
Mild behavioural impairment in Parkinson’s disease: a systematic review
Yu, R., Chan, L., Chou, S., Lin, L., Hu, C., & Hong, C. (2024) · Age and Ageing · doi:10.1093/ageing/afae247 · Cited by 6
Hartley, P., Bond, K., Dance, R., Kuhn, I. L., McPeake, J. M., & Forsyth, F. (2024) · Clinical Rehabilitation · doi:10.1177/02692155241293269 · Cited by 5
Motta-Yanac, E., Riley, V., Ellis, N. J., Mankoo, A., & Gidlow, C. J. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105755 · Cited by 5
Mobile Applications in Breast Cancer Postoperative Care: A Scoping Review
Alidadi, M., Rabiei, R., Akbari, A., Emami, H., & Mousavi, S. M. L. (2024) · Cancer Medicine · doi:10.1002/cam4.70444 · Cited by 5
Mekhuri, S., Dussah, N., Quet, J., et al. (2024) · Journal of Parenteral and Enteral Nutrition · doi:10.1002/jpen.2716 · Cited by 5
Freeman, C., Evans, R., Drever, N., White, J., Larkins, S., & Morrey, C. (2025) · ANZ Journal of Surgery · doi:10.1111/ans.19334 · Cited by 7
“24”
Patmisari, E., Huang, Y., Orr, M., Govindasamy, S., Hielscher, E., & McLaren, H. (2025) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-025-02812-8 · Cited by 7
“The Mixed Methods Appraisal Tool (MMAT) for quality assessment was chosen for its capability to evaluate various study designs; qualitative, quantitative, and mixed methods [34, 35].”
Mei, X., Yeung, W., Hu, Y., He, M., Lu, W., Bayuo, J., Lantta, T., & Li, Y. (2025) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2025.151855 · Cited by 6
Enablers and Barriers of Compassionate Care From a Nurses' Perspective: A Scoping Review
van den Berg, N. M., van der Wal‐Huisman, H., van Leeuwen, B. L., Paans, W., & Schroevers, M. J. (2025) · Scandinavian Journal of Caring Sciences · doi:10.1111/scs.13319 · Cited by 10
Participation of Children With Developmental Coordination Disorder: A Scoping Review
Beliche, T. W. D. O., Weber, M. D., Tudella, E., & de Campos, A. C. (2025) · Child Care Health and Development · doi:10.1111/cch.70059 · Cited by 6
Akib, M. M. M., Ishak, H., Zabidi, A. F. M., Sa’ari, C. Z., Muhsin, S. B. S., & Yahya, N. S. M. (2025) · Journal of Religion and Health · doi:10.1007/s10943-025-02304-8 · Cited by 37
Heyes, K., Brodrick, I., Best, D., Thompson, K., Leah, C., Miller, E., Craig, E., Serrant, L., Dixon, J., Bergqvist, A., et al. (2025) · PLOS mental health. · doi:10.1371/journal.pmen.0000041 · Cited by 7
Exploring the Impact of Social Media on E-Cigarette Usage Among Adolescents: A Scoping Review
Adekeye, O. T., & Exten, C. L. (2025) · Journal of Child & Adolescent Substance Use · doi:10.1080/29973368.2025.2488837 · Cited by 8
“The MMAT was created to assess the methodological quality and bias risk in the most frequent studies, such as qualitative, randomized controlled trials, non-randomized studies, quantitative descriptive, and mixed-method research (Hong et al., 2018).”
InfluentialHealth system adaptation to extreme weather events in Australia: A scoping review
Legg, R., Prior, J., McIntyre, E., Liu, E., Tracy, M., Tan, L., Dawson, A. J., Richmond, J., & Perry, C. P. (2025) · The Journal of Climate Change and Health · doi:10.1016/j.joclim.2025.100443 · Cited by 6
“The Mixed Methods Appraisal Tool (MMAT) was chosen for the quality assessment as it provides a means of assessing quantitative, qualitative, and mixed methods studies [23].”
Okmi, M., Ang, T. F., Zaki, F., Ku, C. S., Phan, K. Y., Wahyudi, I., & Por, L. Y. (2025) · PLoS ONE · doi:10.1371/journal.pone.0322520 · Cited by 7
“For quantitative studies, the Mixed Methods Appraisal Tool (MMAT) [24] was chosen due to its structured approach in assessing methodological quality, particularly in studies employing non-traditional data sources such as MPND.”
Ogungbe, O., Jabakhanji, S. B., Mehta, R., McCaffrey, J., Byrne, D., Hurley, S. M., Rosman, L. M., Bansah, E. C., Ibukun, F. A., Quarshie, I. A., et al. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12760-3 · Cited by 10
Interprofessional Collaborations on Interventions for People With Loneliness: A Scoping Review
Chu, L., Zhang, Y., Smith, G. D., & Ho, K. H. M. (2025) · Nursing Open · doi:10.1002/nop2.70239 · Cited by 6
“Although scoping review does not require a quality appraisal, we critically appraised the quality of included studies using JBI and mixed methods appraisal tools (MMAT) (Hong et al. 2018; Lockwood et al. 2015; Moola et al. 2020; Tufanaru et al. 2020).”
Gudziunaite, S., Mackintosh, K. A., Davies, G. A., Jordan, K. A., Lewis, P. D., Griffiths, C. J., Swain, T. A., & McNarry, M. A. (2025) · Sports Medicine - Open · doi:10.1186/s40798-025-00856-3 · Cited by 10
Unmet Care Needs of Adult Survivors of Thyroid Cancer: A Systematic Review
Das, A., Garcia, G. P. R., Rubio, E., Acosta, G. J., Bylund, C. L., Brito, J. P., & Ospina, N. S. (2025) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2025.0855 · Cited by 7
Akther, A., Laurie, C., Elton‐Marshall, T., Ly, V., & Sulis, G. (2025) · Vaccine · doi:10.1016/j.vaccine.2025.127331 · Cited by 7
Peng, M., Lu, Y., & Mo, W. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-094206 · Cited by 9
“16 Therefore, the purpose of this study was to provide a theory-based review of barriers and facilitators that an interdisciplinary HF team experiences in referring patients with HF to specialist PC.”
Mashora, M. C., Dzinamarira, T., & Muvunyi, C. M. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-030814 · Cited by 10
McCabe‐White, L., Moghaddam, N. G., Tickle, A., & Biswas, S. (2021) · Psycho-Oncology · doi:10.1002/pon.5686 · Cited by 5
Stewart, R. J., Humphris, G. M., Donaldson, J., & Cruickshank, S. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.635660 · Cited by 6
“The MMAT includes five criteria of quality to judge studies (Hong et al., 2018).”
MethodInfluentialBrewer, K., Grey, C., Paynter, J., Winter-Smith, J., Hanchard, S., Selak, V., Ameratunga, S. N., & Harwood, M. L. N. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060145 · Cited by 5
Kim, H., & Martin, E. G. (2022) · AIDS Care · doi:10.1080/09540121.2022.2121959 · Cited by 7
“Each criterion can be rated as “yes,” “no,” or “cannot tell” (Hong et al., 2018a).”
BackgroundMethodInfluentialDurish, C. L., Lin, J., Pol, S. J., Damer, A., Anthony, S. J., Wray, J., & Gold, A. (2022) · Pediatric Transplantation · doi:10.1111/petr.14448 · Cited by 9
Khodabandelou, R., Chaharbashloo, H., Ghaderi, M., Zeinabadi, H., & Karimi, L. (2022) · Interactive Learning Environments · doi:10.1080/10494820.2022.2152057 · Cited by 10
“After the data extraction phase, to include high quailed papers, the methodological quality of all included papers was assessed using the Mixed Methods Appraisal Tool (MMAT) (Hong et al., 2018).”
Diagnostic delay of sarcoidosis: Protocol for an integrated systematic review
Namsrai, T., Desborough, J., Gregory, D., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0269762 · Cited by 5
Metadata
- Authors
- Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., Rousseau, M.-C., Vedel, I., & Pluye, P.
- Affiliations
- McGill University (CA)
- Universitat Oberta de Catalunya (ES)
- University of Warwick (GB)
- University of Canberra (AU)
- Université de Sherbrooke (CA)
- Université Laval (CA)
- University of Sheffield (GB)
- Institut National de la Recherche Scientifique (CA)
- Corresponding author
- Pluye, Pierre
- ORCID
- Venue
- Education for Information
- Publisher
- SAGE Publications
- Published
- 2018-12-18
- Volume
- 34
- Issue
- 4
- Pages
- 285-291
- ISSN
- 0167-8329 (ISSN-L)
- 1875-8649
- OpenAlex
- W2901724277
- Cited by
- 4,737
- References
- 21
- Citations by year
- 2026: 1312 · 2025: 974 · 2024: 800 · 2023: 610 · 2022: 501 · 2021: 370 · 2020: 143 · 2019: 22 · 2018: 3
- FWCI
- 102.21
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- Locations
- Education for Information (publishedVersion)
- O2 - Repositori Institucional (Universitat Oberta de Catalunya) (publishedVersion, cc-by-nc-nd)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (publishedVersion, cc-by-nc-nd)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- HAL (submittedVersion)
- eScholarship@McGill (McGill) (submittedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by-nc-nd)
- eScholarship@McGill (McGill) (submittedVersion, cc-by-nc-nd)
- EspaceINRS (National Institute for Scientific Research (Canada)) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Education › Qualitative Research Methods and Applications
- Keywords
- Mixed Methods Appraisal Tool, critical appraisal, study quality assessment, mixed methods, systematic reviews, qualitative research, quantitative research, randomized controlled trials, non-randomized studies, e-Delphi, inter-rater reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.