Scales to Assess the Quality of Randomized Controlled Trials: A Systematic Review
The DOI matches its Crossref record; 184 of the 184 references it cites were found in a registry or an index.
Abstract
Background and Purpose: The methodological quality of randomized controlled trials (RCTs) is commonly evaluated in order to assess the risk of biased estimates of treatment effects. The purpose of this systematic review was to identify scales used to evaluate the methodological quality of RCTs in health care research and summarize the content, construction, development, and psychometric properties of these scales. Methods: Extensive electronic database searches, along with a manual search, were performed. Results: One hundred five relevant studies were identified. They accounted for 21 scales and their modifications. The majority of scales had not been rigorously developed or tested for validity and reliability. The Jadad Scale presented the best validity and reliability evidence; however, its validity for physical therapy trials has not been supported. Discussion and Conclusion: Many scales are used to evaluate the methodological quality of RCTs, but most of these scales have not been adequately developed and have not been adequately tested for validity and reliability. A valid and reliable scale for the assessment of the methodological quality of physical therapy trials needs to be developed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Quality is not well defined, but has been shown to encompass constructs beyond those that may bias the findings, including, for example, imprecision, reporting completeness, ethics, and applicability.”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [79]
Citations
Cites
2 retracted
Interventions for treating chronic pelvic pain in women
Stones, W., Cheong, Y. C., Howard, F. M., & Singh, S. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000387 · Cited by 165
RetractedInterventions for treating chronic pelvic pain in women
Stones, W., Cheong, Y. C., Howard, F. M., & Singh, S. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000387.pub2 · Cited by 66
RetractedCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
Quality criteria were proposed for measurement properties of health status questionnaires
Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. W. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.012 · Cited by 10,764
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
Downs, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Reliability of the PEDro Scale for Rating Quality of Randomized Controlled Trials
Maher, C. G., Sherrington, C., Herbert, R. D., Moseley, A. M., & Elkins, M. (2003) · Physical Therapy · doi:10.1093/ptj/83.8.713 · Cited by 4,808
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Kessels, A. G. H., Boers, M., Bouter, L. M., & Knipschild, P. G. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00131-0 · Cited by 2,379
Kjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283
Systematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Updated Method Guidelines for Systematic Reviews in the Cochrane Collaboration Back Review Group
van Tulder, M., Furlan, A., Bombardier, C., & Bouter, L. (2003) · Spine · doi:10.1097/01.brs.0000065484.95996.af · Cited by 2,180
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Health Measurement Scales--A Practical Guide to Their Development and Use
Waclawski, E. R. (2010) · Occupational Medicine · doi:10.1093/occmed/kqp179 · Cited by 1,874
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
Is the Placebo Powerless?: An Analysis of Clinical Trials Comparing Placebo with No Treatment
Hróbjartsson, A., & Gøtzsche, P. C. (2001) · New England Journal of Medicine · doi:10.1056/nejm200105243442106 · Cited by 1,503
Health Measurement Scales: A Practical Guide To Their Development And Use
Streiner, D. L., & Norman, G. R. (2003) · doi:10.1093/oso/9780198528470.001.0001 · Cited by 1,460
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Moher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027
Linde, K., Clausius, N., Ramirez, G., Melchart, D., Eitel, F., Hedges, L. V., & Jonas, W. B. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02293-9 · Cited by 979
The impact of physical therapy on functional outcomes after stroke: what's the evidence?
Van Peppen, R. P., Kwakkel, G., Wood-Dauphinee, S., Hendriks, H. J., Van der Wees, P. J., & Dekker, J. (2004) · Clinical Rehabilitation · doi:10.1191/0269215504cr843oa · Cited by 942
Evidence for physiotherapy practice: A survey of the Physiotherapy Evidence Database (PEDro)
Moseley, A. M., Herbert, R. D., Sherrington, C., & Maher, C. G. (2002) · Australian Journal of Physiotherapy · doi:10.1016/s0004-9514(14)60281-6 · Cited by 911
Exercise therapy for treatment of non-specific low back pain
Hayden, J., van Tulder, M. W., Malmivaara, A., & Koes, B. W. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000335.pub2 · Cited by 879
Bias in treatment assignment in controlled clinical trials
Chalmers, T. C., Celano, P., Sacks, H. S., & Smith, H. (1983) · New England Journal of Medicine · doi:10.1056/nejm198312013092204 · Cited by 864
A meta-analysis of voucher-based reinforcement therapy for substance use disorders
Lussier, J. P., Heil, S. H., Mongeon, J. A., Badger, G. J., & Higgins, S. T. (2006) · Addiction · doi:10.1111/j.1360-0443.2006.01311.x · Cited by 858
van Tulder, M. W., Assendelft, W. J. J., Koes, B. W., & Bouter, L. M. (1997) · Spine · doi:10.1097/00007632-199710150-00001 · Cited by 735
Assessing the Quality of Randomized Trials
Clark, H. D., Wells, G. A., Huët, C., McAlister, F. A., Salmi, L. R., Fergusson, D., & Laupacis, A. (1999) · Controlled Clinical Trials · doi:10.1016/s0197-2456(99)00026-4 · Cited by 648
Incorporating variations in the quality of individual randomized trials into meta-analysis
Detsky, A. S., Naylor, C. D., O'Rourke, K., McGeer, A. J., & L'Abbé, K. A. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90085-2 · Cited by 640
Exercises for mechanical neck disorders
Gross, A., Kay, T. M., Paquin, J.-P., Blanchette, S., Lalonde, P., Christie, T., Dupont, G., Graham, N., Burnie, S. J., Gelley, G., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004250.pub5 · Cited by 613
Statistical Power, Sample Size, and Their Reporting in Randomized Controlled Trials
Moher, D. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020048013 · Cited by 608
Cummins, R. O., Chamberlain, D., Hazinski, M. F., Nadkarni, V., Kloeck, W., Kramer, E., Becker, L., Robertson, C., Koster, R., Zaritsky, A., et al. (1997) · Circulation · doi:10.1161/01.cir.95.8.2213 · Cited by 583
Knols, R., Aaronson, N. K., Uebelhart, D., Fransen, J., & Aufdemkampe, G. (2005) · Journal of Clinical Oncology · doi:10.1200/jco.2005.02.148 · Cited by 575
Health measurement scales. A practical guide to their development and use, 3rd ed
Rajmil, L. (2005) · Europe PMC (PubMed Central) · Cited by 567
How study design affects outcomes in comparisons of therapy. I: Medical
Colditz, G. A., Miller, J. N., & Mosteller, F. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080408 · Cited by 520
PEDro. A database of randomized trials and systematic reviews in physiotherapy
Sherrington, C., Herbert, R. D., Maher, C. G., & Moseley, A. M. (2000) · Manual Therapy · doi:10.1054/math.2000.0372 · Cited by 508
Lim, I., van Wegen, E., de Goede, C., Deutekom, M., Nieuwboer, A., Willems, A., Jones, D., Rochester, L., & Kwakkel, G. (2005) · Clinical Rehabilitation · doi:10.1191/0269215505cr906oa · Cited by 490
Balk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478
Assessing the Quality of Randomized Controlled Trials:Current Issues and Future Directions
Moher, D., Jadad, A. R., & Tugwell, P. (1996) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300009570 · Cited by 436
Corticosteroid injections for lateral epicondylitis: a systematic review
Smidt, N., Assendelft, W. J. J., van der Windt, D. A. W. M., Hay, E. M., Buchbinder, R., & Bouter, L. M. (2002) · Pain · doi:10.1016/s0304-3959(01)00388-8 · Cited by 432
Oremus, M., Wolfson, C., Perrault, A., Demers, L., Momoli, F., & Moride, Y. (2001) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000051263 · Cited by 422
Exercise therapy for multiple sclerosis
Rietberg, M. B., Brooks, D., Uitdehaag, B. M., & Kwakkel, G. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003980.pub2 · Cited by 422
Quality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397
Proper, K. I., Koning, M., van der Beek, A. J., Hildebrandt, V. H., Bosscher, R. J., & van Mechelen, W. (2003) · Clinical Journal of Sport Medicine · doi:10.1097/00042752-200303000-00008 · Cited by 390
McNeely, M. L., Armijo Olivo, S., & Magee, D. J. (2006) · Physical Therapy · doi:10.1093/ptj/86.5.710 · Cited by 380
Self-citationMoher, Cook, Jadad, Tugwell, Moher, Jones, Pham, & Klassen (1999) · Health Technology Assessment · doi:10.3310/hta3120 · Cited by 368
Hróbjartsson, A., & Gøtzsche, P. C. (2004) · Journal of Internal Medicine · doi:10.1111/j.1365-2796.2004.01355.x · Cited by 362
Braces and orthoses for treating osteoarthritis of the knee
Duivenvoorden, T., Brouwer, R. W., van Raaij, T. M., Verhagen, A. P., Verhaar, J. A., & Bierma-Zeinstra, S. M. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004020.pub3 · Cited by 314
Salpeter, S. R., Greyber, E., Pasternak, G. A., & Salpeter, E. E. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.21.2594 · Cited by 312
A Proposal for Structured Reporting of Randomized Controlled Trials
Andrew, E. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520240054041 · Cited by 309
BOUTRON, I., MOHER, D., TUGWELL, P., GIRAUDEAU, B., POIRAUDEAU, S., NIZARD, R., & RAVAUD, P. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.05.004 · Cited by 308
Osteotomy for treating knee osteoarthritis
Brouwer, R. W., Huizinga, M. R., Duivenvoorden, T., van Raaij, T. M., Verhagen, A. P., Bierma-Zeinstra, S. M., & Verhaar, J. A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004019.pub4 · Cited by 308
Cignacco, E., Hamers, J. P. H., Stoffel, L., van Lingen, R. A., Gessler, P., McDougall, J., & Nelle, M. (2007) · European Journal of Pain · doi:10.1016/j.ejpain.2006.02.010 · Cited by 306
A Cochrane Review of Manipulation and Mobilization for Mechanical Neck Disorders
Gross, A. R., Hoving, J. L., Haines, T. A., Goldsmith, C. H., Kay, T., Aker, P., & Bronfort, G. (2004) · Spine · doi:10.1097/01.brs.0000131218.35875.ed · Cited by 299
Systematic Review of Antidepressants in the Treatment of Chronic Low Back Pain
Staiger, T. O., Gaster, B., Sullivan, M. D., & A Deyo, R. (2003) · Spine · doi:10.1097/01.brs.0000092372.73527.ba · Cited by 295
Efficacy of biofeedback for migraine: A meta-analysis
Nestoriuc, Y., & Martin, A. (2007) · Pain · doi:10.1016/j.pain.2006.09.007 · Cited by 292
Furlan, A. D., Brosseau, L., Imamura, M., & Irvin, E. (2002) · Spine · doi:10.1097/00007632-200209010-00017 · Cited by 279
Effects on leg muscular performance from whole‐body vibration exercise: a systematic review
Rehn, B., Lidström, J., Skoglund, J., & Lindström, B. (2007) · Scandinavian Journal of Medicine & Science in Sports · doi:10.1111/j.1600-0838.2006.00578.x · Cited by 276
Methodologic issues in effectiveness research on palliative cancer care: a systematic review.
Rinck, G. C., van den Bos, G. A., Kleijnen, J., de Haes, H. J., Schadé, E., & Veenhof, C. H. (1997) · Journal of Clinical Oncology · doi:10.1200/jco.1997.15.4.1697 · Cited by 268
Smith, L. A., Oldman, A. D., McQuay, H. J., & Moore, A. R. (2000) · Pain · doi:10.1016/s0304-3959(00)00234-7 · Cited by 249
The art of quality assessment of RCTs included in systematic reviews
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Boers, M., & A van den Brandt, P. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00360-7 · Cited by 245
BHANDARI, M., RICHARDS, R. R., SPRAGUE, S., & SCHEMITSCH, E. H. (2002) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/00004623-200203000-00009 · Cited by 243
Clinical tests of the sacroiliac joint
van der Wurff, P., Hagmeijer, R. H. M., & Meyne, W. (2000) · Manual Therapy · doi:10.1054/math.1999.0228 · Cited by 236
Effectiveness of physiotherapy for lateral epicondylitis: a systematic review
Smidt, N., Assendelft, W., Arola, H., Malmivaara, A., Green, S., Buchbinder, R., van der Windt, D., & Bouter, L. (2003) · Annals of Medicine · doi:10.1080/07853890310004138 · Cited by 234
Imperiale, T. F., & McCullough, A. J. (1990) · Annals of Internal Medicine · doi:10.7326/0003-4819-113-4-299 · Cited by 232
Foley, N. C., Bhogal, S. K., Teasell, R. W., Bureau, Y., & Speechley, M. R. (2006) · Physical Therapy · doi:10.1093/ptj/86.6.817 · Cited by 231
Bhogal, S. K., Teasell, R. W., Foley, N. C., & Speechley, M. R. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.002 · Cited by 227
A systematic review of the relationship between overjet size and traumatic dental injuries
Nguyen, Q. (1999) · The European Journal of Orthodontics · doi:10.1093/ejo/21.5.503 · Cited by 224
The Effect of Antidepressant Treatment on Chronic Back Pain: A Meta-analysis
Salerno, S. M., Browning, R., & Jackson, J. L. (2002) · Archives of Internal Medicine · doi:10.1001/archinte.162.1.19 · Cited by 219
Adjustment of meta-analyses on the basis of quality scores should be abandoned
Herbison, P., Hay-Smith, J., & Gillespie, W. J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.008 · Cited by 207
A quality assessment of randomized control trials of primary treatment of breast cancer.
Liberati, A., Himel, H. N., & Chalmers, T. C. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.6.942 · Cited by 195
Iorio, A., Marchesini, E., Marcucci, M., Stobart, K., & Chan, A. K. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003429.pub4 · Cited by 192
Conservative treatments for whiplash
Verhagen, A. P., Scholten-Peeters, G. G., van Wijngaarden, S., de Bie, R., & Bierma-Zeinstra, S. M. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003338.pub3 · Cited by 191
Exercises for mechanical neck disorders
Kay, T. M., Gross, A., Goldsmith, C. H., Hoving, J. L., & Brønfort, G. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004250.pub3 · Cited by 188
Surgical Treatment of Osteoarthritis of the Carpometacarpal Joint of the Thumb: A Systematic Review
Martou, G., Veltri, K., & Thoma, A. (2004) · Plastic and Reconstructive Surgery · doi:10.1097/01.prs.0000131989.86319.b1 · Cited by 184
Maher, C. G., Sherrington, C., Elkins, M., Herbert, R. D., & Moseley, A. M. (2004) · Physical Therapy · doi:10.1093/ptj/84.7.644 · Cited by 181
Instruments for Assessing the Quality of Drug Studies Published in the Medical Literature
Cho, M. K. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020027007 · Cited by 180
Systematic Review of the Quality of Randomized Controlled Trials for Patellofemoral Pain Syndrome
Bizzini, M., Childs, J. D., Piva, S. R., & Delitto, A. (2003) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2003.33.1.4 · Cited by 177
Cambach, W., Wagenaar, R. C., Koelman, T. W., van Keimpema, T., & Kemper, H. C. G. (1999) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/s0003-9993(99)90316-7 · Cited by 176
Boutron, I., Tubach, F., Giraudeau, B., & Ravaud, P. (2003) · JAMA · doi:10.1001/jama.290.8.1062 · Cited by 172
Braces and orthoses for treating osteoarthritis of the knee
Brouwer, R. W., van Raaij, T. M., Jakma, T. T. S. C., Verhagen, A. P., Verhaar, J. A., & Bierma-Zeinstra, S. M. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004020.pub2 · Cited by 170
Clinical tests of the sacroiliac joint
van der Wurff, P., Meyne, W., & Hagmeijer, R. H. M. (2000) · Manual Therapy · doi:10.1054/math.1999.0229 · Cited by 169
Van Peppen, R., Kortsmit, M., Lindeman, E., & Kwakkel, G. (2006) · Journal of Rehabilitation Medicine · doi:10.1080/16501970500344902 · Cited by 157
Thomas, K. C., Bailey, C. S., Dvorak, M. F., Kwon, B. K., & Fisher, C. G. (2006) · Journal of Neurosurgery Spine · doi:10.3171/spi.2006.4.5.351 · Cited by 157
A scale for rating the quality of psychological trials for pain
Yates, S. L., Morley, S., Eccleston, C., & de C. Williams, A. C. (2005) · Pain · doi:10.1016/j.pain.2005.06.018 · Cited by 150
Acupuncture for Neck Disorders
Trinh, K., Graham, N., Gross, A., Goldsmith, C. H., Wang, E., Cameron, I. D., & Kay, T. (2007) · Spine · doi:10.1097/01.brs.0000252100.61002.d4 · Cited by 148
Systematic Reviews on the Basis of Methodological Criteria
de Vet, H. C. W., de Bie, R. A., van der Heijden, G. J. M. G., Verhagen, A. P., Sijpkes, P., & Knipschild, P. G. (1997) · Physiotherapy · doi:10.1016/s0031-9406(05)66175-5 · Cited by 146
Information and Low Back Pain Management: A Systematic Review
Henrotin, Y. E., Cedraschi, C., Duplan, B., Bazin, T., & Duquesnoy, B. (2006) · Spine · doi:10.1097/01.brs.0000217620.85893.32 · Cited by 142
Prediction of Sickness Absence in Patients with Chronic Low Back Pain: A Systematic Review
Kuijer‐Siebelink, W., Groothoff, J. W., Brouwer, S., Geertzen, J. H. B., & Dijkstra, P. U. (2006) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-006-9021-8 · Cited by 134
How study design affects outcomes in comparisons of therapy. II: Surgical
Miller, J. N., Colditz, G. A., & Mosteller, F. C. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080409 · Cited by 134
Assessing “Best Evidence”: Issues in Grading the Quality of Studies for Systematic Reviews
Lohr, K. N., & Carey, T. S. (1999) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30461-8 · Cited by 132
Spitzer, W. O., Lawrence, Dales, R., Hill, G., Archer, M. C., Clark, P., Abenhaim, L. L., Hardy, J., Sampalis, J. S., & Pinfold, S. P. (1990) · PubMed · Cited by 132
Herbal Medicine for Low Back Pain: A Cochrane Review
Gagnier, J. J., Oltean, H. N., van Tulder, M. W., Berman, B., Bombardier, C., & Robbins, C. B. (2015) · Spine · doi:10.1097/brs.0000000000001310 · Cited by 129
Lenssinck, M.-L. B., Damen, L., Verhagen, A. P., Berger, M. Y., Passchier, J., & Koes, B. W. (2004) · Pain · doi:10.1016/j.pain.2004.09.026 · Cited by 125
Effectiveness of Treatments of Depression in Older Ambulatory Patients
McCusker, J., Cole, M. G., Keller, E., Bellavance, F., & Bérard, A. (1998) · Archives of Internal Medicine · doi:10.1001/archinte.158.7.705 · Cited by 125
Foot Orthoses in Lower Limb Overuse Conditions: A Systematic Review and Meta-Analysis
Collins, N. J., Bisset, L., McPoil, T. G., & Vicenzino, B. (2007) · Foot & Ankle International · doi:10.3113/fai.2007.0396 · Cited by 125
Dekker, A., Bulley, S. R., Beyene, J., Dupuis, L. L., Doyle, J., & Sung, L. (2006) · Journal of Clinical Oncology · doi:10.1200/jco.2006.06.1663 · Cited by 122
A Meta-analysis of Controlled Clinical Studies With Diacerein in the Treatment of Osteoarthritis
Rintelen, B., Neumann, K., & Leeb, B. F. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.17.1899 · Cited by 122
Aid to the Evaluation of Therapeutic Studies
REISCH, J. S., Tyson, J. E., & Mize, S. G. (1989) · PEDIATRICS · doi:10.1542/peds.84.5.815 · Cited by 120
Importance and clarification of measurement properties in rehabilitation
Gadotti, I. C., Vieira, E. R., & Magee, D. (2006) · Brazilian Journal of Physical Therapy · doi:10.1590/s1413-35552006000200002 · Cited by 119
Self-citationSung, L., Nathan, P. C., Lange, B. J., Beyene, J., & Buchanan, G. R. (2004) · Journal of Clinical Oncology · doi:10.1200/jco.2004.09.106 · Cited by 117
Systematic review of conservative interventions for subacute low back pain
Pengel, H. M., Maher, C. G., & Refshauge, K. M. (2002) · Clinical Rehabilitation · doi:10.1191/0269215502cr562oa · Cited by 116
Assessing allocation concealment and blinding in randomised controlled trials: why bother?
Schulz, K. F. (2001) · Evidence-Based Nursing · doi:10.1136/ebn.4.1.4 · Cited by 116
Herbal Medicine for Low Back Pain: A Cochrane Review
Gagnier, J. J., van Tulder, M. W., Berman, B., & Bombardier, C. (2007) · Spine · doi:10.1097/01.brs.0000249525.70011.fe · Cited by 116
Verhagen, A. P., Karels, C. H., Bierma‐Zeinstra, S., Feleus, A., Dahaghin, S., Alex Burdorf, A., & Koes, B. W. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.05.006 · Cited by 115
Key Methodological Features of Randomized Controlled Trials of Alzheimer’s Disease Therapy
Burback, D., Molnar, F., John, P. S., & Man‐Son‐Hing, M. (1999) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000017201 · Cited by 112
Sutherland, S. E., & Browman, G. P. (2001) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/s0360-3016(00)01456-5 · Cited by 111
Pharmacotherapy for social anxiety disorder
Stein, D. J., Ipser, J., & van Balkom, A. J. L. M. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001206.pub2 · Cited by 110
Jacobs, W. C. H., Clement, D., & Wymenga, A. B. (2005) · Acta Orthopaedica · doi:10.1080/17453670510045345 · Cited by 110
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Kessels, A. G. H., Boers, M., & Knipschild, P. G. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00297-7 · Cited by 102
Influence of hip dysplasia on the development of osteoarthritis of the hip
Lievense, A. M., Bierma‐Zeinstra, S., Verhagen, A. P., Verhaar, J. A. N., & Koes, B. W. (2004) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2003.009860 · Cited by 99
Massage for Mechanical Neck Disorders: A Systematic Review
Ezzo, J., Haraldsson, B. G., Gross, A. R., Myers, C. D., Morien, A., Goldsmith, C. H., Bronfort, G., & Peloso, P. M. (2007) · Spine · doi:10.1097/01.brs.0000254099.07294.21 · Cited by 97
Quality assessment of randomized control trials in dental research I. Methods
Antczak‐Bouckoms, A., Tang, J., & Chalmers, T. C. (1986) · Journal of Periodontal Research · doi:10.1111/j.1600-0765.1986.tb01464.x · Cited by 95
Quality assessment of randomized controlled trials of oral implants.
Esposito, M. A., Coulthard, P., Worthington, H. V., & Jokstad, A. (2001) · PubMed · Cited by 93
Maintenance chemotherapy for small cell lung cancer: a critical review of the literature
Sculier, J. P., Berghmans, T., Castaigne, C., Luce, S., Sotiriou, C., Vermylen, P., & Paesmans, M. (1998) · Lung Cancer · doi:10.1016/s0169-5002(97)00084-6 · Cited by 92
Quality of Full and Final Publications Reporting Acute Stroke Trials: A Systematic Review
Bath-Hextall, F. J., Owen, V. E., & Bath, P. M. (1998) · Stroke · doi:10.1161/01.str.29.10.2203 · Cited by 92
Moher, D., Soeken, K. L., Sampson, M., Ben‐Porat, L., & Berman, B. (2002) · BMC Pediatrics · doi:10.1186/1471-2431-2-3 · Cited by 89
Work-related disease in general practice: a systematic review
Weevers, H. J. A. (2005) · Family Practice · doi:10.1093/fampra/cmh727 · Cited by 89
MECHANICAL TRACTION FOR MECHANICAL NECK DISORDERS: A SYSTEMATIC REVIEW
Graham, N., Gross, A., Goldsmith, C. H., et al. (2006) · Journal of Rehabilitation Medicine · doi:10.1080/16501970600583029 · Cited by 89
Gummesson, C., Atroshi, I., & Ekdahl, C. S. (2004) · The Journal Of Hand Surgery · doi:10.1016/j.jhsa.2004.04.003 · Cited by 87
Morrison, L. J., Brooks, S. C., Sawadsky, B. V., McDonald, A. C., & Verbeek, P. R. (2005) · Academic Emergency Medicine · doi:10.1197/j.aem.2005.07.042 · Cited by 87
Evans, M., & Pollock, A. V. (1985) · British journal of surgery · doi:10.1002/bjs.1800720403 · Cited by 85
Nicolucci, A. (1989) · JAMA · doi:10.1001/jama.262.15.2101 · Cited by 83
A systematic review of physiotherapy for spondylolysis and spondylolisthesis
McNeely, M. L., Torrance, G. W., & Magee, D. J. (2003) · Manual Therapy · doi:10.1016/s1356-689x(02)00066-8 · Cited by 81
Self-citationIntention to treat analysis is related to methodological quality
Ruiz‐Canela, M. (2000) · BMJ · doi:10.1136/bmj.320.7240.1007 · Cited by 76
Tiruvoipati, R., Balasubramanian, S. P., Atturu, G., Peek, G. J., & Elbourne, D. R. (2006) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2005.10.056 · Cited by 74
Quality of reporting randomised clinical trials in dental and medical research
Sjögren, P., & Halling, A. (2002) · BDJ · doi:10.1038/sj.bdj.4801304 · Cited by 74
More Reliable Outcome Measures Can Reduce Sample Size Requirements
Leon, A. C. (1995) · Archives of General Psychiatry · doi:10.1001/archpsyc.1995.03950220077014 · Cited by 71
A Cochrane Review of Electrotherapy for Mechanical Neck Disorders
Kroeling, P., Gross, A., & Goldsmith, C. H. (2005) · Spine · doi:10.1097/01.brs.0000184302.34509.48 · Cited by 70
Pharmacotherapy of social phobia
Davidson, J. R. T. (2003) · Acta Psychiatrica Scandinavica · doi:10.1034/j.1600-0447.108.s417.7.x · Cited by 69
Moher, D., Sampson, M., Campbell, K., Beckner, W., Lepage, L., Gaboury, I., & Berman, B. (2002) · BMC Pediatrics · doi:10.1186/1471-2431-2-2 · Cited by 69
Orthotic devices for tennis elbow: a systematic review.
Struijs, P. A. A., Smidt, N., Arola, H., van Dijk, C. N., Buchbinder, R., & Assendelft, W. J. (2001) · Europe PMC (PubMed Central) · Cited by 69
Colle, F., Rannou, F., Revel, M., Fermanian, J., & Poiraudeau, S. (2002) · Archives of Physical Medicine and Rehabilitation · doi:10.1053/apmr.2002.35657 · Cited by 68
An evaluation of the quality of therapeutic studies in perinatal medicine
Tyson, J. E., Furzán, J. A., REISCH, J. S., & Mize, S. G. (1983) · The Journal of Pediatrics · doi:10.1016/s0022-3476(83)80277-7 · Cited by 67
Moher, D., Jadad, A. R., & Klassen, T. P. (1998) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.152.9.915 · Cited by 67
A review of treatment interventions in whiplash-associated disorders
Seferiadis, A., Rosenfeld, M., & Gunnarsson, R. K. (2004) · European Spine Journal · doi:10.1007/s00586-004-0709-1 · Cited by 65
Sindhu, F., Carpenter, L. M., & Seers, K. (1997) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.1997.19970251262.x · Cited by 63
Osteotomy for treating knee osteoarthritis
Brouwer, R., Jakma, T. S. C., Bierma-Zeinstra, S., Verhagen, A. P., & Verhaar, J. A. N. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004019.pub2 · Cited by 61
Guidelines for Appraisal and Publication of PDSA Quality Improvement
Speroff, T., James, B. C., Nelson, E. C., Headrick, L. A., & Brommels, M. (2004) · Quality Management in Health Care · doi:10.1097/00019514-200401000-00003 · Cited by 59
Baron, G., Boutron, I., Giraudeau, B., & Ravaud, P. (2005) · Arthritis & Rheumatism · doi:10.1002/art.21116 · Cited by 59
Are the clinical effects of homoeopathy placebo effects?
Walach, H., Jonas, W. B., & Lewith, G. T. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67877-4 · Cited by 57
Methods of Randomized Controlled Clinical Trials in Health Services Research
Balas, E. A., Austin, S., Ewigman, B., BROWN, G. D., & Mitchell, J. A. (1995) · Medical Care · doi:10.1097/00005650-199507000-00005 · Cited by 56
Is any one analgesic superior for episodic tension-type headache?
Verhagen, A. P., Damen, L., Berger, M. Y., Passchier, J., Merlijn, V. P. B. M., & Koes, B. W. (2006) · PubMed · Cited by 51
The quality of clinical trials published in The Journal of Family Practice, 1974-1991.
Sonis, J. H., & Joines, J. L. (1994) · PubMed · Cited by 51
Latronico, N., Botteri, M., Minelli, C., Zanotti, C., Bertolini, G., & Candiani, A. (2002) · Intensive Care Medicine · doi:10.1007/s00134-002-1339-x · Cited by 50
Quality assessment of randomized control trials in dental research II. Results: Periodontal research
Antczaic, A. A., Tang, J., & Chalmeks, T. C. (1986) · Journal of Periodontal Research · doi:10.1111/j.1600-0765.1986.tb01465.x · Cited by 49
Signal versus noise in the evidence base for medicine: an alternative to hierarchies of evidence?
Edwards, A., Russell, I. T., & Stott, N. C. H. (1998) · Family Practice · doi:10.1093/fampra/15.4.319 · Cited by 46
A qualitative assessment of randomized controlled trials in otolaryngology
Ah-See, K. W., & Molony, N. (1998) · The Journal of Laryngology & Otology · doi:10.1017/s0022215100140770 · Cited by 46
[Evaluation of the methodological quality of randomized therapeutic trials].
Poynard, T. (1988) · PubMed · Cited by 46
A Scale of Methodological Quality for Clinical Studies of Radiologic Examinations
Arrivé, L., Renard-Penna, R., Carrat, F., Belkacem, A., Dahan, H., Hir, P. L., Monnier‐Cholley, L., & Tubiana, J. M. (2000) · Radiology · doi:10.1148/radiology.217.1.r00oc0669 · Cited by 42
Injectable gold for rheumatoid arthritis
Clark, P., Tugwell, P., BENNETT, K. J., et al. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000520 · Cited by 41
Calcium channel blockers for preventing acute tubular necrosis in kidney transplant recipients
Shilliday, I. R., & Sherif, M. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003421.pub4 · Cited by 38
Cummins, R. O., Chamberlain, D. A., Hazinski, M. F., Nadkarni, V., Kloeck, W., Kramer, E. B., Becker, L. B., Robertson, C., Koster, R., ZARITSKY, A. L., et al. (1998) · Respiratory Care · doi:10.1177/002013249804300107 · Cited by 38
Myocardial Infarction in Women: A Critical Appraisal of Gender Differences in Outcomes
Bell, D., & Nappi, J. M. (2000) · Pharmacotherapy The Journal of Human Pharmacology and Drug Therapy · doi:10.1592/phco.20.13.1034.35034 · Cited by 36
An evidence-based review on the validity of the Kaltenborn rule as applied to the glenohumeral joint
Brandt, C., Sole, G., Krause, M. W., & Nel, M. (2006) · Manual Therapy · doi:10.1016/j.math.2006.02.011 · Cited by 35
Moberg-Mogren, E., & Nelson, D. L. (2006) · American Journal of Occupational Therapy · doi:10.5014/ajot.60.2.226 · Cited by 35
Maxillary sinusitis in adults: an evaluation of placebo-controlled double-blind trials
Stalman, W. A. B. (1997) · Family Practice · doi:10.1093/fampra/14.2.124 · Cited by 35
Bhandari, M., Richards, R. R., Sprague, S., & Schemitsch, E. H. (2001) · Controlled Clinical Trials · doi:10.1016/s0197-2456(01)00147-7 · Cited by 34
Alcoholism treatment outcome studies, 1980-1992: methodological characteristics and quality.
Morley, J. A., Finney, J. W., Monahan, S., & Floyd, A. (1996) · Addictive Behaviours · doi:10.1016/0306-4603(95)00073-9 · Cited by 31
Evidence-based critical care medicine: a potential tool for change.
Cook, D. (1998) · PubMed · Cited by 29
Clinical Evidence of Subcutaneous CO 2 Insufflations: A Systematic Review
Brockow, T., Hausner, T., Dillner, A., & Resch, K. (2000) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2000.6.391 · Cited by 29
Stobart, K., Iorio, A., & Wu, J. K. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003429.pub3 · Cited by 29
Quality and retrieval of obstetrical anaesthesia randomized controlled trials
Bender, J. S., Halpern, S. H., Thangaroopan, M., Jadad, A. R., & Ohlsson, A. (1997) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/bf03014317 · Cited by 27
IMPACT OF QUALITY ITEMS ON STUDY OUTCOME
Verhagen, A., de Bie, R. D., Lenssen, A., de Vet, H. D., Kessels, A., Boers, M., & van den Brandt, P. A. (2000) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300103174 · Cited by 27
Moyer, A. E., & Finney, J. W. (2002) · Journal of Studies on Alcohol · doi:10.15288/jsa.2002.63.542 · Cited by 24
Avaliação da qualidade de estudos clínicos e seu impacto nas metanálises
Filho, C. R. D. S., Saconato, H., Conterno, L. D. O., Marques, I., & Atallah, Á. N. (2005) · Revista de Saúde Pública · doi:10.1590/s0034-89102005000600001 · Cited by 24
Conservative treatments of children with episodic tension–type headache: A systematic review
Verhagen, A. P., Damen, L., Berger, M. Y., Passchier, J., Merlijn, V. P. B. M., & Koes, B. W. (2005) · Journal of Neurology · doi:10.1007/s00415-005-0940-7 · Cited by 21
Bérard, A., Andreu, N., Tétrault, J.-P., Niyonsenga, T., & MYHAL, D. (2000) · Annals of Epidemiology · doi:10.1016/s1047-2797(00)00069-7 · Cited by 21
A Statement for Health Care Professionals from the American Heart Association the European Resuscitation Council, T. H. A. S. F. O. C. (1997) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.1997.tb03586.x · Cited by 21
Method for Assessment of the Reporting Standard of Clinical Trials with Roentgen Contrast Media
Andrew, E. (1984) · Acta Radiologica Diagnosis · doi:10.1177/028418518402500111 · Cited by 20
INTERPRETING AND USING CLINICAL TRIALS
Doig, G. S. (1998) · Critical Care Clinics · doi:10.1016/s0749-0704(05)70014-2 · Cited by 15
Influence of Methodology on Outcomes of Randomised Clozapine Trials
Wahlbeck, K., Tuunainen, A., Gilbody, S. M., & Adams, C. E. (2000) · Pharmacopsychiatry · doi:10.1055/s-2000-7971 · Cited by 14
Pharmacotherapy for social phobia.
Stein, D. J., Jc, I., & van Balkom, A. J. L. M. (2004) · Pure Amsterdam UMC · Cited by 14
Quality Assessment of Trials: A Comparison of Three Criteria Lists
Verhagen, A. P., de Bie, R. A., Lenssen, A. F., de Vet, H. C. W., Kessels, A. G. H., Boers, M., & van den Brandt, P. A. (2000) · Physical Therapy Reviews · doi:10.1179/ptr.2000.5.1.49 · Cited by 13
Evaluation of the quality of radiotherapy randomized trials for painful bone metastases
Shakespeare, T. P., Thiagarajan, A., & Gebski, V. (2005) · Cancer · doi:10.1002/cncr.20993 · Cited by 13
Calcium channel blockers for preventing acute tubular necrosis in kidney transplant recipients
Shilliday, I., & Sherif, M. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003421.pub3 · Cited by 13
Andrew, E., Eide, H., Fuglerud, P., Hagen, E., Kristoffersen, D. T., Lambrechts, M. J., Waaler, A., & Weibye, M. (1990) · European Journal of Radiology · doi:10.1016/0720-048x(90)90114-q · Cited by 12
Prevalence of methodologic errors in rehabilitation research
Bouter, L. M. (1994) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) · Cited by 5
Research works printed but not linked: 7
- Khan, 2001, Stage II: conducting the review, phase 5: study quality assessment, 1
- Streiner, 2004, Validity, 172
- Streiner, 2004, Reliability, 126
- Streiner, 2004, Measuring change, 194
- Hrobjartsson, 2001, Is the placebo powerless, N Engl J Med, 344, 1594
- Markes, 2006, Exercise for women receiving adjuvant therapy for breast cancer, Cochrane Database Syst Rev, CD005001
- Spitzer, 1990, Links between passive smoking and disease: a best-evidence synthesis, Clin Invest Med, 13, 17
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550
OARSI recommendations for the management of hip and knee osteoarthritis
Zhang, W., Nuki, G., Moskowitz, R. W., Abramson, S., Altman, R. D., Arden, N. K., Bierma-Zeinstra, S., Brandt, K. D., Croft, P., Doherty, M., et al. (2010) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2010.01.013 · Cited by 1,700
Armijo‐Olivo, S., Stiles, C. R., Hagen, N. A., Biondo, P. D., & Cummings, G. G. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01516.x · Cited by 1,539
Page, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916
Metadata
- Authors
- Olivo, S. A., Macedo, L. G., Gadotti, I. C., Fuentes, J., Stanton, T., & Magee, D. J.
- Affiliations
- University of Alberta (CA)
- The University of Sydney (AU)
- IC Gadotti, BScPT, MSc, is a PhD candidate in the Faculty of Rehabilitation Medicine, University of Alberta
- Venue
- Physical Therapy
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-02-01
- Volume
- 88
- Issue
- 2
- Pages
- 156-175
- ISSN
- 0031-9023 (ISSN-L)
- 1538-6724
- OpenAlex
- W2123945981
- Cited by
- 829
- References
- 184
- Citations by year
- 2026: 16 · 2025: 24 · 2024: 35 · 2023: 51 · 2022: 62 · 2021: 63 · 2020: 50 · 2019: 53 · 2018: 43 · 2017: 48 · 2016: 54 · 2015: 53 · 2014: 63 · 2013: 61 · 2012: 44
- FWCI
- 4.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Physical Therapy (publishedVersion)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- methodological quality assessment, randomized controlled trials, quality assessment scale, Jadad scale, psychometric properties, reliability and validity, bias in treatment effect estimates
- MeSH terms
- Humans, Quality Assurance, Health Care, Research Design, Randomized Controlled Trials as Topic, Physical Therapy Modalities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.