The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Methods to reduce the impact of intraclass correlation in group-randomized trials.
Abstract
This study reports intraclass correlation (ICC) for dependent variables used in group-randomized trials (GRTs). The authors also document the effect of two methods suggested to reduce the impact of ICC in GRTs; these two methods are modeling time and regression adjustment for covariates. They coded and analyzed 1,188 ICC estimates from 17 published, in press, and unpublished articles representing 21 studies. Findings confirm that both methods can improve the efficiency of analyses shown to be valid across conditions common in GRTs. Investigators planning GRTs should obtain ICC estimates matched to their planned analysis so that they can size their studies properly.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 1×
“This application of mixedmodel regression has come to be known as hierarchical linear modeling or multilevel modeling (Bryk and Raudenbush 1992; Raudenbush and Bryk 2002; Goldstein 1987; Kreft and De Leeuw 1998).”
MethodLongitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550 · cited 1×
“This method is asymptotically robust to misspecification of the structure of the correlation matrix (Liang and Zeger 1986; Zeger and Liang 1986; Diggle, Liang, and Zeger 1994).”
MethodLongitudinal Data Analysis for Discrete and Continuous Outcomes
Zeger, S. L., & Liang, K.-Y. (1986) · Biometrics · doi:10.2307/2531248 · Cited by 7,764 · cited 1×
“This method is asymptotically robust to misspecification of the structure of the correlation matrix (Liang and Zeger 1986; Zeger and Liang 1986; Diggle, Liang, and Zeger 1994).”
Method(2001) · Statistics for Psychologists · doi:10.4324/9781410605542-11 · Cited by 6,877
Introducing Multilevel Modeling
Kreft, I., & de Leeuw, J. (1998) · doi:10.4135/9781849209366 · Cited by 2,997
Applied Mixed Models in Medicine
Brown, H., & Presco, R. (2000) · Technometrics · doi:10.1080/00401706.2000.10485742 · Cited by 1,262 · cited 1×
“…health and medicine, it is more common to write a single model, equivalent to what one would obtain by merging such group- and individual-level models, and it is more common to use the more general mixed-model regression terminology (Brown and Prescott 1999; Murray 1998; Donner and Klar 2000).”
BackgroundDesign and Analysis of Cluster Randomization Trials in Health Research
DONNER, A. P., & Klar, N. S. (2000) · Cited by 1,236
Design and Analysis of Group-Randomized Trials
Murray, D. M. (2007) · doi:10.1093/oso/9780195120363.001.0001 · Cited by 1,116
Self-citationTate, R. L., & Goldstein, H. (1988) · Journal of Educational Statistics · doi:10.3102/10769986013002187 · Cited by 999
Multilevel Models in Educational and Social Research
Tate, R. L., & Goldstein, H. (1988) · Journal of Educational Statistics · doi:10.2307/1164754 · Cited by 993
Gulliford, M. C., Ukoumunne, O. C., & Chinn, S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009904 · Cited by 852 · cited 1×
“These 17 articles reported 1,881 ICCs (Ennett et al. 1997; Feng et al. 1999; Gulliford, Ukoumunne, and Chinn 1999; Hannan et al. 1994; Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui…”
BackgroundRutherford, G., Skinner, C. J., Holt, D., & Smith, T. M. F. (1991) · Applied Statistics · doi:10.2307/2347535 · Cited by 750 · cited 1×
“…involving 20 or more groups per condition but not for smaller studies; these strategies involve special methods to estimate standard errors and include the empirical sandwich, resampling, and Taylor-series linearization methods (Murray et al. 1998; Skinner, Holt, and Smith 1989; Murray 1998).”
DONNER, A., BIRKETT, N., & BUCK, C. (1981) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113261 · Cited by 698 · cited 2×
“: : (5) Here, the parenthetical component in the numerator is the design effect (Kish 1965), also called the variance inflation factor (Donner, Birkett, and Buck 1981), which indexes the degree to which the usual variance of the intervention effect is increased as a result of the number of members…”
BackgroundSYMPOSIUM ON CHD PREVENTION TRIALS: DESIGN ISSUES IN TESTING LIFE STYLE INTERVENTION
CORNFIELD, J. (1978) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112592 · Cited by 539
Ennett, S. T., Flewelling, R. L., Lindrooth, R. C., & Norton, E. C. (1997) · Journal of Health and Social Behavior · doi:10.2307/2955361 · Cited by 331 · cited 1×
“These 17 articles reported 1,881 ICCs (Ennett et al. 1997; Feng et al. 1999; Gulliford, Ukoumunne, and Chinn 1999; Hannan et al. 1994; Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui…”
BackgroundHedeker, D., Gibbons, R. D., & Flay, B. R. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.62.4.757 · Cited by 308 · cited 1×
“Four were excluded because they reported only a single ICC (Hedeker, Gibbons, and Flay 1994; Hedeker et al. 1994; Kleinschmidt, Hills, and Elliot 1995; Lazovich et al. 2002).”
BackgroundPlanning for the appropriate analysis in school-based drug-use prevention studies.
Murray, D. M., & Hannan, P. J. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.4.458 · Cited by 235 · cited 2×
“As the magnitude of the ICC increases, the power of the trial decreases, other factors constant (Donner, Birkett, and Buck 1981; Feldman and McKinlay 1994; Hsieh 1988; Koepsell et al. 1991; Murray and Hannan 1990; Murray 1998; Donner and Klar 2000).”
BackgroundSelf-citationPhysical activity protects against coronary death and deaths from all causes in middle-aged men
Rosengren, A., & Wilhelmsen, L. (1997) · Annals of Epidemiology · doi:10.1016/s1047-2797(96)00106-8 · Cited by 225
Smoking behaviour can be predicted by neighbourhood deprivation measures.
Kleinschmidt, I., Hills, M., & Elliott, P. (1995) · Journal of Epidemiology and Community Health · doi:10.1136/jech.49.suppl_2.s72 · Cited by 222
Allen, J. P., Kuperminc, G., Philliber, S. G., & Herre, K. (1994) · American Journal of Community Psychology · doi:10.1007/bf02506896 · Cited by 162
DONNER, A. P., & Klar, N. S. (2000) · Statistical Methods in Medical Research · doi:10.1191/096228000669355658 · Cited by 153
Siddiqui, O. I., Hedeker, D., Flay, B. R., & Hu, F. B. (1996) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a008945 · Cited by 152 · cited 1×
“…Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui et al. 1996; Murray et al. 2001, 2002; Scheier et al. 2002; Gray and Murray, Minnesota Department of Health, unpublished manuscript).”
BackgroundFeldman, H. A., & McKinlay, S. M. (1994) · Statistics in Medicine · doi:10.1002/sim.4780130108 · Cited by 147 · cited 1×
“As the magnitude of the ICC increases, the power of the trial decreases, other factors constant (Donner, Birkett, and Buck 1981; Feldman and McKinlay 1994; Hsieh 1988; Koepsell et al. 1991; Murray and Hannan 1990; Murray 1998; Donner and Klar 2000).”
BackgroundNorton, E. C., Bieler, G. S., Ennett, S. T., & Zarkin, G. A. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.5.919 · Cited by 133
Koepsell, T. D., Martin, D. C., Diehr, P. H., Psaty, B. M., Wagner, E. H., Perrin, E. B., & Cheadle, A. D. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90030-d · Cited by 132 · cited 1×
“As the magnitude of the ICC increases, the power of the trial decreases, other factors constant (Donner, Birkett, and Buck 1981; Feldman and McKinlay 1994; Hsieh 1988; Koepsell et al. 1991; Murray and Hannan 1990; Murray 1998; Donner and Klar 2000).”
BackgroundMurray, D. M., Rooney, B. L., Hannan, P. J., Peterson, A. V., Ary, D. V., Biglan, A., Botvin, G. J., Evans, R. I., Flay, B. R., Futterman, R., et al. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117194 · Cited by 126
Self-citationSample size formulae for intervention studies with the cluster as unit of randomization
Hsieh, F. Y. (1988) · Statistics in Medicine · doi:10.1002/sim.4780071113 · Cited by 126 · cited 2×
“There are now numerous articles and two books to guide investigators in sample size and power calculations as Murray, Blitstein / GROUP-RANDOMIZED TRIALS 97 they plan a new GRT (e.g., see Murray 1998; Hsieh 1988; Donner and Klar 2000; Murray et al. 2001; Murray, Clark, and Wagenaar 2000).”
BackgroundAnalysis Issues in the Evaluation of Community Trials - Progress Toward Solutions in Sas/Stat Mixed
Murray, D. M., & Wolfinger, R. D. (1994) · Journal of Community Psychology · Cited by 110
Self-citationAn Analysis of Variance Pitfall: The Fixed Effects Analysis in a Nested Design
Zucker, D. M. (1990) · Educational and Psychological Measurement · doi:10.1177/0013164490504002 · Cited by 103 · cited 2×
“…model group as a random effect even if the groups represent a convenience sample; modeling a nested factor as a fixed effect carries in an inflated Type I error rate in the presence of positive group-level ICC (Zucker 1990) as is almost always present in a GRT (Murray 1998; Donner and Klar 2000).”
MethodPARAMETERS TO AID IN THE DESIGN AND ANALYSIS OF COMMUNITY TRIALS
Hannan, P. J., Murray, D. M., Jacobs, D. R., & McGovern, P. G. (1994) · Epidemiology · doi:10.1097/00001648-199401000-00013 · Cited by 99 · cited 1×
“These 17 articles reported 1,881 ICCs (Ennett et al. 1997; Feng et al. 1999; Gulliford, Ukoumunne, and Chinn 1999; Hannan et al. 1994; Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui…”
BackgroundSelf-citationA Monte Carlo Study of Alternative Responses To Intraclass Correlation in Community Trials
Murray, D. M., Hannan, P. J., & Baker, W. L. (1996) · Evaluation Review · doi:10.1177/0193841x9602000305 · Cited by 85
Self-citationMurray, D. M., & Short, B. (1995) · Journal of Studies on Alcohol · doi:10.15288/jsa.1995.56.681 · Cited by 82 · cited 2×
“…Ukoumunne, and Chinn 1999; Hannan et al. 1994; Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui et al. 1996; Murray et al. 2001, 2002; Scheier et al. 2002; Gray and Murray,…”
BackgroundResultSelf-citationMurray, D. M., & Short, B. J. (1997) · Addictive Behaviors · doi:10.1016/0306-4603(95)00099-2 · Cited by 79
Self-citationStatistical models appropriate for designs often used in group‐randomized trials
Murray, D. M. (2001) · Statistics in Medicine · doi:10.1002/sim.675 · Cited by 63
Self-citationDesign considerations in the estimation of intraclass correlation
Donner, A. P., & Koval, J. J. (1982) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1982.tb00718.x · Cited by 63 · cited 1×
“Ordinarily, this would be accomplished by weighting each estimate by the inverse of its variance using a formula such as the following (Donner and Koval 1982): ( ) ( ) ( ) ( )( ) σICC ICC m ICC m m g 2 2 2 2 1 1 1 1 1 = − + − − − .”
MethodMurray, D. M., Phillips, G. A., Birnbaum, A. S., & Lytle, L. A. (2001) · Health Education & Behavior · doi:10.1177/109019810102800602 · Cited by 47 · cited 2×
“There are now numerous articles and two books to guide investigators in sample size and power calculations as Murray, Blitstein / GROUP-RANDOMIZED TRIALS 97 they plan a new GRT (e.g., see Murray 1998; Hsieh 1988; Donner and Klar 2000; Murray et al. 2001; Murray, Clark, and Wagenaar 2000).”
BackgroundSelf-citationMurray, D. M., & Short, B. J. (1996) · Journal of Drug Education · doi:10.2190/kbhp-6frt-u0bn-vauc · Cited by 44
Self-citationAn Evaluation of Analysis Options for the One-Group-Per-Condition Design
Varnell, S. P., Murray, D. M., & Baker, W. L. (2001) · Evaluation Review · doi:10.1177/0193841x0102500402 · Cited by 42 · cited 1×
“…subgroup analyses performed at a level intermediate between the unit of assignment and the unit of observation (Murray, Hannan, and Baker 1996; Varnell, Murray, and Baker 2001), and a two-stage analysis that tests the ICC in the first stage and ignores it in the second if it is not…”
BackgroundSelf-citationMartinson, B. C., Murray, D. M., Jeffery, R. W., & Hennrikus, D. J. (1999) · American Journal of Health Promotion · doi:10.4278/0890-1171-13.6.347 · Cited by 41 · cited 1×
“…17 articles reported 1,881 ICCs (Ennett et al. 1997; Feng et al. 1999; Gulliford, Ukoumunne, and Chinn 1999; Hannan et al. 1994; Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui et…”
BackgroundSelf-citationDesign and Analysis Issues in Community Trials
Murray, D. M., McKinlay, S. M., Martin, D., Donner, A. P., Dwyer, J. H., Raudenbush, S. W., & Graubard, B. I. (1994) · Evaluation Review · doi:10.1177/0193841x9401800407 · Cited by 39
Self-citationAnalysis of data from group-randomized trials with repeat observations on the same groups
Murray, D. M., Hannan, P. J., Wolfinger, R. D., Baker, W. L., & Dwyer, J. H. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980730)17:14<1581::aid-sim864>3.0.co;2-n · Cited by 39 · cited 3×
“Similarly, random coefficient models are valid for analyses involving three or more time intervals across a variety of conditions common to GRTs (Murray et al. 1998).”
BackgroundMethodSelf-citationMethods for combining rates from several studies
Zhou, X., Brizendine, E. J., & Pritz, M. B. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990315)18:5<601::aid-sim48>3.0.co;2-l · Cited by 34
Design and analysis of group-randomized trials: A review of recent developments
Murray, D. M. (1997) · Annals of Epidemiology · doi:10.1016/s1047-2797(97)80009-9 · Cited by 31 · cited 1×
“…a level intermediate between the unit of assignment and the unit of observation (Murray, Hannan, and Baker 1996; Varnell, Murray, and Baker 2001), and a two-stage analysis that tests the ICC in the first stage and ignores it in the second if it is not significant in the first (Murray 1997, 1998).”
BackgroundSelf-citationThe worksite component of variance: design effects and the Healthy Worker Project
Kelder, S. H., Jacobs, D. R., Jeffery, R. W., McGovern, P. G., & Forster, J. L. (1993) · Health Education Research · doi:10.1093/her/8.4.555 · Cited by 27 · cited 1×
“These 17 articles reported 1,881 ICCs (Ennett et al. 1997; Feng et al. 1999; Gulliford, Ukoumunne, and Chinn 1999; Hannan et al. 1994; Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui…”
BackgroundMurray, D. M., Clark, M. H., & Wagenaar, A. C. (2000) · Journal of Studies on Alcohol · doi:10.15288/jsa.2000.61.881 · Cited by 26 · cited 3×
“There are now numerous articles and two books to guide investigators in sample size and power calculations as Murray, Blitstein / GROUP-RANDOMIZED TRIALS 97 they plan a new GRT (e.g., see Murray 1998; Hsieh 1988; Donner and Klar 2000; Murray et al. 2001; Murray, Clark, and Wagenaar 2000).”
BackgroundResultSelf-citationIntraclass correlation among measures related to cigarette use by adolescents
Murray, D. M., Alfano, C. M., Zbikowski, S. M., Padgett, L. S., Robinson, L. A., & Klesges, R. C. (2002) · Addictive Behaviors · doi:10.1016/s0306-4603(01)00189-7 · Cited by 25 · cited 1×
“…Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui et al. 1996; Murray et al. 2001, 2002; Scheier et al. 2002; Gray and Murray, Minnesota Department of Health, unpublished manuscript).”
BackgroundSelf-citationScheier, L. M., Griffin, K. W., Doyle, M. M., & Botvin, G. J. (2002) · Health Education & Behavior · doi:10.1177/109019810202900109 · Cited by 21 · cited 1×
“…Kelder et al. 1993; Martinson et al. 1999; Murray, Clark, and Wagenaar 2000; Murray and Hannan 1990; Murray and Short 1995, 1996, 1997; Norton et al. 1996; Siddiqui et al. 1996; Murray et al. 2001, 2002; Scheier et al. 2002; Gray and Murray, Minnesota Department of Health, unpublished manuscript).”
BackgroundSample Size Considerations for Studies of Intervention Efficacy in the Occupational Setting
Lazovich, D., Murray, D. M., Brosseau, L. M., Parker, D. L., MILTON, F. T., & Dugan, S. (2002) · The Annals of Occupational Hygiene · doi:10.1093/annhyg/mef028 · Cited by 18 · cited 1×
“Four were excluded because they reported only a single ICC (Hedeker, Gibbons, and Flay 1994; Hedeker et al. 1994; Kleinschmidt, Hills, and Elliot 1995; Lazovich et al. 2002).”
BackgroundSelf-citationMurray, D. M., Feldman, H. A., McGovern, P. G., & For the REACT Study Group (2000) · Statistical Methods in Medical Research · doi:10.1177/096228020000900204 · Cited by 9 · cited 1×
“Another study was excluded because it presented ICCs based on a unique analytic model (Murray, Feldman, and McGovern 2000).”
BackgroundSelf-citationScheier, L. M., Griffin, K. W., Doyle, M. M., et al. (2002) · Health Education & Behavior · doi:10.1177/1090198102029001009 · Cited by 1
Research works printed but not linked: 4
- 10.1002/(sici)1097-0258(19990315)18:5<539::aid-sim50>3.0.co;2-s · DOI
- 10.1037/0022-006x.62.4.757 · DOI · Paper page
- Kish L. 1965. Survey sampling. New York: John Wiley.
- 10.1037/0022-006x.58.4.458 · doi:10.1037/0022-006x.58.4.458 · Paper page
Cited by
Intraclass Correlation Values for Planning Group-Randomized Trials in Education
Hedges, L. V., & Hedberg, E. C. (2007) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373707299706 · Cited by 847
“Murray and Blitstein (2003) reported a summary of intraclass correlations obtained from 17 articles reporting cluster-randomized trials in psychology and public health, and Murray et al. (2004) gave references to 14 very recent studies that provide data on intraclass correlations for health-related…”
BackgroundSchool-based programs to reduce bullying and victimization: (528362010-001)
Farrington, D. P., & Ttofi, M. M. (2009) · PsycEXTRA Dataset · doi:10.1037/e528362010-001 · Cited by 667
“, & Olweus, D. (1998). Violence among rural youth.”
BackgroundInfluentialDesign and analysis of group-randomized trials: a review of recent methodological developments
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.423 · Cited by 677
Self-citationAddressing Social Determinants of Health at Well Child Care Visits: A Cluster RCT
Garg, A., Toy, S., Tripodis, Y., Silverstein, M., & Freeman, E. (2015) · Pediatrics · doi:10.1542/peds.2014-2888 · Cited by 643
Gaffney, H., Ttofi, M. M., & Farrington, D. P. (2019) · Aggression and Violent Behavior · doi:10.1016/j.avb.2018.07.001 · Cited by 518
Metadata
- Authors
- Murray, D. M., & Blitstein, J. L.
- Affiliations
- University of Memphis (US)
- Venue
- Evaluation Review
- Publisher
- SAGE Publications
- Published
- 2003-02
- Volume
- 27
- Issue
- 1
- Pages
- 79-103
- ISSN
- 0145-4692 (ISSN-L)
- 0193-841X
- 1552-3926
- OpenAlex
- W2113296669
- Cited by
- 221
- References
- 49
- Citations by year
- 2026: 8 · 2025: 4 · 2024: 12 · 2023: 11 · 2022: 13 · 2021: 16 · 2020: 7 · 2019: 6 · 2018: 8 · 2017: 6 · 2016: 12 · 2015: 12 · 2014: 13 · 2013: 8 · 2012: 11
- FWCI
- 7.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Evaluation Review (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- intraclass correlation coefficient, group-randomized trials, regression adjustment, sample size determination, statistical efficiency, clustered data, covariate adjustment
- MeSH terms
- Analysis of Variance, Humans, Regression Analysis, Research Design, Time Factors, Models, Statistical, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.