Clinical Practice Models for the Use of E-Mental Health Resources in Primary Health Care by Health Professionals and Peer Workers: A Conceptual Framework
Open accessThe DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Abstract
Background: Research into e-mental health technologies has developed rapidly in the last 15 years. Applications such as Internet-delivered cognitive behavioral therapy interventions have accumulated considerable evidence of efficacy and some evidence of effectiveness. These programs have achieved similar outcomes to face-to-face therapy, while requiring much less clinician time. There is now burgeoning interest in integrating e-mental health resources with the broader mental health delivery system, particularly in primary care. The Australian government has supported the development and deployment of e-mental health resources, including websites that provide information, peer-to-peer support, automated self-help, and guided interventions. An ambitious national project has been commissioned to promote key resources to clinicians, to provide training in their use, and to evaluate the impact of promotion and training upon clinical practice. Previous initiatives have trained clinicians to use a single e-mental health program or a suite of related programs. In contrast, the current initiative will support community-based service providers to access a diverse array of resources developed and provided by many different groups. Objective: The objective of this paper was to develop a conceptual framework to support the use of e-mental health resources in routine primary health care. In particular, models of clinical practice are required to guide the use of the resources by diverse service providers and to inform professional training, promotional, and evaluation activities. Methods: Information about service providers’ use of e-mental health resources was synthesized from a nonsystematic overview of published literature and the authors’ experience of training primary care service providers. Results: Five emerging clinical practice models are proposed: (1) promotion; (2) case management; (3) coaching; (4) symptom-focused treatment; and (5) comprehensive therapy. We also consider the service provider skills required for each model and the ways that e-mental health resources might be used by general practice doctors and nurses, pharmacists, psychologists, social workers, occupational therapists, counselors, and peer workers Conclusions: The models proposed in the current paper provide a conceptual framework for policy-makers, researchers and clinicians interested in integrating e-mental health resources into primary care. Research is needed to establish the safety and effectiveness of the models in routine care and the best ways to support their implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013
Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J. W., Patel, V., & Silove, D. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu038 · Cited by 2,846 · cited 1×
“For example, up to half of those living in English-speaking developed countries will experience a mental disorder in their lifetime [1-3].”
Advantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · cited 1×
“Other applications include peer-to-peer support [19], game-based interventions [20], mobile apps [21], online chat [22], and video-conferenced therapy [23].”
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 1×
“It was proposed to aid research, but is a useful conceptual aid for practitioners entering this area [71].”
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · cited 1×
“iCBT interventions have achieved similar outcomes to individually administered face-to-face CBT while requiring much less therapist time [8,9].”
The Effectiveness of Telemental Health: A 2013 Review
Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0075 · Cited by 1,048
Delivering interventions for depression by using the internet: randomised controlled trial
Christensen, H. (2004) · BMJ · doi:10.1136/bmj.37945.566632.ee · Cited by 928 · cited 2×
“Online psycho-education has been shown to improve attitudes to help seeking [13,14] and may be associated with symptom reduction [6].”
Hedman, E., Ljótsson, B., & Lindefors, N. (2012) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.12.67 · Cited by 672 · cited 2×
“iCBT interventions have achieved similar outcomes to individually administered face-to-face CBT while requiring much less therapist time [8,9].”
Lange, A., Rietdijk, D., Hudcovicova, M., van de Ven, J.-P., Schrieken, B., & Emmelkamp, P. M. G. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.5.901 · Cited by 495
PROUDFOOT, J., GOLDBERG, D., MANN, A., EVERITT, B., MARKS, I., & GRAY, J. A. (2003) · Psychological Medicine · doi:10.1017/s0033291702007225 · Cited by 389 · cited 1×
“For example, e-mental health programs listed by NREPP include Beating the Blues [5], MoodGYM [6], and the Co-ordinated Anxiety Learning and Management Tools (CALM) program [7].”
A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety.
Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R. E., Prosser, S., & Kenardy, J. (2011) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0024512 · Cited by 381 · cited 2×
“These include tailoring the program in response to individual service users’ progress (for example by controlling the release of new content) and helping them to complete critical tasks such as exposure, which they might otherwise avoid [67-69].”
Wright, J. H., Wright, A. S., Albano, A. M., Basco, M. R., Goldsmith, L. J., Raffield, T., & Otto, M. W. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.6.1158 · Cited by 319
Slade, T., Johnston, A., Teesson, M., Whiteford, H., Burgess, P., Pirkis, J., & Saw, S. (2009) · PsycEXTRA Dataset · doi:10.1037/e676562010-001 · Cited by 313 · cited 3×
“Therapists’ roles in relation to e-mental health will vary from case to case and may resemble activities in described Models 2, 3, or 4.”
InfluentialWagner, B., Horn, A. B., & Maercker, A. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.032 · Cited by 311 · cited 1×
“Online formats can reliably deliver material with high fidelity and may enhance learning and retention of critical material compared to traditionally delivered CBT [50,51].”
Proudfoot, J., Clarke, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., Harrison, V., Christensen, H., & Hadzi-Pavlovic, D. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-312 · Cited by 264 · cited 1×
“Indeed, many coaching functions can be at least partially automated, for example reminders to complete tasks, feedback about symptom quizzes, and prompts to seek professional advice [56,59,68,74-76].”
Griffiths, K. M., Calear, A. L., & Banfield, M. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1270 · Cited by 228 · cited 1×
“Other applications include peer-to-peer support [19], game-based interventions [20], mobile apps [21], online chat [22], and video-conferenced therapy [23].”
Self-citationCoventry, P. A., Hudson, J. L., Kontopantelis, E., Archer, J., Richards, D. A., Gilbody, S., Lovell, K., Dickens, C., Gask, L., Waheed, W., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0108114 · Cited by 221 · cited 1×
“Access to psychological interventions within collaborative care models is associated with better outcome [90].”
Game-based digital interventions for depression therapy: a systematic review and meta-analysis
Li, J., Theng, Y.-L., & Foo, S. (2014) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2013.0481 · Cited by 219 · cited 1×
“Other applications include peer-to-peer support [19], game-based interventions [20], mobile apps [21], online chat [22], and video-conferenced therapy [23].”
Best Practices in Online Therapy
Abbott, J.-A. M., Klein, B., & Ciechomski, L. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802097257 · Cited by 185
Newby, J. M., Mackenzie, A., Williams, A. D., McIntyre, K., Watts, S., Wong, N., & Andrews, G. (2013) · Psychological Medicine · doi:10.1017/s0033291713000111 · Cited by 181 · cited 7×
“at critical times, such as when users have not made contact within a specified time period, if coaches are concerned about users’ engagement with the program or their clinical status and when service users begin or complete key tasks [12,45-47,54,56].”
InfluentialAcceptability of Internet Treatment of Anxiety and Depression
Gun, S. Y., Titov, N., & Andrews, G. (2011) · Australasian Psychiatry · doi:10.3109/10398562.2011.562295 · Cited by 174 · cited 1×
“Commonly cited barriers include providers’ lack of accurate knowledge about the resources, lack of training in their use, and concerns about their effectiveness, safety and clinical responsibility [97,98,100-105].”
The Effectiveness of Online Cognitive Behavioral Treatment in Routine Clinical Practice
Ruwaard, J., Lange, A., Schrieken, B., Dolan, C. V., & Emmelkamp, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040089 · Cited by 173 · cited 2×
“They have largely been applied in relatively controlled settings such as research trials, centralized online clinics and university or hospital-based clinics (eg, [31,52,60,64]).”
Craske, M. G., Rose, R. D., Lang, A., Welch, S. S., Campbell-Sills, L., Sullivan, G., Sherbourne, C., Bystritsky, A., Stein, M. B., & Roy-Byrne, P. P. (2009) · Depression and Anxiety · doi:10.1002/da.20542 · Cited by 170 · cited 5×
“In the CALM program, coaches also demonstrate skills such as controlled breathing [7].”
InfluentialEffectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165
Taylor-Rodgers, E., & Batterham, P. J. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.06.047 · Cited by 165
Paxling, B., Lundgren, S., Norman, A., Almlöv, J., Carlbring, P., Cuijpers, P., & Andersson, G. (2013) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465812000240 · Cited by 162 · cited 1×
“Poorer outcomes were associated with therapists being more flexible about program deadlines, but the direction of causality was not clear [72].”
The Law of Attrition Revisited
Christensen, H., & Mackinnon, A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.3.e20 · Cited by 161
Donker, T., Bennett, K., Bennett, A., Mackinnon, A., van Straten, A., Cuijpers, P., Christensen, H., & Griffiths, K. M. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2307 · Cited by 154 · cited 1×
“These include Internet-delivered programs drawing on interpersonal therapy [10], psychodynamic therapy [11], and structured writing techniques [12].”
Self-citationHedman, E., Ljótsson, B., Rück, C., Bergström, J., Andersson, G., Kaldo, V., Jansson, L., Andersson, E., Andersson, E., Blom, K., et al. (2013) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12079 · Cited by 144
Farrer, L., Christensen, H., Griffiths, K. M., & Mackinnon, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028099 · Cited by 140 · cited 1×
“In many protocols, contact between coaches and service users is asynchronous and conducted via emails, but may also occur through face-to-face meetings and telephone calls (eg, [44-46, 52, 54-56,64,66,79]).”
Self-citationWilhelmsen, M., Lillevoll, K., Risør, M. B., Høifødt, R., Johansen, M.-L., Waterloo, K., Eisemann, M., & Kolstrup, N. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-296 · Cited by 133
The Use of Computerized Self-Help Packages to Treat Adolescent Depression and Anxiety
Sethi, S., Campbell, A. J., & Ellis, L. A. (2010) · Journal of Technology in Human Services · doi:10.1080/15228835.2010.508317 · Cited by 129 · cited 1×
“Outcomes for anxiety, distress, and depression in the combined (face-to-face and online) intervention were as good or better than outcomes in the traditionally delivered (face-to-face only) intervention [83].”
Twomey, C., O’Reilly, G., & Byrne, M. (2015) · Family Practice · doi:10.1093/fampra/cmu060 · Cited by 123
Internet‐Based Treatment for Panic Disorder: Does Frequency of Therapist Contact Make a Difference?
Klein, B., Austin, D., Pier, C., Kiropoulos, L., Shandley, K., Mitchell, J., Gilson, K., & Ciechomski, L. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802561132 · Cited by 123
Status of computerized cognitive behavioural therapy for adults
Titov, N. (2007) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670601109873 · Cited by 120 · cited 1×
“Users may feel isolated and unmotivated if the coaching is too brief [70,77], although increasing amounts of therapist time may not necessarily improve outcomes [78].”
Holländare, F., Johnsson, S., Randestad, M., Tillfors, M., Carlbring, P., Andersson, G., & Engström, I. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2011.01698.x · Cited by 111 · cited 1×
“Relapse prevention interventions are also showing promise across service users with diverse diagnostic [17] and/or treatment histories [18].”
Implementing a stepped-care approach in primary care: results of a qualitative study
Franx, G., Oud, M., de Lange, J., Wensing, M., & Grol, R. (2012) · Implementation Science · doi:10.1186/1748-5908-7-8 · Cited by 106 · cited 1×
“For example, stepped care and stratified care models are distinguished from usual care partly by the systematic inclusion of less specialist and lower intensity psychological interventions [86-88].”
Johansson, R., Björklund, M., Hornborg, C., Karlsson, S., Hesser, H., Ljótsson, B., Rousseau, A., Frederick, R. J., & Andersson, G. (2013) · PeerJ · doi:10.7717/peerj.102 · Cited by 102 · cited 1×
“These include Internet-delivered programs drawing on interpersonal therapy [10], psychodynamic therapy [11], and structured writing techniques [12].”
Carper, M. M., McHugh, R. K., & Barlow, D. H. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0377-5 · Cited by 92 · cited 1×
“Commonly cited barriers include providers’ lack of accurate knowledge about the resources, lack of training in their use, and concerns about their effectiveness, safety and clinical responsibility [97,98,100-105].”
Shandley, K., Austin, D. W., Klein, B., Pier, C., Schattner, P., Pierce, D., & Wade, V. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1033 · Cited by 84
Whitfield, G., & Williams, C. (2004) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465804001031 · Cited by 83 · cited 4×
“Commonly cited barriers include providers’ lack of accurate knowledge about the resources, lack of training in their use, and concerns about their effectiveness, safety and clinical responsibility [97,98,100-105].”
InfluentialVigerland, S., Ljótsson, B., Bergdahl Gustafsson, F., Hagert, S., Thulin, U., Andersson, G., & Serlachius, E. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.06.002 · Cited by 70
Computer-Assisted Therapies: Examination of Therapist-Level Barriers to Their Use
Becker, E. M., & Jensen-Doss, A. (2013) · Behavior Therapy · doi:10.1016/j.beth.2013.05.002 · Cited by 68 · cited 3×
“Commonly cited barriers include providers’ lack of accurate knowledge about the resources, lack of training in their use, and concerns about their effectiveness, safety and clinical responsibility [97,98,100-105].”
The effectiveness of internet chat groups in relapse prevention after inpatient psychotherapy
Bauer, S., Wolf, M., Haug, S., & Kordy, H. (2011) · Psychotherapy Research · doi:10.1080/10503307.2010.547530 · Cited by 63
Computer-assisted cognitive–behavior therapy for depression.
Eells, T. D., Barrett, M. S., Wright, J. H., & Thase, M. (2014) · Psychotherapy · doi:10.1037/a0032406 · Cited by 62
Internet-Delivered Cognitive Therapy for Social Anxiety Disorder: A Development Pilot Series
Stott, R., Wild, J., Grey, N., Liness, S., Warnock-Parkes, E., Commins, S., Readings, J., Bremner, G., Woodward, E., Ehlers, A., et al. (2013) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465813000404 · Cited by 61
Sharry, J., Davidson, R., McLoughlin, O., & Doherty, G. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2248 · Cited by 55 · cited 2×
“They have largely been applied in relatively controlled settings such as research trials, centralized online clinics and university or hospital-based clinics (eg, [31,52,60,64]).”
Williams, A. D., O'Moore, K., Mason, E., & Andrews, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.11.001 · Cited by 53
Cavanagh, K., Seccombe, N., & Lidbetter, N. (2011) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465810000858 · Cited by 47 · cited 2×
“Other studies have included coaches who were: general medical practitioners with additional mental health training [54,55]; primary care nurses and social workers [7]; psychologists working in private practice [44] and in a non-government mental health organization [56]; community-based psychologists and social worker…”
Gega, L., Smith, J., & Reynolds, S. (2013) · Psychotherapy Research · doi:10.1080/10503307.2013.766941 · Cited by 47
Hadjistavropoulos, H. D., Thompson, M. J., Klein, B., & Austin, D. W. (2012) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.645550 · Cited by 41
Computerized cognitive-behavioral therapy in a stepped care model of treatment
Green, K. E., & Iverson, K. M. (2009) · Professional Psychology: Research and Practice · doi:10.1037/a0012847 · Cited by 39 · cited 1×
“The promotion, case management and coaching models can be used to deliver psycho-education, support, and symptom-focused interventions in low intensity interventions [89].”
Youth work service providers' attitudes towards computerized CBT for adolescents
Fleming, T., & Merry, S. (2013) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465812000306 · Cited by 37 · cited 3×
“Commonly cited barriers include providers’ lack of accurate knowledge about the resources, lack of training in their use, and concerns about their effectiveness, safety and clinical responsibility [97,98,100-105].”
Kirkpatrick, T., Manoukian, L., Dear, B. F., Johnston, L., & Titov, N. (2013) · PeerJ · doi:10.7717/peerj.210 · Cited by 29 · cited 5×
“In many protocols, contact between coaches and service users is asynchronous and conducted via emails, but may also occur through face-to-face meetings and telephone calls (eg, [44-46, 52, 54-56,64,66,79]).”
InfluentialJacmon, J., Malouff, J., & Taylor, N. (2010) · E-Journal of Applied Psychology · doi:10.7790/ejap.v5i2.153 · Cited by 17
A Case Study Illustrating Therapist-Assisted Internet Cognitive Behavior Therapy for Depression
Pugh, N. E., Hadjistavropoulos, H. D., Klein, B., & Austin, D. W. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2013.08.002 · Cited by 16 · cited 3×
“Additional disorder-specific therapist communications were found, such as email content intended to increase hope and normalize the client’s experience [62].”
Farrand, P., Confue, P., Byng, R., & Shaw, S. (2009) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2008.00792.x · Cited by 15
An open trial in the NHS of Blues Begone®: a new home based computerized CBT program
Purves, D. G., Bennett, M., & Wellman, N. (2009) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465809990282 · Cited by 14 · cited 1×
“Indeed, many coaching functions can be at least partially automated, for example reminders to complete tasks, feedback about symptom quizzes, and prompts to seek professional advice [56,59,68,74-76].”
Cited by
Raudenská, J., Steinerová, V., Javůrková, A., Urits, I., Kaye, A. D., Viswanath, O., & Varrassi, G. (2020) · Best Practice & Research Clinical Anaesthesiology · doi:10.1016/j.bpa.2020.07.008 · Cited by 452
Hennemann, S., Beutel, M. E., & Zwerenz, R. (2017) · Journal of Health Communication · doi:10.1080/10810730.2017.1284286 · Cited by 274
Gamification and Adherence to Web-Based Mental Health Interventions: A Systematic Review
Brown, M., O'Neill, N., van Woerden, H., Eslambolchilar, P., Jones, M., & John, A. (2016) · JMIR Mental Health · doi:10.2196/mental.5710 · Cited by 178
“Web-based apps have been widely accepted and recognized as a cost-effective means by which to deliver proven and effective evidence-based therapies that were traditionally face-to-face, such as cognitive behavioral therapy (CBT), to improve mental health and well-being outcomes [5-9].”
BackgroundDavies, F., Shepherd, H. L., Beatty, L., Clark, B., Butow, P., & Shaw, J. (2020) · Journal of Medical Internet Research · doi:10.2196/17362 · Cited by 110
“Further research is needed to examine the acceptability of specific models of care [2], which may vary in level of therapist support, timing of the intervention (waitlist, posttherapy, etc), positioning in stepped care, or the way it is incorporated in routine care.”
BackgroundCano-Vindel, A., Muñoz-Navarro, R., Wood, C. M., Limonero, J. T., Medrano, L. A., Ruiz-Rodríguez, P., Gracia-Gracia, I., Dongil-Collado, E., Iruarrizaga, I., Chacón, F., et al. (2016) · JMIR Research Protocols · doi:10.2196/resprot.6351 · Cited by 56
“If the results of this study are similar to those achieved in studies conducted in other countries (eg, Australia [59,60], Great Britain [22], Norway [61], and the United States [62]), then this would provide further empirical evidence in support of more interventions of this type and thus more…”
Metadata
- Authors
- Reynolds, J., Griffiths, K. M., Cunningham, J. A., Bennett, K., & Bennett, A.
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2015-03-23
- Volume
- 2
- Issue
- 1
- Pages
- e6
- ISSN
- 2368-7959 (ISSN-L)
- OpenAlex
- W2144555329
- Cited by
- 54
- References
- 58
- FWCI
- 11.19
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.