Evidence that therapy works in clincally representative conditions.
The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Abstract
This article reports a secondary analysis of past therapy outcome meta-analysis. Fifteen meta-analysis provided effect sizes from 56 studies in previous reviews that met 1 of 3 increasingly stringent levels of criteria for clinical representativeness. The effect sizes were synthesized and compared with results from the original meta-analyses. Effect sizes from more clinically representative studies are the same size at all 3 criteria levels as in past meta-analyses. Almost no studies exist that meet the most stringent level of criteria. Results are interpreted cautiously because of controversy about what criteria best capture the notion of clinical representativeness, because so few experiments have tested therapy in clinical conditions, and because other models for exploring the generalizability of therapy outcome research to clinical conditions might yield different results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Second, clinical representativeness of studies is often rated based on a multitude of criteria, besides recruitment type, such as setting of treatment delivery, experience of therapists, and flexibility in treatment manuals [9,109].”
From Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis (2019) · cites this paper as [109]
Citations
Cites
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,517
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,997
Smith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123
Self-citationLipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608
Update on empirically validated therapies, II: (619622010-001)
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., et al. (1997) · PsycEXTRA Dataset · doi:10.1037/e619622010-001 · Cited by 1,488
Self-citationEffectiveness of psychotherapy
(2011) · Revision MCQs and EMIs for the MRCPsych · doi:10.1201/b13482-76 · Cited by 1,058
Robinson, L. A., Berman, J. S., & Neimeyer, R. A. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.108.1.30 · Cited by 671
Self-citation
Cited by
Items 101–186 of 186
Evidenzbasierte Psychotherapie
Fydrich, T., & Schneider, S. (2006) · Psychotherapeut · doi:10.1007/s00278-006-0522-x · Cited by 23
Jordan, C., Hayee, B., & Chalder, T. (2019) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2326 · Cited by 14
Response Surface Analysis with Missing Data
Humberg, S., & Grund, S. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2021.1884522 · Cited by 17
The long-term outcome of cognitive behaviour therapy for adults in routine clinical practice
Westbrook, D., & Hill, L. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(98)00050-3 · Cited by 15
Haaga, D. A. F. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.4.674 · Cited by 14
Kordy, H., & Bauer, S. (2003) · Cited by 14
Adapting Evidence-Based Psychotherapies While Maintaining Fidelity
Bash, H. A. J. L., Galovski, T. E., & Stirman, S. W. (2019) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-019-00177-9 · Cited by 17
An Effectiveness Study of Group Therapy for Anxiety Disorders
Ingen, D. J. V., & Novicki, D. J. (2009) · International Journal of Group Psychotherapy · doi:10.1521/ijgp.2009.59.2.243 · Cited by 13
Forensic Psychotherapy for Sexual Offenders: Has Its Effectiveness Yet Been Demonstrated?
Hoberman, H. M. (2015) · Springer eBooks · doi:10.1007/978-1-4939-2416-5_28 · Cited by 13
Praxisorientierte Forschung in der Psychotherapie: Entwicklung, Gegenwart und Zukunft
Herzog, P., Kaiser, T., & Brakemeier, E. (2022) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000665 · Cited by 11
Klinische Brauchbarkeit der Konfrontationstherapie für agoraphobische Patienten:
Hahlweg, K., Fiegenbaum, W., Schroeder, B., Frank, M., & von Witzleben, I. (2004) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/0084-5345.33.2.130 · Cited by 13
Benchmarking therapists: furthering the benchmarking method in its application to clinical practice
Minami, T., Brown, G. S., McCulloch, J., & Bolstrom, B. (2011) · Quality & Quantity · doi:10.1007/s11135-011-9548-4 · Cited by 11
“…example, clinical representativeness studies, although innovative, cannot be considered solid evidence because PTAU effectiveness is statistically estimated using data from clinical trials rather than directly measuring treatment outcomes (e.g., Shadish et al. 1997, 2000; Shapiro and Shapiro 1982).”
Uso de técnicas de relajación en una clínica de psicología
Blanco, C., Estupiñá, F. J., Labrador, F. J., Fernández‐Arias, I., Bernaldo‐de‐Quirós, M., & Gómez, L. (2014) · Anales de Psicología · doi:10.6018/analesps.30.2.158451 · Cited by 18
“A pesar de esto, conviene recordar que los centros universitarios han sido considerados centros representativos de la práctica clínica en el ámbito asistencial privado por otros autores (Borkovec, 2004; Shadish et al., 1997, 2000).”
BackgroundAn Integrated Treatment Algorithm for Pharmacotherapy and Psychotherapy
Kisely, S. R., & Jones, J. K. (1999) · Australian & New Zealand Journal of Psychiatry · doi:10.1046/j.1440-1614.1999.00548.x · Cited by 10
Practice-Based Evidence: 45 Years of Psychotherapy’s Effectiveness in a Private Practice
Clement, P. W. (2013) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.2013.67.1.23 · Cited by 11
McCollum, E. E., & Stith, S. M. (2002) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.2002.tb01165.x · Cited by 10
Butcher, J. N. (1997) · Psychological Assessment · doi:10.1037/h0092770 · Cited by 9
Härter, M. C., Klesse, C., Marthias, B., Bermejo, I., Bschor, T., Gensichen, J., Harfst, T., Hautzinger, M., Kühner, C., Mundt, C., et al. (2010) · Zeitschrift für psychosomatische Medizin und Psychotherapie · doi:10.13109/zptm.2010.56.4.334 · Cited by 9
Entwicklung und Beurteilung therapeutischer Interventionen
Jacobi, F. (2011) · Springer-Lehrbuch · doi:10.1007/978-3-642-13018-2_30 · Cited by 15
Internal and External Validity of Intervention Studies
Moras, K. (1998) · Elsevier eBooks · doi:10.1016/b0080-4270(73)00268-6 · Cited by 9
Schaffler, Y., Jesser, A., Humer, E. C., Haider, K., Pieh, C., Probst, T., & Schigl, B. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1264039 · Cited by 9
“Despite our comprehensive and strategic efforts, which encompass re fi ning our research approach, dedicating signi fi cant human resources, and actively involving stakeholders (7) in the context of the POPP study, we persistently encounter challenges that impede our recruitment process.”
BackgroundThe Causal Generalization Paradox: The Case of Treatment Outcome Research
Staines, G. L. (2008) · Review of General Psychology · doi:10.1037/1089-2680.12.3.236 · Cited by 11
“For example, recent meta-analytic analyses (Shadish, Matt, Navarro, & Phillips, 2000; Shadish et al., 1997) have shown that psychotherapy outcomes are quite similar for efficacy studies (conducted in research laboratories) and effectiveness studies (conducted in clinics that approximate typical conditions of clinical…”
ResultVom Labor ins Feld: Die Psychotherapieevaluation geht neue Wege
Heekerens, H.-P. (2005) · Psychotherapeut · doi:10.1007/s00278-005-0441-2 · Cited by 7
Evidencia basada en la práctica en psicoterapia: el reto en Latinoamérica
Trujillo, A., & Paz, C. (2020) · CES Psicología · doi:10.21615/cesp.13.3.1 · Cited by 10
“No obstante, Shadish et al. (1997) formularon una serie de criterios que definen a los estudios basados en el paradigma de la EBP en psicoterapia: a) ser realizado en centros comunitarios de salud mental o centros de atención primaria, b) involucrar clientes remitidos a través de rutas habituales,…”
BackgroundLundqvist, J., Brattmyr, M., Lindberg, M. S., Havnen, A., Solem, S., & Hjemdal, O. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1167058 · Cited by 7
“We used the term TAU to indicate an active clinic-based outpatient therapy as defined by Shadish et al. (1997).”
BackgroundMethodInfluentialCrecelius, V., & Hiller, W. (2014) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000256 · Cited by 6
Kessler, R. S. (2008) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-008-9096-9 · Cited by 6
Estupiñá, F. J., & Encinas, F. J. L. (2012) · The Spanish Journal of Psychology · doi:10.5209/rev_sjop.2012.v15.n3.39423 · Cited by 9
“…criteria of treatment efficacy proposed by the 12th Division of the APA (Chambless et al., 1998) have received much criticism due to the difficulty of generalizing the results of the randomized clinical trials (RCTs) on which they are based (Rodríguez, 2004; Seligman, 1995; Shadish et al., 1997).”
BackgroundEnhancing the clinical relevance of psychotherapy outcome research
Guthrie, E. (2000) · Journal of Mental Health · doi:10.1080/713680244 · Cited by 6
Evidence-based practice: is there a link between research and practice?
Roth, T. (1999) · Clinical Psychology Forum · doi:10.53841/bpscpf.1999.1.133.37 · Cited by 6
The Cognitive Behavioural Approach: CBT’s Big Brother
Merrett, C., & Easton, S. (2008) · Counselling Psychology Review · doi:10.53841/bpscpr.2008.23.1.21 · Cited by 5
A Vision of the Next Generation of Behavioral Therapies Research in the Addictions
Carroll, K. M., & Rounsaville, B. J. (2011) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/foc.9.1.foc118 · Cited by 5
Empirically supported treatments and comorbid psychopathology: Spelunking Plato's cave.
Hufford, M. R. (2000) · Professional Psychology Research and Practice · doi:10.1037//0735-7028.31.1.96 · Cited by 6
A Study of Patients who go to a Psychology Clinic Seeking Treatment
Estupiñá, F. J., Labrador, F. J., & García‐Vera, M. P. (2012) · The Spanish Journal of Psychology · doi:10.5209/rev_sjop.2012.v15.n1.37334 · Cited by 10
Brattmyr, M., Lindberg, M. S., Lundqvist, J., Öst, L., Solem, S., Hjemdal, O., & Havnen, A. (2023) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12976 · Cited by 4
Entwicklung und Beurteilung therapeutischer Interventionen
Jacobi, F. (2020) · Springer eBooks · doi:10.1007/978-3-662-61814-1_19 · Cited by 4
Blocher, W. G. (2011) · Iowa State University Digital Repository (Iowa State University) · doi:10.31274/etd-180810-2778 · Cited by 7
“For example, meta-analyses have found that on average, therapy clients were better off than 75% of untreated individuals and the effect size ranged from of .68 to .85(Shadish et al., 1997; Smith and Glass, 1977; Smith & Glass, 1979).”
MethodDeny nothing, doubt everything: A comment on Westen and Morrison (2001).
Nathan, P. E. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.69.6.900 · Cited by 4
Clinically representative research in the psychological therapies: an emerging paradigm
Cahill, J. (2012) · Journal of research in nursing · doi:10.1177/1744987112465079 · Cited by 4
“In terms of establishing a practice-based discourse, this has, in part, been activated by seminal publications (e.g. Shadish et al., 1997, 2000), by high quality CRR, and by a dedicated readership.”
BackgroundInfluentialEvidenzbasierung in der Psychotherapie
Fydrich, T. (2018) · Familiendynamik · doi:10.21706/fd-43-4-268 · Cited by 3
The Future of Psychotherapy Outcome Research: Science or Political Rhetoric?
Peebles, J. E. (2000) · The Journal of Psychology · doi:10.1080/00223980009598244 · Cited by 4
“Research findings showing that psychotherapy can result in positive outcomes for patients (e.g., Barlow, 1994; Lipsey &Wilson, 1993; Shadish et al., 1997) continue to be met with skepticism, despite a large body of supportive scientific literature (Strupp, 1996).”
BackgroundThe effectiveness of psychological treatments in psychiatry
Fonagy, P., & Paris, J. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511544392.007 · Cited by 3
Trial Design of Psychological Treatments in Chronic Pain: What Can We Tell Patients?
Morley, S. (2007) · Cited by 3
Margraf, J. (2018) · Springer eBooks · doi:10.1007/978-3-662-54911-7_1 · Cited by 4
Ward, D. B. (2002) · VTechWorks (Virginia Tech) · Cited by 3
Disorders of Childhood and Adolescence
Mash, E. J., & Wolfe, D. A. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop208002 · Cited by 3
Messer, S. B., Sanderson, W. C., & Gurman, A. S. (2003) · Wiley eBooks · doi:10.1002/0471264385.wei0817 · Cited by 4
Lundqvist, J., Lindberg, M. S., Brattmyr, M., Havnen, A., Aasdahl, L., Solem, S., & Hjemdal, O. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12856-w · Cited by 2
“In routine care, TAU typically refers to a broad range of therapeutic methods provided to patients with diverse backgrounds by therapists with regular caseloads [26].”
Lundqvist, J., Lindberg, M. S., Brattmyr, M., Havnen, A., Hjemdal, O., & Solem, S. (2024) · Nordic Journal of Psychiatry · doi:10.1080/08039488.2024.2434602 · Cited by 2
“Clinically representative treatment was defined as patients with diverse backgrounds and complaints referred to routine clinics and therapists with regular caseloads who use a variety of therapeutic approaches [3].”
The Question of Psychotherapy Supervision
Gold, J. H., Samios, K., & Lockwood, J. (2000) · Australasian Psychiatry · doi:10.1046/j.1440-1665.2000.00258.x · Cited by 2
“Of the 56% (23) of respondents who had completed their Collegerequired case, only 5% (2) were seeing another patient for supervised psychotherapy.”
BackgroundMühlig, S., & Poldrack, A. (2020) · Springer eBooks · doi:10.1007/978-3-662-61814-1_28 · Cited by 2
Epe‐Jungeblodt, F., Pauli, P., Schwab, F. J., & Andreatta, M. (2024) · Journal of Clinical Psychology · doi:10.1002/jclp.23702 · Cited by 2
Professional Training Issues in Evidence‐Based Clinical Psychology
Baillie, A., & Peters, L. (2012) · Wiley eBooks · doi:10.1002/9781118156391.ebcp002003 · Cited by 2
INTERNET-BASED TREATMENT FOR DEPRESSION AND PANIC DISORDER From Development to Deployment
Bergström, J. (2010) · Figshare · Cited by 4
Entwicklung und Beurteilung therapeutischer Interventionen
Jacobi, F. (2006) · Springer eBooks · doi:10.1007/978-3-540-28511-3_30 · Cited by 7
Experimentelle und nicht-experimentelle Studienpläne in der Rehabilitationsforschung
Faller, H., Haaf, H.-G., Löschmann, C., Maurischat, C., & Schulz, H. (2000) · Springer eBooks · doi:10.1007/978-3-642-57114-5_15 · Cited by 2
Choosing a Psychodynamic Psychotherapy Model for an Australian Public Sector Mental Health Service
Petchkovksy, L., Morris, P., & Rushton, P. (2002) · Australasian Psychiatry · doi:10.1046/j.1440-1665.2002.00491.x · Cited by 1
Warschburger, P. (2009) · Springer eBooks · doi:10.1007/978-3-540-79044-0_3 · Cited by 1
Mühlig, S., & Poldrack, A. (2006) · Springer eBooks · doi:10.1007/978-3-540-28511-3_23 · Cited by 1
Psychological treatment outcomes for outpatients in a clinical context
Lundkvist, J. E., Georgsson, K., Carlbring, P., Borg, E., Ramnerö, J., Johansson, R., Ljungberg, T., & Anderbro, T. (2023) · Nordic Psychology · doi:10.1080/19012276.2023.2206540 · Cited by 1
“…manual, no monitoring of treat-ment other than routine supervision, no restriction on therapeutic procedures, heterogeneous patients regarding age, sex, class, and focal problem, and therapists that have not been given any speci fi c training for the purposes of the study (Shadish et al., 1997).”
Psychodynamische Psychotherapie — Grundlagen und klinische Anwendungen
Ermann, M., & Waldvogel, B. (2008) · Springer eBooks · doi:10.1007/978-3-540-33129-2_30 · Cited by 3
An investigation of the outcomes of psycho-oncology interventions
Croy, P. (2010) · Cited by 1
Meichenbaum, D. H. (2017) · Routledge eBooks · doi:10.4324/9781315748931-17 · Cited by 1
Mühlig, S., & Poldrack, A. (2011) · Springer-Lehrbuch · doi:10.1007/978-3-642-13018-2_25 · Cited by 3
Valente, J. R. (2010) · Digital Archive @ GSU · doi:10.57709/1420851
Margni, A., Molina, M. F., Sartori, N., Rebull, M. E., & Vázquez, L. (2012) · Redalyc (Universidad Autónoma del Estado de México)
Höök, H., & Ogén, O. (2006) · Lund University Publications Student Papers (Lund University)
Gómez, L. S., Labrador, F. J., & García‐Peñalvo, F. J. (2014)
An Internet-based survey of the effectiveness of psychotherapy and mental health care
Knabb, P. D. (2000) · ThinkTech (Texas Tech University)
Evidencias y Competencias en Psicoterapias. Evidence and Competence in Psychotherapy.
Angona, P., Ruiz‐Delgado, I., & Castejón, F. S. (2013)
Krause, M., Vilches, O., Dagnino, P., & Echávarri, O. (2005)
Bower, P., & Gilbody, S. M. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511861147.014
Historical Paths in Psychotherapy
Braakmann, D. (2015)
William Raymond Shadish Jr. Will Shadish's Intellectual Accomplishments
Cook, T. D. (2016) · American Journal of Evaluation · doi:10.1177/1098214016666714
“In several articles (Shadish et al., 1997; Shadish, Matt, Navarro, & Phillips, 2000), Will documented that most evaluations of psychotherapy are done as doctoral theses in university clinics with very local populations and that they test the short-term outcomes of a minor variant of some existing…”
in der Rehabilitationsforschung
Faller, H., Löschmann, C., Maurischat, C., & Schulz, H. (2000)
Treatment development: The early years
Galovski, T. E., Nixon, R. D. V., & Kaysen, D. L. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-816715-1.00003-0 · Cited by 1
Evaluation of psychotherapy procedures used by Vietnamese therapists
Wells, N.-Q. N. (2014)
(2011) · Odile Jacob eBooks · doi:10.3917/oj.cottr.2011.01.0323
(2009) · Springer eBooks · doi:10.1007/978-3-540-68316-2_8
Pederson, L. D. (2015) · Wiley eBooks · doi:10.1002/9781118957882.refs
Romijn, G., Batelaan, N. M., Kok, R., Koning, J., van Balkom, A. J. L. M., Titov, N., & Riper, H. M. (2018) · doi:10.2196/preprints.11706
Problèmes généraux dans l’évaluation des psychothérapies
Cottraux, J. A. (2020) · Elsevier eBooks · doi:10.1016/b978-2-294-76778-4.00024-7
Metaanalyser til både hjelp og forvirring
Solem, S. (2025) · Tidsskrift for Norsk psykologforening · doi:10.52734/imno6688
Problèmes généraux dans l’évaluation des psychothérapies
Cottraux, J. A. (2011) · Elsevier eBooks · doi:10.1016/b978-2-294-70814-5.00020-8
Vitry, G. (2021) · theses.fr (ABES) · doi:10.70675/9ca77eb1zbd3az4379zbd87zd7d8bf641d4c · Cited by 2
Metadata
- Authors
- Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D., Jorm, A. F., Lyons, L. C., Nietzel, M. T., Robinson, L., Prout, H. T., Smith, M. L., Svartberg, M., & Weiss, B.
- Affiliations
- University of Memphis (US)
- ORCID
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 1997
- Volume
- 65
- Issue
- 3
- Pages
- 355-365
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2049024183
- Cited by
- 186
- References
- 94
- Citations by year
- 2025: 2 · 2024: 3 · 2023: 3 · 2022: 3 · 2021: 3 · 2020: 6 · 2019: 3 · 2018: 6 · 2017: 1 · 2016: 1 · 2015: 5 · 2014: 7 · 2013: 6 · 2012: 9
- FWCI
- 14.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- generalizability, effect size, clinical conditions
- MeSH terms
- Humans, Psychotherapy, Meta-Analysis as Topic, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.