The DOI matches its Crossref record; 117 of the 118 references it cites were found in a registry or an index.
Testing delayed, gradual, and temporary treatment effects in randomized single-case experiments: A general response function framework
Open accessAbstract
Randomization tests represent a class of significance tests to assess the statistical significance of treatment effects in randomized single-case experiments. Most applications of single-case randomization tests concern simple treatment effects: immediate, abrupt, and permanent changes in the level of the outcome variable. However, researchers are confronted with delayed, gradual, and temporary treatment effects; in general, with “response functions” that are markedly different from single-step functions. We here introduce a general framework that allows specifying a test statistic for a randomization test based on predicted response functions that is sensitive to a wide variety of data patterns beyond immediate and sustained changes in level: different latencies (degrees of delay) of effect, abrupt versus gradual effects, and different durations of the effect (permanent or temporary). There may be reasonable expectations regarding the kind of effect (abrupt or gradual), entailing a different focal data feature (e.g., level or slope). However, the exact amount of latency and the exact duration of a temporary effect may not be known a priori, justifying an exploratory approach studying the effect of specifying different latencies or delayed effects and different durations for temporary effects. We provide illustrations of the proposal with real data, and we present a user-friendly freely available web application implementing it.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Using test statistics based on predicted response functions for SCED studies is a newly described framework with the purpose of offering statistical analysis for data with nonlinearity and delayed or gradual changes to the primary outcome measure, as is often seen in psychological treatment [60].”
From Internet-Delivered Therapy for Parents With Health Anxiety by Proxy: Protocol for a Single-Case Experimental Design Study (2023) · cites this paper as [60]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306 · cited 2×
“Thus, there have been suggestions (Lakens, 2021) and efforts (Wasserstein et al., 2019; Wasserstein & Lazar, 2016) to promote the correct use and interpretation of p values.”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003 · cited 1×
“P values and null hypothesis statistical testing have been objects of controversy and criticism in the context of social and behavioral sciences (Cohen, 1990, 1994; Gigerenzer, 2004; Nickerson, 2000) and more specifically in the SCED context (Branch, 2014; Perone, 1999).”
BackgroundThe Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005) · Exceptional Children · doi:10.1177/001440290507100203 · Cited by 3,368 · cited 2×
“…evidence regarding functional relations and informing professional practice in several fields such as education (Kennedy, 2005), special education (Horner et al., 2005), clinical psychological (Morley, 2018), behavioral sciences (Ledford & Gast, 2018), rehabilitation (Tate & Perdices, 2019), and…”
BackgroundStatistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200 · cited 1×
“Additionally, it is not clear that suggested alternatives such as effect-size measures and confidence intervals 6 (Wilkinson et al., 1999) are free from misinterpretations and misuses (Cortina & Landis, 2011; Greenland et al., 2016).”
BackgroundMoving to a World Beyond “ p < 0.05”
Wasserstein, R. L., Schirm, A. L., & Lazar, N. A. (2019) · The American Statistician · doi:10.1080/00031305.2019.1583913 · Cited by 2,976 · cited 1×
“Thus, there have been suggestions (Lakens, 2021) and efforts (Wasserstein et al., 2019; Wasserstein & Lazar, 2016) to promote the correct use and interpretation of p values.”
BackgroundStatistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791 · cited 1×
“Additionally, it is not clear that suggested alternatives such as effect-size measures and confidence intervals 6 (Wilkinson et al., 1999) are free from misinterpretations and misuses (Cortina & Landis, 2011; Greenland et al., 2016).”
BackgroundEdgington, E. S. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2169 · Cited by 2,028
Self-citationThings I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
Single-Case Designs for Educational Research
Kennedy, C. H. (2004) · Cited by 1,465
Single-Case Intervention Research Design Standards
Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013) · Remedial and Special Education · doi:10.1177/0741932512452794 · Cited by 1,331 · cited 1×
“However, all visually analyzed data features (Kratochwill et al., 2013) have been discussed and/or tested as test statistics.”
Background
Research works printed but not linked: 2
- Kazdin, A. E. (2020). Single-case research designs: Methods for clinical and applied settings (3rd ed.). Oxford University Press.
- Kratochwill, T. R., Levin, J. R., & Horner, R. H. (2018). Negative results: Conceptual and methodological dimensions in single-case intervention research. Remedial and Special Education, 34(1), 26–38. https://doi.org/10.1177/0741932512452794 · DOI · Paper page
Cited by
Ingeman, K., Frostholm, L., Wellnitz, K. B., Wright, K., Frydendal, D. H., Onghena, P., & Rask, C. U. (2023) · JMIR Research Protocols · doi:10.2196/46927 · Cited by 3
“Secondary test statistic: response functions [60] will be used to test the hypothesis of delayed and gradual reduction in anxiety (see the Aim section).”
InfluentialSelf-citationIngeman, K., Frydendal, D. H., Frostholm, L., Bjerre-Nielsen, E., Wellnitz, K. B., Onghena, P., Wright, K. D., & Rask, C. U. (2025) · JMIR Formative Research · doi:10.2196/65396 · Cited by 1
“Second, the original study protocol indicated that response functions [60] would serve as a secondary randomization test statistic.”
Self-citationCarrozzo, E., Zimmermann, G., Bathke, A. C., Neunhäeuserer, D., Niebauer, J., & Kulnik, S. T. (2025) · Biometrical Journal · doi:10.1002/bimj.70045 · Cited by 3
Sharaa, H. A., Bartels, S. L., Onghena, P., Taygar, A. S., Engman, L., Flink, I. K., Petersson, S., Boersma, K., McCracken, L. M., Simons, L. E., et al. (2026) · Digital Health · doi:10.1177/20552076261467865 · Cited by 1
Self-citationUsing Case-Specific Effect Sizes to Complement Visual Analysis in Single-Case Design Research
Ferron, J. M., Kirby, M. S., Lipien, L., Pustejovsky, J. E., Grekov, P., Machalicek, W., & Moeyaert, M. (2026) · Perspectives on Behavior Science · doi:10.1007/s40614-026-00516-1
Metadata
- Authors
- Manolov, R., & Onghena, P.
- Affiliations
- Universitat de Barcelona (ES)
- KU Leuven (BE)
- Corresponding author
- Manolov, Rumen
- Venue
- Behavior Research Methods
- Published
- 2023-09-25
- Volume
- 56
- Issue
- 4
- Pages
- 3915-3936
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- PMC
- PMC11133040
- OpenAlex
- W4387010042
- Cited by
- 5
- References
- 118
- Citations by year
- 2026: 2 · 2025: 2 · 2023: 1
- FWCI
- 1.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Behavior Research Methods (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Lirias (submittedVersion, other-oa)
- Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) (submittedVersion, cc-by)
- Funders
- Universitat de Barcelona
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- permutation tests, response functions, delayed treatment effect, test statistics, web application
- MeSH terms
- Single-Case Studies as Topic, Data Interpretation, Statistical, Humans, Random Allocation, Research Design, Time Factors, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Testing delayed, gradual, and temporary treatment effects in randomized single-case experiments: A general response function framework. https://app.cochat.ai/papers/10.3758/s13428-023-02230-1
- The paper
- Manolov, R., & Onghena, P. (2023). Testing delayed, gradual, and temporary treatment effects in randomized single-case experiments: A general response function framework. Behavior Research Methods. https://doi.org/10.3758/s13428-023-02230-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.