CoChat

The DOI matches its Crossref record; 117 of the 118 references it cites were found in a registry or an index.

Testing delayed, gradual, and temporary treatment effects in randomized single-case experiments: A general response function framework

Open access
Manolov, Rumen, Onghena, Patrick · 2023 · Behavior Research Methods

Abstract

Randomization tests represent a class of significance tests to assess the statistical significance of treatment effects in randomized single-case experiments. Most applications of single-case randomization tests concern simple treatment effects: immediate, abrupt, and permanent changes in the level of the outcome variable. However, researchers are confronted with delayed, gradual, and temporary treatment effects; in general, with “response functions” that are markedly different from single-step functions. We here introduce a general framework that allows specifying a test statistic for a randomization test based on predicted response functions that is sensitive to a wide variety of data patterns beyond immediate and sustained changes in level: different latencies (degrees of delay) of effect, abrupt versus gradual effects, and different durations of the effect (permanent or temporary). There may be reasonable expectations regarding the kind of effect (abrupt or gradual), entailing a different focal data feature (e.g., level or slope). However, the exact amount of latency and the exact duration of a temporary effect may not be known a priori, justifying an exploratory approach studying the effect of specifying different latencies or delayed effects and different durations for temporary effects. We provide illustrations of the proposal with real data, and we present a user-friendly freely available web application implementing it.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3758/s13428-023-02230-1

Cites

117 of 117 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Prototypical immediate effects
Fig. 1 Prototypical immediate effectsCC BY · PubMed Central
Fig. 2 Prototypical delayed effects
Fig. 2 Prototypical delayed effectsCC BY · PubMed Central
Fig. 3 te Brake et al. (2023) data for participant 4
Fig. 3 te Brake et al. (2023) data for participant 4CC BY · PubMed Central
Fig. 4 Results of the exploratory randomization approach, using Pearson’s correlation as test statistic, for the te Brake et al. (2023) data for participant 4. Exploring an immediate and abrupt effect
Fig. 4 Results of the exploratory randomization approach, using Pearson’s correlation as test statistic, for the te Brake et al. (2023) data for participant 4. Exploring an immediate and abrupt effectCC BY · PubMed Central
Fig. 5 te Brake et al. (2023) data for participant 3
Fig. 5 te Brake et al. (2023) data for participant 3CC BY · PubMed Central
Fig. 6 Results of the exploratory randomization approach, using Pearson’s correlation as test statistic, for the te Brake et al. (2023) data for participant 3. Exploring an immediate gradual effect
Fig. 6 Results of the exploratory randomization approach, using Pearson’s correlation as test statistic, for the te Brake et al. (2023) data for participant 3. Exploring an immediate gradual effectCC BY · PubMed Central
Fig. 7 te Brake et al. (2023) data for participant 5
Fig. 7 te Brake et al. (2023) data for participant 5CC BY · PubMed Central
Fig. 8 Results of the exploratory randomization approach, using Pearson’s correlation as test statistic, for the te Brake et al. (2023) data for participant 5. Exploring a delayed effect
Fig. 8 Results of the exploratory randomization approach, using Pearson’s correlation as test statistic, for the te Brake et al. (2023) data for participant 5. Exploring a delayed effectCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 118 references

Research works printed but not linked: 2

  1. Kazdin, A. E. (2020). Single-case research designs: Methods for clinical and applied settings (3rd ed.). Oxford University Press.
  2. Kratochwill, T. R., Levin, J. R., & Horner, R. H. (2018). Negative results: Conceptual and methodological dimensions in single-case intervention research. Remedial and Special Education, 34(1), 26–38. https://doi.org/10.1177/0741932512452794 · DOI · Paper page

Cited by

See all 5

Metadata

Authors
Manolov, R., & Onghena, P.
Affiliations
  • Universitat de Barcelona (ES)
  • KU Leuven (BE)
Corresponding author
Manolov, Rumen
Venue
Behavior Research Methods
Published
2023-09-25
Volume
56
Issue
4
Pages
3915-3936
ISSN
  • 1554-351X (ISSN-L)
  • 1554-3528
OpenAlex
W4387010042
Cited by
5
References
118
Citations by year
2026: 2 · 2025: 2 · 2023: 1
FWCI
1.01
Type
journal article
Language
en
Open access
Licence
Locations
  • Behavior Research Methods (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Lirias (submittedVersion, other-oa)
  • Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) (submittedVersion, cc-by)
Funders
Universitat de Barcelona
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Keywords
permutation tests, response functions, delayed treatment effect, test statistics, web application
MeSH terms
Single-Case Studies as Topic, Data Interpretation, Statistical, Humans, Random Allocation, Research Design, Time Factors, Models, Statistical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Testing delayed, gradual, and temporary treatment effects in randomized single-case experiments: A general response function framework. https://app.cochat.ai/papers/10.3758/s13428-023-02230-1
The paper
Manolov, R., & Onghena, P. (2023). Testing delayed, gradual, and temporary treatment effects in randomized single-case experiments: A general response function framework. Behavior Research Methods. https://doi.org/10.3758/s13428-023-02230-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.