The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Visual aids and structured criteria for improving visual inspection and interpretation of single-case designs
Open accessAbstract
Because behavior analysis is a data-driven process, a critical skill for behavior analysts is accurate visual inspection and interpretation of single-case data. Study 1 was a basic study in which we increased the accuracy of visual inspection methods for A-B designs through two refinements of the split-middle (SM) method called the dual-criteria (DC) and conservative dual-criteria (CDC) methods. The accuracy of these visual inspection methods was compared with one another and with two statistical methods (Allison & Gorman, 1993; Gottman, 1981) using a computer-simulated Monte Carlo study. Results indicated that the DC and CDC methods controlled Type I error rates much better than the SM method and had considerably higher power (to detect real treatment effects) than the two statistical methods. In Study 2, brief verbal and written instructions with modeling were used to train 5 staff members to use the DC method, and in Study 3, these training methods were incorporated into a slide presentation and were used to rapidly (i.e., 15 min) train a large group of individuals (N = 87). Interpretation accuracy increased from a baseline mean of 55% to a treatment mean of 94% in Study 2 and from a baseline mean of 71% to a treatment mean of 95% in Study 3. Thus, Study 1 answered basic questions about the accuracy of several methods of interpreting A-B designs; Study 2 showed how that information could be used to increase the accuracy of human visual inspectors; and Study 3 showed how the training procedures from Study 2 could be modified into a format that would facilitate rapid training of large groups of individuals to interpret single-case designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Conservative dual-criterion (CDC; Fisher et al., 2003; Swoboda et al., 2010) analyses were also conducted to increase reliability of visual inspection.”
From Feasibility and preliminary outcomes of compassion-focused acceptance and commitment therapy delivered via telehealth in a community behavioral health clinic (2025) · cites this paper as Fisher et al., 2003
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Single-Case Research Designs: Methods for Clinical and Applied Settings
Kazdin, A. E. (1982) · Cited by 2,852
Single-case research designs: Methods for clinical and applied settings
Hayes, S. C. (1983) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(83)90018-6 · Cited by 2,677
Time-Series Analysis: A Comprehensive Introduction for Social Scientists
Cordray, D. S., & Gottman, J. M. (1983) · The American Journal of Psychology · doi:10.2307/1422219 · Cited by 416
Time Series Analysis: A Comprehensive Introduction for Social Scientists.
Ray, W. D., & Gottman, J. M. (1982) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2982108 · Cited by 316
Design and analysis of single-case research
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1208 · Cited by 297
“PERHAPS IT WOULD BE BETTER NOT TO KNOW EVERYTHING”1
Baer, D. M. (1977) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1977.10-167 · Cited by 279
INCONSISTENT VISUAL ANALYSES OF INTRASUBJECT DATA
DeProspero, A., & Cohen, S. (1979) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1979.12-573 · Cited by 260
Design and Analysis of Single-Case Research
(2014) · Psychology Press eBooks · doi:10.4324/9781315806402 · Cited by 244
TOWARD THE DEVELOPMENT OF STRUCTURED CRITERIA FOR INTERPRETATION OF FUNCTIONAL ANALYSIS DATA
Hagopian, L. P., Fisher, W. W., Thompson, R. H., Owen‐DeSchryver, J., Iwata, B. A., & Wacker, D. P. (1997) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1997.30-313 · Cited by 229
Self-citationMatyas, T. A., & Greenwood, K. M. (1990) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1990.23-341 · Cited by 222
STATISTICAL INFERENCE FOR INDIVIDUAL ORGANISM RESEARCH: MIXED BLESSING OR CURSE?1
Michael, J. L. (1974) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1974.7-647 · Cited by 207
Review: single-subject clinical-outcome research: designs, data, effect sizes, and analyses
ROBEY, R. R., SCHULTZ, M. C., CRAWFORD, A. B., & SINNER, C. A. (1999) · Aphasiology · doi:10.1080/026870399402028 · Cited by 194
EFFECTS OF SERIAL DEPENDENCY ON THE AGREEMENT BETWEEN VISUAL AND STATISTICAL INFERENCE1
Jones, R. R., Weinrott, M. R., & Vaught, R. S. (1978) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1978.11-277 · Cited by 186
A Methodology for the Quantitative Synthesis of Intra-Subject Design Research
Skiba, R. J., & Casey, A. (1985) · The Journal of Special Education · doi:10.1177/002246698501900404 · Cited by 184
PYRAMIDAL TRAINING: A LARGE‐SCALE APPLICATION WITH INSTITUTIONAL STAFF
Page, T. J., Iwata, B. A., & Reid, D. H. (1982) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1982.15-335 · Cited by 155
Parsonson, B. S., & Baer, D. M. (1986) · Springer eBooks · doi:10.1007/978-1-4684-8786-2_8 · Cited by 125
Autocorrelation in applied behavior analysis: A myth.
Huitema, B. E. (1985) · Behavioral Assessment · Cited by 111
Visual Inspection and Statistical Analysis in Single-Case Designs
Park, H. S., Marascuilo, L. A., & Gaylord‐Ross, R. (1990) · The Journal of Experimental Education · doi:10.1080/00220973.1990.10806545 · Cited by 110
Visual inspection of single-subject data: an empirical analysis.
Ottenbacher, K. J. (1990) · PubMed · Cited by 78
Graphical Display and Visual Analysis
Franklin, G. (2014) · doi:10.4324/9781315806402-11 · Cited by 77
Analyzing Single-Case Data: The Power of Randomization Tests
Ferron, J. M., & Ware, W. (1995) · The Journal of Experimental Education · doi:10.1080/00220973.1995.9943820 · Cited by 64
Interrater Reliability of Therapists' Judgments of Graphed Data
Harbst, K., Ottenbacher, K. J., & Harris, S. R. (1991) · Physical Therapy · doi:10.1093/ptj/71.2.107 · Cited by 56
EFFECTS OF LINES OF PROGRESS AND SEMILOGARITHMIC CHARTS ON RATINGS OF CHARTED DATA
Bailey, D. B. (1984) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1984.17-359 · Cited by 50
COMPARING CHOICE AND QUESTIONNAIRE MEASURES OF THE ACCEPTABILITY OF A STAFF TRAINING PROCEDURE
Reid, D. H., & Parsons, M. B. (1995) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1995.28-95 · Cited by 26
Watson, T. S., & Kramer, J. J. (1995) · Journal of Behavioral Education · doi:10.1007/bf02110316 · Cited by 26
Boykin, R. A., & Nelson, R. O. (1981) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1981.14-479 · Cited by 24
Rojahn, J., & Schulze, H. H. (1985) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/bf00960752 · Cited by 23
Allison, D. B., & Gorman, B. S. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053001014 · Cited by 7
Flagged first, then by citations
Research works printed but not linked: 4
- Crosbie J., 1987, The inability of the binomial test to control Type I error with single‐subject data, Behavioral Assessment, 9, 141
- Crosbie J., 1995, The analysis of change, 361
- Matyas T. A., 1996, Design and analysis of single case research, 215
- White O. R., 1974, The “split middle”—a “quickie” method of trend estimation
Cited by
Sorted by citations
Single-Case Intervention Research Design Standards
Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013) · Remedial and Special Education · doi:10.1177/0741932512452794 · Cited by 1,331
Kratochwill, T. R., & Levin, J. R. (2010) · Psychological Methods · doi:10.1037/a0017736 · Cited by 497
Krasny-Pacini, A., & Evans, J. (2017) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2017.12.002 · Cited by 335
Clinical Application of Functional Analysis Methodology
Iwata, B. A., & Dozier, C. L. (2008) · Behavior Analysis in Practice · doi:10.1007/bf03391714 · Cited by 301
Interpreting Kendall’s Tau and Tau- U for single-case experimental designs
Brossart, D. F., Laird, V. C., & Armstrong, T. W. (2018) · Cogent Psychology · doi:10.1080/23311908.2018.1518687 · Cited by 210
“However, recent studies have shown that structured criteria and training may improve the accuracy of visual raters (Fisher et al., 2003; Kahng et al., 2010; Stewart, Carr, Brandt, & McHenry, 2007).”
Background
Metadata
- Authors
- Fisher, W. W., Kelley, M. E., & Lomas, J. E.
- Affiliations
- Louisiana State University (US)
- Corresponding author
- Fisher, Wayne W.
- Venue
- Journal of Applied Behavior Analysis
- Publisher
- Wiley
- Published
- 2003-09
- Volume
- 36
- Issue
- 3
- Pages
- 387-406
- ISSN
- 0021-8855 (ISSN-L)
- 1938-3703
- PMC
- PMC1284456
- OpenAlex
- W2048320738
- Cited by
- 351
- References
- 28
- Citations by year
- 2026: 19 · 2025: 11 · 2024: 15 · 2023: 25 · 2022: 29 · 2021: 33 · 2020: 32 · 2019: 16 · 2018: 14 · 2017: 22 · 2016: 13 · 2015: 21 · 2014: 22 · 2013: 16 · 2012: 14
- FWCI
- 3.65
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Applied Behavior Analysis (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Department of Health and Human Services (5 R01 HD37837-03)
- National Institutes of Health (5r01hd037837-03)
- National Institute of Child Health and Human Development
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (5 R01 HD37837-03)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Social Sciences › Psychology › Applied Psychology › Human Resource Development and Performance Evaluation
- Keywords
- visual inspection, single-case experimental design, type I error control, statistical power, interpreting accuracy, employee training, modeling, behavior analysis
- MeSH terms
- Audiovisual Aids, Behavior Therapy, Computer Graphics, Computer Simulation, Humans, Mathematical Computing, Monte Carlo Method, Outcome and Process Assessment, Health Care, Regression Analysis, Software, Reproducibility of Results, Observer Variation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
