Establishing a Scale for Assessing the Social Validity of Skill Building Interventions for Young Children with Autism Spectrum Disorder
The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
This study evaluated the psychometric properties of the Scale of Treatment Perceptions (STP), a measure of treatment acceptability targeting skill-building interventions for Autism Spectrum Disorder (ASD). This scale utilizes a strength-based approach to intervention assessment, and was established by modifying the Behavior Intervention Rating Scale (Elliott and Von Brock Treuting in J School Psychol 29(1):43-51, 1991. doi: 10.1016/0022-4405(91)90014-I ) and the Treatment Evaluation Inventory (Kazdin in J Appl Behav Anal 13(2):259-273, 1980. doi: 10.1901/jaba.1980.13-259 ) to be appropriate for assessing multiple dimensions of acceptability across skill-building ASD treatments. Overall, the STP demonstrated good psychometric properties: the scale had appropriate internal consistency, demonstrated a stable three-factor structure that was invariant across samples, and discriminated among different skill-building treatments for ASD. This has important implications for dissemination, as perceived acceptability of a treatment relates to treatment utilization and adherence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
A Rationale and Test for the Number of Factors in Factor Analysis
Horn, J. L. (1965) · Psychometrika · doi:10.1007/bf02289447 · Cited by 8,714
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · cited 2×
“A non-significant change in Chi square fit between model 1 and model 2 indicates that the factor structure fits equally well for Sample A and Sample B, and suggests that measurement of the latent variables is consistent across groups (Reise et al. 1993, 2000; Vandenberg and Lance 2000).”
BackgroundBaio, J., Wiggins, L., Christensen, D. L., Maenner, M. J., Daniels, J., Warren, Z., Kurzius-Spencer, M., Zahorodny, W., Robinson, C., Rosenberg, et al. (2018) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6706a1 · Cited by 6,078
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Factor analysis in the development and refinement of clinical assessment instruments.
Floyd, F. J., & Widaman, K. F. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.286 · Cited by 3,970
Morbidity and Mortality Weekly Report
(2011) · Wilderness & Environmental Medicine · doi:10.1016/j.wem.2010.11.007 · Cited by 3,423
Wolf, M. M. (1978) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1978.11-203 · Cited by 3,176
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Summated Rating Scale Construction
Spector, P. (1992) · Sage eBooks · doi:10.4135/9781412986038 · Cited by 2,158
Wong, C., Odom, S. L., Hume, K. A., Cox, A. W., Fettig, A., Kucharczyk, S., Brock, M. E., Plavnick, J. B., Fleury, V. P., & Schultz, T. R. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2351-z · Cited by 1,584
Schreibman, L., Dawson, G., Stahmer, A. C., Landa, R., Rogers, S. J., McGee, G. G., Kasari, C., Ingersoll, B., Kaiser, A. P., Bruinsma, Y., et al. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2407-8 · Cited by 1,421
Self-citationNaarden Braun, K. V., Lopez, M., White, T., et al. (2023) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/y3kk-5x30 · Cited by 1,381
Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993) · Psychological Bulletin · doi:10.1037//0033-2909.114.3.552 · Cited by 1,224
Using Mechanical Turk to Study Clinical Populations
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013) · Clinical Psychological Science · doi:10.1177/2167702612469015 · Cited by 1,139
Assessing the Clinical or Applied Importance of Behavior Change through Social Validation
Kazdin, A. E. (1977) · Behavior Modification · doi:10.1177/014544557714001 · Cited by 1,117
Evidence‐Based Psychotherapies for Children and Adolescents
Woolgar, M. (2011) · Child and Adolescent Mental Health · doi:10.1111/j.1475-3588.2011.00617_11.x · Cited by 1,095
The viability of crowdsourcing for survey research
Behrend, T. S., Sharek, D. J., Meade, A. W., & Wiebe, E. N. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0081-0 · Cited by 1,018
Factor analysis and scale revision.
Reise, S. P., Waller, N. G., & Comrey, A. L. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.3.287 · Cited by 855
Family experience of barriers to treatment and premature termination from child therapy.
Kazdin, A. E., Holland, L., & Crowley, M. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.65.3.453 · Cited by 720
ACCEPTABILITY OF ALTERNATIVE TREATMENTS FOR DEVIANT CHILD BEHAVIOR
Kazdin, A. E. (1980) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1980.13-259 · Cited by 692
Teacher judgments concerning the acceptability of school-based interventions.
Martens, B. K., Witt, J. C., Elliott, S. N., & Darveaux, D. X. (1985) · Professional Psychology: Research and Practice · doi:10.1037//0735-7028.16.2.191 · Cited by 669
Bellini, S., Peters, J. K., Benner, L., & Hopf, A. (2007) · Remedial and Special Education · doi:10.1177/07419325070280030401 · Cited by 658
Lau, A. S. (2006) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2006.00042.x · Cited by 624
Jiles, R. B., Hughes, E., Murphy, W., Flowers, N., McCracken, M., Roberts, H., Ochner, M., Balluz, L. S., Mokdad, A., Elam–Evans, L. D., et al. (2005) · PubMed · Cited by 596
Gutkin, T. B. (1986) · Journal of School Psychology · doi:10.1016/0022-4405(86)90051-8 · Cited by 493
Evaluation of Comprehensive Treatment Models for Individuals with Autism Spectrum Disorders
Odom, S. L., Boyd, B. A., Hall, L. J., & Hume, K. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0825-1 · Cited by 424
Development of a modified treatment evaluation inventory
Kelley, M. L., Heffer, R. W., Gresham, F. M., & Elliott, S. N. (1989) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/bf00960495 · Cited by 408
Laushey, K. M., & Heflin, L. J. (2000) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005558101038 · Cited by 348
Assessing social validity in clinical treatment research: Issues and procedures.
Foster, S. L., & Mash, E. J. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.3.308 · Cited by 347
Elliott, S. N., & Treuting, M. V. B. (1991) · Journal of School Psychology · doi:10.1016/0022-4405(91)90014-i · Cited by 328
Reimers, T. M., & Wacker, D. P. (1988) · Behavioral Disorders · doi:10.1177/019874298801400104 · Cited by 295
Social Validation of Evidence-Based Practices in Autism by Parents, Teachers, and Administrators
Callahan, K., Henson, R. K., & Cowan, A. K. (2008) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-007-0434-9 · Cited by 241
SOCIAL VALIDATION: THE EVOLUTION OF STANDARDS OF COMPETENCY FOR TARGET BEHAVIORS
Houten, R. V. (1979) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1979.12-581 · Cited by 208
Gresham, F. M., Cook, C. R., Crews, S. D., & Kern, L. (2004) · Behavioral Disorders · doi:10.1177/019874290403000101 · Cited by 198
Kazdin, A. E. (2000) · Journal of Child and Family Studies · doi:10.1023/a:1009414904228 · Cited by 193
Hume, K., Bellini, S., & Pratt, C. (2005) · Topics in Early Childhood Special Education · doi:10.1177/02711214050250040101 · Cited by 174
Assessing treatment acceptance: The abbreviated acceptability rating profile
Tarnowski, K. J., & Simonian, S. J. (1992) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(92)90007-6 · Cited by 167
Yeh, M., McCabe, K., Hough, R. L., Lau, A., Fakhry, F., & Garland, A. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.800 · Cited by 159
System and Cost Research Issues in Treatments for People with Autistic Disorders
Jacobson, J. W., & Mulick, J. A. (2000) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005691411255 · Cited by 135
Vereb, R. L., & DiPerna, J. C. (2004) · School Psychology Review · doi:10.1080/02796015.2004.12086259 · Cited by 130
Reimers, T. M., Wacker, D. P., & Cooper, L. J. (1991) · Child & Family Behavior Therapy · doi:10.1300/j019v13n02_04 · Cited by 130
ABA Versus TEACCH: The Case for Defining and Validating Comprehensive Treatment Models in Autism
Callahan, K., Mehta, S. S., Magee, S. K., & Wie, M. (2009) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0834-0 · Cited by 122
Assessment of Treatment Acceptability: A Review of the Literature
Miltenberger, R. G. (1990) · Topics in Early Childhood Special Education · doi:10.1177/027112149001000304 · Cited by 116
Reimers, T. M., Wacker, D. P., Cooper, L. J., & Deraad, A. O. (1992) · Behavioral Disorders · doi:10.1177/019874299201800108 · Cited by 104
Differences Among States in the Identification of Autistic Spectrum Disorders
Mandell, D. S., & Palmer, R. (2005) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.159.3.266 · Cited by 101
ABA and the Development of Meaningful Social Relations for Young Children with Autism
Strain, P. S., & Schwartz, I. (2001) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/108835760101600208 · Cited by 100
The role of treatment acceptability in the initiation of treatment for ADHD
Krain, A. L., Kendall, P. C., & Power, T. J. (2005) · Journal of Attention Disorders · doi:10.1177/1087054705279996 · Cited by 95
Pilot study of a school-based parent training program for preschoolers with ASD
Ingersoll, B. R., & Wainer, A. L. (2013) · Autism · doi:10.1177/1362361311427155 · Cited by 84
Self-citationLiu, C., Robin, A. L., Brenner, S., & Eastman, J. (1991) · Pediatrics · doi:10.1542/peds.88.3.560 · Cited by 75
Arndorfer, R. E., Allen, K. D., & Aljazireh, L. (1999) · Behavior Therapy · doi:10.1016/s0005-7894(99)80050-1 · Cited by 58
Kuza, C. C., Gjesfjeld, C. D., & Greeno, C. G. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0139-6 · Cited by 29
Evaluation of the psychometric properties of the Pediatric Parenting Stress Inventory (PPSI).
Devine, K. A., Heckler, C. E., Katz, E. R., Fairclough, D. L., Phipps, S., Sherman‐Bien, S., Dolgin, M. J., Noll, R. B., Askins, M. A., Butler, R. W., et al. (2013) · Health Psychology · doi:10.1037/a0032306 · Cited by 25
Green, V. A., Drysdale, H., Boelema, T., Smart, E. L., van der Meer, L. A. J., Achmadi, D., Prior, T., O’Reilly, M. F., Didden, R., & Lancioni, G. (2013) · Education and Treatment of Children · doi:10.1353/etc.2013.0016 · Cited by 18
Treatment acceptability of alternative therapies for depression: A comparative analysis.
Banken, D. M., & Wilson, G. L. (1992) · Psychotherapy · doi:10.1037/0033-3204.29.4.610 · Cited by 17
Review of Recent Treatment Acceptability Research
Carter, S. L. (2007) · Education and Training in Developmental Disabilities · doi:10.1177/215416470704200306 · Cited by 10
Research works printed but not linked: 1
- Wong, C., Odom, S. L., Hume, K., Cox, A. W., Fettig, A., Kucharczyk, S., et al. (2013). Evidence-based practices for children, youth, and young adults with Autism Spectrum Disorder. Chapel Hill: The University of North Carolina, Frank Porter Graham Child Development Institute, Autism Evidence-Based Practice Review Group.
Cited by
Schuck, R. K., Tagavi, D. M., Baiden, K. M. P., Dwyer, P., Williams, Z. J., Osuna, A., Ferguson, E. F., Jimenez Muñoz, M., Poyser, S. K., Johnson, J. F., et al. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05316-x · Cited by 208
Yoo, G. E., & Kim, S. J. (2018) · Journal of Music Therapy · doi:10.1093/jmt/thy013 · Cited by 75
Rigorous Assessment of Social Validity: A Scoping Review of a 40-Year Conversation
Snodgrass, M. R., Chung, M. Y., Kretzer, J., & Biggs, E. E. (2021) · Remedial and Special Education · doi:10.1177/07419325211017295 · Cited by 73
“C), and Berger et al. (2016) advocated for the use of a psychometrically validated rating scale (5.”
BackgroundMethodInfluentialWainer, A., Arnold, Z. E., Leonczyk, C., & Soorya, L. V. (2021) · Molecular Autism · doi:10.1186/s13229-021-00443-9 · Cited by 73
“The STP has demonstrated appropriate internal consistency, a stable factor structure, and divergent validity [51].”
BackgroundSchuck, R. K., Dwyer, P. S. R., Baiden, K. M. P., Williams, Z. J., & Wang, M. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-022-05808-4 · Cited by 48
“Others have emphasized the importance of more subjective measures, with researchers giving participants questionnaires (e.g., Berger et al., 2016; Luiselli et al., 2015; see Finn & Sladezcek, 2001 for a review) or conducting qualitative interviews (e.g., Leko, 2014).”
Background
Metadata
- Authors
- Berger, N. I., Manston, L., & Ingersoll, B.
- Affiliations
- Michigan State University (US)
- Corresponding author
- Berger, Natalie I.
- Venue
- Journal of Autism and Developmental Disorders
- Published
- 2016-07-27
- Volume
- 46
- Issue
- 10
- Pages
- 3258-3269
- ISSN
- 0162-3257 (ISSN-L)
- 1573-3432
- OpenAlex
- W2492342807
- Cited by
- 31
- References
- 59
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 6 · 2023: 5 · 2022: 2 · 2021: 6 · 2019: 3 · 2018: 1 · 2017: 1
- FWCI
- 1.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Autism and Developmental Disorders (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Health Sciences › Medicine › Psychiatry and Mental health › Child Nutrition and Feeding Issues
- Keywords
- autism spectrum disorder, social validity, treatment acceptability, psychometric properties, young children, medication adherence, treatment utilization, factor structure, measurement invariance
- MeSH terms
- Behavior Rating Scale, Autism Spectrum Disorder, Adolescent, Adult, Child, Female, Humans, Male, Middle Aged, Parents, Psychometrics, Surveys and Questionnaires, Young Adult, Social Skills
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.