The Role of Behavior Observation in Measurement Systems for Randomized Prevention Trials
Abstract
The role of behavior observation in theory-driven prevention intervention trials is examined. A model is presented to guide choice of strategies for the measurement of five core elements in theoretically informed, randomized prevention trials: (1) training intervention agents, (2) delivery of key intervention conditions by intervention agents, (3) responses of clients to intervention conditions, (4) short-term risk reduction in targeted client behaviors, and (5) long-term change in client adjustment. It is argued that the social processes typically thought to mediate interventionist training (Element 1) and the efficacy of psychosocial interventions (Elements 2 and 3) may be powerfully captured by behavior observation. It is also argued that behavior observation has advantages in the measurement of short-term change (Element 4) engendered by intervention, including sensitivity to behavior change and blinding to intervention status.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Knowing how to measure intervention aspects depends centrally on explicit theories of program content and process.
“Snyder et al. (2006) contended that explicit program content and process theories are central to determining how to measure aspects of an intervention.”
From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Snyder et al. 2006
Observation is the gold standard for assessing implementation fidelity.
“Although multiple sources of data provide insight into implementation fidelity, as described, the gold standard is observation (e.g., Snyder et al. 2006); other sources of data are used to triangulate and provide insight as needed.”
From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Snyder et al. 2006
Cites
(1991) · Medical Entomology and Zoology · Cited by 4,438 · see citing works
(1982) · Medical Entomology and Zoology · Cited by 2,951 · see citing works
Observing Interaction: An Introduction to Sequential Analysis
Bakeman, R., & Gottman, J. M. (1997) · doi:10.1017/cbo9780511527685 · Cited by 1,439 · see citing works
(2002) · American Psychological Association eBooks · doi:10.1037/10468-000 · Cited by 795 · see citing works
Advances in Psychological Assessment
(1984) · The Australian Educational and Developmental Psychologist · doi:10.1017/s0816512200025116 · Cited by 596 · see citing works
Prenatal and infancy home visiting by nurses: From randomized trials to community replication
Olds, D. L. (2002) · Prevention Science · doi:10.1023/a:1019990432161 · Cited by 490 · see citing works
Placebo Theory, Research , and Mechanisms
WHITE, L. E., Tursky, B., & SCHWARTZ, G. E. R. (1985) · Guilford Press eBooks · Cited by 485 · see citing works
Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005) · Behavior Therapy · doi:10.1016/s0005-7894(05)80049-8 · Cited by 320 · see citing works
Ialongo, N., PODUSKA, J. M., Werthamer‐Larsson, L., & Kellam, S. G. (2001) · Journal of Emotional and Behavioral Disorders · doi:10.1177/106342660100900301 · Cited by 298 · see citing works
How Do Outcomes in a Specified Parent Training Intervention Maintain or Wane Over Time?
DeGarmo, D. S., Patterson, G. R., & Forgatch, M. S. (2004) · Prevention Science · doi:10.1023/b:prev.0000023078.30191.e0 · Cited by 298 · see citing works
Willett, J. B. (1989) · Educational and Psychological Measurement · doi:10.1177/001316448904900309 · Cited by 289 · see citing works
Depression and Aggression in Family interaction
(2013) · Routledge eBooks · doi:10.4324/9780203771334 · Cited by 222 · see citing works
Stoolmiller, M., Eddy, J. M., & Reid, J. B. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.2.296 · Cited by 214 · see citing works
Self-citationReductions in HIV Risk Among Runaway Youth
Rotheram‐Borus, M. J., Song, J., Gwadz, M. V., Lee, M., Rossem, R. V., & Koopman, C. (2003) · Prevention Science · doi:10.1023/a:1024697706033 · Cited by 186 · see citing works
Scientific standards of psychological practice : issues and recommendations
Hayes, S. C. (2007) · Cited by 180 · see citing works
Intervention for families of aggressive boys: A replication study
Patterson, G. R., & Reid, J. B. (1973) · Behaviour Research and Therapy · doi:10.1016/0005-7967(73)90096-x · Cited by 171 · see citing works
Self-citationStoolmiller, M., Eddy, J. M., & Reid, J. B. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.2.296 · Cited by 155 · see citing works
Self-citationNaturalistic observation in clinical assessment
Patterson, G. R. (1977) · Research on Child and Adolescent Psychopathology · doi:10.1007/bf00913701 · Cited by 148 · see citing works
Walter, H., & Gilmore, S. K. (1973) · Behavior Therapy · doi:10.1016/s0005-7894(73)80116-9 · Cited by 146 · see citing works
Treatment adherence process research in family therapy: A rationale and some practical guidelines.
Hogue, A., Liddle, H. A., & Rowe, C. L. (1996) · Psychotherapy · doi:10.1037/0033-3204.33.2.332 · Cited by 141 · see citing works
Some problems and solutions in the study of change: Significant patterns in client resistance.
Stoolmiller, M., Duncan, T. E., Bank, L., & Patterson, G. R. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.6.920 · Cited by 137 · see citing works
Self-citationExpectation biases in observational evaluation of therapeutic change.
Kent, R. N., O’Leary, K. D., Diament, C., & Dietz, A. (1974) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0037516 · Cited by 115 · see citing works
Eddy, J. M., Dishion, T. J., & Stoolmiller, M. (1998) · Research on Child and Adolescent Psychopathology · doi:10.1023/a:1022634807098 · Cited by 106 · see citing works
Self-citationReinforcement and coercion mechanisms in the development of antisocial behavior: The family.
Snyder, J. J., & Stoolmiller, M. (2002) · American Psychological Association eBooks · doi:10.1037/10468-004 · Cited by 102 · see citing works
Self-citationAdvances in Statistical Methods for Substance Abuse Prevention Research
MacKinnon, D. P., & Lockwood, C. M. (2003) · Prevention Science · doi:10.1023/a:1024649822872 · Cited by 94 · see citing works
Some problems and solutions in the study of change: Significant patterns in client resistance.
Stoolmiller, M., Duncan, T. E., Bank, L., et al. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.6.920 · Cited by 84 · see citing works
Self-citationTo increase power in randomized clinical trials without increasing sample size.
Hc, K. (1991) · PubMed · Cited by 57 · see citing works
Hierarchical modeling of sequential behavioral data: An empirical Bayesian approach.
Dagne, G. A., Howe, G. W., Brown, C. H., & Muthén, B. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.262 · Cited by 43 · see citing works
Self-citationCarroll, K. M., Rounsaville, B. J., & Nich, C. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.62.2.276 · Cited by 43 · see citing works
Statistical methods for preventive trials in mental health
Brown, C. H. (1993) · Statistics in Medicine · doi:10.1002/sim.4780120312 · Cited by 41 · see citing works
Life skills training. : promoting health and personal development
Botvin, G. J. (2000) · Medical Entomology and Zoology · Cited by 40 · see citing works
Measurement in longitudinal research.
Collins, L. M. (1991) · American Psychological Association eBooks · doi:10.1037/10099-009 · Cited by 35 · see citing works
Correcting methodological weaknesses in the knowledge base used to derive practice standards.
Follette, W. C. (1995) · Cited by 34 · see citing works
Methods for the analysis of parallel streams of continuously recorded social behaviors.
Gardner, W. P., & Griffin, W. A. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.3.446 · Cited by 32 · see citing works
Carroll, K. M., Rounsaville, B. J., & Nich, C. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.2.276 · Cited by 29 · see citing works
Schrepferman, L., & Snyder, J. J. (2002) · Behavior Therapy · doi:10.1016/s0005-7894(02)80032-6 · Cited by 28 · see citing works
Self-citationA BRIEF REPORT ON INVALIDITY OF PARENT EVALUATIONS OF BEHAVIOR CHANGE
Schnelle, J. F. (1974) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1974.7-341 · Cited by 27 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Frey, K. S., Hirschstein, M. K., Edstrom, L. V. S., & Snell, J. L. (2009) · Journal of Educational Psychology · doi:10.1037/a0013839 · Cited by 188 · see citing works
Brown, C. H., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P., Poduska, J., Ialongo, N., Wyman, P. A., Chamberlain, P., et al. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2007.11.013 · Cited by 177 · see citing works
Forehand, R., Lafko, N., Parent, J., & Burt, K. B. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.10.001 · Cited by 164 · see citing works
Dishion, T. J., Forgatch, M. S., Chamberlain, P., & Pelham, W. E. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.02.002 · Cited by 139 · see citing works
Does a Brief Suicide Prevention Gatekeeper Training Program Enhance Observed Skills?
Cross, W. F., Matthieu, M. M., Lezine, D. A., & Knox, K. L. (2010) · Crisis · doi:10.1027/0227-5910/a000014 · Cited by 139 · see citing works
Self-citationFoster Youth and the Transition to Adulthood
Greeson, J. K. P. (2013) · Emerging Adulthood · doi:10.1177/2167696812467780 · Cited by 119 · see citing works
Gewirtz, A. H., DeGarmo, D. S., & Zamir, O. (2018) · Prevention Science · doi:10.1007/s11121-017-0839-4 · Cited by 97 · see citing works
Examining implementer fidelity: conceptualising and measuring adherence and competence
Cross, W., & West, J. (2011) · Journal of Children's Services · doi:10.5042/jcs.2011.0123 · Cited by 93 · see citing works
Self-citationWolfe, D. A., Crooks, C. V., Chiodo, D., Hughes, R., & Ellis, W. E. (2011) · Prevention Science · doi:10.1007/s11121-011-0256-z · Cited by 95 · see citing works
Cluster randomized trials with treatment noncompliance.
Jo, B., Asparouhov, T., Muthén, B. O., Ialongo, N. S., & Brown, C. H. (2008) · Psychological Methods · doi:10.1037/1082-989x.13.1.1 · Cited by 83 · see citing works
Doabler, C. T., Baker, S. K., Kosty, D. B., Smolkowski, K., Clarke, B., Miller, S. J., & Fien, H. (2015) · The Elementary School Journal · doi:10.1086/679969 · Cited by 77 · see citing works
Low, S. K., Frey, K. S., & Brockman, C. J. (2010) · School Psychology Review · doi:10.1080/02796015.2010.12087740 · Cited by 66 · see citing works
Observations of the middle school environment: The context for student behavior beyond the classroom
Rusby, J. C., Crowley, R. N., Sprague, J. R., & Biglan, A. (2011) · Psychology in the Schools · doi:10.1002/pits.20562 · Cited by 60 · see citing works
Barnett, M. L., Niec, L. N., & Acevedo-Polakovich, I. D. (2013) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-013-9396-8 · Cited by 58 · see citing works
Mashburn, A. J., Downer, J. T., Rivers, S. E., Brackett, M. A., & Martínez, A. (2013) · Prevention Science · doi:10.1007/s11121-012-0357-3 · Cited by 54 · see citing works
Translational research in South Africa: evaluating implementation quality using a factorial design
Caldwell, L. L., Smith, E. A., Collins, L. M., Graham, J. W., Lai, M., Wegner, L., Vergnani, T., Matthews, C., & Jacobs, J. (2012) · Child & Youth Care Forum · doi:10.1007/s10566-011-9164-4 · Cited by 50 · see citing works
Preventing behavior problems and health-risking behaviors in girls in foster care.
Chamberlain, P., Leve, L. D., & Smith, D. K. (2006) · International Journal of Behavioral Consultation and Therapy · doi:10.1037/h0101004 · Cited by 35 · see citing works
Cross, W. F., West, J., Wyman, P. A., Schmeelk‐Cone, K., Xia, Y., Tu, X. M., Teisl, M., Brown, C. H., & Forgatch, M. S. (2014) · Prevention Science · doi:10.1007/s11121-014-0488-9 · Cited by 34 · see citing works
Self-citationKim, J. J., Brookman-Frazee, L. I., Barnett, M. L., Tran, M., Kuckertz, M., Yu, S. H., & Lau, A. S. (2020) · Journal of Community Psychology · doi:10.1002/jcop.22333 · Cited by 30 · see citing works
Advances in Prevention Science: A Developmental Psychopathology Perspective
Toth, S. L., Petrenko, C. L. M., Gravener, J. A., & Handley, E. D. (2016) · Wiley eBooks · doi:10.1002/9781119125556.devpsy416 · Cited by 30 · see citing works
Stadnick, N. A., Haine‐Schlagel, R., & Martinez, J. I. (2016) · Child & Youth Care Forum · doi:10.1007/s10566-016-9356-z · Cited by 30 · see citing works
Aging Out of Foster Care in Emerging Adulthood
Greeson, J. K. P., & Thompson, A. E. (2014) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199795574.013.18 · Cited by 26 · see citing works
Doabler, C. T., Clarke, B., Kosty, D. B., Turtura, J., Sutherland, M., Maddox, S. A., & Smolkowski, K. (2020) · Journal of Learning Disabilities · doi:10.1177/0022219420911375 · Cited by 25 · see citing works
Resurrecting the chimera: Progressions in parenting and peer processes
Forgatch, M. S., Snyder, J. J., Patterson, G. R., Pauldine, M. R., Chaw, Y., Elish, K., Harris, J. B., & Richardson, E. B. (2016) · Development and Psychopathology · doi:10.1017/s0954579416000250 · Cited by 20 · see citing works
Self-citationPredicting Dissemination of a Disaster Mental Health “Train-the-Trainer” Program
Cross, W. F., Cerulli, C., Richards, H., He, H., & Herrmann, J. (2010) · Disaster Medicine and Public Health Preparedness · doi:10.1001/dmp.2010.6 · Cited by 19 · see citing works
Self-citationReed, A., Snyder, J. J., Staats, S., Forgatch, M. S., DeGarmo, D. S., Patterson, G. R., Low, S. K., Sinclair, R. T., & Schmidt, N. (2013) · Journal of Family Psychology · doi:10.1037/a0032887 · Cited by 18 · see citing works
Self-citationMicroanalytic coding versus global rating of maternal parenting behaviour
Morawska, A., Basha, A., Adamson, M., & Winter, L. (2014) · Early Child Development and Care · doi:10.1080/03004430.2014.932279 · Cited by 18 · see citing works
Zhang, J., Palmer, A. R., Zhang, N., & Gewirtz, A. H. (2020) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-020-00625-8 · Cited by 18 · see citing works
Dagne, G. A., Brown, C. H., & Howe, G. W. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.3.298 · Cited by 18 · see citing works
Self-citationReliability of observers' subjective impressions of families: A generalizability theory approach
Storå, B., Hagtvet, K. A., & Heyerdahl, S. (2012) · Psychotherapy Research · doi:10.1080/10503307.2012.733830 · Cited by 16 · see citing works
A Research and Intervention Agenda for Children with Incarcerated Parents and Their Families
Poehlmann, J., & Eddy, J. M. (2019) · Springer eBooks · doi:10.1007/978-3-030-16707-3_24 · Cited by 15 · see citing works
Mason, W. A., Fleming, C. B., Ringle, J. L., Thompson, R. W., Haggerty, K. P., & Snyder, J. J. (2014) · Journal of Child and Family Studies · doi:10.1007/s10826-014-0059-5 · Cited by 14 · see citing works
Self-citationOats, R. G., Cross, W. F., Mason, W. A., Casey-Goldstein, M., Thompson, R. W., Hanson, K. G., & Haggerty, K. P. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.02.002 · Cited by 13 · see citing works
Self-citationEmulating real-life situations with a play task to observe parenting skills and child behaviors.
Rusby, J. C., Metzler, C. W., Sanders, M. R., & Crowley, R. N. (2015) · Journal of Family Psychology · doi:10.1037/fam0000056 · Cited by 9 · see citing works
Doabler, C. T., Nelson, N. J., Kennedy, P. C., Stoolmiller, M., Fien, H., Clarke, B., Gearin, B., Smolkowski, K., & Baker, S. (2018) · Learning Disability Quarterly · doi:10.1177/0731948718756040 · Cited by 10 · see citing works
Self-citationLee, S., Gewirtz, A. H., & Piehler, T. F. (2024) · Prevention Science · doi:10.1007/s11121-024-01721-7 · Cited by 5 · see citing works
Poulin, F., Capuano, F., Vitaro, F., Verlaan, P., Brodeur, M., Giroux, J., & Gagnon, C. (2023) · Revue de psychoéducation · doi:10.7202/1096851ar · Cited by 3 · see citing works
Johnson, E. S., Reddy, L. A., & Jones, N. D. (2020) · Journal of Learning Disabilities · doi:10.1177/0022219420944795 · Cited by 3 · see citing works
Spear, C. F. (2015) · Scholars' Bank (University of Oregon) · Cited by 3 · see citing works
Akin, B. A., Rodríguez, M. M. D., Yan, Y., DeGarmo, D. S., McDonald, T. P., & Forgatch, M. S. (2016) · Journal of Child and Family Studies · doi:10.1007/s10826-016-0556-9 · Cited by 2 · see citing works
Poulin, F., Moisan, A., & Cantin, S. (2014) · Mesure et évaluation en éducation · doi:10.7202/1024861ar · Cited by 2 · see citing works
Doabler, C. T., Nelson, N. J., Kosty, D. B., Baker, S., Smolkowski, K., & Fien, H. (2013) · Society for Research on Educational Effectiveness · Cited by 1 · see citing works
Morawska, A., Adamson, M., & Especkerman, J. F. (2015) · Behaviour Change · doi:10.1017/bec.2015.9 · Cited by 1 · see citing works
Doabler, C. T., Smolkowski, K., Fien, H., Kosty, D. B., & Cary, M. S. (2010) · Society for Research on Educational Effectiveness
Early Patterns of Change in Parent-Child Interaction Therapy
Legato, L. J. (2015) · Digital Commons-DePaul (DePaul University)
Storå, B., Hagtvet, K. A., & Heyerdahl, S. (2013) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12086
High School Boys' Experiences of a Violence Against Women Prevention Program
Henshaw, M. W. (2016) · Scholarship@Western (Western University)
Forehand, R., Breslend, N. L., Parent, J. M., & Burt, K. B. (2015) · Gezinstherapie Wereldwijd · doi:10.1007/s12440-015-0010-0
Li, N., Peng, J., Sun, X., & Guo, S. (2025) · International perspectives on social policy, administration, and practice · doi:10.1007/978-3-032-00395-9_8
Brafford, T. L., Doabler, C. T., Gersib, J. A., Lussier, C., Clarke, B., Turtura, J. E., Sutton, B. N., & Kosty, D. B. (2026) · Learning Disabilities Research and Practice · doi:10.1177/09388982261448180
- Authors
- Snyder, J., Reid, J., Stoolmiller, M., Howe, G., Brown, H., Dagne, G., & Cross, W.
- Affiliations
- Wichita State University (US)
- Oregon Social Learning Center (US)
- George Washington University (US)
- University of South Florida (US)
- University of Rochester Medicine (US)
- Corresponding author
- Snyder, James
- Venue
- Prevention Science
- Published
- 2006-03
- Volume
- 7
- Issue
- 1
- Pages
- 43-56
- ISSN
- 1389-4986 (ISSN-L)
- 1573-6695
- OpenAlex
- W2053152804
- Cited by
- 50
- References
- 34
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2023: 1 · 2020: 4 · 2019: 1 · 2018: 1 · 2017: 1 · 2016: 6 · 2015: 6 · 2014: 7 · 2013: 6 · 2012: 2
- FWCI
- 3.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Prevention Science (publishedVersion)
- PubMed (publishedVersion)
- Holmes Museum Of Anthropology (Wichita State University) (submittedVersion)
- Funders
- National Institutes of Health (5r01mh059855-05)
- National Institute of Mental Health (3P30-MH46690-13S1, R01 MH57342, R01MH40859, MH59855, T32 MH-18911, T32MH018911, R01MH040859, P30MH046690, R01MH057342)
- National Institute on Drug Abuse (R01DA015409)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Keywords
- behavioral observation, prevention trials, randomized controlled trials, intervention fidelity, interventionist training, risk mitigation, blinding, psychosocial interventions, measurement systems
- MeSH terms
- Child, Child Behavior, Humans, Models, Theoretical, Parents, Research Design, Randomized Controlled Trials as Topic, Observation, Conduct Disorder, Risk Reduction Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
