Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS).
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
The Evidence-Based Practice Attitude Scale (EBPAS) assesses mental health and social service provider attitudes toward adopting evidence-based practices. Scores on the EBPAS derive from 4 subscales (i.e., Appeal, Requirements, Openness, and Divergence) as well as the total scale, and preliminary studies have linked EBPAS scores to clinic structure and policies, organizational culture and climate, and first-level leadership. EBPAS scores are also related to service provider characteristics, including age, education level, and level of professional development. The present study examined the factor structure, reliability, and norms of EBPAS scores in a sample of 1,089 mental health service providers from a nationwide sample drawn from 100 service institutions in 26 states in the United States. The study also examined associations of provider demographic characteristics with EBPAS subscale and total scores. Confirmatory factor analysis supported a second-order factor model, and reliability coefficients for the subscales ranged from .91 to .67 (total scale = .74). The study establishes national norms for the EBPAS so that comparisons can be drawn for U.S. local as well as international studies of attitudes toward evidence-based practices. The results suggest that the factor structure and reliability are likely generalizable to a variety of service provider contexts and different service settings and that the EBPAS subscales are associated with provider characteristics. Directions for future research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Level of education, level of professional experience, primary discipline, and race/ethnicity are associated with openness toward adopting EBPs (Aarons 2004, 2005; Aarons et al. 2010).”
From Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors (2011) · cites this paper as Aarons et al. 2010
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Curran, P. J., West, S. G., & Finch, J. F. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.16 · Cited by 5,512
Estimating within-group interrater reliability with and without response bias
James, L. R., Demaree, R. G., & Wolf, G. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.1.85 · Cited by 4,774 · cited 2×
“On the basis of the results presented in Table 1 and in light of the rule of thumb that awg values less than .60 are indicative of low agreement (James et al., 1984, 1993), most EBPAS items and all subscales should be considered as representing clinician-level and not clinic-level constructs.”
BackgroundStructural Equation Modeling: Concepts, Issues, and Applications
Rigdon, E. E., & Hoyle, R. H. (1997) · Journal of Marketing Research · doi:10.2307/3151904 · Cited by 4,060
Using LISREL for Structural Equation Modeling: A Researcher′s Guide
Kelloway, E. K. (1998) · Cited by 2,789
Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic
Satorra, A., & Bentler, P. M. (2010) · Psychometrika · doi:10.1007/s11336-009-9135-y · Cited by 2,695
rwg: an assessment of within-group interrater agreement
James, L. R., Demaree, R. G., & Wolf, G. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.2.306 · Cited by 2,221 · cited 2×
“On the basis of the results presented in Table 1 and in light of the rule of thumb that awg values less than .60 are indicative of low agreement (James et al., 1984, 1993), most EBPAS items and all subscales should be considered as representing clinician-level and not clinic-level constructs.”
BackgroundThe Influence of Attitudes on Behavior
(2014) · The Handbook of Attitudes · doi:10.4324/9781410612823-13 · Cited by 1,917
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · cited 2×
“…there are education or training experiences that might account for these differences; however, further work is needed to develop effective approaches to training practitioners and researchers in implementation of EBPs across mental health and social service disciplines (Proctor et al., 2009).”
BackgroundSelf-citation(1995) · Cited by 1,801
Managing Clinical Knowledge for Health Care Improvement
Balas, E. A., & Boren, S. A. (2000) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1637943 · Cited by 1,479 · cited 1×
“However, the pace at which evidence-based health and mental health practices and technologies are implemented is painstakingly slow (Balas & Boren, 2000).”
BackgroundWhat drives change? Barriers to and incentives for achieving evidence‐based practice
Grol, R., & Wensing, M. (2004) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2004.tb05948.x · Cited by 1,378
Aarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · cited 20×
“For example, the original study consisted of a sample of service institutions and participants in one California county in which half the sample was used to conduct an exploratory factor analysis and the other half to conduct a CFA (mental health programs 49, N 322; Aarons, 2004).”
BackgroundMethodResultInfluentialSelf-citationFrambach, R. T., & Schillewaert, N. (2002) · Journal of Business Research · doi:10.1016/s0148-2963(00)00152-1 · Cited by 1,270 · cited 1×
“Second, if providers do decide to try a new practice, the affective, or emotional, component of attitudes can impact decision processes regarding the actual implementation and use of the innovation (Aarons, 2005; Candel & Pennings, 1999; Frambach & Schillewaert, 2002; Rogers, 1995).”
BackgroundBURNS, B. J., PHILLIPS, S. D., WAGNER, H. R., BARTH, R. P., KOLKO, D. J., CAMPBELL, Y., & LANDSVERK, J. (2004) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000127590.95585.65 · Cited by 1,153
Self-citationThe Influence of Attitudes on Behavior
Ajzen, I., Fishbein, M., Lohmann, S., & Albarracín, D. (2018) · Dialnet (Universidad de la Rioja) · doi:10.4324/9781315178103-5 · Cited by 1,047
(2014) · Psychology Press eBooks · doi:10.4324/9781410612823 · Cited by 644
Lau, A. S. (2006) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2006.00042.x · Cited by 624 · cited 1×
“Although some researchers have developed recommendations or approaches for adaptation of EBPs for particular cultural groups (Lau, 2006; McCabe, Yeh, Garland, Lau, & Chavez, 2005), such approaches are not widespread.”
BackgroundGlisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608
Self-citationUnderstanding implicit and explicit attitude change: A systems of reasoning analysis.
Rydell, R. J., & McConnell, A. R. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.91.6.995 · Cited by 593
Attitudes and the prediction of behavior.
Ajzen, I., & Cote, N. G. (2008) · Cited by 586
Aarons, G. A. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.8.1162 · Cited by 518
Self-citationAarons, G. A., & Sawitzky, A. C. (2006) · Psychological Services · doi:10.1037/1541-1559.3.1.61 · Cited by 482
Self-citationWhaley, A. L., & Davis, K. E. (2007) · American Psychologist · doi:10.1037/0003-066x.62.6.563 · Cited by 458 · cited 1×
“However, EBPs and cultural adaptation should ultimately be seen as complementary and accomplishable (Whaley & Davis, 2007).”
BackgroundImplementation of Evidence-based Practice in Child Welfare: Service Provider Perspectives
Aarons, G. A., & Palinkas, L. A. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0121-3 · Cited by 450 · cited 2×
“However, where local adaptation of EBPs is needed to meet the constraints of implementation context or the needs of particular clients or populations (Aarons & Palinkas, 2007), fidelity assessment may require reformulation.”
BackgroundSelf-citationGlisson, C., & Schoenwald, S. K. (2005) · Mental Health Services Research · doi:10.1007/s11020-005-7456-1 · Cited by 373 · cited 1×
“…characteristics of the organization attempting to implement the innovation; and characteristics of both the providers and clients (Aarons, 2004, 2005; Glisson & Schoenwald, 2005; Glisson, Schoenwald, et al., 2008; Greenhalgh, Robert, Macfarlane, Bate, & Kyriakidou, 2004; Grol & Wensing, 2004).”
BackgroundSelf-citationThe Organizational Context of Children's Mental Health Services
Glisson, C. (2002) · Clinical Child and Family Psychology Review · doi:10.1023/a:1020972906177 · Cited by 367
Self-citationInterrater Agreement Reconsidered: An Alternative to the rwg Indices
Brown, R. D., & Hauenstein, N. M. A. (2005) · Organizational Research Methods · doi:10.1177/1094428105275376 · Cited by 297
Aarons, G. A. (2005) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2004.04.008 · Cited by 296 · cited 5×
“In addition, it will be important to examine factors that might moderate the relationship between attitudes and behavior (Aarons, 2005; Ajzen & Cote, 2008; Ajzen & Fishbein, 2005; Jaccard & Blanton, 2005).”
BackgroundInfluentialSelf-citationAarons, G. A., Sommerfeld, D. H., & Walrath-Greene, C. M. (2009) · Implementation Science · doi:10.1186/1748-5908-4-83 · Cited by 276
Self-citationFamily‐based services in children's mental health: a research review and synthesis
Hoagwood, K. E. (2005) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2005.01451.x · Cited by 236
Self-citationGlisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0152-9 · Cited by 232
Self-citationMcCabe, K. M., Yeh, M., Garland, A. F., Lau, A. S., & Chavez, G. S. (2005) · University Libraries (University of Maryland) · doi:10.13016/eman-s23m · Cited by 187
Aarons, G. A., McDonald, E. J., Sheehan, A. K., & Walrath-Greene, C. M. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0127-x · Cited by 166
Self-citationNew Developments in Psychometrics
Yanai, H., Okada, A., Shigemasu, K., Kano, Y., & Meulman, J. J. (2003) · Springer eBooks · doi:10.1007/978-4-431-66996-8 · Cited by 114
Magnabosco, J. L. (2006) · Implementation Science · doi:10.1186/1748-5908-1-13 · Cited by 91
Principles of Multicultural Counseling and Therapy
Gielen, U. P., Dragūns, J. G., & Fish, J. M. (2008) · Routledge eBooks · doi:10.4324/9780203893302 · Cited by 89
Bruns, E. J., & Hoagwood, K. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31816485f4 · Cited by 78
Self-citationSchoenwald, S., Kelleher, K., Weisz, J., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0160-9 · Cited by 77
Self-citationBruns, E. J., Hoagwood, K., Rivard, J. C., Wotring, J., Marsenich, L., & CARTER, B. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181684557 · Cited by 72
Self-citationThe Origins and Structure of Behavior: Conceptualizing Behavior in Attitude Research
Jaccard, J. J., & Blanton, H. (2005) · Dialnet (Universidad de la Rioja) · doi:10.4324/9781410612823.ch4 · Cited by 72
Evaluating Outlier Identification Tests: Mahalanobis D Squared and Comrey Dk
Rasmussen, J. L. (1988) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2302_4 · Cited by 50
Cultural Competence, Evidence-Based Medicine, and Evidence-Based Practices
Whitley, R. (2007) · Psychiatric Services · doi:10.1176/ps.2007.58.12.1588 · Cited by 48
Attitude-based models for binary choices: A test for choices involving an innovation
Candel, M. J. J. M., & Pennings, J. M. E. (1999) · Journal of Economic Psychology · doi:10.1016/s0167-4870(99)00024-0 · Cited by 39
Use of SEM Programs to Precisely Measure Scale Reliability
Kano, Y., & Azuma, Y. (2003) · Springer eBooks · doi:10.1007/978-4-431-66996-8_14 · Cited by 32
Cashin, C., Scheffler, R., Felton, M., Adams, N., & Miller, L. (2008) · Psychiatric Services · doi:10.1176/appi.ps.59.10.1107 · Cited by 27
Performance of Fit Indices in Different Conditions and the Selection of Cut-off Values
Qing-Ke, G. U. O. (2008) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2008.00109 · Cited by 20
Persuasion from majority and minority groups
Martin, R., Hewstone, M., Martin, P. Y., & Gardikiotis, A. (2008) · Research Explorer (The University of Manchester) · doi:10.4324/9780203838068 · Cited by 10
Yanai, H., Okada, A., Shigemasu, K., et al. (2003) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 7
Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic
Satorra, A., & Bentler, P. M. (2008) · eScholarship (California Digital Library) · Cited by 5
Research works printed but not linked: 3
- Cochran WG Sampling techniques 1977 Wiley New York 3rd ed
- Glisson C Schoenwald SK Kelleher K Landsverk J Hoagwood KE Mayberg S Assessing the organizational and social context (OSC) of mental health services: Implications for research and practice Administration and Policy in Mental Health 2008 35 124 133 18085434
- Rogers EM Diffusions of Innovations 1995 The Free Press New York 4th ed
Cited by
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
“Level of education, level of professional experience, primary discipline, and race/ethnicity are associated with openness toward adopting EBPs (Aarons 2004, 2005; Aarons et al. 2010).”
BackgroundSelf-citationAarons, G. A., & Sommerfeld, D. H. (2012) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.01.018 · Cited by 318
Self-citationCabassa, L. J., & Baumann, A. A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-90 · Cited by 290
“Providers may perceive t hat some EBTs and their manuals or guidelines have a tendency to ‘overlook client’s family n eeds, culture, and strengths’ [51,52], affecting both provider and client engagement in the intervention.”
BackgroundThe Research Network on Youth Mental Health, Aarons, G. A., Glisson, C., Green, P. D., Hoagwood, K., Kelleher, K. J., & Landsverk, J. A. (2012) · Implementation Science · doi:10.1186/1748-5908-7-56 · Cited by 271
Self-citationWilliams, N. J., & Beidas, R. S. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12960 · Cited by 233
“Frequently used to measure EBP attitudes, the Evidence Based Practice Attitudes Scale, a 15-item self-report measure, assesses willingness to adopt an EBP based upon its appeal, requirements from external sources, general openness to innovation, and perceptions of divergence between EBP and current practices (Aarons e…”
BackgroundMethod
Metadata
- Authors
- Aarons, G. A., Research Network on Youth Mental Health, Glisson, C., Hoagwood, K., Kelleher, K., Landsverk, J., & Cafri, G.
- Affiliations
- University of California San Diego (US)
- University of Tennessee at Knoxville (US)
- New York State Office of Mental Health (US)
- The Ohio State University (US)
- Venue
- Psychological Assessment
- Published
- 2010
- Volume
- 22
- Issue
- 2
- Pages
- 356-365
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- PMC
- PMC3841109
- OpenAlex
- W2023816276
- Cited by
- 316
- References
- 53
- Citations by year
- 2026: 10 · 2025: 20 · 2024: 16 · 2023: 21 · 2022: 15 · 2021: 31 · 2020: 20 · 2019: 37 · 2018: 26 · 2017: 23 · 2016: 25 · 2015: 24 · 2014: 19 · 2013: 14 · 2012: 9
- FWCI
- 10.16
- Type
- journal article
- Language
- en
- Update notices
- correction (2010-09-06)
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychological Assessment (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- John D. and Catherine T. MacArthur Foundation
- National Institute of Mental Health (R01MH072961)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- evidence-based practice, attitudes toward evidence-based practice, mental health service providers, social service providers, psychometric properties, factor structure, reliability statistics, national standards, organizational culture
- MeSH terms
- Adult, Attitude of Health Personnel, Factor Analysis, Statistical, Female, Humans, Male, Mental Health Services, Middle Aged, Practice Patterns, Physicians', Psychometrics, Surveys and Questionnaires, United States, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.