Understanding Barriers to Evidence-Based Assessment: Clinician Attitudes Toward Standardized Assessment Tools
Open accessAbstract
In an era of evidence-based practice, why are clinicians not typically engaged in evidence-based assessment? To begin to understand this issue, a national multidisciplinary survey was conducted to examine clinician attitudes toward standardized assessment tools. There were 1,442 child clinicians who provided opinions about the psychometric qualities of these tools, their benefit over clinical judgment alone, and their practicality. Doctoral-level clinicians and psychologists expressed more positive ratings in all three domains than master's-level clinicians and nonpsychologists, respectively, although only the disciplinary differences remained significant when predictors were examined simultaneously. All three attitude scales were predictive of standardized assessment tool use, although practical concerns were the strongest and only independent predictor of use.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is some evidence that links clinical orientation to attitudes toward use of standardized assessment (Jensen-Doss & Hawley, 2010).
“there is some evidence that links clinical orientation to attitudes toward use of standardized assessment (Jensen-Doss & Hawley, 2010).”
From Visualizing Uncertainty to Promote Clinicians’ Understanding of Measurement Error (2023) · cites this paper as Jensen-Doss & Hawley, 2010
The Results and Discussion (page unavailable) link professional discipline to attitudes toward standardized assessment tools. The paper also reports that theoretical orientation was named as an influence on assessment practices, but it does not establish a link between clinical orientation and attitudes specifically. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587 · see citing works
Efficacy of the Theory of Planned Behaviour: A meta‐analytic review
Armitage, C. J., & Conner, M. (2001) · British Journal of Social Psychology · doi:10.1348/014466601164939 · Cited by 9,970 · see citing works
A test of missing completely at random for multivariate data with missing values
Little, R. J. A. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478722 · Cited by 8,963 · see citing works
The Theory of Planned Behavior: A Review of its Applications to Health-Related Behaviors
Godin, G., & Kok, G. (1996) · American Journal of Health Promotion · doi:10.4278/0890-1171-11.2.87 · Cited by 3,185 · see citing works
A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals
Addis, M. E., & Krasnow, A. D. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.2.331 · Cited by 509 · see citing works
The Use of Outcome Measures by Psychologists in Clinical Practice.
Hatfield, D. R., & Ogles, B. M. (2004) · Professional Psychology: Research and Practice · doi:10.1037/0735-7028.35.5.485 · Cited by 305 · see citing works
Flagged first, then by citations
Research works printed but not linked: 29
- Aarons GA Woodbridge M Carmazzi A 2003 Examining leadership, organizational climate and service quality in a children’s system of care Paper presented at the 15th Annual Research Conference A System of Care for Children’s Mental Health: Expanding the Research Base Tampa, FL
- Anderson DA Paulosky CA 2004 A survey of the use of assessment instruments by eating disorder professionals in clinical practice Eating and Weight Disorders 9 3 238 241 15656022
- Angold A Fisher PW Shaffer D Lucas CP Richters JE 1999 Interviewer-based interviews Diagnostic assessment in child and adolescent psychopathology 34 64 New York, NY Guilford Press
- APA Presidential Task Force on Evidence-Based Practice 2006 Evidence-based practice in psychology American Psychologist 61 4 271 285 16719673
- Basco MR Bostic JQ Davies D Rush AJ Witte B Hendrickse W 2000 Methods to improve diagnostic accuracy in a community mental health setting American Journal of Psychiatry 157 10 1599 1605 11007713
- Dillman DA 2000 Mail and Internet Surveys: The Tailored Design Method 2 New York John Wiley & Sons
- Frauenhoffer D Ross MJ Gfeller J Searight HR Piotrowski C 1998 Psychological test usage among licensed mental health practitioners: A multidisciplinary survey Journal of Psychological Practice 4 1 28 33
- Garb HN 2005 Clinical judgment And decision making Annual Review of Clinical Psychology 1 1 67 89 17716082
- Garland AF Aarons GA Hawley KM Hough RL 2003 Relationship of Youth Satisfaction With Mental Health Services and Changes in Symptoms and Functioning Psychiatric Services 54 11 1544 1546 14600318
- Garland AF Kruse M Aarons GA 2003 Clinicians and outcome measurement: What’s the use? The Journal of Behavioral Health Services & Research 30 4 393 405 14593663
- Gilbody SM House AO Sheldon TA 2002 Psychiatrists in the UK do not use outcomes measures: National survey British Journal of Psychiatry 180 2 101 103 11823316
- Goodman R Ford T Simmons H Gatward R Meltzer H 2000 Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample British Journal of Psychiatry 177 534 539 11102329
- Handler MW DuPaul GJ 2005 Assessment of ADHD: Differences across psychology specialty areas Journal of Attention Disorders 9 2 402 412 16371663
- Hannan C Lambert MJ Harmon C Nielsen SL Smart DW Shimokawa K 2005 A lab test and algorithms for identifying cases at risk for treatment failure Journal of Clinical Psychology 61 155 163 15609357
- Hatfield DR Ogles BM 2007 Why some clinicians use outcome measures and others do not Administration and Policy in Mental Health and Mental Health Services Research 34 3 283 291 17211715
- Hawley KM Cook JR Jensen-Doss A 2009 Do noncontingent incentives increase survey response rates among mental health providers? A randomized trial comparison Administration and Policy in Mental Health 36 5 343 348 19421851 PMC2715443
- Hunsley J Mash EJ 2007 Evidence-based assessment Annual Review of Clinical Psychology 3 29 51 17716047
- Jensen-Doss A Weisz JR 2008 Diagnostic agreement predicts treatment process and outcomes in youth mental health clinics Journal of Consulting and Clinical Psychology 76 5 711 722 18837589
- Jensen AL Weisz JR 2002 Assessing match and mismatch between practitioner-generated and standardized interview-generated diagnoses for clinic-referred children and adolescents Journal of Consulting and Clinical Psychology 70 1 158 168 11860042
- Jensen Doss A 2005 Evidence-based diagnosis: Incorporating diagnostic instruments into clinical practice Journal of the American Academy of Child & Adolescent Psychiatry 44 9 947 952 16113624
- Jewell J Handwerk M Almquist J Lucas C 2004 Comparing the validity of clinician-generated diagnosis of conduct disorder to the Diagnostic Interview Schedule for Children Journal of Clinical Child and Adolescent Psychology 33 3 536 546 15271611
- Kahana SY Youngstrom EA Findling RL Calabrese JR 2003 Employing Parent, Teacher, and Youth Self-Report Checklists in Identifying Pediatric Bipolar Spectrum Disorders: An Examination of Diagnostic Accuracy and Clinical Utility Journal Of Child And Adolescent Psychopharmacology 13 4 471 488 14977460
- Mash EJ Hunsley J 2005 Evidence-Based Assessment of Child and Adolescent Disorders: Issues and Challenges Journal of Clinical Child and Adolescent Psychology 34 3 362 379 16026210
- Palmiter DJ Jr 2004 A Survey of the Assessment Practices of Child and Adolescent Clinicians American Journal of Orthopsychiatry 74 2 122 128 15113241
- Pogge DL Wayland-Smith D Zaccario M Borgaro S Stokes J Harvey PD 2001 Diagnosis of manic episodes in adolescent inpatients: Structured diagnostic procedures compared to clinical chart diagnoses Psychiatry Research 101 1 47 54 11223119
- Rettew DC Lynch AD Achenbach TM Dumenci L Ivanova MY 2009 Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews International Journal of Methods in Psychiatric Research 18 3 169 184 19701924 PMC6878243
- Schacht RL Dimidjian S George WH Berns SB 2009 Domestic violence assessment procedures among couple therapists Journal of Marital & Family Therapy 35 1 47 59 19161583
- Tenney NH Schotte CKW Denys DAJP van Megen HJGM Westenberg HGM 2003 Assessment of DSM-IV personality disorders in obsessive-compulsive disorder: Comparison of clinical diagnosis, self-report questionnaire, and semi-structured interview Journal of Personality Disorders 17 6 550 561 14744080
- Warnick EM Weersing VR Scahill L Woolston JL 2009 Selecting measures for use in child mental health services: A scorecard approach Administration and Policy in Mental Health and Mental Health Services Research 36 2 112 122 19127425
Cited by
Sorted by citations
Using Measurement-Based Care to Enhance Any Treatment
Scott, K., & Lewis, C. C. (2015) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.01.010 · Cited by 461 · see citing works
Lewis, C. C., Fischer, S., Weiner, B. J., Stanick, C., Kim, M., & Martinez, R. G. (2015) · Implementation Science · doi:10.1186/s13012-015-0342-x · Cited by 430 · see citing works
Stanick, C. F., Halko, H. M., Dorsey, C. N., Weiner, B. J., Powell, B. J., Palinkas, L. A., & Lewis, C. C. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3709-2 · Cited by 54 · see citing works
LeBeau, R., Bögels, S., Möller, E., & Craske, M. (2015) · Psychopathology Review · doi:10.5127/pr.036414 · Cited by 23 · see citing works
Arora, P. G., Connors, E. H., George, M. W., Lyon, A. R., Wolk, C. B., & Weist, M. D. (2016) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-016-0217-y · Cited by 17 · see citing works
Lindhiem, O., Bennett, C. B., Beidas, R. S., Grasso, D. J., Sakolsky, D. J., & Druzdzel, M. J. (2018) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2017.07.002 · Cited by 5 · see citing works
Visualizing Uncertainty to Promote Clinicians’ Understanding of Measurement Error
Frans, N., Hummelen, B., Albers, C. J., & Paap, M. C. S. (2023) · Assessment · doi:10.1177/10731911221147042 · Cited by 5 · see citing works
“In addition, there is some evidence that links clinical orientation to attitudes toward use of standardized assessment (Jensen-Doss & Hawley, 2010).”
Background
- Authors
- Jensen-Doss, A., & Hawley, K. M.
- Affiliations
- University of Missouri (US)
- ORCID
- Hawley, Kristin M.
- Venue
- Journal of Clinical Child & Adolescent Psychology
- Publisher
- Informa UK Limited
- Published
- 2010-11-11
- Volume
- 39
- Issue
- 6
- Pages
- 885-896
- ISSN
- 1537-4416 (ISSN-L)
- 1537-4424
- PMC
- PMC3058768
- OpenAlex
- W2076985113
- Cited by
- 238
- References
- 6
- Citations by year
- 2026: 18 · 2025: 14 · 2024: 14 · 2023: 12 · 2022: 16 · 2021: 25 · 2020: 15 · 2019: 18 · 2018: 21 · 2017: 16 · 2016: 15 · 2015: 20 · 2014: 15 · 2013: 8 · 2012: 7
- FWCI
- 8.66
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Clinical Child & Adolescent Psychology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R03MH077752)
- Topics
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- evidence-based assessment, standardized assessment tools, clinician attitudes, barriers to assessment, psychometric properties, clinical judgment, disciplinary differences
- MeSH terms
- Adult, Attitude of Health Personnel, Mental Disorders, Female, Humans, Judgment, Male, Mental Health, Middle Aged, Physician's Role, Physicians, Psychometrics, Surveys and Questionnaires, Logistic Models, Practice Guidelines as Topic, Evidence-Based Medicine, Comprehension
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review