CoChat

Using Focus Groups and Rasch Item Response Theory to Improve Instrument Development

Mallinckrodt, Brent, Miles, Joseph R., Recabarren, Daniela A. · 2016 · The Counseling Psychologist
Cited by 31

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

Item response theory (IRT) is not widely used in counseling psychology research, despite its considerable advantages for instrument development. Focus groups help create a broad and representative item pool that is more likely to tap the full range of the latent dimension, thereby capitalizing on IRT strengths. We provide suggestions for using these tools, with an empirical example, the Everyday Multicultural Competencies/Revised Scale of Ethnocultural Empathy (EMC/RSEE). Rasch IRT methods were used to (a) analyze response format performance and collapse poorly performing categories, (b) evaluate differential item functioning sex bias, and (c) select items to maximize subscale sensitivity and bandwidth. Traditional classical test theory (CTT) subscales composed of items with the highest factor loadings were compared with subscales based on IRT criteria. Compared with CTT subscales, IRT subscales used in the EMC/RSEE demonstrated generally higher correlations with other variables of interest, and superior sensitivity to change over time and to group differences.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/0011000015596437

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 58

  1. Andrich D., 2002, Journal of Applied Measurement, 3, 325
  2. Bandalos D. J., 2001, New developments and techniques in structural equation modeling, 269
  3. 10.3758/s13428-011-0130-8 · DOI
  4. Bond T. G., 2007, Applying the Rasch model: Fundamental measurement in the human sciences
  5. 10.1037/a0023350 · DOI · Paper page
  6. Carey M. A., 2012, Focus group research
  7. 10.1177/1558689810382916 · DOI · Paper page
  8. 10.1080/00049537408255223 · DOI · Paper page
  9. 10.1037/h0040957 · DOI · Paper page
  10. 10.1177/1548051808318000 · DOI
  11. de Ayala R. J., 2009, The theory and practice of item response theory
  12. 10.1037/a0020940 · DOI
  13. DeVellis R. F., 2003, Scale development: Theory and applications
  14. 10.1080/10503300902894422 · DOI
  15. Embretson S. E., 2000, Item response theory for psychologists
  16. 10.1037/1082-989X.4.3.272 · DOI · Paper page
  17. Flick W., 1998, An introduction to qualitative research
  18. 10.1037/1040-3590.7.3.286 · DOI · Paper page
  19. 10.1177/014662168100500203 · doi:10.1177/014662168100500203
  20. 10.1037/0022-0167.45.1.30 · doi:10.1037/0022-0167.45.1.30 · Paper page
  21. 10.1080/07481756.2000.12069007 · DOI · Paper page
  22. 10.1037/0022-006X.56.4.483 · DOI
  23. Gorsuch R. L., 1983, Factor analysis
  24. Greenson R. R., 1967, Technique and practice of psychoanalysis
  25. Hambleton R. K., 2010, Item response theory: Principles and applications
  26. 10.1037/0022-0167.52.2.224 · DOI · Paper page
  27. 10.1177/0011000099273004 · DOI · Paper page
  28. Horvath A. O., 1986, The psychotherapeutic process: A research handbook, 529
  29. 10.1037/0022-0167.36.2.223 · doi:10.1037/0022-0167.36.2.223 · Paper page
  30. 10.1037/13754-003 · doi:10.1037/13754-003
  31. 10.1016/j.ijintrel.2005.01.012 · DOI
  32. 10.1007/s11136-012-0122-x · DOI · Paper page
  33. Kline R. B., 2011, Principles and practice of structural equation modeling
  34. Krueger R. A., 2009, Focus groups: A practical guide for applied research
  35. 10.1007/s11336-010-9199-8 · DOI
  36. Linacre J. M., 1998, Journal of Outcome Measurement, 2, 266
  37. Linacre J. M., 1999, Journal of Outcome Measurement, 3, 103
  38. Linacre J. M., 2004, Rasch Measurement Transactions, 18, 959
  39. 10.1037/0022-0167.49.3.355 · doi:10.1037/0022-0167.49.3.355 · Paper page
  40. 10.1027/1614-2241.4.2.73 · DOI · Paper page
  41. 10.1037/a0026549 · DOI
  42. 10.1037/a0035214 · DOI
  43. Mallinckrodt B., Psychotherapy Research
  44. 10.1037/a0029855 · DOI · Paper page
  45. 10.1177/0265532211430367 · DOI
  46. 10.4135/9781412993913 · DOI · Paper page
  47. 10.1080/01411920903018182 · DOI
  48. 10.2307/2943979 · doi:10.2307/2943979
  49. 10.1016/B978-0-12-590241-0.50006-X · DOI · Paper page
  50. 10.1037/0033-3204.38.4.443 · DOI · Paper page
  51. 10.1037/1082-989X.8.2.164 · DOI · Paper page
  52. Revelle W. (2013). The “new psychometrics”—Item response theory. In Revelle W. (Ed.), The personality project (pp. 235-238). Retrieved from http://www.personality-project.org/r/book/Chapter8.pdf
  53. 10.1037/1082-989X.1.1.81 · DOI
  54. 10.1007/BF02293705 · DOI · Paper page
  55. 10.1177/014662168601000104 · doi:10.1177/014662168601000104
  56. 10.1037/0022-0167.45.1.46 · DOI
  57. 10.1177/0013164414528209 · DOI · Paper page
  58. 10.1111/j.1745-3992.1997.tb00606.x · DOI · Paper page

Cited by

See all 31

Metadata

Authors
Mallinckrodt, B., Miles, J. R., & Recabarren, D. A.
Affiliations
University of Tennessee, Knoxville, TN, USA
Venue
The Counseling Psychologist
Published
2015-08-05
Volume
44
Issue
2
Pages
146-194
ISSN
  • 0011-0000
  • 1552-3861
Cited by
31
References
10
Language
en
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Using Focus Groups and Rasch Item Response Theory to Improve Instrument Development. https://app.cochat.ai/papers/10.1177/0011000015596437
The paper
Mallinckrodt, B., Miles, J. R., & Recabarren, D. A. (2016). Using Focus Groups and Rasch Item Response Theory to Improve Instrument Development. The Counseling Psychologist. https://doi.org/10.1177/0011000015596437

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.