The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Mixed Research as a Tool for Developing Quantitative Instruments
Abstract
In this methodological article, the authors present a meta-framework—comprising several frameworks and models, as well as multiple research approaches—that they call an Instrument Development and Construct Validation (IDCV) process for optimizing the development of quantitative instruments. Using mixed research techniques, the IDCV contains 10 phases that detail the progression from an interdisciplinary review of the literature to the development of the instrument to the evaluation of the instrument development and construct validation process and product(s). Crossover analyses represent a key mechanism in the IDCV, wherein analysis types from one tradition (e.g., quantitative analysis) are used to analyze data from a different tradition (e.g., qualitative data). Finally, the authors provide a heuristic example of a rigorous way to develop a Likert-format scale.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Discovery of Grounded Theory: Strategies for Qualitative Research.
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,361
Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(85)90062-8 · Cited by 45,787
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations across Nations
Bhagat, R. S., & Hofstede, G. (2002) · The Academy of Management Review · doi:10.2307/4134391 · Cited by 21,664
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Organizational culture and leadership
(1993) · Long Range Planning · doi:10.1016/0024-6301(93)90120-5 · Cited by 16,462
The Interpretation of Cultures
(2017) · Macat Library eBooks · doi:10.4324/9781912128310 · Cited by 16,449
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 2×
“Yet this research paradigm involves ‘‘mix[ing] or combin[ing] quantitative and qualitative research techniques, methods, approaches, concepts or language into a single study’’ (R. B. Johnson & Onwuegbuzie, 2004, p. 17).”
BackgroundMethodSelf-citationTHE STRUCTURE OF SCIENTIFIC REVOLUTIONS
MCGUIRE, J. E. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00813.x · Cited by 8,424
(2017) · The SAGE Encyclopedia of Communication Research Methods · doi:10.4135/9781483381411.n168 · Cited by 8,276
Toward a Theory of Culturally Relevant Pedagogy
Ladson-Billings, G. (1995) · American Educational Research Journal · doi:10.3102/00028312032003465 · Cited by 8,057
Toward a definition of mixed methods research
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689806298224 · Cited by 6,464
Self-citationToward a Conceptual Framework for Mixed-Method Evaluation Designs
Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737011003255 · Cited by 5,687
Mixed Methodology: Combining Qualitative and Quantitative Approaches
Cotten, S. R., Tashakkori, A., & Teddlie, C. (1999) · Contemporary Sociology · doi:10.2307/2655606 · Cited by 5,204
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
Culture, leadership, and organizations: the GLOBE study of 62 societies
(2005) · Choice Reviews Online · doi:10.5860/choice.42-4132 · Cited by 5,058
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
Pundt, A. (2006) · Zeitschrift für Arbeits- und Organisationspsychologie A&O · doi:10.1026/0932-4089.50.3.167 · Cited by 3,745
Administrative Science Quarterly
Miewald, R. (1981) · The American Review of Public Administration · doi:10.1177/027507408101500109 · Cited by 3,638
Multicultural Education: Issues and Perspectives
Banks, J. A., & Banks, C. A. M. (1989) · Cited by 3,538
But that's just good teaching! The case for culturally relevant pedagogy
Ladson‐Billings, G. (1995) · Theory Into Practice · doi:10.1080/00405849509543675 · Cited by 3,482
Exploratory and confirmatory factor analysis: Understanding concepts and applications.
Thompson, B. (2004) · doi:10.1037/10694-000 · Cited by 3,469
Variations in Value Orientations.
Rosenberg, M., Kluckhohn, F. R., Strodtbeck, F. L., Roberts, J. M., Romney, A. K., Kluckhohn, C., & Scarr, H. A. (1961) · American Sociological Review · doi:10.2307/2090580 · Cited by 2,816
The Systematic Design of Instruction
Chang, S. L. (2006) · Educational Technology Research and Development · doi:10.1007/s11423-006-9606-0 · Cited by 2,588
Professional School Counseling
Thompson, R., & Thompson, D. R. (2012) · Routledge eBooks · doi:10.4324/9780203881644 · Cited by 2,531
Henson, R. K., & Roberts, J. K. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164405282485 · Cited by 2,454
Educational Leadership: A Field of Inquiry and Practice
Hart, A. W. (1999) · Educational Management & Administration · doi:10.1177/0263211x990273008 · Cited by 2,359
The systematic design of instruction
Dick, W., Carey, L. M., & Carey, J. O. (1978) · Cited by 2,225
The Scientific Use of Factor Analysis in Behavioral and Life Sciences
Cattell, R. B. (1978) · doi:10.1007/978-1-4684-2262-7 · Cited by 2,165
Fina, A. D. (2019) · The Routledge Handbook of Linguistic Ethnography · doi:10.4324/9781315675824-12 · Cited by 2,119
(2015) · Cross-Cultural Explorations · doi:10.4324/9781315664446-7 · Cited by 2,005
CULTURES CONSEQUENCES: INTERNATIONAL DIFFERENCES IN WORK RELATED VALUES
Hofestede, G. (1980) · Cited by 1,983
Minimum Sample Size Recommendations for Conducting Factor Analyses
Mundfrom, D. J., Shaw, D. G., & Ke, T. L. (2005) · International Journal of Testing · doi:10.1207/s15327574ijt0502_4 · Cited by 1,704
Morgan, D. (1998) · Sage eBooks · doi:10.4135/9781483328164 · Cited by 1,691
A Typology of Mixed Methods Sampling Designs in Social Science Research
Onwuegbuzie, A., & Collins, K. (2015) · The Qualitative Report · doi:10.46743/2160-3715/2007.1638 · Cited by 1,565
Self-citationAn array of qualitative data analysis tools: A call for data analysis triangulation.
Leech, N. L., & Onwuegbuzie, A. J. (2007) · School Psychology Quarterly · doi:10.1037/1045-3830.22.4.557 · Cited by 1,525
Self-citationVariations in Value Orientations
Opler, M. E., Kluckhohn, F. R., & Strodtbeck, F. L. (1961) · Ethnohistory · doi:10.2307/480364 · Cited by 1,508
Uses of factor analysis in counseling psychology research.
Tinsley, H. E. A., & Tinsley, D. J. (1987) · Journal of Counseling Psychology · doi:10.1037//0022-0167.34.4.414 · Cited by 1,324
Boote, D. N., & Beile, P. (2005) · Educational Researcher · doi:10.3102/0013189x034006003 · Cited by 1,212
The effects of diversity on business performance: Report of the diversity research network
Kochan, T., Bezrukova, K., Ely, R., Jackson, S., Joshi, A., Jehn, K., Leonard, J., Levine, D., & Thomas, D. (2003) · Human Resource Management · doi:10.1002/hrm.10061 · Cited by 1,152
An Introduction to Multicultural Education
Banks, J. A. (1993) · Cited by 1,028
The Fact of Fiction in Organizational Ethnography
Van John, M. (2017) · The Anthropology of Organisations · doi:10.4324/9781315241371-24 · Cited by 978
Introduction: multicultural education 2.0
Mahiri, J. (2017) · Multicultural Education Review · doi:10.1080/2005615x.2017.1346555 · Cited by 881
Riding the waves of culture : understanding cultural diversity in global business
Trompenaars, A., & Hampden‐Turner, C. (1998) · McGraw-Hill eBooks · Cited by 802
Multidimensional Facets of Cultural Competence
Sue, D. W. (2001) · The Counseling Psychologist · doi:10.1177/0011000001296002 · Cited by 795 · cited 1×
“…settings (House, Hanges, Javidan, Dorfman, & Gupta, 2004; Kochan et al., 2003), and cultural competence as defined in human service organizations (Cross, Bazron, Dennis, & Isaacs, 1989; Darnell & Kuperminc, 2006; National Center for Cultural Competence, 2005; Sue, 2001; Sue & Constantine, 2005).”
EDUCATIONAL ADMINISTRATION QUARTERLY
Barnett, B. G., Blase, J. J., Bogotch, I. E., Cambron-McCabe, N. H., Capper, C. A., Cibulka, J. G., Conley, D. T., Cooper, B. S., Cuban, L., Derlin, R. L., et al. (2001) · Cited by 779
Collins, K. M. T., Onwuegbuzie, A. J., & Sutton, I. L. (2006) · Learning disabilities · Cited by 772
Self-citationMultivariate Analysis: The Need for Data, and other Problems
Everitt, B. S. (1975) · British Journal of Psychiatry · doi:10.1192/bjp.126.3.237 · Cited by 772
Intercultural Competence: Interpersonal Communication Across Cultures
Lustig, M. W., & Koester, J. (1995) · Cited by 746
Intercultural communication competence
Wiseman, R. L., & Koester, J. (1993) · Cited by 737
Communities of Practice: A Research Paradigm for the Mixed Methods Approach
Denscombe, M. (2008) · Journal of Mixed Methods Research · doi:10.1177/1558689808316807 · Cited by 713
Riehl, C. J. (2000) · Review of Educational Research · doi:10.3102/00346543070001055 · Cited by 648
Intercultural competence: Interpersonal communication across cultures
Cranmer, D. J. (1995) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(95)90057-8 · Cited by 629
Hogarty, K. Y., Hines, C. V., Kromrey, J. D., Ferron, J. M., & Mumford, K. R. (2005) · Educational and Psychological Measurement · doi:10.1177/0013164404267287 · Cited by 559
Leech, N. L., & Onwuegbuzie, A. J. (2008) · School Psychology Quarterly · doi:10.1037/1045-3830.23.4.587 · Cited by 547
Self-citationDeveloping Cross-Cultural Competence: A Guide for Working With Young Children and Their Families
Lynch, E. W., & Hanson, M. J. (1995) · Medical Entomology and Zoology · Cited by 527
Advances in Social Science Methodology
Thompson, B. (1994) · Cited by 423
Foundations of multimethod research: synthesizing styles
Brewer, J., & Hunter, A. (2006) · Sage eBooks · Cited by 358
Equity Audits: A Practical Leadership Tool for Developing Equitable and Excellent Schools
Skrla, L., Scheurich, J. J., Garcia, J., & Nolly, G. (2004) · Educational Administration Quarterly · doi:10.1177/0013161x03259148 · Cited by 357
Cultural Proficiency: A Manual for School Leaders
Lindsey, R. B., Robins, K. N., & Terrell, R. D. (1999) · Cited by 312
Managing intercultural conflict effectively
(2002) · Choice Reviews Online · doi:10.5860/choice.39-4658 · Cited by 299
Managing Intercultural Conflict Effectively
Ting-Toomey, S., & Oetzel, J. (2001) · Sage eBooks · doi:10.4135/9781452229485 · Cited by 289
Foundations of Multimethod Research
Brewer, J., & Hunter, A. (2006) · doi:10.4135/9781412984294 · Cited by 287
Onwuegbuzie, A. J., Witcher, A. E., Collins, K. M. T., Filer, J. D., Wiedmaier, C. D., & Moore, C. W. (2007) · American Educational Research Journal · doi:10.3102/0002831206298169 · Cited by 283
Self-citationEffect Sizes in Qualitative Research: A Prolegomenon
Onwuegbuzie, A. J. (2003) · Quality and Quantity · doi:10.1023/a:1027379223537 · Cited by 257
Self-citationOnwuegbuzie, A. J., & Daniel, L. G. (2015) · Current Issues in Education · Cited by 252
Self-citationEmergent Data Analysis Techniques in Mixed Methods Research: A Synthesis
Onwuegbuzie, A. J., & Combs, J. P. (2010) · SAGE Handbook of Mixed Methods in Social & Behavioral Research · doi:10.4135/9781506335193.n17 · Cited by 244
Self-citationOn the theoretical, conceptual, and philosophical foundations for research in mathematics education
Lester, F. K. (2005) · ZDM · doi:10.1007/bf02655854 · Cited by 235
Foundations for the study of intercultural communication based on a third-culture building model
Casrnir, F. L. (1999) · International Journal of Intercultural Relations · doi:10.1016/s0147-1767(98)00027-3 · Cited by 199
Onwuegbuzie, A. J., Leech, N. L., & Collins, K. M. T. (2008) · International Journal of Qualitative Methods · doi:10.1177/160940690800700401 · Cited by 197
Self-citationAssessing Schoolwide Cultural Competence: Implications for School Leadership Preparation
Bustamante, R. M., Nelson, J. A., & Onwuegbuzie, A. J. (2009) · Educational Administration Quarterly · doi:10.1177/0013161x09347277 · Cited by 184
Self-citationPowell, H., Mihalas, S., Onwuegbuzie, A. J., Suldo, S., & Daley, C. E. (2008) · Psychology in the Schools · doi:10.1002/pits.20296 · Cited by 164
Self-citationBanks, J. A. (2001) · International Encyclopedia of the Social & Behavioral Sciences · doi:10.1016/b0-08-043076-7/02390-1 · Cited by 161
On the Theoretical, Conceptual, and Philosophical Foundations for Research in Mathematics Education
Lester, F. K. (2010) · Theories of Mathematics Education · doi:10.1007/978-3-642-00742-2_8 · Cited by 160
The Culturally Proficient School: An Implementation Guide for School Leaders
Lindsey, R. B., Roberts, L. M., & CampbellJones, F. (2004) · Cited by 119
Assessing the Multicultural Competence of School Counselors: A Checklist.
Holcomb‐McCoy, C. C. (2004) · Professional School Counseling · Cited by 109
A meta-validation model for assessing the score-validity of student teaching evaluations
Onwuegbuzie, A. J., Daniel, L. G., & Collins, K. M. T. (2007) · Quality & Quantity · doi:10.1007/s11135-007-9112-4 · Cited by 104
Self-citationAn Introductory Primer on the Appropriate Use of Exploratory and Confirmatory Factor Analysis.
Kieffer, K. M. (1999) · Research in the schools · Cited by 103
Illustrating a mixed-method approach for validating culturally specific constructs
Hitchcock, J. H., Nastasi, B. K., Dai, D. Y., Newman, J., Jayasena, A., Moore, R. B., Sarkar, S., & Varjas, K. M. (2005) · Journal of School Psychology · doi:10.1016/j.jsp.2005.04.007 · Cited by 75
Hitchcock, J. H., Sarkar, S., Nastasi, B. K., Burkholder, G. J., Varjas, K., & Jayasena, A. (2006) · Journal of Applied School Psychology · doi:10.1300/j370v22n02_02 · Cited by 40
Nelson, J. A., Bustamante, R. M., Wilson, E., & Onwuegbuzie, A. J. (2008) · Professional School Counseling · doi:10.5330/psc.n.2010-11.207 · Cited by 36
Self-citationOrganizational Cultural Competence in Mental Health Service Delivery: A Multilevel Analysis
Darnell, A. J., & Kuperminc, G. P. (2006) · Journal of Multicultural Counseling and Development · doi:10.1002/j.2161-1912.2006.tb00039.x · Cited by 17
Research works printed but not linked: 32
- Brislin, R., 1993, Understanding culture’s influence on behavior
- Bustamante, R.M., 2005, Features of cultural proficiency in American International Schools in Latin America: A Delphi study. Unpublished doctoral dissertation
- Bustamante, R.M., 2006, Connexions. Retrieved March, 22, 2009
- Bustamante, R.M., 2007, The School-Wide Cultural Competence Observation Checklist. Unpublished manuscript
- Bustamante, R. M., Nelson, J. A. & Onwuegbuzie, A. J. (in press). Assessing school-wide cultural competence: Implications for school leader preparation. Educational Administration Quarterly.
- Collins, K.M.T., 2006, Learning Disabilities: A Contemporary Journal, 4, 67
- Combs, J.P., Bustamante, R.M. & Onwuegbuzie, A.J. (in press). A mixed methods approach to conducting literature reviews for stress and coping researchers: An interactive literature review process framework. In K. M. T. Collins , A. J. Onwuegbuzie, & Q. G. Jiao (Eds.), Toward a broader understanding of stress and coping: Mixed methods approaches. The Research on Stress and Coping in Education Series (Vol. 5) Greenway, CT: Information Age.
- Cross, T.L., 1989, Towards a culturally competent system of care
- Fabrigar, L.R. & Joelle Estrada, M. (2007). Multitrait multimethod matrix and construct validity. In N. J. Salkind (Ed.), Encyclopedia of measurement and statistics (pp. 666-669). Thousand Oaks, CA: SAGE.
- Freiberg, H.J., 1998, Educational Leadership, 56, 336
- Geertz, C., 1979, The interpretation of culture
- Hall, E.T., 1976, Beyond culture
- Halpern, E.S. ( 1983). Auditing naturalistic inquiries: The development and application of a model. Unpublished doctoral dissertation, Indiana University.
- Hammer, M. ( 1989). Intercultural communication competence. In M. K. Asante & W. Gudykunst (Eds.), Handbook of international and intercultural communication (pp. 246-260). Newbury Park, CA: SAGE.
- Henson, R.K., 2004, Research in the Schools, 11, 61
- Henze, R., 2002, Leading for diversity
- 10.1080/1467598032000044629 · doi:10.1080/1467598032000044629
- Johnson, R.B., 2004, April). Development and use of the Philosophical Beliefs Questionnaire. Paper presented at the annual meeting of the
- 10.1177/019263659608057606 · doi:10.1177/019263659608057606
- Kieffer, K.M., 1999, Research in the Schools, 6, 75
- Messick, S. ( 1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). Old Tappan, NJ: Macmillan.
- Onwuegbuzie, A.J., 2007, The Qualitative Report, 12, 281
- Onwuegbuzie, A.J., Toward a broader understanding of stress and coping: Mixed methods approaches. The Research on Stress and Coping in Education Series, 5
- Onwuegbuzie, A. J., Collins, K. M. T. & Leech, N. L. (in press). Mixed research: A step-by-step guide. New York: Taylor & Francis.
- Onwuegbuzie, A.J., Toward a broader understanding of stress and coping: Mixed methods approaches. The Research on Stress and Coping in Education Series, 5
- Onwuegbuzie, A.J. & Teddlie, C. ( 2003). A framework for analyzing data in mixed methods research . In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 351-383). Thousand Oaks, CA: SAGE.
- Salvaggio, K.C., 2003, Perceptions of formal and informal school leaders regarding cultural proficiency in high-achieving, highly diverse elementary schools. Unpublished doctoral dissertation, University of LaVerne
- Stufflebeam, D.L., 2002, Kalamazoo, MI: The Evaluation Center. Retrieved February, 4, 2009
- Sue, D.W. & Constantine, M.G. (2005). Effective multicultural consultation and organizational development. In M. G. Constantine & D. W. Sue (Eds.), Strategies for building multicultural competence in mental health settings (pp. 212-226). Hoboken, NJ: Wiley.
- Tashakkori, A., 1998, Applied Social Research Methods, 6
- Teddlie, C. & Johnson, R.B. (2009). Methodological thought since the 20th century. In C. Teddlie & A Tashakkori (Eds.), Foundations of mixed methods research: Integrating quantitative and qualitative techniques in the social and behavioral sciences (pp. 62-82). Thousand Oaks, CA: SAGE.
- 10.1037/0022-0167.34.4.414 · doi:10.1037/0022-0167.34.4.414 · Paper page
Cited by
Achieving integration in mixed methods designs-principles and practices
Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013) · Health Services Research · doi:10.1111/1475-6773.12117 · Cited by 7,219
Ungar, M., & Liebenberg, L. (2011) · Journal of Mixed Methods Research · doi:10.1177/1558689811400607 · Cited by 740
Is Meat Male? A Quantitative Multimethod Framework to Establish Metaphoric Relationships
Rozin, P., Hormes, J. M., Faith, M. S., & Wansink, B. (2012) · Journal of Consumer Research · doi:10.1086/664970 · Cited by 358
Towards the use of mixed methods inquiry as best practice in health outcomes research
On behalf of the International Society for Quality of Life Research (ISOQOL) Mixed Methods Special Interest Group (SIG), Regnault, A., Willgoss, T., & Barbic, S. (2018) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-018-0043-8 · Cited by 266
Akinade, O. O., Oyedele, L. O., Ajayi, S. O., Bilal, M., Alaka, H. A., Owolabi, H. A., & Arawomo, O. O. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.01.022 · Cited by 260
Metadata
- Authors
- Onwuegbuzie, A. J., Bustamante, R. M., & Nelson, J. A.
- Venue
- Journal of Mixed Methods Research
- Publisher
- SAGE Publications
- Published
- 2009-12-29
- Volume
- 4
- Issue
- 1
- Pages
- 56-78
- ISSN
- 1558-6898 (ISSN-L)
- 1558-6901
- OpenAlex
- W2065274508
- Cited by
- 366
- References
- 83
- FWCI
- 11.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.