The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
Quality in Interpretive Engineering Education Research: Reflections on an Example Study
Open accessAbstract
Background: The emerging discipline of engineering education research is increasingly embracing a diverse range of interpretive research methods, whose adoption is characterized by a lack of coherent ways to conceptualize, communicate, and judge the quality of interpretive inquiries. Yet fields that have traditionally employed these methods do not offer a consensus about research quality. Purpose: This article presents reflections on challenges to research quality in an example interpretive engineering education study, and offers a quality framework that emerged from this study as a coherent, discipline‐specific view on interpretive research quality. Design/Method: Analysis of the prior study of engineering students' competency formation by the author(s) is combined with a synthesis of the literature from the broad intellectual traditions of the interpretive paradigm to inform the development of a theoretical framework of research quality. Results: Drawing on the engineering metaphor of quality management, we propose a systematic, process‐oriented framework of research quality along two dimensions: a process model locates quality strategies throughout the research process, and a typology systemizes fundamental aspects of validation (theoretical, procedural, communicative, and pragmatic) and the concept of process reliability to explicate quality strategies in their fundamental contribution to substantiating knowledge claims. Conclusion: The quality framework provides a way to develop and demonstrate overall research quality in the interpretive inquiry by shifting attention away from assessing the research quality of a final product. Rather, the framework provides guidance to systematically document and explicitly demonstrate quality considerations throughout the entire research process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420
The Discovery of Grounded Theory: Strategies for Qualitative Research.
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,361
Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(85)90062-8 · Cited by 45,787
Cohen, L., Manion, L., & Morrison, K. (2007) · Routledge eBooks · doi:10.4324/9780203029053 · Cited by 20,105
(2006) · Cited by 18,730
(1998) · Cited by 18,576
The social construction of reality : a treatise in the sociology of knowledge
Simpson, G., Berger, P. L., & Luckmann, T. (1967) · American Sociological Review · doi:10.2307/2091739 · Cited by 16,462
Constructing Grounded Theory. A Practical Guide Through Qualitative Analysis
(2006) · QMiP Bulletin · doi:10.53841/bpsqmip.2006.1.2.36 · Cited by 11,828
(1996) · Cited by 11,584
An Introduction to Qualitative Research
Flick, U. (2023) · SAGE Publications Ltd eBooks · doi:10.4135/9781036231712 · Cited by 8,198
The critical incident technique.
Flanagan, J. C. (1954) · Psychological Bulletin · doi:10.1037/h0061470 · Cited by 8,191
Qualitative research in health care: Analysing qualitative data
Pope, C. (2000) · BMJ · doi:10.1136/bmj.320.7227.114 · Cited by 8,131
Qualitative Quality: Eight “Big-Tent” Criteria for Excellent Qualitative Research
Tracy, S. J. (2010) · Qualitative Inquiry · doi:10.1177/1077800410383121 · Cited by 7,536 · cited 1×
“Discussions of research quality in these fields are extremely diverse and span proposals of both traditional and reinterpreted criteria (Cohen, Manion, & Morrison, 2000; Maxwell, 1992) and also suggestions for various alternative approaches (Lincoln & Guba, 1985; Tracy, 2010).”
BackgroundBecoming Qualitative Researchers: An Introduction
Glesne, C. (1991) · Cited by 7,507
Deming, W. E. (1982) · Medical Entomology and Zoology · Cited by 7,297
The Discovery of Grounded Theory: Strategies for Qualitative Research
Brodsky, C. M. (1968) · Psychosomatics · doi:10.1016/s0033-3182(68)71872-7 · Cited by 6,679
(2007) · Encyclopedia of Industrial and Organizational Psychology · doi:10.4135/9781412952651.n55 · Cited by 5,287
Cohen, L., Manion, L., & Morrison, K. (2002) · Routledge eBooks · doi:10.4324/9780203224342 · Cited by 4,837
Testing for competence rather than for "intelligence."
McClelland, D. C. (1973) · American Psychologist · doi:10.1037/h0034092 · Cited by 4,425
Gibbs, G. (2007) · doi:10.4135/9781849208574 · Cited by 4,299
Theory in Practice: Increasing Professional Effectiveness
Runkel, P. J., Argyris, C., & Schön, D. A. (1976) · The Journal of Higher Education · doi:10.2307/1978718 · Cited by 4,083
Doing Qualitative Research in Education Settings
(2002) · doi:10.1353/book4583 · Cited by 3,502
Competence at Work: Models for Superior Performance
Spencer, L. M., & Spencer, S. M. (1993) · Cited by 3,158
Understanding and Validity in Qualitative Research
Maxwell, J. (1992) · Harvard Educational Review · doi:10.17763/haer.62.3.8323320856251826 · Cited by 2,951 · cited 11×
“Theoretical validation with respect to the concepts of theory concerns “the legitimacy of the application of a given concept to established facts” (Maxwell, 1992, p. 292).”
BackgroundInfluentialThe Competent Manager: A Model for Effective Performance
Boyatzis, R. E. (1982) · Andalas University Repository (Andalas University) · Cited by 2,533
The Qualitative Researcher's Companion
Huberman, A., & Miles, M. (2002) · Sage eBooks · doi:10.4135/9781412986274 · Cited by 2,324
"From the Native's Point of View": On the Nature of Anthropological Understanding
Geertz, C. (1974) · Bulletin of the American Academy of Arts and Sciences · doi:10.2307/3822971 · Cited by 2,185
Reliability and Validity in Qualitative Research
(2004) · The SAGE Encyclopedia of Social Science Research Methods · doi:10.4135/9781412950589.n846 · Cited by 2,184
Kvale, S. (2007) · doi:10.4135/9781849208963 · Cited by 2,182
The competent manager: A model for effective performance
Newton, C., & o̊Consultant (1983) · Long Range Planning · doi:10.1016/0024-6301(83)90170-x · Cited by 2,075
Complexity and post-modernism: understanding complex systems
Cilliers, P., & Spurrett, D. (1999) · South African Journal of Philosophy · doi:10.1080/02580136.1999.10878187 · Cited by 1,913
Handling Qualitative Data: A Practical Guide
Richards, L. (2005) · Cited by 1,885
Emerging Criteria for Quality in Qualitative and Interpretive Research
Lincoln, Y. S. (1995) · Qualitative Inquiry · doi:10.1177/107780049500100301 · Cited by 1,568
Handling Qualitative Data: A Practical Guide
Pearson, M. (2005) · Sociological Research Online · doi:10.1177/136078040501000407 · Cited by 1,512
Reliability and Validity in Qualitative Research
Kirk, J., & Miller, M. (1986) · doi:10.4135/9781412985659 · Cited by 1,462
Measurement and evaluation in teaching
Gronlund, N. E. (1965) · Cited by 1,425
Barriers to the Advance of Organizational Science: Paradigm Development as a Dependent Variable
Pfeffer, J. (1993) · The Academy of Management Review · doi:10.2307/258592 · Cited by 1,402
Qualitative Analysis on Stage: Making the Research Process More Public
Anfara, V. A., Brown, K. M., & Mangione, T. L. (2002) · Educational Researcher · doi:10.3102/0013189x031007028 · Cited by 1,362
Validity in qualitative research revisited
Cho, J., & Trent, A. (2006) · Qualitative Research · doi:10.1177/1468794106065006 · Cited by 1,037
An Introduction to Qualitative Research
Bryden, E. (2010) · Sight and Life Magazine: Issue 1/2010 · doi:10.52439/uzxe5427 · Cited by 1,023
Validation in Inquiry-Guided Research: The Role of Exemplars in Narrative Studies
Mishler, E. (1990) · Harvard Educational Review · doi:10.17763/haer.60.4.n4405243p6635752 · Cited by 1,004
What's wrong with ethnography?: methodological explorations
(1992) · Choice Reviews Online · doi:10.5860/choice.30-1008 · Cited by 920
Everyday Problem Solving in Engineering: Lessons for Engineering Educators
Jonassen, D., Strobel, J., & Lee, C. B. (2006) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2006.tb00885.x · Cited by 913
The Student-Physician: Introductory Studies in the Sociology of Medical Education
(1957) · Harvard University Press eBooks · doi:10.4159/harvard.9780674366831 · Cited by 850
Quantitative, Qualitative, and Mixed Research Methods in Engineering Education
Borrego, M., Douglas, E. P., & Amelink, C. T. (2009) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2009.tb01005.x · Cited by 770
Identifying Competencies with Behavioral-Event Interviews
McClelland, D. C. (1998) · Psychological Science · doi:10.1111/1467-9280.00065 · Cited by 745
Social Emergence: Societies As Complex Systems
Sawyer, R. K. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511734892 · Cited by 724
Theory in Practice: Increasing Professional Effectiveness.
Meyer, M. W., Argyris, C., & Schon, D. A. (1976) · Contemporary Sociology · doi:10.2307/2062989 · Cited by 680
How Do We Justify Knowledge Produced Within Interpretive Approaches?
Sandberg, J. (2005) · Organizational Research Methods · doi:10.1177/1094428104272000 · Cited by 670
Managing Quality in Qualitative Research
Flick, U. (2007) · doi:10.4135/9781849209441 · Cited by 649
Complexity and Education: Inquiries Into Learning, Teaching, and Research
Davis, B., & Sumara, D. (2006) · Cited by 605
Complexity and education: Inquiries into learning, teaching and research
Baker, J. (2006) · Journal of Contemporary Issues in Education · doi:10.20355/c5h593 · Cited by 566
Unveiling Professional Development: A Critical Review of Stage Models
Dall’Alba, G., & Sandberg, J. (2006) · Review of Educational Research · doi:10.3102/00346543076003383 · Cited by 550
Social emergence societies as complex systems
Sawyer, R. K. (2005) · Cited by 535
Fielding, N., & Fielding, J. (1986) · Sage eBooks · doi:10.4135/9781412984775 · Cited by 520
Matusovich, H. M., Streveler, R. A., & Miller, R. L. (2010) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2010.tb01064.x · Cited by 435
Emerging Research Methodologies in Engineering Education Research
Case, J. M., & Light, G. (2011) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2011.tb00008.x · Cited by 392
Validity and the Research Process.
Higgins, J., Brunberg, D., & McGrath, J. E. (1986) · The Statistician · doi:10.2307/2987770 · Cited by 349
Definitions of Interdisciplinary Research: Toward Graduate-Level Interdisciplinary Learning Outcomes
Borrego, M., & Newswander, L. K. (2010) · The Review of Higher Education · doi:10.1353/rhe.2010.0006 · Cited by 331
Complexity Theory and the Philosophy of Education
Mason, M. (2008) · Educational Philosophy and Theory · doi:10.1111/j.1469-5812.2007.00412.x · Cited by 328
The Emergence of Engineering Education Research as an Internationally Connected Field of Inquiry
Borrego, M., & Bernhard, J. (2011) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2011.tb00003.x · Cited by 327
Narrative and Story in Practice and Research.
Clandinin, D. J., & Connelly, F. M. (1989) · Cited by 323
Qualitative Methods Used in the Assessment of Engineering Education
LEYDENS, J. A., MOSKAL, B. M., & PAVELICH, M. J. (2004) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2004.tb00789.x · Cited by 261
Issues in Participant Observation: A Text and Reader
Pettigrew, A. M. (1970) · Sociology · doi:10.1177/003803857000400337 · Cited by 236
What's Wrong with Ethnography? Methodological Explorations
Marks, J. T. W., & Hammersley, M. (1994) · Canadian Journal of Sociology / Cahiers canadiens de sociologie · doi:10.2307/3341159 · Cited by 212
The Research Agenda for the New Discipline of Engineering Education
(2006) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2006.tb00900.x · Cited by 210
Conceptual Difficulties Experienced by Trained Engineers Learning Educational Research Methods
Borrego, M. (2007) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2007.tb00920.x · Cited by 200
Borrego, M. (2007) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2007.tb00911.x · Cited by 188
Conducting Rigorous Research in Engineering Education
Streveler, R. A., & Smith, K. A. (2006) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2006.tb00882.x · Cited by 183
Walther, J., Kellam, N. N., Sochacka, N. W., & Radcliffe, D. F. (2011) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2011.tb00033.x · Cited by 160
Self-citationThe a priori of communication and the foundation of the humanities
Apel, K. O. (1972) · Continental Philosophy Review · doi:10.1007/bf01253016 · Cited by 141
"Bracketing" in phenomenology: Renouncing assumptions in hearing about student cheating
Ashworth, P. D. (1999) · International Journal of Qualitative Studies in Education · doi:10.1080/095183999235845 · Cited by 127
Becoming a Professional Engineering Educator: A New Role for a New Era
Fink, L. D., Ambrose, S. A., & Wheeler, D. (2005) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2005.tb00837.x · Cited by 124
Chaos, complexity, curriculum, and culture : a conversation
Doll, W. E., Fleener, M. J., & Julien, J. S. (2005) · Cited by 100
Complexity Theory and the Philosophy of Education
(2008) · Wiley eBooks · doi:10.1002/9781444307351 · Cited by 100
Validity, Reliability and the Assessment of Engineering Education
Moskal, B., Leydens, J. A., & Pavelich, M. J. (2002) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2002.tb00714.x · Cited by 86
Streveler, R. A., Borrego, M. J., & Smith, K. A. (2007) · To improve the academy · doi:10.1002/j.2334-4822.2007.tb00479.x · Cited by 60
Validity and the research process
Kristensen, K. (1986) · European Journal of Operational Research · doi:10.1016/0377-2217(86)90171-2 · Cited by 57
Baillie, C. A., Ko, E. I., Newstetter, W., & Radcliffe, D. F. (2011) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2011.tb00002.x · Cited by 32
Sochacka, N., Walther, J., Jolly, L., & Kavanagh, L. (2009) · Cited by 13
Self-citation
Research works printed but not linked: 19
- 10.1515/zfsoz-1985-0605 · doi:10.1515/zfsoz-1985-0605
- Cilliers P., 1998, Complexity and postmodernism: Understanding complex systems
- Cottman R. J., 1993, Total engineering quality management
- 10.1080/03043791003703177 · doi:10.1080/03043791003703177
- 10.1002/0471744697 · doi:10.1002/0471744697
- Husserl E., 1936, Die Krisis der europäischen Wissenschaften und die transzendentale Phänomenologie
- 10.1002/j.2168-9830.2008.tb00947.x · doi:10.1002/j.2168-9830.2008.tb00947.x
- Merton R. K., 1994, A life of learning
- Radcliffe D. F.(2008).Contingent immersion: A naturalistic methodology for discovering the socio‐technical realities of engineering practice. Paper presented at the Research on Engineering Education Symposium (REES) Davos Switzerland.
- 10.1002/j.2168-9830.1999.tb00449.x · doi:10.1002/j.2168-9830.1999.tb00449.x
- 10.1002/j.2168-9830.2005.tb00825.x · doi:10.1002/j.2168-9830.2005.tb00825.x
- Sirohi R. S., 1983, Mechanical measurements
- Walther J. Boonchai C. &Radcliffe D. F.(2008).Understanding fundamental assumptions underlying educational research through the lens of a cultural “Verfremdungseffekt.” Paper presented at the Research on Engineering Education Symposium (REES) Davos Switzerland.
- Walther J. Kellam N. N. Radcliffe D. F. &Boonchai C.(2009).Integrating students' learning experiences through deliberate reflective practice. Paper presented at the Frontiers in Education Conference San Antonio TX. · doi:10.1109/fie.2009.5350657
- Walther J. &Radcliffe D. F.(2007a).Analysis of the use of an accidental competency discourse as a reflexive tool for professional placement students. Paper presented at the Frontiers in Education Conference Milwaukee WI. · doi:10.1109/fie.2007.4417974
- 10.1080/22054952.2007.11464000 · doi:10.1080/22054952.2007.11464000
- Walther J. Sochacka N. &Kellam N. N.(2011).Emotional indicators as a way to elicit authentic student reflection in engineering programs. Paper presented at the ASEE Annual Conference (ERM Division) Vancouver BC Canada.
- Zairi M., 1993, Total quality management for engineers
- Znaniecki F., 1934, Method of sociology
Cited by
Chatbot application in a 5th grade science course
Deveci Topal, A., Dilek Eren, C., & Kolburan Geçer, A. (2021) · Education and Information Technologies · doi:10.1007/s10639-021-10627-8 · Cited by 182
Martin, J. P., Stefl, S. K., Cain, L. W., & Pfirman, A. L. (2020) · International Journal of STEM Education · doi:10.1186/s40594-020-00237-0 · Cited by 144
Borrego, M., Foster, M. J., & Froyd, J. E. (2015) · Journal of Engineering Education · doi:10.1002/jee.20069 · Cited by 124
Computing Education Research Today
Fincher, S. A., Tenenberg, J., Dorn, B., Hundhausen, C., McCartney, R., & Murphy, L. (2019) · The Cambridge Handbook of Computing Education Research · doi:10.1017/9781108654555.003 · Cited by 7
Metadata
- Authors
- Walther, J., Sochacka, N. W., & Kellam, N. N.
- Venue
- Journal of Engineering Education
- Publisher
- Wiley
- Published
- 2013-10
- Volume
- 102
- Issue
- 4
- Pages
- 626-659
- ISSN
- 1069-4730 (ISSN-L)
- 2168-9830
- OpenAlex
- W2131808423
- Cited by
- 458
- References
- 80
- FWCI
- 65.45
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.