The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Empirical Elephants—Why Multiple Methods are Essential to Quality Research in Operations and Supply Chain Management
Open accessAbstract
Much like the blind men and the elephant, researchers in the field of operations and supply chain management (OSCM) often study natural phenomena (business processes are our "elephants") using widely varied perspectives. Though we seek objectivity, each of us is prone to form an attachment to a given perspective, influenced by our training and by the perspectives of our mentors and peers. As editors, numerous conversations with researchers have given us cause to be concerned that there is a tendency in the academic community to discount the findings of others who are using their different "senses" (research methods) to examine various parts of the elephant. In this editorial, we take the opportunity to briefly review a variety of research methodologies. It is our strong belief that multiple approaches are required in order to develop a holistic understanding of operations and supply chain management phenomena. Only by being open to reading, digesting and synthesizing multiple perspectives can we get a true picture of the elephant. For a couple of reasons, we limit our comments to address only empirical research methods. First, while recognizing that modeling and purely analytical techniques have produced large advances in OSCM, we also take the position that the study of OSCM is a social science. Research in OSCM is more than problem solving; it is the study of business processes with the objective of developing theories that explain them. Business processes contain both natural and social phenomena. As such, while systems and decisions affecting business processes can be modeled, examinations of empirical data are crucial for the development and validation of models. It is especially important that we uncover the often complex social and behavioral elements involved in OSCM. Biological sciences can explain the universal characteristics of an elephant, but in practice different elephants have personalities and individual characteristics that must be observed in order to be understood. A second reason for limiting this discussion to empirical methods is the fact that the Journal of Operations Management is entirely dedicated to the publication of theory-driven, empirical research. The JOM is the only OM journal stating such a focused mission, and we are committed to it. At the same time, we would not want the journal to become too focused in terms of the empirical methodologies employed. We want to encourage research employing a wide range of perspectives and methods. In the following paragraphs we very briefly examine the benefits and limitations of several broad methodological approaches, including primary data collection (survey, case, experiments) and secondary data collection. This is clearly not an exhaustive guide or comparison of empirical techniques. There are numerous resources for this, including the recent article by Roth (2007). Our goal is to remind readers that every approach has good and bad points. There is no universally superior methodology. In the discussion we also present several recent or forthcoming JOM articles that exemplify each approach. Finally, we discuss potential synergies between the various approaches which can provide a holistic view of the elephant. Following the seminal work of Flynn et al. (1990), there has been a notable growth in empirical research generally, and in survey-based research in particular. While Flynn et al. (1990) provided an overview of numerous empirical techniques, their work focused on survey-based research. Survey research is a common methodological approach in the fields of management and marketing, with well-established protocols that are summarized by Flynn et al. (1990) and many others. The question is not whether survey-based research is appropriate, but when is it appropriate? A survey provides a low cost, non-invasive means for measuring aspects of an operational or supply chain issue. Measures included in a survey can be designed to target specific factors or attributes which may not be directly observable. For example, many behavioral variables affecting an operational process are "latent," and can be assessed only via perceptual measures. Moreover, even directly observable attributes are often not measured by organizations, either because they are not of interest or because they cannot be measured in a cost effective manner. Frequently, measures that are published by organizations do not report data at the needed unit of analysis. For example, measures of costs or sales at the plant or lower levels are not typically available from published sources. Via a survey, data can be collected directly from the individual or unit directly responsible for managing a certain operation of interest. Much of the controversy surrounding surveys has to do with the use of perceptual measures. The use of perceptual measures is not necessarily wrong. In fact, they may be necessitated by the nature of the variable of interest. This is clearly the case when var
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1984) · Cited by 81,983
Case Study Research: Design and Methods
Chaiklin, H. (1991) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199102000-00025 · Cited by 39,535
Building theories from case study research
Eisenhardt, K. M. (2009) · STUDI ORGANIZZATIVI · doi:10.3280/so2008-002004 · Cited by 11,299
Building operations management theory through case and field research
Meredith, J. (1998) · Journal of Operations Management · doi:10.1016/s0272-6963(98)00023-0 · Cited by 1,657
Empirical research methods in operations management
Flynn, B. B., Sakakibara, S., Schroeder, R. G., Bates, K. A., & Flynn, E. J. (1990) · Journal of Operations Management · doi:10.1016/0272-6963(90)90098-x · Cited by 1,634
The effect of supply chain glitches on shareholder wealth
Hendricks, K. B., & Singhal, V. R. (2003) · Journal of Operations Management · doi:10.1016/j.jom.2003.02.003 · Cited by 1,074
Creating supply chain relational capital: The impact of formal and informal socialization processes
Cousins, P. D., Handfield, R. B., Lawson, B., & Petersen, K. J. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2005.08.007 · Cited by 537
Wu, Z., & Choi, T. Y. (2005) · Journal of Operations Management · doi:10.1016/j.jom.2005.02.001 · Cited by 385
Building Theory from Case Study Research
(2016) · Case Study Research · doi:10.1108/978-1-78560-461-420152014 · Cited by 264
Toward a theory of competencies for the management of product complexity: Six case studies
Closs, D. J., Jacobs, M. A., Swink, M., & Webb, G. S. (2008) · Journal of Operations Management · doi:10.1016/j.jom.2007.10.003 · Cited by 207
Self-citation
Cited by
Ensuring Supply Chain Resilience: Development and Implementation of an Assessment Tool
Pettit, T. J., Croxton, K. L., & Fiksel, J. (2013) · Journal of Business Logistics · doi:10.1111/jbl.12009 · Cited by 1,080
Dubey, R., Gunasekaran, A., Childe, S. J., Fosso Wamba, S., Roubaud, D., & Foropon, C. (2021) · International Journal of Production Research · doi:10.1080/00207543.2019.1582820 · Cited by 958
CORPORATE SOCIAL RESPONSIBILITY REPORTS: A THEMATIC ANALYSIS RELATED TO SUPPLY CHAIN MANAGEMENT
TATE, W. L., ELLRAM, L. M., & KIRCHOFF, J. F. (2010) · Journal of Supply Chain Management · doi:10.1111/j.1745-493x.2009.03184.x · Cited by 679
Dubey, R., Gunasekaran, A., Bryde, D. J., Dwivedi, Y. K., & Papadopoulos, T. (2020) · International Journal of Production Research · doi:10.1080/00207543.2020.1722860 · Cited by 672
The role of Big Data in explaining disaster resilience in supply chains for sustainability
Papadopoulos, T., Gunasekaran, A., Dubey, R., Altay, N., Childe, S. J., & Fosso-Wamba, S. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.03.059 · Cited by 646
Dealing with supply chain risks: Linking risk management practices and strategies to performance
Wieland, A., & Wallenburg, C. M. (2012) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/09600031211281411 · Cited by 576
Dynamic digital capabilities and supply chain resilience: The role of government effectiveness
Dubey, R., Bryde, D. J., Dwivedi, Y. K., Graham, G., Foropon, C., & Papadopoulos, T. (2023) · International Journal of Production Economics · doi:10.1016/j.ijpe.2023.108790 · Cited by 473
Assessing the vulnerability of supply chains using graph theory
Wagner, S. M., & Neshat, N. (2010) · International Journal of Production Economics · doi:10.1016/j.ijpe.2009.10.007 · Cited by 449
Analysis of cost and schedule performance of international development projects
Ahsan, K., & Gunawan, I. (2010) · International Journal of Project Management · doi:10.1016/j.ijproman.2009.03.005 · Cited by 375
Wu, Z., Choi, T. Y., & Rungtusanatham, M. J. (2010) · Journal of Operations Management · doi:10.1016/j.jom.2009.09.002 · Cited by 340
Dubey, R., Bryde, D. J., Dwivedi, Y. K., Graham, G., & Foropon, C. (2022) · International Journal of Production Economics · doi:10.1016/j.ijpe.2022.108618 · Cited by 335
Hofer, C., Cantor, D. E., & Dai, J. (2012) · Journal of Operations Management · doi:10.1016/j.jom.2011.06.002 · Cited by 305
Data-driven supply chain capabilities and performance: A resource-based view
Yu, W., Chavez, R., Jacobs, M. A., & Feng, M. (2018) · Transportation Research Part E: Logistics and Transportation Review · doi:10.1016/j.tre.2017.04.002 · Cited by 300
van Aken, J., Chandrasekaran, A., & Halman, J. (2016) · Journal of Operations Management · doi:10.1016/j.jom.2016.06.004 · Cited by 290
The customer consequences of returns in online retailing: An empirical analysis
Griffis, S. E., Rao, S., Goldsby, T. J., & Niranjan, T. T. (2012) · Journal of Operations Management · doi:10.1016/j.jom.2012.02.002 · Cited by 261
Drivers of Supplier Sustainability: Moving Beyond Compliance to Commitment
Foerstl, K., Azadegan, A., Leppelt, T., & Hartmann, E. (2015) · Journal of Supply Chain Management · doi:10.1111/jscm.12067 · Cited by 259
Cegielski, C. G., Allison Jones‐Farmer, L., Wu, Y., & Hazen, B. T. (2012) · The International Journal of Logistics Management · doi:10.1108/09574091211265350 · Cited by 258
The link between supply chain fit and financial performance of the firm⋆
Wagner, S. M., Grosse‐Ruyken, P. T., & Erhun, F. (2012) · Journal of Operations Management · doi:10.1016/j.jom.2012.01.001 · Cited by 252
Multi‐Methodological Research in Operations Management
Choi, T., Cheng, T. C. E., & Zhao, X. (2016) · Production and Operations Management · doi:10.1111/poms.12534 · Cited by 206
Internal lean practices and performance: The role of technological turbulence
Chavez, R., Yu, W., Jacobs, M., Fynes, B., Wiengarten, F., & Lecuna, A. (2015) · International Journal of Production Economics · doi:10.1016/j.ijpe.2014.10.005 · Cited by 200
A Note on the Use of Survey Research Firms to Enable Empirical Data Collection
Schoenherr, T., Ellram, L. M., & Tate, W. L. (2015) · Journal of Business Logistics · doi:10.1111/jbl.12092 · Cited by 169
Chandrasekaran, A., Linderman, K., & Sting, F. J. (2018) · Journal of Operations Management · doi:10.1016/j.jom.2018.11.003 · Cited by 37
Kumar, A., Bhattacharyya, S. S., & Krishnamoorthy, B. (2023) · Journal of Enterprise Information Management · doi:10.1108/jeim-09-2022-0307 · Cited by 34
Designing e‐government services: Key service attributes and citizens’ preference structures
Venkatesh, V., Chan, F. K. Y., & Thong, J. Y. L. (2012) · Journal of Operations Management · doi:10.1016/j.jom.2011.10.001 · Cited by 33
Brandon-Jones, A. (2017) · International Journal of Operations & Production Management · doi:10.1108/ijopm-08-2016-0480 · Cited by 30
Metadata
- Authors
- Boyer, K. K., & Swink, M. L.
- Venue
- Journal of Operations Management
- Publisher
- Wiley
- Published
- 2008-04-16
- Volume
- 26
- Issue
- 3
- Pages
- 338-344
- ISSN
- 0272-6963 (ISSN-L)
- 1873-1317
- OpenAlex
- W2153954935
- Cited by
- 308
- References
- 23
- FWCI
- 24.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.