The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Empirical Elephants—Why Multiple Methods are Essential to Quality Research in Operations and Supply Chain Management
Open accessAbstract
Much like the blind men and the elephant, researchers in the field of operations and supply chain management (OSCM) often study natural phenomena (business processes are our "elephants") using widely varied perspectives. Though we seek objectivity, each of us is prone to form an attachment to a given perspective, influenced by our training and by the perspectives of our mentors and peers. As editors, numerous conversations with researchers have given us cause to be concerned that there is a tendency in the academic community to discount the findings of others who are using their different "senses" (research methods) to examine various parts of the elephant. In this editorial, we take the opportunity to briefly review a variety of research methodologies. It is our strong belief that multiple approaches are required in order to develop a holistic understanding of operations and supply chain management phenomena. Only by being open to reading, digesting and synthesizing multiple perspectives can we get a true picture of the elephant. For a couple of reasons, we limit our comments to address only empirical research methods. First, while recognizing that modeling and purely analytical techniques have produced large advances in OSCM, we also take the position that the study of OSCM is a social science. Research in OSCM is more than problem solving; it is the study of business processes with the objective of developing theories that explain them. Business processes contain both natural and social phenomena. As such, while systems and decisions affecting business processes can be modeled, examinations of empirical data are crucial for the development and validation of models. It is especially important that we uncover the often complex social and behavioral elements involved in OSCM. Biological sciences can explain the universal characteristics of an elephant, but in practice different elephants have personalities and individual characteristics that must be observed in order to be understood. A second reason for limiting this discussion to empirical methods is the fact that the Journal of Operations Management is entirely dedicated to the publication of theory-driven, empirical research. The JOM is the only OM journal stating such a focused mission, and we are committed to it. At the same time, we would not want the journal to become too focused in terms of the empirical methodologies employed. We want to encourage research employing a wide range of perspectives and methods. In the following paragraphs we very briefly examine the benefits and limitations of several broad methodological approaches, including primary data collection (survey, case, experiments) and secondary data collection. This is clearly not an exhaustive guide or comparison of empirical techniques. There are numerous resources for this, including the recent article by Roth (2007). Our goal is to remind readers that every approach has good and bad points. There is no universally superior methodology. In the discussion we also present several recent or forthcoming JOM articles that exemplify each approach. Finally, we discuss potential synergies between the various approaches which can provide a holistic view of the elephant. Following the seminal work of Flynn et al. (1990), there has been a notable growth in empirical research generally, and in survey-based research in particular. While Flynn et al. (1990) provided an overview of numerous empirical techniques, their work focused on survey-based research. Survey research is a common methodological approach in the fields of management and marketing, with well-established protocols that are summarized by Flynn et al. (1990) and many others. The question is not whether survey-based research is appropriate, but when is it appropriate? A survey provides a low cost, non-invasive means for measuring aspects of an operational or supply chain issue. Measures included in a survey can be designed to target specific factors or attributes which may not be directly observable. For example, many behavioral variables affecting an operational process are "latent," and can be assessed only via perceptual measures. Moreover, even directly observable attributes are often not measured by organizations, either because they are not of interest or because they cannot be measured in a cost effective manner. Frequently, measures that are published by organizations do not report data at the needed unit of analysis. For example, measures of costs or sales at the plant or lower levels are not typically available from published sources. Via a survey, data can be collected directly from the individual or unit directly responsible for managing a certain operation of interest. Much of the controversy surrounding surveys has to do with the use of perceptual measures. The use of perceptual measures is not necessarily wrong. In fact, they may be necessitated by the nature of the variable of interest. This is clearly the case when var
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1984) · Cited by 81,983
Case Study Research: Design and Methods
Chaiklin, H. (1991) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199102000-00025 · Cited by 39,535
Building theories from case study research
Eisenhardt, K. M. (2009) · STUDI ORGANIZZATIVI · doi:10.3280/so2008-002004 · Cited by 11,299
Building operations management theory through case and field research
Meredith, J. (1998) · Journal of Operations Management · doi:10.1016/s0272-6963(98)00023-0 · Cited by 1,657
Empirical research methods in operations management
Flynn, B. B., Sakakibara, S., Schroeder, R. G., Bates, K. A., & Flynn, E. J. (1990) · Journal of Operations Management · doi:10.1016/0272-6963(90)90098-x · Cited by 1,634
The effect of supply chain glitches on shareholder wealth
Hendricks, K. B., & Singhal, V. R. (2003) · Journal of Operations Management · doi:10.1016/j.jom.2003.02.003 · Cited by 1,074
Creating supply chain relational capital: The impact of formal and informal socialization processes
Cousins, P. D., Handfield, R. B., Lawson, B., & Petersen, K. J. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2005.08.007 · Cited by 537
Wu, Z., & Choi, T. Y. (2005) · Journal of Operations Management · doi:10.1016/j.jom.2005.02.001 · Cited by 385
Building Theory from Case Study Research
(2016) · Case Study Research · doi:10.1108/978-1-78560-461-420152014 · Cited by 264
Toward a theory of competencies for the management of product complexity: Six case studies
Closs, D. J., Jacobs, M. A., Swink, M., & Webb, G. S. (2008) · Journal of Operations Management · doi:10.1016/j.jom.2007.10.003 · Cited by 207
Self-citationA behavioral study of supply manager decision‐making: Factors influencing make versus buy evaluation
Mantel, S. P., Tatikonda, M. V., & Liao, Y. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2005.09.007 · Cited by 168
Moderating effects of information access on project management behavior, performance and perceptions
Bendoly, E., & Swink, M. L. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2006.02.009 · Cited by 154
Self-citationStrengthening the Empirical Base of Operations Management
Fisher, M. (2007) · Manufacturing & Service Operations Management · doi:10.1287/msom.1070.0168 · Cited by 153
Customer Behavior in an Online Ordering Application: A Decision Scoring Model*
Boyer, K. K., & Hult, G. T. M. (2005) · Decision Sciences · doi:10.1111/j.1540-5414.2005.00103.x · Cited by 150
Self-citationShah, R., & Shin, H. (2007) · Journal of Operations Management · doi:10.1016/j.jom.2007.01.011 · Cited by 133 · cited 1×
“Shah and Shin (2007) use data collected from Bureau of Economic Analysis at the U.S.”
MethodProcess drivers of e‐service quality: Analysis of data from an online rating site
Heim, G. R., & Field, J. M. (2007) · Journal of Operations Management · doi:10.1016/j.jom.2006.10.002 · Cited by 118
Carter, C. R., & Stevens, C. K. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2006.10.005 · Cited by 110
Understanding behavioral sources of process variation following enterprise system deployment
Bendoly, E., & Cotteleer, M. J. (2007) · Journal of Operations Management · doi:10.1016/j.jom.2007.03.002 · Cited by 109
Rabinovich, E., Knemeyer, A. M., & Mayer, C. M. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2006.05.012 · Cited by 106
Applications of Empirical Science in Manufacturing and Service Operations
Roth, A. V. (2007) · Manufacturing & Service Operations Management · doi:10.1287/msom.1070.0197 · Cited by 101
The use of bundling in B2B online reverse auctions
Schoenherr, T., & Mabert, V. A. (2007) · Journal of Operations Management · doi:10.1016/j.jom.2007.05.001 · Cited by 82
Action variety of planners: Cognitive load and requisite variety
Fransoo, J. C., & Wiers, V. C. S. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2005.09.008 · Cited by 70
A video method for empirically studying wait‐perception bias
Seawright, K. K., & Sampson, S. E. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2006.10.006 · Cited by 55
Cited by
Ensuring Supply Chain Resilience: Development and Implementation of an Assessment Tool
Pettit, T. J., Croxton, K. L., & Fiksel, J. (2013) · Journal of Business Logistics · doi:10.1111/jbl.12009 · Cited by 1,080
Dubey, R., Gunasekaran, A., Childe, S. J., Fosso Wamba, S., Roubaud, D., & Foropon, C. (2021) · International Journal of Production Research · doi:10.1080/00207543.2019.1582820 · Cited by 958
CORPORATE SOCIAL RESPONSIBILITY REPORTS: A THEMATIC ANALYSIS RELATED TO SUPPLY CHAIN MANAGEMENT
TATE, W. L., ELLRAM, L. M., & KIRCHOFF, J. F. (2010) · Journal of Supply Chain Management · doi:10.1111/j.1745-493x.2009.03184.x · Cited by 679
Dubey, R., Gunasekaran, A., Bryde, D. J., Dwivedi, Y. K., & Papadopoulos, T. (2020) · International Journal of Production Research · doi:10.1080/00207543.2020.1722860 · Cited by 672
The role of Big Data in explaining disaster resilience in supply chains for sustainability
Papadopoulos, T., Gunasekaran, A., Dubey, R., Altay, N., Childe, S. J., & Fosso-Wamba, S. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.03.059 · Cited by 646
Metadata
- Authors
- Boyer, K. K., & Swink, M. L.
- Venue
- Journal of Operations Management
- Publisher
- Wiley
- Published
- 2008-04-16
- Volume
- 26
- Issue
- 3
- Pages
- 338-344
- ISSN
- 0272-6963 (ISSN-L)
- 1873-1317
- OpenAlex
- W2153954935
- Cited by
- 308
- References
- 23
- FWCI
- 24.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.