Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory?
Abstract
The authors analyzed for content all empirical articles from 1966, 1970, and 1974 volumes of Journal of Applied Psychology, Organizational Behavior and Human Performance, and Personnel Psychology to determine types of organizations, subjects, and dependent measures studied. Contrary to common belief that field settings provide for more generalisation of research findings than settings do, field research appeared as narrow as research in actors, settings, and behaviors sampled. Indeed, industrial-organisational psychology seems to be developing in a psychology of college student, and in field, a psychology of self-report of male, professional, technical, and managerial employees in productiveeconomic organizations. The authors suggest that coordinated strategies of research in both and field settings are needed to construct an externally valid industrial and organizational psychology. Should industrial and organizational psychologists conduct their research in settings? For many industrial and organizational psychologists, answer to this question would be an emphatic no, but others would defend as a legitimate setting for research (Fromkin & Streufert, 1976; Weick, 196S). The relative merits of and field settings have been debated within many areas of psychology, including comparative psychology (Miller, 1977), environmental psychology (Proshansky, 1976), social psychology (Ellsworth, 1977; McGuire, 1967; Ring, 1967), race relations (Fromkin & Ostrom, 1974), and perception (Gibson, 1966). Two common criticisms of research are that settings are susceptible to experimental artifacts (Rosenthai & Rosnow, 1969; Silverman, 1977) and .serious ethical problems (Kelman, 1967). Although these two criticisms have been debated in numerous articles and have not been resolved entirely, Fromkin and Streufert have argued persuasively that artifacts and ethical problems also exist in field settings and are not unique to laboratory. A third criticism of research is that artificiality of imposes severe restraints on external validity of findings. Even those critics who concede that settings provide for more elimination of alternative interpretations of results than typical field settings do are often doubtful that one can generalize findings from to predict, understand, or control real-world phenomena. A perusal of recent Handbook of Industrial and Organizational Psychology (Dunnette, 1976) reveals differences of opinion that exist among industrial and organizational psychologists with regard to generalizability of research. Ohapanis (1976) observed that most experiments in psychology have only very limited relevance for solution of practical Vol. 34, No. 2, 141-150 Portions of this article were presented at meeting of Midwestern Psychological Association, Chicago, May 1977. The authors' names are listed in alphabetical order, reflecting equal contributions by both to design, implementation, analysis, and writing of this study. The authors thank John Dzamba, Claude Mattox, Brian Robinson, and William Wratten for their assistance with data analysis. Requests for reprints should be sent to Robert L. Dipboye, Rice University, Department of Psychology, Houston, Texas 77001. AMERICAN PSYCHOLOGIST • FEBRUARY 1979 • 141 Copyright 1979 by American Psychological Association, Inc. 0003-066X/79/3402-0141$00.75 problems. . . . Unsuspected interactions in real life may nullify or even reverse conclusions reached in (p. 730). Similarly, Bouchard (1976) observed that laboratory experiments seldom deal adequately with boundary conditions or context factors and therefore, lend themselves to unjustified and often erroneous extrapolations (p. 364). In contrast with these arguments, Fromkin and Streufert (1976) argued that the artificiality of laboratories is being unjustly elevated to status of a fatal flaw (p. 433). Furthermore, they asserted that instead of reinforcing myth that settings seldom yield data which are relevant to real world problems, it is proposed that settings merely impose identifiable limitations upon range of criterion situations to which a particular set of findings may be practically applied, (p. 442) Despite firm convictions held by proponents and critics, many of arguments for and against external validity of research are based on stereotypes rather than data. One such stereotype has been that a field setting, because it is natural to subject and not contrived, automatically provides for more generalization of results than an artificial setting does. However, problem of external validity is one of making inferences not only from settings but from actors and behaviors of these actors (Runkel & McGrath, 1972). Critics of research often place inordinate weight on setting, in discussions of external validity, to neglect of actors and their behavior. For instance, some have assumed that because setting in field research is typically an actual organization, data collected in such a setting must be more generalizable to other
Cites (22)
- Untitled work1963 · Medical Entomology and Zoology
- The Social Psychology of Organizations.Hackman, J. Richard, Katz, Daniel, Kahn, Robert L. · 1979 · Administrative Science Quarterly
- Handbook of Industrial and Organizational Psychology.Hammer, Tove Helland, Anderson, John, Gurdon, Michael, Jick, Todd, Petit, Andre, Stern, Robert, Schwartz, Howard, Vardi, Yoav, Dunnette, Marvin D. · 1977 · Administrative Science Quarterly
- The Senses Considered as Perceptual SystemsWest, Charles K., Gibson, James J. · 1969 · Journal of Aesthetic Education
- Obedience to Authority: An Experimental View.Wenglinsky, Martin, Milgram, Stanley · 1975 · Contemporary Sociology
- Artifact in behavioral researchRobert Rosenthal, Ralph L. Rosnow · 1969 · Medical Entomology and Zoology
- Where is the person in personality research?Carlson, Rae · 1971 · Psychological Bulletin
- Human use of human subjects: The problem of deception in social psychological experiments.Kelman, Herbert C. · 1967 · Psychological Bulletin
- Experimental social psychology: Some sober questions about some frivolous valuesRing, Kenneth · 1967 · Journal of Experimental Social Psychology
- Research on Human Behavior: A Systematic Guide to MethodMillman, Jason, Runkel, Philip J., McGrath, Joseph E. · 1973 · American Educational Research Journal
Cited by (24)
- Self-Reports in Organizational Research: Problems and ProspectsPodsakoff, Philip M., Organ, Dennis W. · 1986 · Journal of Management
- Voice and cooperative behavior as contrasting forms of contextual performance: Evidence of differential relationships with Big Five personality characteristics and cognitive ability.Jeffery A. LePine, Linn Van Dyne · 2001 · Journal of Applied Psychology
- An inconvenient truth: Arbitrary distinctions between organizational, mechanical Turk, and other convenience samplesLanders, Richard N., Behrend, Tara S. · 2015 · Industrial and Organizational Psychology
- Bridging faultlines by valuing diversity: Diversity beliefs, information elaboration, and performance in diverse work groups.Homan, Astrid C., van Knippenberg, Daan, Van Kleef, Gerben A., De Dreu, Carsten K. W. · 2007 · Journal of Applied Psychology
- Cambridge Handbook of Experimental Political Science2011 · Cambridge University Press eBooks
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory? https://app.cochat.ai/papers/10.1037//0003-066x.34.2.141
- The paper
- Dipboye, R. L., & Flanagan, M. F. (1979). Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory? American Psychologist. https://doi.org/10.1037//0003-066x.34.2.141
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.