The Double-Edged Sword of Big Data in Organizational and Management Research: A Review of Opportunities and Risks
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
While many disciplines embrace the possibilities that Big Data present for advancing scholarship and practice, organizational and management research has yet to realize Big Data’s potential. In an effort to chart this newfound territory, we briefly describe the principal drivers and key characteristics of Big Data. We then review a broad range of opportunities and risks that are related to the Big Data paradigm, the data itself, and the associated analytical methods. For each, we provide research ideas and recommendations on how to embrace the potentials or address the concerns. Our assessment shows that Big Data, as a paradigm, can be a double- edged sword, capable of significantly advancing our field but also causing backlash if not utilized properly. Our review seeks to inform individual research practices as well as a broader policy agenda in order to advance organizational and management research as a scientifically rigorous and professionally relevant field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 1×
“Consequently, there may not be a “method-divide” (Johnson & Onwuegbuzie, 2009) between “small” qualitative and “large” quantitative data sets.”
Business intelligence and analytics: from big data to big impact
Chen, H., Chiang, R. H. L., & Storey, V. C. (2012) · MIS Quarterly · doi:10.2307/41703503 · Cited by 6,250
boyd, D., & Crawford, K. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.678878 · Cited by 5,479
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687 · cited 1×
“However, about 700,000 people were unaware when their social network provider, Facebook, placed positive or negative posts and images in their news feeds to gauge whether this information would affect emotions (Kramer, Guillory, & Hancock, 2014).”
BackgroundThe Increasing Dominance of Teams in Production of Knowledge
Wuchty, S., Jones, B. F., & Uzzi, B. (2007) · Science · doi:10.1126/science.1136099 · Cited by 3,615
Private traits and attributes are predictable from digital records of human behavior
Kosinski, M., Stillwell, D., & Graepel, T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218772110 · Cited by 2,829
Psychological Aspects of Natural Language Use: Our Words, Our Selves
Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145041 · Cited by 2,624 · cited 1×
“For instance, language is self-descriptive, personal, and affect-laden and thus a meaningful marker of personality and cognitions as well as a mediator of social processes as they occur at work (Pennebaker, Mehl, & Niederhoffer, 2003).”
BackgroundDeep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
On making causal claims: A review and recommendations
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010) · The Leadership Quarterly · doi:10.1016/j.leaqua.2010.10.010 · Cited by 2,441
Barrick, M. R., Mount, M. K., & Judge, T. A. (2001) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00160 · Cited by 2,356
Predicting the future with social media
Asur, S., & Huberman, B. A. (2010) · 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology · doi:10.1109/wi-iat.2010.63 · Cited by 2,081
Identity construction on Facebook: Digital empowerment in anchored relationships.
Zhao, S., Grasmuck, S., & Martin, J. (2008) · Computers in Human Behavior · doi:10.1016/j.chb.2008.02.012 · Cited by 1,848
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
Data science and its relationship to big data and data-driven decision making
Provost, F., & Fawcett, T. (2013) · Big Data · doi:10.1089/big.2013.1508 · Cited by 1,568 · cited 1×
“In particular, data that are connected over time lend themselves to craft and test algorithms (i.e., recipe, rubric) that can predict a high outcome score relating to some future behavior or value (Provost & Fawcett, 2013).”
BackgroundChallenges of Big Data analysis
Fan, J., Han, F., & Liu, H. (2014) · National Science Review · doi:10.1093/nsr/nwt032 · Cited by 1,482
The stability of behavior: I. On predicting most of the people much of the time.
Epstein, S. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.7.1097 · Cited by 1,468 · cited 1×
“Creating robust models of such multilevel phenomena requires ample N and p at different levels, or even multiple observations ( p ) of the same occasion or action, which in aggregate outperform any single observation (Epstein, 1979; Fishbein & Ajzen, 1974).”
BackgroundAdjusting for multiple testing when reporting research results: the Bonferroni vs Holm methods.
Aickin, M., & Gensler, H. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.5.726 · Cited by 1,346
Social contagion theory: examining dynamic social networks and human behavior
Christakis, N. A., & Fowler, J. H. (2013) · Statistics in Medicine · doi:10.1002/sim.5408 · Cited by 1,303 · cited 1×
“The sociodemographic and relationship data originally carried as metadata may then be used to adjust entities’ relative contribution to the phenomena of interest (Christakis & Fowler, 2013).”
MethodDigital Inequality: Differences in Young Adults' Use of the Internet
Hargittai, E., & Hinnant, A. (2008) · Communication Research · doi:10.1177/0093650208321782 · Cited by 1,251
Systematic review of the validity and reliability of consumer-wearable activity trackers
Evenson, K. R., Goto, M. M., & Furberg, R. D. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0314-1 · Cited by 1,232
George, G., Haas, M. R., & Pentland, A. (2014) · Academy of Management Journal · doi:10.5465/amj.2014.4002 · Cited by 1,198
Chou, H.-T. G., & Edge, N. (2012) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2011.0324 · Cited by 1,166
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
Big data and its technical challenges.
Jagadish, H. V., Gehrke, J., Labrinidis, A., Papakonstantinou, Y., Patel, J. M., Ramakrishnan, R., & Shahabi, C. (2014) · Communications of the ACM · doi:10.1145/2611567 · Cited by 1,048 · cited 1×
“Despite unprecedented technological progress in many fields, more data are continuously being produced than can be stored, and more data are being stored than can be processed (Jagadish et al., 2014).”
BackgroundSwan, M. (2012) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan1030217 · Cited by 934 · cited 1×
“Data sources essentially emerge from all the technological permutations of systems associated with communication, mobility, production, commerce, and construction (J. Anderson & Rainie, 2014; Swan, 2012).”
Social signal processing: Survey of an emerging domain
Vinciarelli, A., Pantic, M., & Bourlard, H. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.11.007 · Cited by 842
Surveillance, Snowden, and Big Data: Capacities, consequences, critique
Lyon, D. (2014) · Big Data & Society · doi:10.1177/2053951714541861 · Cited by 839
Information-seeking, curiosity, and attention: computational and neural mechanisms
Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.001 · Cited by 784 · cited 1×
“…affective arousal via physiological reactions in employees (e.g., pulse, skin conductance; Becker & Menges, 2013) and information-seeking via visuospatial attention on their computer screens (e.g., eye fixation, gaze patterns; Gottlieb, Oudeyer, Lopes, & Baranes, 2013; Hoffman & Subramaniam, 1995).”
Tufekci, Z. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14517 · Cited by 780
Correlational effect size benchmarks
Bosco, F. A., Aguinis, H., Singh, K., Field, J. G., & Pierce, C. A. (2015) · Journal of Applied Psychology · doi:10.1037/a0038047 · Cited by 768 · cited 2×
“…meta-analytic research demonstrates that the engrained evaluation thresholds of effect sizes “bear almost no resemblance to findings in the field” (Bosco, Aguinis, Field, & Pierce, 2015, p. 439), it is also crucial to contextually construct and rationalize what may be deemed a small, medium,…”
BackgroundMethodInfluential“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734 · cited 1×
“We are not alone in believing such perceptions are flawed and that they negatively affect the advancement of organizational and management scholarship and practice (“A Different Agenda,” 2012; Fanelli, 2010; Hedges, 1987; “In Praise of Soft Science,” 2005).”
BackgroundLanders, R. N., & Behrend, T. S. (2015) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.13 · Cited by 714
Mack, C. A. (2011) · IEEE Transactions on Semiconductor Manufacturing · doi:10.1109/tsm.2010.2096437 · Cited by 658
Unique in the shopping mall: On the reidentifiability of credit card metadata
de Montjoye, Y.-A., Radaelli, L., Singh, V. K., & Pentland, A. “. (2015) · Science · doi:10.1126/science.1256297 · Cited by 570
The Fallacy of Formative Measurement
Edwards, J. R. (2011) · Organizational Research Methods · doi:10.1177/1094428110378369 · Cited by 495
Zwitter, A. (2014) · Big Data & Society · doi:10.1177/2053951714559253 · Cited by 465 · cited 1×
“…physical, and technical safeguards (Altman, Wood, O’Brien, Vadhan, & Gasser, 2015; Dwork & Roth, 2014; Greenwood et al., 2014; Hewson et al., 2013; Information Commissioner’s Office, 2012; Lane et al., 2014; Richards & King, 2014; Stopczynski, Pietri, Pentland, Lazer, & Lehmann, 2014; WEF, 2011).”
Chapter 3 The Two QCAs: From a Small-N to a Large-N Set Theoretic Approach
Greckhamer, T., Misangyi, V. F., & Fiss, P. C. (2013) · Research in the Sociology of Organizations · doi:10.1108/s0733-558x(2013)0000038007 · Cited by 435
Greckhamer, T., Misangyi, V. F., Elms, H., & Lacey, R. (2008) · Organizational Research Methods · doi:10.1177/1094428107302907 · Cited by 399
Affective Arousal as Information: How Affective Arousal Influences Judgments, Learning, and Memory
Storbeck, J., & Clore, G. L. (2008) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2008.00138.x · Cited by 382 · cited 1×
“For instance, the affect as information framework posits that affective arousal influences modes of learning and thinking (Storbeck & Clore, 2008).”
BackgroundIs the coverage of google scholar enough to be used alone for systematic reviews
Gehanno, J.-F., Rollin, L., & Darmoni, S. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-7 · Cited by 357
Designing experiments that generalize
Highhouse, S. (2009) · Organizational Research Methods · doi:10.1177/1094428107300396 · Cited by 353 · cited 1×
“Relatedly, OMS considers randomized experiments to be the gold standard in estimating causal relationships as potential confounding factors equally affect treatment and control groups (Highhouse, 2009).”
BackgroundMyths and fallacies of personally identifiable information
Narayanan, A., & Shmatikov, V. (2010) · Communications of the ACM · doi:10.1145/1743546.1743558 · Cited by 346
Mantua, J., Gravel, N., & Spencer, R. (2016) · Sensors · doi:10.3390/s16050646 · Cited by 314 · cited 1×
“…high for normal step count and sleep duration; however, problems arise at slow walking speeds (under-estimation) and vigorous physical activity (overcounting) as well as for estimating sleep efficiency ( ¼ time in bed/time asleep) (Evenson, Goto, & Furberg, 2015; Mantua, Gravel, & Spencer, 2016).”
BackgroundDaily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits
Bogomolov, A., Lepri, B., Ferron, M., Pianesi, F., & Pentland, A. (. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654933 · Cited by 217
The first twenty years of the Strategic Management Journal
Phelan, S. E., Ferreira, M., & Salvador, R. (2002) · Strategic Management Journal · doi:10.1002/smj.268 · Cited by 131 · cited 1×
“…usual disciplinary boundaries (e.g., computational sciences, physics, media studies) but also exceed the typical size and configuration of research teams (i.e., >1.8 authors per OMS paper; Acedo, Barroso, Casanueva, & Gala´n, 2006; Phelan, Ferreira, & Salvador, 2002; Wuchty, Jones, & Uzzi, 2007).”
BackgroundInfluentialBruns, A. (2013) · First Monday · doi:10.5210/fm.v18i10.4879 · Cited by 86 · cited 3×
“As a result, the act of reporting research that incorporates substantial conceptual, statistical, and computational components may become so complex and extensive that it creates spatial, format, and temporal limitations (Bruns, 2013).”
BackgroundInfluential
Cited by
Vrontis, D., Christofi, M., Pereira, V., Tarba, S., Makrides, A., & Trichina, E. (2022) · The International Journal of Human Resource Management · doi:10.1080/09585192.2020.1871398 · Cited by 1,134
“For example, Wenzel and Van Quaquebeke (2018) review potential opportunities and risks in organizational research based on the central characteristics of Big Data and Giacumo and Breman (2016) analyze the utilization of Big Data in workplace learning.”
BackgroundMeijerink, J., & Bondarouk, T. (2023) · Human Resource Management Review · doi:10.1016/j.hrmr.2021.100876 · Cited by 303
EPM 20/20: A Review, Framework, and Research Agenda for Electronic Performance Monitoring
Ravid, D. M., Tomczak, D. L., White, J. C., & Behrend, T. S. (2020) · Journal of Management · doi:10.1177/0149206319869435 · Cited by 277
Meijerink, J., Boons, M., Keegan, A., & Marler, J. (2021) · The International Journal of Human Resource Management · doi:10.1080/09585192.2021.1925326 · Cited by 267
Big data contributions to human resource management: a systematic review
Garcia-Arroyo, J., & Osca, A. (2021) · The International Journal of Human Resource Management · doi:10.1080/09585192.2019.1674357 · Cited by 118
Metadata
- Authors
- Wenzel, R., & Van Quaquebeke, N.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2017-07-12
- Volume
- 21
- Issue
- 3
- Pages
- 548-591
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2738135550
- Cited by
- 98
- References
- 48
- FWCI
- 10.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.