The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Text Mining in Organizational Research
Open accessAbstract
Despite the ubiquity of textual data, so far few researchers have applied text mining to answer organizational research questions. Text mining, which essentially entails a quantitative approach to the analysis of (usually) voluminous textual data, helps accelerate knowledge discovery by radically increasing the amount data that can be analyzed. This article aims to acquaint organizational researchers with the fundamental logic underpinning text mining, the analytical stages involved, and contemporary techniques that may be used to achieve different types of objectives. The specific analytical techniques reviewed are (a) dimensionality reduction, (b) distance and similarity computing, (c) clustering, (d) topic modeling, and (e) classification. We describe how text mining may extend contemporary organizational research by allowing the testing of existing or new research questions with data that are likely to be rich, contextualized, and ecologically valid. After an exploration of how evidence for the validity of text mining output may be generated, we conclude the article by illustrating the text mining process in a job analysis setting using a dataset composed of job vacancies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Jolliffe, I. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa501 · Cited by 14,310
Jain, A. K., Murty, M. N., & Flynn, P. J. (1999) · ACM Computing Surveys · doi:10.1145/331499.331504 · Cited by 13,199
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096 · cited 1×
“A popular stemming algorithm was developed by Porter (Porter, 1980; Willett, 2006).”
MethodMining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 1×
“Singular value decomposition (SVD) is a classic tool that underlies techniques such as latent semantic analysis (Landauer, Foltz, & Laham, 1998) and principal component analysis (PCA; Jolliffe, 2005).”
MethodA Comparative Study on Feature Selection in Text Categorization
Yang, Y., & Pedersen, J. (1997) · Cited by 4,790
Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis
Hayton, J. C., Allen, D. G., & Scarpello, V. (2004) · Organizational Research Methods · doi:10.1177/1094428104263675 · Cited by 3,104
Information Retrieval: Data Structures and Algorithms
Frakes, W. B., & Baeza-Yates, R. A. (1992) · Cited by 2,757
An extensive empirical study of feature selection metrics for text classification
Forman, G. (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944974 · Cited by 2,394
Structural Topic Models for Open‐Ended Survey Responses
Roberts, M. E., Stewart, B. M., Tingley, D., Lucas, C., Leder‐Luis, J., Gadarian, S. K., Albertson, B., & Rand, D. G. (2014) · American Journal of Political Science · doi:10.1111/ajps.12103 · Cited by 1,952
Mining the peanut gallery: opinion extraction and semantic classification of product reviews
Dave, K., Lawrence, S., & Pennock, D. M. (2003) · Proceedings of the twelfth international conference on World Wide Web - WWW '03 · doi:10.1145/775152.775226 · Cited by 1,916
THE APPLICATION OF EXPLORATORY FACTOR ANALYSIS IN APPLIED PSYCHOLOGY: A CRITICAL REVIEW AND ANALYSIS
FORD, J. K., MacCALLUM, R. C., & TAIT, M. (1986) · Personnel Psychology · doi:10.1111/j.1744-6570.1986.tb00583.x · Cited by 1,732
The singular value decomposition: Its computation and some applications
Klema, V., & Laub, A. (1980) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1980.1102314 · Cited by 1,631
Random projection in dimensionality reduction: applications to image and text data
Bingham, E., & Mannila, H. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502546 · Cited by 1,274
Effectiveness of training in organizations: A meta-analysis of design and evaluation features.
Arthur, W., Bennett, W., Edens, P. S., & Bell, S. T. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.2.234 · Cited by 1,252
George, G., Haas, M. R., & Pentland, A. (2014) · Academy of Management Journal · doi:10.5465/amj.2014.4002 · Cited by 1,198
Corpus-based and Knowledge-based Measures of Text Semantic Similarity
Mihalcea, R. F., Corley, C. D., & Strapparava, C. (2006) · University of North Texas Digital Library (University of North Texas) · Cited by 1,194
Handbook of Natural Language Processing
(2010) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420085938 · Cited by 1,092
A correlated topic model of Science
Blei, D. M., & Lafferty, J. (2018) · doi:10.1184/r1/6587330.v1 · Cited by 1,088
An Introduction to Machine Learning
Kubat, M. (2015) · Springer eBooks · doi:10.1007/978-3-319-20010-1 · Cited by 1,007
A correlated topic model of Science
Blei, D. M., & Lafferty, J. D. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas114 · Cited by 953
A density-based method for adaptive LDA model selection
Cao, J., Xia, T., Li, J., Zhang, Y., & Tang, S. (2009) · Neurocomputing · doi:10.1016/j.neucom.2008.06.011 · Cited by 880
Personality and Charisma in the U.S. Presidency: A Psychological Theory of Leader Effectiveness
House, R. J., Spangler, W. D., & Woycke, J. (1991) · Administrative Science Quarterly · doi:10.2307/2393201 · Cited by 870
Evaluation methods for topic models
Wallach, H. M., Murray, I., Salakhutdinov, R., & Mimno, D. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553515 · Cited by 863
A Survey of Text Classification Algorithms
Aggarwal, C. C., & Zhai, C. (2012) · Mining Text Data · doi:10.1007/978-1-4614-3223-4_6 · Cited by 842
Phan, X.-H., Nguyen, L.-M., & Horiguchi, S. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367510 · Cited by 740
On Finding the Natural Number of Topics with Latent Dirichlet Allocation: Some Observations
Arun, R., Suresh, V., Veni Madhavan, C. E., & Narasimha Murthy, M. N. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13657-3_43 · Cited by 719
A Survey of Text Mining Techniques and Applications
Gupta, V., & Lehal, G. S. (2009) · Journal of Emerging Technologies in Web Intelligence · doi:10.4304/jetwi.1.1.60-76 · Cited by 699
Short, J. C., Broberg, J. C., Cogliser, C. C., & Brigham, K. H. (2010) · Organizational Research Methods · doi:10.1177/1094428109335949 · Cited by 644
Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers
Yarkoni, T. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.04.001 · Cited by 637
Feature selection and feature extraction for text categorization
Lewis, D. D. (1992) · Proceedings of the workshop on Speech and Natural Language - HLT '91 · doi:10.3115/1075527.1075574 · Cited by 578
Feature selection for text classification with Naïve Bayes
Chen, J., Huang, H., Tian, S., & Qu, Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.06.054 · Cited by 576
Supervised and Traditional Term Weighting Methods for Automatic Text Categorization
Lan, M., Tan, C. L., Su, J., & Lu, Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.110 · Cited by 562
Fast collapsed gibbs sampling for latent dirichlet allocation
Porteous, I., Newman, D., Ihler, A., Asuncion, A., Smyth, P., & Welling, M. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401960 · Cited by 560
Extracting Product Features and Opinions from Reviews
Popescu, A.-M., & Etzioni, O. (2007) · Natural Language Processing and Text Mining · doi:10.1007/978-1-84628-754-1_2 · Cited by 494
Natural Language Processing and Text Mining
(2007) · Springer eBooks · doi:10.1007/978-1-84628-754-1 · Cited by 474
The Porter stemming algorithm: then and now
Willett, P. (2006) · Program · doi:10.1108/00330330610681295 · Cited by 406
Olston, C., & Najork, M. (2010) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000017 · Cited by 370
Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases.
Binning, J. F., & Barrett, G. V. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.3.478 · Cited by 344
Feature Engineering for Text Classification
Scott, S., & Matwin, S. (1999) · Cited by 307
Development and Content Validation of a "Hyperdimensional" Taxonomy of Managerial Competence
Tett, R. P., Guterman, H. A., Bleier, A., & Murphy, P. J. (2000) · Human Performance · doi:10.1207/s15327043hup1303_1 · Cited by 296
Montanelli, R. G., & Humphreys, L. G. (1976) · Psychometrika · doi:10.1007/bf02293559 · Cited by 268
Text classification based on multi-word with support vector machine
Zhang, W., Yoshida, T., & Tang, X. (2008) · Knowledge-Based Systems · doi:10.1016/j.knosys.2008.03.044 · Cited by 265
The data warehouse and data mining
Inmon, W. H. (1996) · Communications of the ACM · doi:10.1145/240455.240470 · Cited by 260
A Concept-Driven Algorithm for Clustering Search Results
Osiński, S., & Weiss, D. (2005) · IEEE Intelligent Systems · doi:10.1109/mis.2005.38 · Cited by 253
Seeing the whole in parts: text summarization for web browsing on handheld devices
Buyukkokten, O., Garcia-Molina, H., & Paepcke, A. (2001) · Proceedings of the 10th international conference on World Wide Web · doi:10.1145/371920.372178 · Cited by 252
Text mining for product attribute extraction
Ghani, R., Probst, K., Liu, Y., Krema, M., & Fano, A. (2006) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1147234.1147241 · Cited by 242
Social and cognitive sources of potential inaccuracy in job analysis.
Morgeson, F. P., & Campion, M. A. (1997) · Journal of Applied Psychology · doi:10.1037//0021-9010.82.5.627 · Cited by 215
N-Gram Feature Selection for Authorship Identification
Houvardas, J., & Stamatatos, E. (2006) · Lecture Notes in Computer Science · doi:10.1007/11861461_10 · Cited by 199
McKenny, A. F., Short, J. C., & Payne, G. T. (2013) · Organizational Research Methods · doi:10.1177/1094428112459910 · Cited by 193
Yu, C. H., Jannasch-Pennell, A. K., & DiGangi, S. A. (2014) · The Qualitative Report · doi:10.46743/2160-3715/2011.1085 · Cited by 157
Supporting Systematic Reviews Using Text Mining
Ananiadou, S., Rea, B., Okazaki, N., Procter, R., & Thomas, J. (2009) · Social Science Computer Review · doi:10.1177/0894439309332293 · Cited by 144
Ethical issues in web data mining
van Wel, L., & Royakkers, L. (2004) · Ethics and Information Technology · doi:10.1023/b:etin.0000047476.05912.3d · Cited by 143
Holton, C. F. (2008) · Decision Support Systems · doi:10.1016/j.dss.2008.11.013 · Cited by 142
The Rise and Fall of Job Analysis and the Future of Work Analysis
Sánchez, J. I., & Levine, E. L. (2011) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100401 · Cited by 142
Big data in psychology: Introduction to the special issue.
Harlow, L. L., & Oswald, F. L. (2016) · Psychological Methods · doi:10.1037/met0000120 · Cited by 131
An Empirical Comparison of Four Text Mining Methods
Lee, S., Baker, J., Song, J., & Wetherbe, J. C. (2010) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2010.48 · Cited by 127
Text Classification for Organizational Researchers: A Tutorial
Kobayashi, V., Mol, S. T., Berkers, H. A., Kismihók, G., & Hartog, D. N. D. (2017) · Organizational Research Methods · doi:10.1177/1094428117719322 · Cited by 127
Self-citationMeasuring motive imagery contained in the vision statement
Kirkpatrick, S. A., Wofford, J. C., & Baum, J. R. (2002) · The Leadership Quarterly · doi:10.1016/s1048-9843(02)00096-6 · Cited by 121
Morgeson, F. P., Delaney‐Klinger, K., Mayfield, M. S., Ferrara, P., & Campion, M. A. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.4.674 · Cited by 108
International Journal of Computers and Communications
(2022) · International Journal of Computers and Communications · doi:10.46300/91013 · Cited by 99
Zhang, Y., Chen, M., & Liu, L. (2015) · IEEE International Conference on Software Engineering and Service Science (ICSESS) · doi:10.1109/icsess.2015.7339149 · Cited by 96
Work analysis: From technique to theory.
Morgeson, F. P., & Dierdorff, E. C. (2010) · American Psychological Association eBooks · doi:10.1037/12170-001 · Cited by 93
Content analysis of OR job advertisements to infer required skills
Sodhi, M. S., & Son, B.-G. (2009) · Journal of the Operational Research Society · doi:10.1057/jors.2009.80 · Cited by 87
Analyzing the history of Cognition using Topic Models
Priva, U. C., & Austerweil, J. L. (2014) · Cognition · doi:10.1016/j.cognition.2014.11.006 · Cited by 84
Vo, D.-T., & Ock, C.-Y. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.09.031 · Cited by 76
A comparative study on text representation schemes in text categorization
Song, F., Liu, S., & Yang, J. (2005) · Pattern Analysis and Applications · doi:10.1007/s10044-005-0256-3 · Cited by 72
Analyzing Computer Programming Job Trend Using Web Data Mining
Smith, D. T., & Ali, A. (2014) · Issues in Informing Science and Information Technology · doi:10.28945/1989 · Cited by 56
LINKING O*NET JOB ANALYSIS INFORMATION TO JOB REQUIREMENT PREDICTORS: AN O*NET APPLICATION
Jeanneret, P. R., & STRONG, M. H. (2003) · Personnel Psychology · doi:10.1111/j.1744-6570.2003.tb00159.x · Cited by 50
Verwaeren, B., Hoye, G. V., & Baeten, X. (2016) · The International Journal of Human Resource Management · doi:10.1080/09585192.2016.1138989 · Cited by 40
Inmon, W. H., & Nesavich, A. (2007) · Cited by 39
SYNTHETIC VALIDITY: PAST, PRESENT, AND FUTURE
Scherbaum, C. A. (2005) · Personnel Psychology · doi:10.1111/j.1744-6570.2005.00547.x · Cited by 39
EFFECTS OF DESCRIPTOR SPECIFICITY AND OBSERVABILITY ON INCUMBENT WORK ANALYSIS RATINGS
Dierdorff, E. C., & Morgeson, F. P. (2009) · Personnel Psychology · doi:10.1111/j.1744-6570.2009.01151.x · Cited by 39
The Blackwell Handbook of Personnel Selection
(2006) · Personnel Psychology · doi:10.1111/j.1744-6570.2006.00052_4.x · Cited by 28
Innovations in job analysis: Development and application of metrics to analyze job data
McEntire, L. E., Dailey, L. R., Osburn, H. K., & Mumford, M. D. (2006) · Human Resource Management Review · doi:10.1016/j.hrmr.2006.05.004 · Cited by 25
Text mining for efficient search and assisted creation of clinical trials
Korkontzelos, I., Mu, T., Restificar, A. C., & Ananiadou, S. (2011) · Data and Text Mining in Bioinformatics · doi:10.1145/2064696.2064706 · Cited by 14
Applying Topic Modeling to Forensic Data
de Waal, A., Venter, J. D., & Barnard, E. (2008) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/978-0-387-84927-0_10 · Cited by 9
Text mining of personal communication
Jonsson, H., Nugues, P., Bach, C., & Gunnarsson, J. (2010) · International Conference on Intelligence in Next Generation Networks · doi:10.1109/icin.2010.5640938 · Cited by 7
Cited by
Sustainable careers: Towards a conceptual model
De Vos, A., Van der Heijden, B. I. J. M., & Akkermans, J. (2020) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2018.06.011 · Cited by 1,010
Text Preprocessing for Text Mining in Organizational Research: Review and Recommendations
Hickman, L., Thapa, S., Tay, L., Cao, M., & Srinivasan, P. (2022) · Organizational Research Methods · doi:10.1177/1094428120971683 · Cited by 362
Artificial intelligence and the conduct of literature reviews
Wagner, G., Lukyanenko, R., & Paré, G. (2022) · Journal of Information Technology · doi:10.1177/02683962211048201 · Cited by 296
#Trending topics in careers: a review and future research agenda
Akkermans, J., & Kubasch, S. (2017) · Career Development International · doi:10.1108/cdi-08-2017-0143 · Cited by 262
Industry 4.0: Emerging themes and future research avenues using a text mining approach
Galati, F., & Bigliardi, B. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.04.018 · Cited by 257
Metadata
- Authors
- Kobayashi, V. B., Mol, S. T., Berkers, H. A., Kismihók, G., & Den Hartog, D. N.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2017-08-10
- Volume
- 21
- Issue
- 3
- Pages
- 733-765
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2743671341
- Cited by
- 275
- References
- 84
- FWCI
- 87.52
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.