Longitudinal Research: The Theory, Design, and Analysis of Change

Ployhart, Robert E.; Vandenberg, Robert J.

doi:10.1177/0149206309352110

Cited by 1,496Statistical Methods and Bayesian InferenceBusiness Strategies and Management ResearchBusiness and Management Studies

Longitudinal Research: The Theory, Design, and Analysis of Change

Ployhart, Robert E., Vandenberg, Robert J.·2010·Journal of Management

DOI 10.1177/0149206309352110

Open this paper in CoChat — free account

Abstract

The purpose of this article is to present cutting-edge research on issues relating to the theory, design, and analysis of change. Rather than a highly technical review, our goal is to provide management scholars with a relatively nontechnical single source useful for helping them develop and evaluate longitudinal research. Toward that end, we provide readers with “checklists” of issues to consider when theorizing and designing a longitudinal study. We also discuss the trade-offs among analytic strategies (repeated measures general linear model, random coefficient modeling, and latent growth modeling), circumstances in which such methods are most appropriate, and ways to analyze data when one is using each approach.

Integrity signals

Registry

Crossref · 10.1177/0149206309352110

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

It is possible to find relationships observed cross-sectionally to be in direct contrast to relationships observed across time.
“It is possible to find relationships observed cross-sectionally to be in direct contrast to relationships observed across time (Ployhart & Vandenberg, 2010).”
From Psychological Processes Underlying the Impact of Gender-Related Discrimination on Psychological Distress in Transgender and Gender Nonconforming People. (2019) · cites this paper as Ployhart & Vandenberg, 2010
Longitudinal studies allow for causal conclusions to be drawn.
“This is why it is reasonable to design a research project that includes longitudinal studies, which record the process of change over time [20], allowing for causal conclusions to be drawn [21].”
From The Entry of Autistic University Graduates into the Labor Market in the Era of Generative AI: Their Concerns and Strategies Regarding the Technology. Research in Progress: The Entry of Autistic Graduates into the Labor Market in the Era of GenAI (2026) · cites this paper as [21]
Two waves of measurement are not considered longitudinal studies.
“Note that two waves of measurement are not considered longitudinal studies [82,83].”
From What Do We Mean When We Talk about Trust in Social Media? A Systematic Review (2023) · cites this paper as [83]

Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,768 · see citing works
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,384 · see citing works
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,820 · see citing works
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638 · see citing works
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187 · see citing works
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647 · see citing works
SAS System for Mixed Models
Littell, R. C. (1996) · Medical Entomology and Zoology · Cited by 10,345 · see citing works
Inference and missing data
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925 · see citing works
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278 · see citing works
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539 · see citing works
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473 · see citing works
A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · see citing works
Self-citation
Book Reviews: Keppel, Geoffrey. Design and Analysis: A Researcher’s Handbook . Englewood Cliffs, N. J.: Prentice Hall, 1973. 658 + xiii pp. $13.95
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,857 · see citing works
Introduction to Statistical Mediation Analysis
MacKinnon, D. P. (2012) · doi:10.4324/9780203809556 · Cited by 5,618 · see citing works
Experimental Design: Procedures for the Behavioral Sciences.
Addelman, S., & Kirk, R. E. (1969) · Journal of the American Statistical Association · doi:10.2307/2283497 · Cited by 5,241 · see citing works
Academy of Management Journal
Ireland, R. D., Elfring, T., & Hmieleski, K. M. (2011) · Edward Elgar Publishing eBooks · doi:10.4337/9781849807630.00017 · Cited by 4,777 · see citing works
The dynamic resource‐based view: capability lifecycles
Helfat, C. E., & Peteraf, M. A. (2003) · Strategic Management Journal · doi:10.1002/smj.332 · Cited by 4,553 · see citing works
Bias in cross-sectional analyses of longitudinal mediation
Maxwell, S. E., & Cole, D. A. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.23 · Cited by 3,401 · see citing works
Negative Self-Efficacy and Goal Effects Revisited
Bandura, A., & Locke, E. A. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.1.87 · Cited by 2,813 · see citing works
Toward a theory of organizational socialization
Maanen, J. V., & Schein, E. H. (1977) · Cited by 2,808 · see citing works
How we should measure "change": Or should we?
Cronbach, L. J., & Furby, L. (1970) · Psychological Bulletin · doi:10.1037/h0029382 · Cited by 2,456 · see citing works
Book Review: Design and Analysis: A Researcher's Handbook
Aaker, D. A., & Keppel, G. (1976) · Journal of Marketing Research · doi:10.2307/3150757 · Cited by 2,033 · see citing works
Latent Curve Models
Bollen, K. A., & Curran, P. J. (2005) · Wiley series in probability and statistics · doi:10.1002/0471746096 · Cited by 1,731 · see citing works
SOCIALIZATION TACTICS, SELF-EFFICACY, AND NEWCOMERS' ADJUSTMENTS TO ORGANIZATIONS.
Jones, G. R. (1986) · Academy of Management Journal · doi:10.2307/256188 · Cited by 1,560 · see citing works
Application of hierarchical linear models to assessing change.
Bryk, A. S., & Raudenbush, S. W. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.1.147 · Cited by 1,505 · see citing works
Latent Curve Analysis
Meredith, W. H., & Tisak, J. (1990) · Psychometrika · doi:10.1007/bf02294746 · Cited by 1,491 · see citing works
Latent Curve Models: A Structural Equation Perspective
Horan, P. M. (2006) · Contemporary Sociology A Journal of Reviews · doi:10.1177/009430610603500650 · Cited by 1,214 · see citing works
Using SAS PROC MIXED to Fit Multilevel Models, Hierarchical Models, and Individual Growth Models
Singer, J. D. (1998) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165280 · Cited by 1,092 · see citing works
A growth curve approach to the measurement of change.
Rogosa, D., Brandt, D., & Zimowski, M. F. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.726 · Cited by 1,084 · see citing works
Building Better Theory: Time and The Specification of When Things Happen
Mitchell, T. R., & James, L. R. (2001) · Academy of Management Review · doi:10.5465/amr.2001.5393889 · Cited by 976 · see citing works
On structural equation modeling with data that are not missing completely at random
Muthén, B., Kaplan, D., & Hollis, M. (1987) · Psychometrika · doi:10.1007/bf02294365 · Cited by 883 · see citing works
Growth Modeling Using Random Coefficient Models: Model Building, Testing, and Illustrations
Bliese, P. D., & Ployhart, R. E. (2002) · Organizational Research Methods · doi:10.1177/109442802237116 · Cited by 790 · see citing works
Self-citation
Assessing the non-random sampling effects of subject attrition in longitudinal research
Goodman, J. S., & Blum, T. C. (1996) · Journal of Management · doi:10.1177/014920639602200405 · Cited by 766 · see citing works
The Role of Time in Theory and Theory Building
George, J. M., & Jones, G. R. (2000) · Journal of Management · doi:10.1177/014920630002600404 · Cited by 690 · see citing works
Longitudinal Modeling with Randomly and Systematically Missing Data: A Simulation of Ad Hoc, Maximum Likelihood, and Multiple Imputation Techniques
Newman, D. A. (2003) · Organizational Research Methods · doi:10.1177/1094428103254673 · Cited by 626 · cited 1× · see citing works
“Should one desire to try various approaches for evaluating or imputing values for the missing data, we recommend readers consult several technical sources (Allison, 2001; Little & Rubin, 2002; Newman, 2003; Schafer & Graham, 2002).”
Background
Taking Account of Time Lags in Causal Models
Gollob, H. F., & Reichardt, C. S. (1987) · Child Development · doi:10.2307/1130293 · Cited by 572 · see citing works
The Interactive Effects of Personal Traits and Experienced States on Intraindividual Patterns of Citizenship Behavior
Ilieș, R., Scott, B. A., & Judge, T. A. (2006) · Academy of Management Journal · doi:10.5465/amj.2006.21794672 · Cited by 555 · see citing works
Organizational Entry: Recruitment, Selection, and Socialization of Newcomers.
Burack, E. H., & Wanous, J. P. (1982) · Industrial and Labor Relations Review · doi:10.2307/2522684 · Cited by 504 · see citing works
Toward a Systems Theory of Motivated Behavior in Work Teams
Chen, G., & Kanfer, R. (2006) · Research in Organizational Behavior · doi:10.1016/s0191-3085(06)27006-0 · Cited by 493 · see citing works
Toward a Further Understanding of and Improvement in Measurement Invariance Methods and Procedures
Vandenberg, R. (2002) · Organizational Research Methods · doi:10.1177/1094428102005002001 · Cited by 489 · see citing works
Self-citation
The changing signs in the relationships among self-efficacy, personal goals, and performance.
Vancouver, J. B., Thompson, C. M., & Williams, A. A. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.4.605 · Cited by 474 · see citing works
The Conceptualization and Analysis of Change Over Time: An Integrative Approach Incorporating Longitudinal Mean and Covariance Structures Analysis (LMACS) and Multiple Indicator Latent Growth Modeling (MLGM)
Chan, D. K. (1998) · Organizational Research Methods · doi:10.1177/109442819814004 · Cited by 454 · see citing works
Myths about longitudinal research.
Rogosa, D. (1988) · Cited by 383 · see citing works
Organizational Entry: Recruitment, Selection, and Socialization of Newcomers
Hall, F. S., & Wanous, J. P. (1981) · Academy of Management Review · doi:10.2307/257388 · Cited by 368 · see citing works
Maximizing the Usefulness of Data Obtained with Planned Missing Value Patterns: An Application of Maximum Likelihood Procedures
Graham, J. A., Hofer, S. M., & MacKinnon, D. P. (1996) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3102_3 · Cited by 366 · see citing works
Some Results on Reliability for the Longitudinal Measurement of Change: Implications for the Design of Studies of Individual Growth
Willett, J. B. (1989) · Educational and Psychological Measurement · doi:10.1177/001316448904900309 · Cited by 289 · see citing works
Latent Growth Models of Individual Change: The Case of Newcomer Adjustment
Lance, C. E., Vandenberg, R. J., & Self, R. M. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2904 · Cited by 206 · see citing works
Self-citation
The Consequences of Human Resource Stocks and Flows: A Longitudinal Examination of Unit Service Orientation and Unit Effectiveness
Ployhart, R. E., Weekley, J. A., & Ramsey, J. R. (2009) · Academy of Management Journal · doi:10.5465/amj.2009.44635041 · Cited by 203 · see citing works
Self-citation
Interpreting and estimating indirect effects assuming time lags really matter.
Gollob, H. F., & Reichardt, C. S. (1991) · Best methods for the analysis of change: Recent advances, unanswered questions, future directions. · doi:10.1037/10099-015 · Cited by 198 · see citing works
Assessing newcomers' changing commitments to the organization during the first 6 months of work.
Vandenberg, R. J., & Self, R. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.4.557 · Cited by 192 · see citing works
Self-citation
Explaining Change: Theorizing and Testing Dynamic Mediated Longitudinal Relationships
Pitariu, A. H., & Ployhart, R. E. (2010) · Journal of Management · doi:10.1177/0149206308331096 · Cited by 187 · see citing works
Self-citation
Estimating Individual Developmental Functions: Methods and Their Assumptions
Burchinal, M., & Appelbaum, M. I. (1991) · Child Development · doi:10.1111/j.1467-8624.1991.tb01512.x · Cited by 183 · see citing works
Multilevel Methods
Bliese, P. D., Chan, D. K., & Ployhart, R. E. (2007) · Organizational Research Methods · doi:10.1177/1094428107301102 · Cited by 181 · see citing works
Self-citation
Missing Data
Little, R. J. A., & Nathaniel Schenker, A. (1995) · Springer eBooks · doi:10.1007/978-1-4899-1292-3_2 · Cited by 158 · see citing works
General mental ability and two types of adaptation to unforeseen change: Applying discontinuous growth models to the task-change paradigm.
Lang, J. W. B., & Bliese, P. D. (2009) · Journal of Applied Psychology · doi:10.1037/a0013803 · Cited by 146 · see citing works
Longitudinal data analysis
Ployhart, R. E., Holtz, B. C., & Bliese, P. D. (2002) · The Leadership Quarterly · doi:10.1016/s1048-9843(02)00122-4 · Cited by 118 · see citing works
Self-citation
Estimating Individual Developmental Functions: Methods and Their Assumptions
Burchinal, M., & Appelbaum, M. I. (1991) · Child Development · doi:10.2307/1130702 · Cited by 118 · see citing works
Longitudinal Data Analysis
Molenberghs, G., & Verbeke, G. N. (2017) · Wiley eBooks · doi:10.1002/9781118445112.stat00291.pub2 · Cited by 95 · see citing works
Using Dynamic Computational Models to Reconnect Theory and Research: Socialization by the Proactive Newcomer as Example
Vancouver, J. B., Tamanini, K. B., & Yoder, R. J. (2008) · Journal of Management · doi:10.1177/0149206308321550 · Cited by 72 · see citing works
Research design in studies of aging and cognition.
Hertzog, C. K. (1996) · Cited by 58 · see citing works
Measurement of change in research on aging: Old and new issues from an individual growth perspective
Collins, L. M., Birren, J. E., & Schaie, K. W. (1996) · Cited by 33 · see citing works
We Should Measure Change-and Here’s How
Lance, C. E., Meade, A. W., & Williamson, G. M. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-306-47178-7_10 · Cited by 21 · see citing works

Flagged first, then by citations

Sorted by citations

A century of work teams in the Journal of Applied Psychology.
Mathieu, J. E., Hollenbeck, J. R., van Knippenberg, D., & Ilgen, D. R. (2017) · Journal of Applied Psychology · doi:10.1037/apl0000128 · Cited by 593 · see citing works
Tackling the Problem of Construct Proliferation: A Guide to Assessing the Discriminant Validity of Conceptually Related Constructs
Shaffer, J. A., DeGeest, D., & Li, A. (2016) · Organizational Research Methods · doi:10.1177/1094428115598239 · Cited by 393 · see citing works
Mindfulness, authentic functioning, and work engagement: a growth modeling approach
Leroy, H., Anseel, F., Dimitrova, N. G., & Sels, L. (2013) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2013.01.012 · Cited by 336 · see citing works
Inspired to perform: A multilevel investigation of antecedents and consequences of thriving at work
Walumbwa, F. O., Muchiri, M. K., Misati, E., Wu, C., & Meiliani, M. (2018) · Journal of Organizational Behavior · doi:10.1002/job.2216 · Cited by 323 · see citing works
Personality change following unemployment.
Boyce, C. J., Wood, A. M., Daly, M., & Sedikides, C. (2015) · Journal of Applied Psychology · doi:10.1037/a0038647 · Cited by 231 · see citing works
scientific contributions of within-person research in management: Making the juice worth the squeeze
McCormick, B. W., Reeves, C. J., Downes, P. E., Li, N., & Ilies, R. (2020) · Journal of Management · doi:10.1177/0149206318788435 · Cited by 194 · see citing works
Testing the differential effects of changes in psychological contract breach and fulfillment
Conway, N., Guest, D., & Trenberth, L. (2011) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2011.01.003 · Cited by 195 · see citing works
Does ethical leadership enhance group learning behavior? Examining the mediating influence of group ethical conduct, justice climate, and peer justice
Walumbwa, F. O., Hartnell, C. A., & Misati, E. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2016.11.013 · Cited by 179 · see citing works
A Systematic Review of Job Demands and Resources Associated with Compassion Fatigue in Mental Health Professionals
Singh, J., Karanika-Murray, M., Baguley, T., & Hudson, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17196987 · Cited by 132 · see citing works
School Life and Adolescents' Self-Esteem Trajectories
Morin, A. J. S., Maïano, C., Marsh, H. W., Nagengast, B., & Janosz, M. (2013) · Child Development · doi:10.1111/cdev.12089 · Cited by 112 · see citing works
How the human resource (HR) function adds strategic value: A relational perspective of the HR function
Jo, J., Chadwick, C., & Han, J. H. (2024) · Human Resource Management · doi:10.1002/hrm.22184 · Cited by 43 · see citing works
Reflecting on death amidst COVID-19 and individual creativity: Cross-lagged panel data analysis using four-wave longitudinal data.
Takeuchi, R., Guo, N., Teschner, R. S., & Kautz, J. (2021) · Journal of Applied Psychology · doi:10.1037/apl0000949 · Cited by 39 · see citing works
The associations of the Five Factor Model of personality with inflammatory biomarkers: A four-year prospective study
Armon, G., Melamed, S., Shirom, A., Berliner, S., & Shapira, I. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2012.11.035 · Cited by 54 · see citing works
Psychological Processes Underlying the Impact of Gender-Related Discrimination on Psychological Distress in Transgender and Gender Nonconforming People.
Lloyd, J., Chalklin, V., & Bond, F. W. (2019) · Journal of Counseling Psychology · doi:10.1037/cou0000371 · Cited by 30 · see citing works
Creating energy for change: The role of changes in perceived leadership support on commitment to an organizational change initiative
Ford, J. K., Lauricella, T. K., Van Fossen, J. A., & Riley, S. J. (2021) · The Journal of Applied Behavioral Science · doi:10.1177/0021886320907423 · Cited by 26 · see citing works
How mentor support interacts with mother and teacher support in predicting youth academic adjustment: an investigation among youth exposed to big brothers big sisters of Canada programs
Larose, S., Boisclair-Châteauvert, G., De Wit, D. J., DuBois, D., Erdem, G., & Lipman, E. L. (2018) · The Journal of Primary Prevention · doi:10.1007/s10935-018-0509-8 · Cited by 24 · see citing works
What Do We Mean When We Talk about Trust in Social Media? A Systematic Review
Zhang, Y., Gaggiano, J. D., Yongsatianchot, N., Suhaimi, N. M., Kim, M., Sun, Y., Griffin, J., & Parker, A. G. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581019 · Cited by 29 · see citing works
Does Anyone Care About External Validity? A Call (or Plea?) for More OB/HR Research From Multiple Organizations/Industries, Panels, and Publicly Available Datasets
Cruz, K. S. (2021) · Group & Organization Management · doi:10.1177/10596011211055879 · Cited by 23 · see citing works
Does servant leadership decrease bad behaviors? The mediating role of psychological safety and the moderating effect of corporate social responsibility
Roh, T., Kim, M.-J., & Hong, Y. (2023) · Sustainability · doi:10.3390/su152215901 · Cited by 9 · see citing works
The Entry of Autistic University Graduates into the Labor Market in the Era of Generative AI: Their Concerns and Strategies Regarding the Technology. Research in Progress: The Entry of Autistic Graduates into the Labor Market in the Era of GenAI
Matulewski, J., Sikorski, Ł., & Baczała, D. (2026) · Proceedings of the 63rd ACM Conference on Computers and People Research · doi:10.1145/3768310.3807803

Authors: Ployhart, R. E., & Vandenberg, R. J.
Affiliations: University of South Carolina (US)
University of Georgia (US)
Corresponding author: Ployhart, Robert E.
ORCID: Ployhart, Robert E.
Vandenberg, Robert J.
Venue: Journal of Management
Publisher: SAGE Publications
Published: 2009-12-28
Volume: 36
Issue: 1
Pages: 94-120
ISSN: 0149-2063 (ISSN-L)
1557-1211
DOI: 10.1177/0149206309352110
OpenAlex: W2141370332
Cited by: 1,496
References: 62
Citations by year: 2026: 155 · 2025: 139 · 2024: 117 · 2023: 109 · 2022: 116 · 2021: 122 · 2020: 84 · 2019: 98 · 2018: 92 · 2017: 85 · 2016: 82 · 2015: 70 · 2014: 77 · 2013: 58 · 2012: 53
FWCI: 24.35
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Journal of Management (publishedVersion)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Social Sciences › Decision Sciences › Management Science and Operations Research › Business Strategies and Management Research
Social Sciences › Decision Sciences › Information Systems and Management › Business and Management Studies
Keywords: longitudinal study, change over time, research design, theory development, latent growth curve models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Longitudinal Research: The Theory, Design, and Analysis of Change

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks