Some Results on Reliability for the Longitudinal Measurement of Change: Implications for the Design of Studies of Individual Growth
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
When changes in educational or psychological status are being measured, every subject in the sample must be observed on several chronologically successive occasions. In the pursuit of such longitudinal data, traditional researchers have been content to administer only a pre-test and a post-test (thus collecting two waves of data on each subject). More recently, however, methodologists have argued that multiwave data (i.e., more than two waves) must be collected for the effective measurement of change. Multi-wave data allows a suitable mathematical model to be fitted to each of the individual growth records as a way of summarizing the growth of each subject. Subsequent investigations of between-individual differences in growth can then be based on the results of these fits. In this article, individual growth-modeling permits the reliability of change measurement to be examined. This reliability is shown to depend upon three factors: the magnitude of the inter-individual heterogeneity in true growth, the size of the measurement-error variance, and the number of waves of data that have been collected. The paper demonstrates that dramatic increases in the reliability of change measurement can be achieved by collecting relatively few additional waves of data, a finding that has considerable import for the informed design of longitudinal studies of individual change.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Linear Statistical Inference and its Applications: Second Editon
Rao, C. R. (1973) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316436 · Cited by 10,489
Applied Linear Statistical Models
Ziegel, E. R., Neter, J., Wasserman, W., & Kutner, M. (1992) · Technometrics · doi:10.2307/1269588 · Cited by 9,907
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Linear Statistical Inference and Its Applications.
Robertson, C. A., & Rao, C. R. (1975) · Biometrics · doi:10.2307/2529568 · Cited by 3,598
How we should measure "change": Or should we?
Cronbach, L. J., & Furby, L. (1970) · Psychological Bulletin · doi:10.1037/h0029382 · Cited by 2,454
Application of hierarchical linear models to assessing change.
Bryk, A. S., & Raudenbush, S. W. (1987) · Psychological Bulletin · doi:10.1037//0033-2909.101.1.147 · Cited by 1,514
Applied Linear Statistical Models
John, R. C. S. (1986) · Journal of Quality Technology · doi:10.1080/00224065.1986.11978989 · Cited by 1,307
A growth curve approach to the measurement of change.
Rogosa, D., Brandt, D., & Zimowski, M. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.3.726 · Cited by 1,081
Longitudinal Research in the Study of Behavior and Development
Nesselroade, J. R., & Baltes, P. B. (1979) · MPG.PuRe (Max Planck Society) · Cited by 1,004
The problem of inference from curves based on group data.
Estes, W. K. (1956) · Psychological Bulletin · doi:10.1037/h0045156 · Cited by 654
Understanding Correlates of Change by Modeling Individual Differences in Growth
Rogosa, D. R., & Willett, J. B. (1985) · Psychometrika · doi:10.1007/bf02294247 · Cited by 568
Self-citationLinear Models for the Analysis of Longitudinal Studies
Ware, J. H. (1985) · The American Statistician · doi:10.1080/00031305.1985.10479402 · Cited by 483
Questions and Answers in the Measurement of Change
Willett, J. B. (1988) · Review of Research in Education · doi:10.2307/1167368 · Cited by 454
Self-citationDEMONSTRATING THE RELIABILITY THE DIFFERENCE SCORE IN THE MEASUREMENT OF CHANGE
ROGOSA, D. R., & WILLETT, J. B. (1983) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1983.tb00211.x · Cited by 435
Self-citationThe Determination of the Significance of Change between Pre- and Posttesting Periods
Linn, R. L., & Slinde, J. A. (1977) · Review of Educational Research · doi:10.2307/1169971 · Cited by 339
GAIN SCORES IN RESEARCH CAN BE HIGHLY RELIABLE
ZIMMERMAN, D. W., & WILLIAMS, R. H. (1982) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1982.tb00124.x · Cited by 177
The Reliability of Difference Scores When Errors Are Correlated
Williams, R. H., & Zimmerman, D. W. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700310 · Cited by 58
Cited by
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647
Self-citationLongitudinal Research: The Theory, Design, and Analysis of Change
Ployhart, R. E., & Vandenberg, R. J. (2010) · Journal of Management · doi:10.1177/0149206309352110 · Cited by 1,496
“Similar to classical test theory and the positive (but nonlinear) relationship between number of items and reliability, the use of three or more repeated measurements increases the number of “items” and hence reliability (Willett, 1989).”
BackgroundResultWillett, J. B., & Sayer, A. G. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.116.2.363 · Cited by 898
Self-citationBerry, D., & Willoughby, M. T. (2017) · Child Development · doi:10.1111/cdev.12660 · Cited by 737
Jordan, N. C., Kaplan, D., Nabors Oláh, L., & Locuniak, M. N. (2006) · Child Development · doi:10.1111/j.1467-8624.2006.00862.x · Cited by 696
Metadata
- Authors
- Willett, J. B.
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 1989-09
- Volume
- 49
- Issue
- 3
- Pages
- 587-602
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- OpenAlex
- W2057219657
- Cited by
- 278
- References
- 17
- FWCI
- 5.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.