The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Retesting in selection: A meta-analysis of coaching and practice effects for tests of cognitive ability.
Abstract
Previous studies have indicated that as many as 25% to 50% of applicants in organizational and educational settings are retested with measures of cognitive ability. Researchers have shown that practice effects are found across measurement occasions such that scores improve when these applicants retest. In this study, the authors used meta-analysis to summarize the results of 50 studies of practice effects for tests of cognitive ability. Results from 107 samples and 134,436 participants revealed an adjusted overall effect size of .26. Moderator analyses indicated that effects were larger when practice was accompanied by test coaching and when identical forms were used. Additional research is needed to understand the impact of retesting on the validity inferences drawn from test scores.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
(1979) · Medical Entomology and Zoology · Cited by 11,252
(1964) · Medical Entomology and Zoology · Cited by 10,439
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
(1941) · Research in International Economics by Federal Agencies · doi:10.7312/schw92626-009 · Cited by 4,682
Human cognitive abilities a survey of factor-analytic studies
Carroll, J. B. (2004) · Cited by 3,400
International Review of Industrial and Organizational Psychology: Contents of Previous Volumes
(2003) · International Review of Industrial and Organizational Psychology 2004 · doi:10.1002/0470013311.oth1 · Cited by 2,762
Meta-analysis of experiments with matched groups or repeated measures designs
Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.170 · Cited by 1,693
The Perceived Fairness of Selection Systems: An Organizational Justice Perspective
Gilliland, S. W. (1993) · The Academy of Management Review · doi:10.2307/258595 · Cited by 1,185
The Structure of Human Abilities.
Vernon, P. E. (1950) · Medical Entomology and Zoology · Cited by 688
SMITHER, J. W., LONDON, M., & REILLY, R. R. (2005) · Personnel Psychology · doi:10.1111/j.1744-6570.2005.514_1.x · Cited by 601
The "Science of the Sophomore" Revisited: From Conjecture to Empiricism
Gordon, M. E., Slade, L. A., & Schmitt, N. (1986) · The Academy of Management Review · doi:10.2307/258340 · Cited by 574
Psychological testing: By Marianne Cederblad and Allis Danielson
(1968) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1968.tb07939.x · Cited by 557
A Primer on Regression Artifacts
Campbell, D. T., & Kenny, D. A. (1999) · Medical Entomology and Zoology · Cited by 482
ROTH, P. L., BEVIER, C. A., BOBKO, P., SWITZER, F. S., & TYLER, P. (2001) · Personnel Psychology · doi:10.1111/j.1744-6570.2001.tb00094.x · Cited by 325
MOTIVATIONAL COMPONENTS OF TEST TAKING
ARVEY, R. D., STRICKLAND, W., DRAUDEN, G., & MARTIN, C. (1990) · Personnel Psychology · doi:10.1111/j.1744-6570.1990.tb00679.x · Cited by 324
Comparing meta-analytic moderator estimation techniques under realistic conditions.
Steel, P. D., & Kammeyer-Mueller, J. D. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.1.96 · Cited by 309
Age versus Schooling Effects on Intelligence Development
Cahan, S., & Cohen, N. (1989) · Child Development · doi:10.2307/1130797 · Cited by 285
Those confounded moderators in meta-analysis: good, bad, and ugly
Lipsey, M. W. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716202250791 · Cited by 283
Effects of Practice on Aptitude and Achievement Test Scores
Kulik, J. A., Kulik, C.-L. C., & Bangert, R. L. (1984) · American Educational Research Journal · doi:10.2307/1162453 · Cited by 189
Apples and oranges (and pears, oh my!): the search for moderators in meta-analysis
Cortina, J. M. (2003) · Organizational Research Methods · doi:10.1177/1094428103257358 · Cited by 168
Time and method in coaching for the SAT.
Messick, S., & Jungeblut, A. (1981) · Psychological Bulletin · doi:10.1037/0033-2909.89.2.191 · Cited by 163
Development and examination of an expectancy-based measure of test-taking motivation.
Sanchez, R. J., Truxillo, D. M., & Bauer, T. N. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.5.739 · Cited by 155
Modeling Age and Retest Processes in Longitudinal Studies of Cognitive Abilities.
Ferrer, E. E., Salthouse, T. A., Stewart, W. F., & Schwartz, B. S. (2004) · Psychology and Aging · doi:10.1037/0882-7974.19.2.243 · Cited by 147
RETEST EFFECTS IN OPERATIONAL SELECTION SETTINGS: DEVELOPMENT AND TEST OF A FRAMEWORK
Lievens, F., Buyse, T., & Sackett, P. R. (2005) · Personnel Psychology · doi:10.1111/j.1744-6570.2005.00713.x · Cited by 143
Effects of Coaching on SAT I: Reasoning Test Scores
Powers, D. E., & Rock, D. A. (1999) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1999.tb00549.x · Cited by 140
Coaching, test sophistication, and developed abilities.
Anastasi, A. (1981) · American Psychologist · doi:10.1037/0003-066x.36.10.1086 · Cited by 134
FORCED DISTRIBUTION RATING SYSTEMS AND THE IMPROVEMENT OF WORKFORCE POTENTIAL: A BASELINE SIMULATION
Scullen, S. E., Bergey, P. K., & Aiman‐Smith, L. (2005) · Personnel Psychology · doi:10.1111/j.1744-6570.2005.00361.x · Cited by 133
Correlation and Regression: Applications for Industrial Organizational Psychology and Management
Bobko, P. (2001) · Cited by 121
Assisted Reading Practice: Effects on Performance for Poor Readers in Grades 3 and 4
Shany, M., & Biemiller, A. J. (1995) · Reading Research Quarterly · doi:10.2307/747622 · Cited by 109
Effectiveness of coaching for aptitude tests.
Kulik, J. A., Bangert‐Drowns, R. L., & Kulik, C. C. (1984) · Psychological Bulletin · doi:10.1037//0033-2909.95.2.179 · Cited by 96
Hausknecht, J. P., Trevor, C. O., & Farr, J. L. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.2.243 · Cited by 96
Self-citationPractice Effects on the WAIS-III Across 3- and 6-Month Intervals
Basso, M. R., Carona, F. D., Lowery, N., & Axelrod, B. N. (2002) · The Clinical Neuropsychologist · doi:10.1076/clin.16.1.57.8329 · Cited by 94
Testing and Assessment: An Employer's Guide to Good Practices.
Saad, S. M. A., Carter, G. W., Rothenberg, M. E., & Israelson, E. (1999) · Cited by 91
Long-term reliability of the Wonderlic Personnel Test.
Dodrill, C. B. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.2.316 · Cited by 84
Test-retest gains in WAIS scores after four retest intervals
Catron, D. W., & Thompson, C. C. (1979) · Journal of Clinical Psychology · doi:10.1002/1097-4679(197904)35:2<352::aid-jclp2270350226>3.0.co;2-2 · Cited by 59
The Effect of Coaching on the Predictive Validity of Scholastic Aptitude Tests
Allalouf, A., & Ben‐Shakhar, G. (1998) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1998.tb00526.x · Cited by 58
THE EFFECTS OF INSTRUCTION FOR THREE MATHEMATICS ITEM FORMATS1
Evans, F. R., & Pike, L. W. (1973) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1973.tb00803.x · Cited by 52
Coaching and practice effects in personnel selection
Sackett, P. R., Desmarais, L. B., & Ryan, A. M. (1989) · Cited by 51
Oakland, T. (1972) · Journal of School Psychology · doi:10.1016/0022-4405(72)90004-0 · Cited by 51
Practice and Coaching on IQ Tests: Quite a Lot of g
Nijenhuis, J. T., Voskuijl, O. F., & Schijve, N. B. (2001) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00182 · Cited by 42
Effects of Growth, Practice, and Coaching On Scholastic Aptitude Test Scores
FRANKEL, E. B. (1960) · The Personnel and Guidance Journal · doi:10.1002/j.2164-4918.1960.tb02646.x · Cited by 36
Practice Effects with Traditional Mental Test Items
Wing, H. (1980) · Applied Psychological Measurement · doi:10.1177/014662168000400201 · Cited by 34
Powers, D. E. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.100.1.67 · Cited by 31
Test-retest reliability of the Wechsler Memory Scale, Form I
Ryan, J. J., Morris, J., Yaffa, S., & Peterson, L. (1981) · Journal of Clinical Psychology · doi:10.1002/1097-4679(198110)37:4<847::aid-jclp2270370429>3.0.co;2-k · Cited by 31
Effects of Test Preparation on the Validity of a of a Graduate Admissions Test
Powers, D. E. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900206 · Cited by 30
Chernyshenko, O. S., & Öneş, D. S. (1999) · Educational and Psychological Measurement · doi:10.1177/00131649921970279 · Cited by 28
Test-Retest Reliability and Practice Effect with the Shipley-Institute of Living Scale
Ruiz, R., & Krauss, H. H. (1967) · Psychological Reports · doi:10.2466/pr0.1967.20.3c.1085 · Cited by 23
Bunting, B. P., & Mooney, E. (2001) · Educational Psychology · doi:10.1080/01443410120065450 · Cited by 21
The Effects of Test-Taking Practice on Pupil Test Performance
Kreit, L. H. (1968) · American Educational Research Journal · doi:10.2307/1162002 · Cited by 17
Coaching for intelligence tests.
Gilmore, M. E. (1927) · Journal of Educational Psychology · doi:10.1037/h0072608 · Cited by 14
Retest Effect on Cognitive Performance on the Raven-38 Matrices in France and in the Congo
Nkaya, H. N., Huteau, M., & Bonnet, J.-P. (1994) · Perceptual and Motor Skills · doi:10.2466/pms.1994.78.2.503 · Cited by 13
Koenig, J. A., & Leger, K. F. (1997) · Academic Medicine · doi:10.1097/00001888-199710001-00034 · Cited by 12
Practice Effect in Anagram Solving
Gavurin, E. I. (1973) · The Journal of Psychology · doi:10.1080/00223980.1973.9923842 · Cited by 5
Babad, E. Y., & Bashi, J. (1977) · The Journal of Social Psychology · doi:10.1080/00224545.1977.9713314 · Cited by 3
Cited by
The malleability of spatial skills: A meta-analysis of training studies.
Uttal, D. H., Meadow, N. G., Tipton, E., Hand, L. L., Alden, A. R., Warren, C., & Newcombe, N. S. (2013) · Psychological Bulletin · doi:10.1037/a0028446 · Cited by 1,899
Duckworth, A. L., & Yeager, D. S. (2015) · Educational Researcher · doi:10.3102/0013189x15584327 · Cited by 993
Practice effects in healthy adults: A longitudinal study on frequent repetitive cognitive testing
Bartels, C., Wegrzyn, M., Wiedl, A., Ackermann, V., & Ehrenreich, H. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-118 · Cited by 444
Freund, P. A., & Kasten, N. (2012) · Psychological Bulletin · doi:10.1037/a0026556 · Cited by 277
Sackett, P. R., & Lievens, F. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093716 · Cited by 276
Metadata
- Authors
- Hausknecht, J. P., Halpert, J. A., Di Paolo, N. T., & Moriarty Gerrard, M. O.
- Venue
- Journal of Applied Psychology
- Published
- 2007-03
- Volume
- 92
- Issue
- 2
- Pages
- 373-385
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W2062306902
- Cited by
- 340
- References
- 55
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.